# All robots will spider the domain User-agent: * #Disallow: /nobots #Disallow: /management