#Forbid all robots from browsing the site User-agent: * Disallow: /Bin Disallow: /css Disallow: /SiteMapdotNet Disallow: /App_Data