User-agent: * Disallow: /Admin/ Disallow: /App_Browser/ Disallow: /App_Code/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /bin/ Disallow: /Components/ Disallow: /Config/ Disallow: /Controls/ Disallow: /DesktopModules/ Disallow: /Documentation/ Disallow: /Install/ Disallow: /js/ Disallow: /Providers/ Disallow: /SearchResults/ Disallow: /*/Privacy # Specific to Google bot Disallow: /*/Terms # Specific to Google bot Disallow: /Admin/SiteSettings/tabid/39/ctl/Terms/ # Note these are not all of the variations. Should be hard coded. Disallow: /Home/tabid/36/ctl/Terms/ Disallow: /Admin/SiteSettings/tabid/39/ctl/Privacy/ Disallow: /Admin/SiteSettings/tabid/39/ctl/Terms/ Disallow: /TheInstitute/tabid/117/ctl/Privacy/ Disallow: /TheInstitute/tabid/117/ctl/Terms/ Disallow: /Home/tabid/36/ctl/Login/