# Disallow: Any empty value, indicates that all URLs can be retrieved. At least one Disallow field needs to be present in a record. # If the value is '*', the record describes the default access policy for any robot that has not matched any of the other records. User-agent: * Disallow: /cart/ Disallow: /items/catalog.asp Disallow: /items/specials.asp Disallow: /Home/TermsOfUse/tabid/201/Default.aspx Disallow: /Home/PrivacyStatement/tabid/202/Default.aspx