User-agent: * Disallow: /admin/ Disallow: /awstats/ Disallow: /misc/ Disallow: /cart/ Disallow: /config/ Disallow: /myaccount/ Disallow: /upload/ Disallow: /certs/ # Yahoo delay 30 second # http://help.yahoo.com/help/us/ysearch/slurp/slurp-03.html User-agent: Slurp Crawl-delay: 30