User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /graphics/ User-agent: Googlebot Disallow: /cgi-bin/ Disallow: /images/ Disallow: /graphics/ Crawl-delay: 20 User-agent: Slurp Disallow: /cgi-bin/ Disallow: /images/ Disallow: /graphics/ Crawl-delay: 20 User-Agent: msnbot Disallow: /cgi-bin/ Disallow: /images/ Disallow: /graphics/ Crawl-Delay: 20 #Baiduspider User-agent: Baiduspider Disallow: /cgi-bin/ Disallow: /images/ Disallow: /graphics/ Disallow: / #Yandex User-agent: YandexBot Disallow: /cgi-bin/ Disallow: /images/ Disallow: /graphics/ Disallow: /