User-agent: * Disallow: /cgi/ Disallow: /*.jpg$ Disallow: /*.gif$ Disallow: /*.png$ #‹‘”Û User-agent: baiduspider Disallow: / User-agent: BecomeBot Disallow: / User-agent: bot/1.0 (bot; http://; bot@bot.bot) Disallow: / User-agent: CazoodleBot Disallow: / User-agent: China Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: e-SocietyRobot Disallow: / User-agent: Mail.Ru Disallow: / User-agent: Megalodon Disallow: / User-agent: NaverBot Disallow: / User-agent: Nutch Disallow: / User-agent: NimbleCrawler Disallow: / User-agent: girafa Disallow: / User-agent: genieBot Disallow: / User-agent: HyperRobot Disallow: / User-agent: IRLbot Disallow: / User-agent: NG Disallow: / User-agent: OnetSzukaj Disallow: / User-agent: OutfoxBot Disallow: / User-agent: psbot Disallow: / User-agent: Sanity Disallow: / User-agent: Shim-Crawler Disallow: / User-agent: sohu Disallow: / User-agent: Steeler Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: WebAlta Crawler Disallow: / User-agent: wish-la Disallow: / User-agent: wish-lim Disallow: / Yahoo! Slurp China Disallow: / User-agent: YodaoBot Disallow: / User-agent: ZyBorg Disallow: / #‹–‰Â User-agent: Googlebot Crawl-delay: 600 User-agent: msnbot Crawl-delay: 600 User-agent: Slurp Crawl-delay: 600 User-agent: Teoma Crawl-delay: 600 Hatena Antenna Crawl-delay: 21600