| 79 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 153680 | 7.78 GB | 31 May 2011 - 23:59 |
| Yahoo Slurp | 107820 | 3.19 GB | 31 May 2011 - 23:55 |
| MSNBot | 67535 | 705.51 MB | 31 May 2011 - 23:57 |
| Python-urllib | 54918 | 8.46 GB | 31 May 2011 - 23:01 |
| Unknown robot (identified by 'bot*') | 52836 | 1.87 GB | 31 May 2011 - 23:57 |
| Unknown robot (identified by 'robot') | 42902 | 737.76 MB | 31 May 2011 - 10:51 |
| Nagios | 36889 | 1.59 GB | 31 May 2011 - 23:59 |
| Yandex bot | 33800 | 762.51 MB | 31 May 2011 - 23:58 |
| lwp-request | 21597 | 9.63 KB | 31 May 2011 - 23:59 |
| BaiDuSpider | 20563 | 321.18 MB | 31 May 2011 - 23:58 |
| Unknown robot (identified by empty user agent string) | 19366 | 1.73 GB | 31 May 2011 - 23:58 |
| Motor | 17220 | 244.20 MB | 31 May 2011 - 23:33 |
| Feedfetcher-Google | 9311 | 125.14 MB | 31 May 2011 - 23:59 |
| Unknown robot (identified by 'crawl') | 8841 | 78.95 MB | 31 May 2011 - 22:26 |
| MJ12bot | 8639 | 93.85 MB | 31 May 2011 - 23:12 |
| BSpider | 6198 | 98.43 MB | 31 May 2011 - 23:32 |
| Unknown robot (identified by '*bot') | 6174 | 106.75 MB | 31 May 2011 - 23:33 |
| Speedy Spider | 4013 | 50.50 MB | 31 May 2011 - 23:54 |
| Java (Often spam bot) | 3870 | 415.75 MB | 31 May 2011 - 23:21 |
| WordPress | 2701 | 5.19 MB | 31 May 2011 - 23:49 |
| MSNBot-media | 2554 | 43.92 MB | 31 May 2011 - 22:50 |
| Exabot | 2090 | 34.49 MB | 31 May 2011 - 23:56 |
| VORTEX | 1869 | 22.82 MB | 31 May 2011 - 19:31 |
| ichiro | 1534 | 18.87 MB | 27 May 2011 - 12:36 |
| Unknown robot (identified by 'spider') | 1448 | 274.48 MB | 31 May 2011 - 23:20 |
| Mail.ru bot | 922 | 18.22 MB | 28 May 2011 - 21:31 |
| Nutch | 676 | 4.87 MB | 31 May 2011 - 07:19 |
| Custo | 608 | 7.35 MB | 31 May 2011 - 00:49 |
| OutfoxBot/YodaoBot | 566 | 7.46 MB | 31 May 2011 - 20:24 |
| Heritrix | 506 | 20.51 MB | 15 May 2011 - 14:04 |
| Alexa (IA Archiver) | 492 | 14.86 MB | 31 May 2011 - 23:35 |
| Turn It In | 455 | 11.99 MB | 16 May 2011 - 16:03 |
| bender focused_crawler | 392 | 1.61 MB | 31 May 2011 - 12:44 |
| W3C Link Checker | 304 | 10.66 MB | 19 May 2011 - 20:30 |
| Sogou Spider | 287 | 4.18 MB | 31 May 2011 - 16:36 |
| Ask | 280 | 2.29 MB | 31 May 2011 - 18:54 |
| legs | 270 | 1.90 MB | 28 May 2011 - 21:06 |
| GigaBot | 260 | 3.07 MB | 31 May 2011 - 22:36 |
| Feedburner | 254 | 922.58 KB | 31 May 2011 - 22:35 |
| Findlinks | 219 | 3.59 MB | 31 May 2011 - 21:05 |
| Netcraft | 205 | 3.97 MB | 28 May 2011 - 22:32 |
| Jakarta commons-httpclient | 170 | 17.24 MB | 31 May 2011 - 22:17 |
| DoCoMo | 151 | 2.35 MB | 31 May 2011 - 18:21 |
| Powermarks | 126 | 3.52 MB | 31 May 2011 - 17:51 |
| LinkWalker | 122 | 10.96 MB | 25 May 2011 - 23:44 |
| CFNetwork | 111 | 49.39 MB | 31 May 2011 - 23:59 |
| psbot | 86 | 1.65 MB | 30 May 2011 - 18:26 |
| Voila | 84 | 454.69 KB | 31 May 2011 - 23:31 |
| BlogSearch | 58 | 507.16 KB | 30 May 2011 - 13:31 |
| SeznamBot | 54 | 201.88 KB | 31 May 2011 - 06:54 |
| Web Core / Roots | 54 | 114.41 MB | 31 May 2011 - 20:01 |
| Google AdSense | 46 | 761.24 KB | 31 May 2011 - 10:10 |
| SurveyBot | 36 | 307.07 KB | 31 May 2011 - 16:46 |
| MSIECrawler | 30 | 403.66 KB | 25 May 2011 - 14:32 |
| The web archive (IA Archiver) | 27 | 35.47 KB | 26 May 2011 - 22:57 |
| mnoGoSearch search engine software | 25 | 88.15 KB | 22 May 2011 - 18:55 |
| larbin | 18 | 289.91 KB | 12 May 2011 - 22:07 |
| HTTrack off-line browser | 14 | 355.96 KB | 17 May 2011 - 02:53 |
| Voyager | 14 | 180.89 KB | 31 May 2011 - 18:53 |
| Steeler | 13 | 48.72 KB | 28 May 2011 - 22:27 |
| WebCollage | 7 | 191.79 KB | 28 May 2011 - 09:19 |
| Zeus Webster Pro | 7 | 165.75 KB | 23 May 2011 - 10:19 |
| archive.org bot | 7 | 101.67 KB | 15 May 2011 - 19:11 |
| StackRambler | 6 | 7.58 KB | 29 May 2011 - 10:25 |
| InternetSeer | 5 | 155.35 KB | 20 May 2011 - 17:44 |
| Cursor | 4 | 60.11 KB | 19 May 2011 - 17:39 |
| W3C Validator | 3 | 47.34 KB | 30 May 2011 - 20:49 |
| WallPaper (alias crawlpaper) | 3 | 63.18 KB | 23 May 2011 - 23:58 |
| Vagabondo | 3 | 35.31 KB | 20 May 2011 - 21:11 |
| Y!J Yahoo Japan | 3 | 730.96 KB | 18 May 2011 - 14:55 |
| Internet Shinchakubin | 2 | 165.61 KB | 31 May 2011 - 18:36 |
| MagpieRSS | 2 | 25.13 KB | 08 May 2011 - 08:24 |
| Fish search | 2 | 32.77 KB | 11 May 2011 - 21:45 |
| EasyDL | 2 | 42.00 KB | 18 May 2011 - 16:37 |
| CyberSpyder Link Test | 1 | 29.61 KB | 31 May 2011 - 12:13 |
| SpiderBot | 1 | 19.54 KB | 23 May 2011 - 19:12 |
| JoBo Java Web Robot | 1 | 10.56 KB | 15 May 2011 - 02:49 |
| ping.blo.gs | 1 | 126.50 KB | 18 May 2011 - 14:53 |
| MSRBOT | 1 | 141 Bytes | 07 May 2011 - 16:48 |