| 62 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 351807 | 6.11 GB | 31 Jul 2010 - 23:11 |
| Googlebot | 94793+269 | 1.80 GB | 31 Jul 2010 - 23:10 |
| Nagios | 47404 | 2.76 GB | 31 Jul 2010 - 23:11 |
| Yahoo Slurp | 42400+319 | 1.54 GB | 31 Jul 2010 - 23:10 |
| MSNBot | 25345+11212 | 1.16 GB | 31 Jul 2010 - 23:10 |
| Yandex bot | 16976+166 | 644.98 MB | 31 Jul 2010 - 23:11 |
| Unknown robot (identified by 'bot*') | 10348+51 | 222.44 MB | 31 Jul 2010 - 22:39 |
| twiceler | 9728+115 | 162.00 MB | 30 Jul 2010 - 22:07 |
| Heritrix | 9611+36 | 344.97 MB | 14 Jul 2010 - 08:36 |
| Unknown robot (identified by 'crawl') | 7643+56 | 54.30 MB | 31 Jul 2010 - 21:41 |
| Unknown robot (identified by empty user agent string) | 6455+3 | 77.19 MB | 31 Jul 2010 - 23:10 |
| Feedfetcher-Google | 3153 | 42.86 MB | 31 Jul 2010 - 23:10 |
| BaiDuSpider | 2192+15 | 47.59 MB | 31 Jul 2010 - 22:36 |
| MSNBot-media | 1466+68 | 39.85 MB | 31 Jul 2010 - 22:32 |
| Unknown robot (identified by 'robot') | 1509+8 | 78.22 MB | 31 Jul 2010 - 22:42 |
| Java (Often spam bot) | 1077 | 19.46 MB | 31 Jul 2010 - 11:35 |
| Exabot | 962+9 | 72.61 MB | 31 Jul 2010 - 22:45 |
| Turn It In | 794 | 49.56 MB | 21 Jul 2010 - 09:56 |
| MJ12bot | 767+2 | 5.15 MB | 30 Jul 2010 - 20:12 |
| Speedy Spider | 639+17 | 13.09 MB | 31 Jul 2010 - 01:25 |
| Nutch | 610 | 4.14 MB | 29 Jul 2010 - 08:27 |
| Feedburner | 589 | 19.02 MB | 31 Jul 2010 - 22:00 |
| Ask | 426+8 | 13.01 MB | 31 Jul 2010 - 21:59 |
| BSpider | 416+3 | 3.52 MB | 31 Jul 2010 - 18:22 |
| Bloglines | 350 | 3.63 MB | 31 Jul 2010 - 22:55 |
| Custo | 308 | 4.85 MB | 30 Jul 2010 - 18:02 |
| Alexa (IA Archiver) | 271+2 | 7.05 MB | 31 Jul 2010 - 18:33 |
| legs | 181+2 | 998.97 KB | 29 Jul 2010 - 21:25 |
| ichiro | 133 | 2.55 MB | 26 Jul 2010 - 02:02 |
| YahooSeeker Yahoo! Blog crawler | 130 | 1.44 MB | 22 Jul 2010 - 06:33 |
| Unknown robot (identified by 'spider') | 85+4 | 1.79 MB | 31 Jul 2010 - 12:39 |
| Motor | 77 | 758.66 KB | 30 Jul 2010 - 01:15 |
| Jakarta commons-httpclient | 71 | 1.16 MB | 31 Jul 2010 - 18:28 |
| MSIECrawler | 56 | 1.09 MB | 30 Jul 2010 - 06:11 |
| Sogou Spider | 47 | 2.98 MB | 31 Jul 2010 - 13:24 |
| larbin | 43+3 | 955.58 KB | 15 Jul 2010 - 02:55 |
| Powermarks | 42 | 1.25 MB | 30 Jul 2010 - 08:09 |
| BBot | 42 | 1.59 MB | 14 Jul 2010 - 07:51 |
| Netcraft | 40 | 837.14 KB | 30 Jul 2010 - 00:53 |
| SurveyBot | 25+3 | 261.63 KB | 31 Jul 2010 - 06:24 |
| Unknown robot (identified by hit on 'robots.txt') | 0+23 | 29.51 KB | 30 Jul 2010 - 15:27 |
| GigaBot | 20 | 410.89 KB | 30 Jul 2010 - 14:12 |
| Web Core / Roots | 12 | 248.83 MB | 23 Jul 2010 - 00:29 |
| CFNetwork | 11 | 890.92 KB | 31 Jul 2010 - 14:53 |
| psbot | 9+1 | 74.33 KB | 31 Jul 2010 - 13:47 |
| Google AdSense | 7 | 611.14 KB | 29 Jul 2010 - 08:34 |
| WordPress | 7 | 353.23 KB | 26 Jul 2010 - 17:41 |
| NG 1.x (Exalead) | 6 | 123.26 KB | 20 Jul 2010 - 12:57 |
| mnoGoSearch search engine software | 6 | 39.87 KB | 27 Jul 2010 - 01:46 |
| Cursor | 5 | 60.54 KB | 30 Jul 2010 - 13:20 |
| Mail.ru bot | 4 | 75.03 KB | 30 Jul 2010 - 20:48 |
| Gaisbot | 4 | 20.37 KB | 22 Jul 2010 - 18:11 |
| The web archive (IA Archiver) | 2+1 | 23.42 KB | 25 Jul 2010 - 16:36 |
| Unknown robot (identified by '*bot') | 3 | 32.01 KB | 13 Jul 2010 - 18:51 |
| DNAbot | 2 | 21.05 KB | 21 Jul 2010 - 17:04 |
| WebCollage | 2 | 191.95 KB | 24 Jul 2010 - 05:11 |
| QihooBot | 2 | 18.08 KB | 18 Jul 2010 - 06:09 |
| HTMLParser | 1 | 3.30 KB | 23 Jul 2010 - 22:11 |
| Susie | 1 | 13.69 KB | 02 Jul 2010 - 08:22 |
| Voyager | 1 | 17.99 KB | 30 Jul 2010 - 15:32 |
| Internet Shinchakubin | 1 | 29.55 KB | 29 Jul 2010 - 02:17 |
| HTTrack off-line browser | 1 | 28.47 KB | 28 Jul 2010 - 20:53 |