| 62 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by empty user agent string) | 12137+200 | 1.60 GB | 31 Dec 2009 - 23:11 |
| Python-urllib | 1308944 | 37.34 GB | 31 Dec 2009 - 23:11 |
| Googlebot | 65541+671 | 2.21 GB | 31 Dec 2009 - 23:10 |
| Yandex bot | 24191+616 | 2.90 GB | 31 Dec 2009 - 23:10 |
| Nagios | 67091 | 2.78 GB | 31 Dec 2009 - 23:10 |
| Bloglines | 299 | 2.08 MB | 31 Dec 2009 - 23:10 |
| Yahoo Slurp | 37241+1811 | 2.09 GB | 31 Dec 2009 - 23:09 |
| MSNBot | 61117+9448 | 2.24 GB | 31 Dec 2009 - 23:09 |
| twiceler | 8076+1020 | 1.01 GB | 31 Dec 2009 - 23:08 |
| Feedfetcher-Google | 6966 | 57.57 MB | 31 Dec 2009 - 23:07 |
| Unknown robot (identified by 'robot') | 4503+63 | 50.83 MB | 31 Dec 2009 - 23:03 |
| BSpider | 109+133 | 961.99 KB | 31 Dec 2009 - 23:00 |
| Ask | 619+284 | 58.15 MB | 31 Dec 2009 - 23:00 |
| BaiDuSpider | 2002+467 | 37.71 MB | 31 Dec 2009 - 22:54 |
| Sogou Spider | 465+107 | 10.14 MB | 31 Dec 2009 - 22:51 |
| Unknown robot (identified by 'crawl') | 1381+422 | 140.39 MB | 31 Dec 2009 - 22:47 |
| Exabot | 1575+270 | 295.51 MB | 31 Dec 2009 - 22:40 |
| Speedy Spider | 191+281 | 2.09 MB | 31 Dec 2009 - 22:30 |
| Unknown robot (identified by 'bot*') | 3459+145 | 59.68 MB | 31 Dec 2009 - 22:22 |
| Feedburner | 1284 | 28.83 MB | 31 Dec 2009 - 22:18 |
| yacy | 11+2 | 83.14 KB | 31 Dec 2009 - 21:28 |
| larbin | 120+74 | 2.55 MB | 31 Dec 2009 - 20:40 |
| Nutch | 224+43 | 2.27 MB | 31 Dec 2009 - 19:44 |
| Unknown robot (identified by hit on 'robots.txt') | 0+743 | 1.12 MB | 31 Dec 2009 - 19:39 |
| MSNBot-media | 13+6 | 605.66 KB | 31 Dec 2009 - 19:02 |
| MSIECrawler | 36 | 1.23 MB | 31 Dec 2009 - 18:50 |
| Voyager | 7+5 | 58.73 KB | 31 Dec 2009 - 18:30 |
| Unknown robot (identified by 'spider') | 108+31 | 1.76 MB | 31 Dec 2009 - 18:19 |
| Java (Often spam bot) | 891+1 | 20.43 MB | 31 Dec 2009 - 17:26 |
| legs | 99+28 | 1.52 MB | 31 Dec 2009 - 16:09 |
| Heritrix | 5214+138 | 193.56 MB | 31 Dec 2009 - 11:25 |
| Alexa (IA Archiver) | 152+31 | 4.36 MB | 31 Dec 2009 - 07:58 |
| CFNetwork | 18 | 910.57 KB | 31 Dec 2009 - 06:10 |
| WordPress | 22 | 183.79 KB | 31 Dec 2009 - 04:53 |
| Voila | 28+14 | 211.12 KB | 31 Dec 2009 - 04:17 |
| Custo | 465+17 | 5.43 MB | 31 Dec 2009 - 02:24 |
| WebCollage | 2 | 45.11 KB | 30 Dec 2009 - 19:11 |
| Powermarks | 48 | 1.51 MB | 30 Dec 2009 - 05:12 |
| Jakarta commons-httpclient | 11 | 3.20 MB | 30 Dec 2009 - 02:20 |
| MJ12bot | 449+22 | 3.75 MB | 29 Dec 2009 - 21:13 |
| SurveyBot | 35+22 | 404.62 KB | 29 Dec 2009 - 18:52 |
| Turn It In | 232+3 | 16.92 MB | 29 Dec 2009 - 01:19 |
| Google AdSense | 4 | 163.22 KB | 28 Dec 2009 - 14:45 |
| mnoGoSearch search engine software | 24 | 40.73 KB | 27 Dec 2009 - 18:26 |
| The web archive (IA Archiver) | 0+3 | 4.66 KB | 27 Dec 2009 - 16:59 |
| DoCoMo | 0+1 | 1.55 KB | 25 Dec 2009 - 20:37 |
| BBot | 50+1 | 3.17 MB | 25 Dec 2009 - 17:42 |
| arks | 0+2 | 3.11 KB | 25 Dec 2009 - 05:20 |
| Cursor | 4 | 77.46 KB | 22 Dec 2009 - 21:10 |
| YahooSeeker Yahoo! Blog crawler | 26 | 284.45 KB | 22 Dec 2009 - 00:32 |
| Holmes | 1+17 | 48.15 KB | 19 Dec 2009 - 04:25 |
| Susie | 1 | 40.20 KB | 17 Dec 2009 - 04:12 |
| SeznamBot | 2+1 | 34.88 KB | 15 Dec 2009 - 20:41 |
| StackRambler | 0+2 | 3.11 KB | 15 Dec 2009 - 11:33 |
| Netcraft | 31 | 675.60 KB | 12 Dec 2009 - 04:30 |
| NutchCVS | 8 | 160.22 KB | 12 Dec 2009 - 04:12 |
| Unknown robot (identified by '*bot') | 1+1 | 24.39 KB | 11 Dec 2009 - 17:50 |
| Yahoo Feed Seeker | 1 | 10.77 KB | 08 Dec 2009 - 18:17 |
| Spiderman | 14+2 | 56.91 KB | 08 Dec 2009 - 15:45 |
| lwp-trivial | 1 | 39.70 KB | 06 Dec 2009 - 09:17 |
| psbot | 3+1 | 24.75 KB | 04 Dec 2009 - 00:06 |
| archive.org bot | 0+1 | 1.55 KB | 02 Dec 2009 - 01:22 |