| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Yandex bot | 3240 | 61.52 MB | 31 Aug 2011 - 23:58 |
| Yahoo Slurp | 10035 | 8.14 GB | 31 Aug 2011 - 23:57 |
| Googlebot | 6886 | 386.70 MB | 31 Aug 2011 - 23:48 |
| Sogou Spider | 20 | 110.45 KB | 31 Aug 2011 - 23:05 |
| Unknown robot (identified by 'bot*') | 2288 | 220.36 MB | 31 Aug 2011 - 22:38 |
| MSNBot-media | 36 | 2.31 MB | 31 Aug 2011 - 22:12 |
| Python-urllib | 9437 | 8.79 MB | 31 Aug 2011 - 22:08 |
| Nutch | 62 | 7.68 MB | 31 Aug 2011 - 21:30 |
| Speedy Spider | 201 | 1.03 MB | 31 Aug 2011 - 21:12 |
| BaiDuSpider | 444 | 11.75 MB | 31 Aug 2011 - 20:23 |
| MJ12bot | 124 | 1.14 MB | 31 Aug 2011 - 19:55 |
| BSpider | 102 | 251.36 KB | 31 Aug 2011 - 19:08 |
| Unknown robot (identified by empty user agent string) | 590 | 16.83 MB | 31 Aug 2011 - 16:25 |
| Voila | 18 | 231.27 KB | 31 Aug 2011 - 15:31 |
| Unknown robot (identified by '*bot') | 196 | 7.06 MB | 31 Aug 2011 - 14:20 |
| Findlinks | 9 | 37.00 KB | 31 Aug 2011 - 13:41 |
| Exabot | 30 | 373.04 KB | 31 Aug 2011 - 10:35 |
| Unknown robot (identified by 'spider') | 211 | 4.30 MB | 31 Aug 2011 - 07:14 |
| Unknown robot (identified by 'robot') | 8276 | 75.84 MB | 31 Aug 2011 - 03:06 |
| NG 1.x (Exalead) | 589 | 45.33 MB | 30 Aug 2011 - 11:01 |
| Custo | 11 | 114.95 KB | 30 Aug 2011 - 03:08 |
| HTTrack off-line browser | 31 | 10.51 MB | 29 Aug 2011 - 10:53 |
| archive.org bot | 55 | 31.85 MB | 29 Aug 2011 - 05:10 |
| DoCoMo | 14 | 80.00 KB | 28 Aug 2011 - 19:48 |
| yacy | 27 | 1.25 MB | 27 Aug 2011 - 23:03 |
| Holmes | 1 | 2.42 KB | 27 Aug 2011 - 04:44 |
| Alexa (IA Archiver) | 2 | 8.59 KB | 26 Aug 2011 - 19:27 |
| MojeekBot | 2 | 31.17 KB | 26 Aug 2011 - 15:11 |
| Netcraft | 1 | 2.42 KB | 24 Aug 2011 - 19:30 |
| Unknown robot (identified by 'crawl') | 3465 | 30.88 MB | 20 Aug 2011 - 20:00 |
| Turn It In | 304 | 6.52 MB | 20 Aug 2011 - 02:47 |
| Java (Often spam bot) | 8 | 763.63 KB | 18 Aug 2011 - 22:50 |
| CFNetwork | 3 | 8.18 MB | 15 Aug 2011 - 21:22 |
| GigaBot | 1 | 2.42 KB | 13 Aug 2011 - 17:40 |
| larbin | 1 | 2.42 KB | 12 Aug 2011 - 19:11 |
| VSE | 1 | 34.64 KB | 10 Aug 2011 - 00:19 |
| OutfoxBot/YodaoBot | 21 | 50.84 KB | 09 Aug 2011 - 05:58 |
| SeznamBot | 3 | 5.50 KB | 08 Aug 2011 - 07:06 |
| Powermarks | 1 | 10.16 KB | 05 Aug 2011 - 02:39 |
| bender focused_crawler | 1 | 238.58 KB | 04 Aug 2011 - 11:54 |
| MSIECrawler | 1 | 2.42 KB | 02 Aug 2011 - 17:35 |
| W3C Validator | 2 | 648.37 KB | 01 Aug 2011 - 20:55 |