| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 10361 | 7.68 GB | 31 May 2011 - 23:59 |
| Yandex bot | 2630 | 20.74 MB | 31 May 2011 - 23:55 |
| Googlebot | 2421 | 235.14 MB | 31 May 2011 - 23:51 |
| BaiDuSpider | 941 | 18.02 MB | 31 May 2011 - 23:40 |
| Unknown robot (identified by 'bot*') | 1822 | 128.44 MB | 31 May 2011 - 23:36 |
| Speedy Spider | 161 | 1.26 MB | 31 May 2011 - 18:54 |
| Sogou Spider | 9 | 113.74 KB | 31 May 2011 - 18:46 |
| Unknown robot (identified by empty user agent string) | 680 | 40.58 MB | 31 May 2011 - 16:22 |
| Unknown robot (identified by '*bot') | 37 | 588.34 KB | 31 May 2011 - 15:26 |
| Python-urllib | 9046 | 6.97 MB | 31 May 2011 - 15:21 |
| BSpider | 105 | 244.88 KB | 31 May 2011 - 12:47 |
| DoCoMo | 24 | 156.02 KB | 31 May 2011 - 09:46 |
| MSNBot-media | 39 | 2.98 MB | 31 May 2011 - 09:30 |
| Unknown robot (identified by 'spider') | 171 | 2.98 MB | 31 May 2011 - 07:25 |
| MJ12bot | 128 | 1.65 MB | 31 May 2011 - 05:43 |
| MSNBot | 1331 | 7.50 MB | 31 May 2011 - 03:37 |
| SeznamBot | 10 | 9.68 MB | 30 May 2011 - 23:47 |
| Voila | 18 | 232.43 KB | 30 May 2011 - 15:23 |
| Exabot | 111 | 5.25 MB | 30 May 2011 - 04:45 |
| Unknown robot (identified by 'robot') | 6182 | 13.50 MB | 30 May 2011 - 03:33 |
| MSIECrawler | 1 | 9.95 KB | 28 May 2011 - 19:49 |
| Netcraft | 2 | 4.65 KB | 28 May 2011 - 11:24 |
| Findlinks | 9 | 39.58 KB | 28 May 2011 - 10:49 |
| Java (Often spam bot) | 52 | 10.84 MB | 27 May 2011 - 21:45 |
| Alexa (IA Archiver) | 22 | 173.79 KB | 27 May 2011 - 11:21 |
| Nutch | 7 | 165.35 KB | 27 May 2011 - 01:36 |
| WordPress | 24 | 11.21 MB | 26 May 2011 - 23:03 |
| CFNetwork | 17 | 8.11 MB | 25 May 2011 - 12:24 |
| Unknown robot (identified by 'crawl') | 3291 | 30.61 MB | 24 May 2011 - 17:00 |
| VSE | 15 | 81.79 KB | 24 May 2011 - 13:15 |
| larbin | 2 | 30.09 KB | 24 May 2011 - 02:26 |
| Custo | 59 | 3.90 MB | 23 May 2011 - 14:50 |
| HTTrack off-line browser | 37 | 3.15 MB | 23 May 2011 - 07:12 |
| Holmes | 1 | 2.23 KB | 21 May 2011 - 06:49 |
| StackRambler | 8 | 55.24 KB | 21 May 2011 - 02:58 |
| ichiro | 37 | 551.20 KB | 20 May 2011 - 15:00 |
| bender focused_crawler | 1 | 53.77 KB | 17 May 2011 - 20:00 |
| psbot | 3 | 7.78 KB | 16 May 2011 - 23:55 |
| GigaBot | 2 | 3.48 KB | 16 May 2011 - 13:16 |
| yacy | 145 | 15.38 MB | 12 May 2011 - 12:41 |
| Turn It In | 175 | 820.30 KB | 11 May 2011 - 15:19 |
| The web archive (IA Archiver) | 29 | 139.17 KB | 10 May 2011 - 11:55 |
| NG 1.x (Exalead) | 6 | 28.96 KB | 08 May 2011 - 08:02 |
| Heritrix | 135 | 161.88 MB | 05 May 2011 - 11:43 |