| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 1253711 | 360.69 MB | 31 Mar 2013 - 22:11 |
| Java (Often spam bot) | 17789 | 156.36 GB | 31 Mar 2013 - 21:53 |
| Heritrix | 2747 | 45.44 MB | 28 Mar 2013 - 19:00 |
| Unknown robot (identified by 'robot') | 2312 | 1.55 GB | 31 Mar 2013 - 21:59 |
| Yandex bot | 1675 | 438.27 MB | 31 Mar 2013 - 11:18 |
| BaiDuSpider | 1468 | 835.45 MB | 31 Mar 2013 - 22:06 |
| Unknown robot (identified by empty user agent string) | 1209 | 6.63 GB | 31 Mar 2013 - 21:49 |
| Googlebot | 439 | 815.44 MB | 31 Mar 2013 - 17:02 |
| Unknown robot (identified by 'bot*') | 401 | 94.46 MB | 31 Mar 2013 - 21:59 |
| Unknown robot (identified by 'spider') | 381 | 518.48 MB | 31 Mar 2013 - 21:00 |
| Unknown robot (identified by 'crawl') | 305 | 1009.08 MB | 28 Mar 2013 - 18:13 |
| Unknown robot (identified by '*bot') | 269 | 51.21 MB | 31 Mar 2013 - 21:17 |
| HTTrack off-line browser | 89 | 175.64 MB | 27 Mar 2013 - 05:24 |
| Exabot | 82 | 299.85 MB | 31 Mar 2013 - 11:49 |
| BSpider | 69 | 28.89 MB | 31 Mar 2013 - 21:47 |
| Web Core / Roots | 62 | 148.87 MB | 31 Mar 2013 - 12:12 |
| MJ12bot | 62 | 112.81 MB | 31 Mar 2013 - 18:11 |
| legs | 59 | 601.88 MB | 31 Mar 2013 - 11:23 |
| Sogou Spider | 59 | 9.80 MB | 31 Mar 2013 - 06:57 |
| Yahoo Slurp | 50 | 114.09 MB | 27 Mar 2013 - 03:30 |
| ABCdatos BotLink | 41 | 340.57 MB | 30 Mar 2013 - 03:17 |
| MSNBot | 35 | 12.74 MB | 29 Mar 2013 - 18:22 |
| Mail.ru bot | 28 | 166.41 KB | 26 Mar 2013 - 17:14 |
| Google AdSense | 28 | 238.48 MB | 31 Mar 2013 - 20:03 |
| WebFilter | 26 | 79.04 KB | 31 Mar 2013 - 02:55 |
| VSE | 18 | 37.22 MB | 30 Mar 2013 - 16:58 |
| MSNBot-media | 15 | 8.93 KB | 30 Mar 2013 - 11:08 |
| Alexa (IA Archiver) | 13 | 55.16 KB | 23 Mar 2013 - 06:00 |
| NG 1.x (Exalead) | 8 | 12.50 MB | 10 Mar 2013 - 11:15 |
| CFNetwork | 8 | 69.86 MB | 29 Mar 2013 - 19:53 |
| NG 2.x (Exalead) | 8 | 12.41 MB | 10 Mar 2013 - 10:06 |
| SeznamBot | 4 | 10.79 KB | 15 Mar 2013 - 17:13 |
| WordPress | 4 | 12.40 MB | 04 Mar 2013 - 16:21 |
| DoCoMo | 2 | 32.15 KB | 28 Mar 2013 - 02:59 |
| Nutch | 2 | 6.24 KB | 29 Mar 2013 - 07:15 |
| archive.org bot | 2 | 2.67 MB | 25 Mar 2013 - 00:04 |
| W3C Validator | 1 | 7.66 KB | 02 Mar 2013 - 12:51 |
| Voila | 1 | 7.78 KB | 25 Mar 2013 - 00:43 |
| arks | 1 | 12.40 MB | 28 Mar 2013 - 00:59 |
| Netcraft | 1 | 3.12 KB | 09 Mar 2013 - 03:43 |