36 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 8978 | 6.22 GB | 30 Apr 2011 - 23:59 |
Googlebot | 6851 | 440.73 MB | 30 Apr 2011 - 23:52 |
Python-urllib | 4570 | 4.41 MB | 30 Apr 2011 - 14:34 |
Unknown robot (identified by 'robot') | 4217 | 38.42 MB | 30 Apr 2011 - 07:13 |
Yandex bot | 2875 | 35.41 MB | 30 Apr 2011 - 23:41 |
Unknown robot (identified by 'bot*') | 1246 | 44.84 MB | 30 Apr 2011 - 22:48 |
MSNBot | 1211 | 6.11 MB | 29 Apr 2011 - 20:39 |
Unknown robot (identified by empty user agent string) | 815 | 90.72 MB | 30 Apr 2011 - 16:20 |
BaiDuSpider | 608 | 16.10 MB | 30 Apr 2011 - 21:29 |
Unknown robot (identified by 'spider') | 368 | 6.39 MB | 27 Apr 2011 - 12:31 |
MJ12bot | 188 | 1.95 MB | 30 Apr 2011 - 16:17 |
Speedy Spider | 127 | 1.15 MB | 30 Apr 2011 - 13:43 |
BSpider | 103 | 233.95 KB | 30 Apr 2011 - 18:34 |
Exabot | 59 | 2.96 MB | 30 Apr 2011 - 15:45 |
Java (Often spam bot) | 41 | 4.26 MB | 19 Apr 2011 - 23:19 |
Nutch | 39 | 474.05 KB | 27 Apr 2011 - 22:22 |
Unknown robot (identified by '*bot') | 32 | 219.39 KB | 27 Apr 2011 - 00:58 |
OutfoxBot/YodaoBot | 32 | 65.28 KB | 20 Apr 2011 - 17:31 |
MSNBot-media | 18 | 1.47 MB | 30 Apr 2011 - 21:05 |
The web archive (IA Archiver) | 15 | 71.66 KB | 20 Apr 2011 - 01:45 |
Voila | 14 | 147.68 KB | 30 Apr 2011 - 16:11 |
ichiro | 13 | 182.82 KB | 25 Apr 2011 - 09:41 |
NG 1.x (Exalead) | 12 | 66.62 KB | 03 Apr 2011 - 13:10 |
SeznamBot | 10 | 20.08 KB | 28 Apr 2011 - 07:30 |
Custo | 10 | 586.20 KB | 27 Apr 2011 - 14:56 |
Findlinks | 7 | 81.46 KB | 21 Apr 2011 - 21:48 |
StackRambler | 7 | 53.63 KB | 24 Apr 2011 - 02:14 |
Alexa (IA Archiver) | 4 | 32.03 KB | 25 Apr 2011 - 19:52 |
yacy | 3 | 553.09 KB | 19 Apr 2011 - 05:31 |
Powermarks | 1 | 9.95 KB | 07 Apr 2011 - 12:02 |
Jakarta commons-httpclient | 1 | 2.04 KB | 14 Apr 2011 - 02:41 |
Holmes | 1 | 2.04 KB | 15 Apr 2011 - 05:54 |
Unknown robot (identified by 'crawl') | 1 | 2.04 KB | 05 Apr 2011 - 00:30 |
larbin | 1 | 2.04 KB | 27 Apr 2011 - 07:52 |
MSIECrawler | 1 | 9.95 KB | 26 Apr 2011 - 22:58 |
Netcraft | 1 | 2.04 KB | 28 Apr 2011 - 10:44 |