37 different robots | Hits | Bandwidth | Last visit |
Python-urllib | 1186648 | 132.99 MB | 30 Sep 2013 - 23:59 |
Java (Often spam bot) | 8995 | 78.27 GB | 30 Sep 2013 - 23:38 |
Unknown robot (identified by 'spider') | 2754 | 528.96 MB | 30 Sep 2013 - 16:20 |
Unknown robot (identified by empty user agent string) | 1787 | 8.74 GB | 30 Sep 2013 - 21:58 |
Unknown robot (identified by 'bot*') | 947 | 279.00 MB | 30 Sep 2013 - 23:59 |
Heritrix | 743 | 40.07 MB | 20 Sep 2013 - 02:00 |
Yandex bot | 567 | 62.97 MB | 30 Sep 2013 - 22:51 |
Unknown robot (identified by '*bot') | 448 | 55.85 MB | 30 Sep 2013 - 22:54 |
archive.org bot | 408 | 1.16 GB | 23 Sep 2013 - 17:25 |
BaiDuSpider | 358 | 429.76 MB | 30 Sep 2013 - 22:48 |
Googlebot | 333 | 606.83 MB | 30 Sep 2013 - 23:41 |
CFNetwork | 297 | 3.98 GB | 30 Sep 2013 - 20:57 |
Mail.ru bot | 180 | 22.66 MB | 30 Sep 2013 - 19:00 |
Unknown robot (identified by 'crawl') | 162 | 255.32 MB | 30 Sep 2013 - 20:47 |
Sogou Spider | 136 | 63.11 MB | 29 Sep 2013 - 16:45 |
MJ12bot | 113 | 62.26 MB | 30 Sep 2013 - 04:57 |
Alexa (IA Archiver) | 61 | 75.74 MB | 24 Sep 2013 - 10:52 |
ABCdatos BotLink | 56 | 459.33 MB | 30 Sep 2013 - 02:22 |
Turn It In | 46 | 215.72 KB | 24 Sep 2013 - 04:10 |
Web Core / Roots | 40 | 86.84 MB | 25 Sep 2013 - 22:26 |
WebFilter | 31 | 89.02 KB | 30 Sep 2013 - 23:02 |
Google AdSense | 30 | 324.91 MB | 30 Sep 2013 - 16:20 |
Exabot | 27 | 89.56 MB | 23 Sep 2013 - 17:06 |
Yahoo Slurp | 25 | 2.72 MB | 28 Sep 2013 - 03:30 |
StackRambler | 20 | 24.82 MB | 19 Sep 2013 - 15:44 |
SeznamBot | 13 | 95.75 KB | 30 Sep 2013 - 19:34 |
MSNBot-media | 12 | 3.90 KB | 30 Sep 2013 - 01:24 |
NG 2.x (Exalead) | 9 | 12.41 MB | 14 Sep 2013 - 03:19 |
WordPress | 7 | 24.79 MB | 22 Sep 2013 - 16:47 |
MSNBot | 6 | 24.24 KB | 22 Sep 2013 - 20:20 |
Phantom | 6 | 9.83 KB | 01 Sep 2013 - 17:56 |
BSpider | 5 | 32.08 MB | 18 Sep 2013 - 13:15 |
Nomad | 5 | 31.43 KB | 20 Sep 2013 - 12:07 |
Unknown robot (identified by 'robot') | 4 | 12.01 KB | 26 Sep 2013 - 11:36 |
W3C Validator | 2 | 15.87 KB | 18 Sep 2013 - 14:48 |
Voila | 1 | 8.06 KB | 22 Sep 2013 - 00:18 |
Netcraft | 1 | 3.26 KB | 09 Sep 2013 - 15:41 |