36 different robots | Hits | Bandwidth | Last visit |
Python-urllib | 199992 | 777.76 MB | 30 Nov 2016 - 23:59 |
Unknown robot (identified by 'crawl') | 3062 | 228.99 MB | 30 Nov 2016 - 22:51 |
Unknown robot (identified by 'bot*') | 1855 | 3.30 GB | 30 Nov 2016 - 20:28 |
Unknown robot (identified by empty user agent string) | 1015 | 5.08 GB | 30 Nov 2016 - 21:58 |
MJ12bot | 907 | 401.25 MB | 30 Nov 2016 - 13:02 |
Googlebot | 785 | 228.29 MB | 30 Nov 2016 - 23:58 |
BaiDuSpider | 710 | 262.87 MB | 30 Nov 2016 - 23:09 |
Yahoo Slurp | 664 | 1.47 GB | 30 Nov 2016 - 22:42 |
Java (Often spam bot) | 512 | 742.59 MB | 30 Nov 2016 - 20:26 |
Mail.ru bot | 335 | 147.66 MB | 27 Nov 2016 - 03:50 |
Unknown robot (identified by 'robot') | 269 | 862.54 MB | 30 Nov 2016 - 20:03 |
Web Core / Roots | 231 | 541.34 MB | 29 Nov 2016 - 10:40 |
CFNetwork | 217 | 4.27 GB | 30 Nov 2016 - 20:39 |
Yandex bot | 130 | 432.95 MB | 30 Nov 2016 - 22:40 |
Alexa (IA Archiver) | 65 | 379.74 MB | 25 Nov 2016 - 17:17 |
Unknown robot (identified by 'spider') | 59 | 220.39 MB | 30 Nov 2016 - 20:42 |
ABCdatos BotLink | 54 | 442.93 MB | 30 Nov 2016 - 01:15 |
Steeler | 43 | 165.16 MB | 23 Nov 2016 - 22:53 |
WordPress | 41 | 56.45 MB | 29 Nov 2016 - 02:43 |
Sogou Spider | 36 | 220.55 KB | 30 Nov 2016 - 00:09 |
SeznamBot | 20 | 38.68 MB | 30 Nov 2016 - 03:04 |
Exabot | 14 | 50.51 KB | 24 Nov 2016 - 10:06 |
yacy | 12 | 25.49 MB | 27 Nov 2016 - 09:22 |
NG 2.x (Exalead) | 11 | 15.24 MB | 18 Nov 2016 - 11:36 |
Google AdSense | 6 | 73.26 MB | 25 Nov 2016 - 21:01 |
Powermarks | 4 | 34.11 KB | 04 Nov 2016 - 15:07 |
Nutch | 3 | 20.52 KB | 27 Nov 2016 - 05:39 |
arks | 3 | 25.33 KB | 19 Nov 2016 - 22:36 |
Jakarta commons-httpclient | 2 | 7.07 KB | 22 Nov 2016 - 12:41 |
Phantom | 2 | 26.47 MB | 14 Nov 2016 - 17:30 |
Sift | 2 | 12.00 KB | 22 Nov 2016 - 03:01 |
psbot | 2 | 15.41 KB | 22 Nov 2016 - 12:25 |
MojeekBot | 2 | 7.07 KB | 19 Nov 2016 - 22:52 |
HTTrack off-line browser | 2 | 3.38 MB | 06 Nov 2016 - 06:10 |
Feedburner | 2 | 0 | 26 Nov 2016 - 00:11 |
W3C Validator | 1 | 4.51 KB | 26 Nov 2016 - 23:04 |