24 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 800 | 643.73 MB | 31 May 2016 - 22:11 |
Unknown robot (identified by 'bot*') | 561 | 404.02 MB | 31 May 2016 - 19:05 |
BaiDuSpider | 384 | 225.42 MB | 31 May 2016 - 23:36 |
Googlebot | 236 | 28.79 MB | 31 May 2016 - 21:43 |
Java (Often spam bot) | 228 | 269.76 MB | 31 May 2016 - 17:54 |
Unknown robot (identified by 'crawl') | 148 | 121.53 MB | 31 May 2016 - 16:49 |
Unknown robot (identified by 'robot') | 136 | 221.03 MB | 31 May 2016 - 21:36 |
Alexa (IA Archiver) | 80 | 41.01 MB | 18 May 2016 - 15:38 |
Yandex bot | 79 | 34.01 MB | 31 May 2016 - 22:03 |
MJ12bot | 77 | 40.53 MB | 31 May 2016 - 19:40 |
Python-urllib | 56 | 14.54 MB | 30 May 2016 - 22:23 |
Mail.ru bot | 52 | 16.47 MB | 30 May 2016 - 19:09 |
Unknown robot (identified by empty user agent string) | 40 | 55.75 MB | 30 May 2016 - 23:54 |
Unknown robot (identified by 'spider') | 33 | 5.14 MB | 31 May 2016 - 23:34 |
archive.org bot | 33 | 48.90 MB | 26 May 2016 - 17:43 |
Sogou Spider | 18 | 770.04 KB | 27 May 2016 - 06:47 |
SeznamBot | 16 | 5.02 MB | 31 May 2016 - 04:05 |
Exabot | 5 | 42.95 KB | 16 May 2016 - 08:42 |
yacy | 5 | 8.84 MB | 31 May 2016 - 08:29 |
MojeekBot | 3 | 126.86 KB | 03 May 2016 - 12:33 |
Turn It In | 2 | 85.91 KB | 12 May 2016 - 07:04 |
Web Core / Roots | 1 | 3.16 MB | 13 May 2016 - 23:11 |
HTTrack off-line browser | 1 | 3.16 MB | 31 May 2016 - 20:34 |
Nutch | 1 | 42.20 KB | 05 May 2016 - 12:51 |