24 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'bot*') | 10012 | 34.00 GB | 30 Sep 2017 - 22:53 |
Unknown robot (identified by 'robot') | 6424 | 15.16 GB | 30 Sep 2017 - 13:24 |
Unknown robot (identified by 'crawl') | 2564 | 4.27 GB | 30 Sep 2017 - 22:59 |
Python-urllib | 2388 | 236.80 MB | 30 Sep 2017 - 23:15 |
BaiDuSpider | 1724 | 16.59 GB | 30 Sep 2017 - 23:50 |
Yandex bot | 1714 | 26.22 GB | 30 Sep 2017 - 23:46 |
Java (Often spam bot) | 1623 | 83.88 GB | 29 Sep 2017 - 10:00 |
Yahoo Slurp | 832 | 2.68 GB | 30 Sep 2017 - 23:56 |
Unknown robot (identified by empty user agent string) | 233 | 24.49 GB | 30 Sep 2017 - 11:50 |
MJ12bot | 136 | 35.46 MB | 25 Sep 2017 - 23:45 |
Googlebot | 96 | 95.31 MB | 30 Sep 2017 - 23:50 |
Alexa (IA Archiver) | 47 | 162.06 KB | 29 Sep 2017 - 01:53 |
Nutch | 37 | 3.66 GB | 26 Sep 2017 - 17:52 |
Jakarta commons-httpclient | 34 | 544 Bytes | 29 Sep 2017 - 10:00 |
archive.org bot | 28 | 38.57 MB | 28 Sep 2017 - 22:12 |
Exabot | 19 | 2.48 MB | 30 Sep 2017 - 07:14 |
Web Core / Roots | 10 | 94.85 MB | 19 Sep 2017 - 12:22 |
SeznamBot | 9 | 33.70 KB | 29 Sep 2017 - 11:35 |
Unknown robot (identified by 'spider') | 6 | 41.74 MB | 26 Sep 2017 - 16:27 |
CFNetwork | 3 | 6.59 GB | 22 Sep 2017 - 00:34 |
Sogou Spider | 3 | 14.97 KB | 25 Sep 2017 - 23:59 |
LinkWalker | 2 | 32.91 KB | 22 Sep 2017 - 06:25 |
Mail.ru bot | 1 | 3.54 KB | 13 Sep 2017 - 13:06 |
MSNBot | 1 | 8.75 MB | 03 Sep 2017 - 11:00 |