24 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 112,187 | 244.28 GB | 30 Jun 2018 - 23:59 |
Unknown robot (identified by 'robot') | 14,477 | 7.71 GB | 30 Jun 2018 - 23:13 |
bot[+:,\.\;\/\\-] | 5,838 | 18.36 GB | 30 Jun 2018 - 23:59 |
Python-urllib | 1,394 | 69.77 GB | 30 Jun 2018 - 23:15 |
BaiDuSpider | 1,136 | 1.72 GB | 30 Jun 2018 - 23:56 |
java | 590 | 45.46 GB | 30 Jun 2018 - 20:03 |
Googlebot | 441 | 291.00 MB | 30 Jun 2018 - 22:45 |
Yandex Bot | 395 | 41.60 GB | 30 Jun 2018 - 23:47 |
Unknown robot (identified by empty user agent string) | 272 | 33.78 GB | 30 Jun 2018 - 21:48 |
MJ12bot | 151 | 1.27 GB | 30 Jun 2018 - 18:41 |
Jakarta commons-httpclient | 29 | 464 Bytes | 29 Jun 2018 - 08:01 |
Sogou Spider | 14 | 12.30 MB | 29 Jun 2018 - 15:14 |
LinkChecker | 12 | 0 | 26 Jun 2018 - 23:45 |
CFNetwork | 9 | 137.81 MB | 17 Jun 2018 - 21:02 |
SeznamBot | 8 | 40.68 KB | 29 Jun 2018 - 23:17 |
HTTrack off-line browser | 4 | 1.77 MB | 10 Jun 2018 - 14:23 |
Alexa (IA Archiver) | 3 | 12.54 KB | 25 Jun 2018 - 22:09 |
Unknown robot (identified by 'spider') | 2 | 18.89 MB | 29 Jun 2018 - 16:11 |
archive.org bot | 2 | 18.97 MB | 18 Jun 2018 - 18:29 |
GigaBot | 1 | 3.66 KB | 02 Jun 2018 - 11:29 |
MojeekBot | 1 | 29.38 KB | 24 Jun 2018 - 07:57 |
InfoBot | 1 | 6.68 KB | 15 Jun 2018 - 07:19 |
Web Core / Roots | 1 | 9.49 MB | 01 Jun 2018 - 07:04 |
YaCy | 1 | 3.66 KB | 04 Jun 2018 - 21:52 |
|