25 different robots | Hits | Bandwidth | Last visit |
Yandex bot | 350 | 197.76 MB | 30 Jun 2017 - 23:39 |
Unknown robot (identified by empty user agent string) | 49 | 31.16 MB | 30 Jun 2017 - 23:32 |
Unknown robot (identified by 'bot*') | 937 | 401.12 MB | 30 Jun 2017 - 23:14 |
BaiDuSpider | 267 | 125.38 MB | 30 Jun 2017 - 22:50 |
Python-urllib | 907 | 14.02 MB | 30 Jun 2017 - 22:20 |
Googlebot | 236 | 50.67 MB | 30 Jun 2017 - 21:12 |
Alexa (IA Archiver) | 6 | 4.93 MB | 30 Jun 2017 - 18:44 |
Java (Often spam bot) | 168 | 194.48 MB | 30 Jun 2017 - 17:50 |
archive.org bot | 218 | 360.40 MB | 30 Jun 2017 - 17:34 |
Unknown robot (identified by 'robot') | 235 | 328.24 MB | 30 Jun 2017 - 16:17 |
Sogou Spider | 27 | 1.16 MB | 30 Jun 2017 - 16:12 |
Yahoo Slurp | 6 | 9.60 MB | 30 Jun 2017 - 13:00 |
MJ12bot | 42 | 1.67 MB | 30 Jun 2017 - 11:29 |
Unknown robot (identified by 'spider') | 21 | 885.59 KB | 30 Jun 2017 - 11:28 |
Unknown robot (identified by 'crawl') | 328 | 231.79 MB | 28 Jun 2017 - 04:06 |
Exabot | 9 | 132.66 KB | 27 Jun 2017 - 08:40 |
HTTrack off-line browser | 1 | 3.24 MB | 26 Jun 2017 - 12:37 |
Mail.ru bot | 38 | 28.64 MB | 25 Jun 2017 - 14:47 |
Web Core / Roots | 165 | 269.35 MB | 22 Jun 2017 - 06:52 |
yacy | 90 | 235.10 MB | 15 Jun 2017 - 22:15 |
Nutch | 2 | 2.39 MB | 14 Jun 2017 - 22:54 |
psbot | 1 | 44.21 KB | 12 Jun 2017 - 05:26 |
CFNetwork | 1 | 3.03 MB | 11 Jun 2017 - 17:52 |
Netcraft | 1 | 44.21 KB | 09 Jun 2017 - 00:12 |
UniversalFeedParser | 6 | 15.07 MB | 05 Jun 2017 - 02:20 |