32 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 74,879 | 430.02 GB | 31 May 2018 - 18:46 |
Python-urllib | 28,604 | 88.51 GB | 31 May 2018 - 23:58 |
Yandex Bot | 19,208 | 1389.15 GB | 31 May 2018 - 23:42 |
bot[+:,\.\;\/\\-] | 14,926 | 460.91 GB | 31 May 2018 - 23:41 |
Googlebot | 11,089 | 74.65 GB | 31 May 2018 - 23:20 |
Unknown robot (identified by empty user agent string) | 8,157 | 145.17 GB | 31 May 2018 - 23:45 |
BaiDuSpider | 4,760 | 55.29 GB | 31 May 2018 - 23:20 |
java | 765 | 13.96 GB | 31 May 2018 - 18:52 |
Unknown robot (identified by 'robot') | 710 | 858.51 MB | 31 May 2018 - 22:50 |
Web Core / Roots | 323 | 21.83 GB | 31 May 2018 - 22:38 |
Sogou Spider | 314 | 573.69 MB | 31 May 2018 - 16:31 |
Unknown robot (identified by 'spider') | 163 | 17.60 GB | 30 May 2018 - 22:58 |
MJ12bot | 159 | 9.46 GB | 29 May 2018 - 22:23 |
Exabot | 152 | 476.76 KB | 30 May 2018 - 03:32 |
MagpieRSS | 130 | 21.13 GB | 31 May 2018 - 16:15 |
SeznamBot | 128 | 2.99 GB | 30 May 2018 - 10:57 |
Mail.ru bot | 106 | 711.30 MB | 31 May 2018 - 20:32 |
[+:,\.\;\/\\-]bot | 86 | 22.50 GB | 19 May 2018 - 01:13 |
Alexa (IA Archiver) | 84 | 31.31 MB | 29 May 2018 - 11:05 |
YaCy | 34 | 2.39 GB | 31 May 2018 - 07:55 |
Nutch | 18 | 2.23 GB | 27 May 2018 - 22:32 |
Phantom | 18 | 49.08 KB | 30 May 2018 - 21:54 |
CFNetwork | 18 | 8.23 GB | 24 May 2018 - 04:12 |
Jakarta commons-httpclient | 8 | 658.56 MB | 31 May 2018 - 23:43 |
MojeekBot | 8 | 95.58 KB | 30 May 2018 - 13:06 |
Google AdSense | 8 | 14.02 GB | 26 May 2018 - 12:17 |
Netcraft | 6 | 17.01 KB | 31 May 2018 - 16:05 |
archive.org bot | 6 | 14.06 KB | 12 May 2018 - 08:23 |
Sift | 6 | 20.31 KB | 31 May 2018 - 06:00 |
LinkChecker | 3 | 0 | 17 May 2018 - 23:50 |
MSIECrawler | 1 | 270.58 MB | 25 May 2018 - 16:46 |
HTTrack off-line browser | 1 | 49.89 MB | 14 May 2018 - 02:43 |
|