43 different robots | Hits | Bandwidth | Last visit |
Python-urllib | 217070 | 825.04 MB | 31 Jan 2017 - 23:59 |
Unknown robot (identified by 'crawl') | 2597 | 350.08 MB | 31 Jan 2017 - 21:16 |
Unknown robot (identified by 'bot*') | 2101 | 4.68 GB | 31 Jan 2017 - 22:45 |
Unknown robot (identified by empty user agent string) | 1445 | 5.66 GB | 31 Jan 2017 - 23:05 |
Yandex bot | 984 | 2.41 GB | 31 Jan 2017 - 22:55 |
BaiDuSpider | 965 | 346.74 MB | 31 Jan 2017 - 23:47 |
MJ12bot | 850 | 318.08 MB | 31 Jan 2017 - 17:36 |
Googlebot | 823 | 2.10 GB | 31 Jan 2017 - 21:36 |
Java (Often spam bot) | 713 | 473.22 MB | 31 Jan 2017 - 23:32 |
Yahoo Slurp | 574 | 1.40 GB | 31 Jan 2017 - 23:29 |
Mail.ru bot | 406 | 58.55 MB | 30 Jan 2017 - 18:07 |
Unknown robot (identified by 'robot') | 212 | 717.85 MB | 31 Jan 2017 - 07:01 |
CFNetwork | 187 | 3.74 GB | 31 Jan 2017 - 19:08 |
SeznamBot | 170 | 383.09 MB | 30 Jan 2017 - 09:16 |
Web Core / Roots | 167 | 265.61 MB | 31 Jan 2017 - 02:25 |
Unknown robot (identified by 'spider') | 92 | 176.11 MB | 31 Jan 2017 - 21:56 |
ABCdatos BotLink | 58 | 475.74 MB | 31 Jan 2017 - 01:13 |
Sogou Spider | 47 | 319.38 KB | 31 Jan 2017 - 09:31 |
Exabot | 22 | 70.96 KB | 30 Jan 2017 - 23:06 |
Phantom | 17 | 58.95 KB | 31 Jan 2017 - 10:11 |
yacy | 16 | 31.23 MB | 30 Jan 2017 - 13:30 |
StackRambler | 15 | 39.71 KB | 02 Jan 2017 - 21:54 |
arks | 12 | 15.26 MB | 29 Jan 2017 - 10:54 |
Spiderman | 10 | 35.58 KB | 23 Jan 2017 - 22:40 |
Nutch | 9 | 100.67 MB | 27 Jan 2017 - 20:22 |
Custo | 8 | 18.93 KB | 31 Jan 2017 - 17:35 |
archive.org bot | 7 | 49.60 MB | 31 Jan 2017 - 08:26 |
WordPress | 7 | 8.53 KB | 20 Jan 2017 - 05:35 |
Google AdSense | 6 | 60.27 MB | 30 Jan 2017 - 13:16 |
Steeler | 5 | 20.34 KB | 01 Jan 2017 - 14:37 |
Alexa (IA Archiver) | 4 | 14.61 MB | 23 Jan 2017 - 15:56 |
Unknown robot (identified by '*bot') | 3 | 21 Bytes | 20 Jan 2017 - 03:15 |
Kevin | 3 | 8.62 KB | 05 Jan 2017 - 03:59 |
W3C Validator | 3 | 21.32 KB | 30 Jan 2017 - 02:57 |
HTTrack off-line browser | 3 | 25.10 KB | 06 Jan 2017 - 20:46 |
FeedValidator | 2 | 9.28 KB | 22 Jan 2017 - 17:03 |
MojeekBot | 2 | 8.23 KB | 20 Jan 2017 - 10:37 |
Jakarta commons-httpclient | 1 | 3.60 KB | 16 Jan 2017 - 08:58 |
UniversalFeedParser | 1 | 3.60 KB | 05 Jan 2017 - 17:29 |
LinkChecker | 1 | 0 | 04 Jan 2017 - 14:22 |
LinkBot | 1 | 8.53 KB | 16 Jan 2017 - 18:16 |
Netcraft | 1 | 3.60 KB | 11 Jan 2017 - 07:26 |
NG 2.x (Exalead) | 1 | 0 | 01 Jan 2017 - 14:07 |