45 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 8,049 | 21.12 GB | 30 Apr 2020 - 23:09 |
AhrefsBot | 19,270 | 560.00 GB | 30 Apr 2020 - 23:08 |
DotBot, Open Site Explorer | 6,264 | 52.60 GB | 30 Apr 2020 - 23:08 |
Unknown robot (identified by empty user agent string) | 1,565 | 92.77 GB | 30 Apr 2020 - 23:06 |
Perl tool | 259 | 7.17 MB | 30 Apr 2020 - 23:03 |
Python-urllib | 824 | 312.80 GB | 30 Apr 2020 - 23:02 |
Yandex Bot | 1,796 | 114.18 GB | 30 Apr 2020 - 22:59 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,737 | 253.15 MB | 30 Apr 2020 - 22:53 |
WGet tools | 3,161 | 767.13 GB | 30 Apr 2020 - 22:52 |
Common *nix tool for automating web document retireval. Most likely a bot. | 3,635 | 736.68 GB | 30 Apr 2020 - 22:16 |
Java (Often spam bot) | 790 | 46.74 GB | 30 Apr 2020 - 22:14 |
Googlebot | 212 | 504.61 MB | 30 Apr 2020 - 22:03 |
CFNetwork | 78 | 2.24 GB | 30 Apr 2020 - 22:02 |
Unknown robot (identified by 'crawl') | 4,541 | 116.15 GB | 30 Apr 2020 - 21:44 |
Bingbot | 185 | 480.90 MB | 30 Apr 2020 - 21:03 |
LinkChecker | 264 | 0 | 30 Apr 2020 - 19:43 |
Jakarta commons-httpclient | 55 | 880 Bytes | 30 Apr 2020 - 14:01 |
BaiDuSpider | 33 | 79.86 MB | 30 Apr 2020 - 11:27 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 10,392+1 | 44.07 GB | 30 Apr 2020 - 10:45 |
Cliqzbot | 1 | 56.56 KB | 30 Apr 2020 - 08:33 |
MJ12bot | 32 | 39.81 MB | 29 Apr 2020 - 18:58 |
archive.org bot | 8 | 236.89 MB | 29 Apr 2020 - 18:18 |
FaceBook bot | 59 | 49.80 MB | 29 Apr 2020 - 17:14 |
Web Core / Roots | 23 | 544.78 MB | 29 Apr 2020 - 14:04 |
Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 29 Apr 2020 - 11:20 |
yie8 | 11 | 0 | 29 Apr 2020 - 11:07 |
MojeekBot | 2 | 60.02 KB | 29 Apr 2020 - 01:19 |
Bing Preview bot | 1 | 28.67 MB | 28 Apr 2020 - 20:24 |
MSNBot | 1 | 28.67 MB | 28 Apr 2020 - 19:23 |
WordPress | 22 | 132.60 MB | 28 Apr 2020 - 08:58 |
SeznamBot | 18 | 96.53 KB | 27 Apr 2020 - 15:53 |
ltx71 | 6 | 3.07 MB | 27 Apr 2020 - 00:27 |
Google AdSense | 3 | 4.35 MB | 24 Apr 2020 - 15:11 |
Yahoo Slurp | 1 | 1.45 MB | 22 Apr 2020 - 23:56 |
Sogou Spider | 8 | 12.30 MB | 22 Apr 2020 - 01:58 |
FavIconizer | 2 | 28.68 MB | 20 Apr 2020 - 22:23 |
ning | 2 | 32.27 MB | 18 Apr 2020 - 21:45 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 7 | 33.77 KB | 16 Apr 2020 - 16:44 |
Unknown robot (identified by 'robot') | 1 | 8.04 KB | 16 Apr 2020 - 10:48 |
Turn It In | 36,123 | 4.33 GB | 15 Apr 2020 - 06:03 |
Alexa (IA Archiver) | 40 | 98.01 KB | 13 Apr 2020 - 20:57 |
Mail.ru bot | 2 | 7.17 KB | 13 Apr 2020 - 16:59 |
Sift | 5 | 132.60 MB | 12 Apr 2020 - 21:31 |
Motor | 1 | 9.49 MB | 10 Apr 2020 - 08:37 |
Common Crawl | 8 | 94.25 KB | 09 Apr 2020 - 19:52 |
|