30 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,101 | 71.40 MB | 31 Jul 2019 - 23:05 |
SemrushBot | 6,490 | 438.11 MB | 31 Jul 2019 - 23:08 |
Unknown robot (identified by 'crawl') | 5,212 | 210.93 MB | 31 Jul 2019 - 12:37 |
AhrefsBot | 4,019 | 582.55 MB | 31 Jul 2019 - 22:18 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,168 | 11.56 MB | 30 Jul 2019 - 01:25 |
WGet tools | 637 | 593.96 MB | 31 Jul 2019 - 20:12 |
BaiDuSpider | 370 | 18.24 MB | 31 Jul 2019 - 22:09 |
Bingbot | 272 | 5.03 MB | 31 Jul 2019 - 16:47 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 170 | 1.17 MB | 31 Jul 2019 - 22:04 |
Googlebot | 129 | 2.85 MB | 31 Jul 2019 - 21:46 |
Yandex Bot | 106 | 24.11 MB | 31 Jul 2019 - 14:35 |
DotBot, Open Site Explorer | 60 | 5.26 MB | 31 Jul 2019 - 02:13 |
Java (Often spam bot) | 32 | 5.34 MB | 27 Jul 2019 - 00:01 |
MJ12bot | 29 | 176.04 KB | 31 Jul 2019 - 17:41 |
Common Crawl | 20 | 79.59 KB | 23 Jul 2019 - 05:22 |
SeznamBot | 10 | 23.41 KB | 29 Jul 2019 - 20:34 |
Alexa (IA Archiver) | 9 | 34.09 KB | 30 Jul 2019 - 13:21 |
ltx71 | 8 | 1.35 MB | 21 Jul 2019 - 23:36 |
Unknown robot (identified by empty user agent string) | 5 | 131.84 KB | 26 Jul 2019 - 03:27 |
FaceBook bot | 4 | 12.71 KB | 04 Jul 2019 - 15:44 |
Sift | 4 | 123.62 KB | 16 Jul 2019 - 21:27 |
Python-urllib | 3 | 1.44 MB | 18 Jul 2019 - 14:45 |
Mail.ru bot | 2 | 6.36 KB | 26 Jul 2019 - 17:11 |
CFNetwork | 2 | 9.51 KB | 23 Jul 2019 - 02:33 |
Web Core / Roots | 2 | 6.36 KB | 08 Jul 2019 - 10:12 |
yeti | 2 | 8.69 KB | 07 Jul 2019 - 22:27 |
LinkBot | 2 | 2.94 KB | 14 Jul 2019 - 17:39 |
Nutch | 1 | 4.34 KB | 24 Jul 2019 - 13:42 |
Unknown robot (identified by 'spider') | 1 | 4.34 KB | 19 Jul 2019 - 02:08 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 131.45 KB | 30 Jul 2019 - 11:43 |
|