32 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 17,342 | 166.71 MB | 31 Mar 2019 - 23:05 |
Unknown robot (identified by 'crawl') | 11,643 | 1.10 GB | 30 Mar 2019 - 23:46 |
SemrushBot | 6,698 | 765.65 MB | 31 Mar 2019 - 23:07 |
AhrefsBot | 2,519 | 403.85 MB | 31 Mar 2019 - 21:08 |
Yandex Bot | 1,646 | 199.68 MB | 31 Mar 2019 - 21:08 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,356 | 356.82 MB | 31 Mar 2019 - 22:19 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 854 | 9.59 MB | 23 Mar 2019 - 15:33 |
WGet tools | 671 | 611.79 MB | 31 Mar 2019 - 21:07 |
Bingbot | 329 | 15.09 MB | 31 Mar 2019 - 21:08 |
BaiDuSpider | 268 | 7.13 MB | 31 Mar 2019 - 22:45 |
DotBot, Open Site Explorer | 177 | 8.29 MB | 31 Mar 2019 - 19:40 |
MJ12bot | 129 | 49.97 MB | 28 Mar 2019 - 03:29 |
Googlebot | 109 | 5.28 MB | 31 Mar 2019 - 20:18 |
Java (Often spam bot) | 105 | 2.38 MB | 31 Mar 2019 - 02:29 |
Y!J Yahoo Japan | 31 | 500.94 KB | 24 Mar 2019 - 12:39 |
Python-urllib | 28 | 28.78 MB | 29 Mar 2019 - 01:32 |
Common Crawl | 28 | 2.77 MB | 24 Mar 2019 - 09:55 |
ltx71 | 12 | 285.16 KB | 29 Mar 2019 - 21:42 |
Alexa (IA Archiver) | 11 | 102.95 KB | 16 Mar 2019 - 00:34 |
Mail.ru bot | 8 | 666.92 KB | 30 Mar 2019 - 02:35 |
Web Core / Roots | 8 | 4.38 MB | 27 Mar 2019 - 10:16 |
Sift | 8 | 247.24 KB | 31 Mar 2019 - 18:03 |
yeti | 6 | 26.06 KB | 31 Mar 2019 - 22:51 |
HTTrack off-line browser | 4 | 181.79 KB | 21 Mar 2019 - 08:09 |
SeznamBot | 4 | 4.34 KB | 28 Mar 2019 - 17:46 |
Unknown robot (identified by 'spider') | 3 | 63.17 KB | 21 Mar 2019 - 04:08 |
Sogou Spider | 3 | 9.51 KB | 29 Mar 2019 - 18:50 |
Cliqzbot | 3 | 15.50 KB | 16 Mar 2019 - 03:58 |
Unknown robot (identified by empty user agent string) | 2 | 1.27 MB | 23 Mar 2019 - 04:08 |
lwp-trivial | 1 | 4.34 KB | 30 Mar 2019 - 19:24 |
YaCy | 1 | 3.18 KB | 30 Mar 2019 - 03:27 |
MojeekBot | 1 | 3.18 KB | 05 Mar 2019 - 09:15 |
|