29 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 15,567 | 130.41 MB | 30 Sep 2019 - 22:00 |
SemrushBot | 8,740 | 471.02 MB | 30 Sep 2019 - 22:09 |
Unknown robot (identified by 'crawl') | 5,353 | 545.19 MB | 30 Sep 2019 - 14:36 |
AhrefsBot | 2,676 | 319.80 MB | 30 Sep 2019 - 21:57 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 2,225 | 57.67 MB | 26 Sep 2019 - 17:34 |
Yandex Bot | 923 | 60.51 MB | 30 Sep 2019 - 19:24 |
WGet tools | 519 | 482.44 MB | 30 Sep 2019 - 21:46 |
Bingbot | 363 | 28.96 MB | 30 Sep 2019 - 20:58 |
Java (Often spam bot) | 134 | 2.76 MB | 30 Sep 2019 - 02:12 |
DotBot, Open Site Explorer | 129 | 2.86 MB | 30 Sep 2019 - 16:11 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 124 | 1.36 MB | 29 Sep 2019 - 12:39 |
Googlebot | 118 | 4.56 MB | 30 Sep 2019 - 21:00 |
MJ12bot | 64 | 1.14 MB | 30 Sep 2019 - 09:18 |
Common Crawl | 18 | 256.74 KB | 23 Sep 2019 - 14:16 |
SeznamBot | 12 | 37.60 KB | 29 Sep 2019 - 19:49 |
Web Core / Roots | 10 | 3.08 MB | 27 Sep 2019 - 04:19 |
ltx71 | 10 | 963.76 KB | 26 Sep 2019 - 14:43 |
Sift | 7 | 245.42 KB | 30 Sep 2019 - 19:49 |
Alexa (IA Archiver) | 6 | 84.92 KB | 30 Sep 2019 - 20:12 |
Python-urllib | 6 | 6.36 KB | 29 Sep 2019 - 20:16 |
yeti | 4 | 70.50 KB | 29 Sep 2019 - 21:17 |
BaiDuSpider | 3 | 142.05 KB | 10 Sep 2019 - 23:26 |
archive.org bot | 1 | 1.82 KB | 03 Sep 2019 - 15:16 |
360spider | 1 | 3.30 KB | 01 Sep 2019 - 01:59 |
Suspected bot masqurading as Mozilla | 1 | 4.34 KB | 20 Sep 2019 - 00:36 |
InternetArchive | 1 | 0 | 10 Sep 2019 - 03:05 |
Unknown robot (identified by 'spider') | 1 | 59.99 KB | 07 Sep 2019 - 05:28 |
Mail.ru bot | 1 | 819 Bytes | 11 Sep 2019 - 06:28 |
SEOkicks Webcrawler | 1 | 3.30 KB | 02 Sep 2019 - 01:49 |
|