28 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 33,654 | 114.65 GB | 30 Sep 2020 - 23:59 |
AhrefsBot | 14,142 | 49.07 GB | 30 Sep 2020 - 23:59 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 7,978 | 25.54 MB | 09 Sep 2020 - 19:29 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 6,654 | 62.53 GB | 30 Sep 2020 - 06:44 |
MJ12bot | 4,041 | 82.44 GB | 30 Sep 2020 - 21:08 |
Yandex Bot | 649 | 793.35 MB | 28 Sep 2020 - 14:39 |
WGet tools | 350 | 12.14 GB | 30 Sep 2020 - 22:10 |
Common *nix tool for automating web document retireval. Most likely a bot. | 168 | 4.35 GB | 30 Sep 2020 - 17:09 |
Unknown robot (identified by 'crawl') | 131 | 199.02 MB | 29 Sep 2020 - 20:15 |
Googlebot | 102 | 592.78 KB | 30 Sep 2020 - 20:25 |
Bingbot | 90 | 314.12 KB | 30 Sep 2020 - 14:48 |
Alexa (IA Archiver) | 59 | 209.47 KB | 29 Sep 2020 - 17:40 |
Python-urllib | 26 | 56.10 MB | 29 Sep 2020 - 16:45 |
Unknown robot (identified by empty user agent string) | 25 | 2.87 GB | 29 Sep 2020 - 18:34 |
Grabber (SDSC) | 17 | 401.12 MB | 29 Sep 2020 - 08:33 |
archive.org bot | 16 | 52.39 KB | 30 Sep 2020 - 07:04 |
Unknown robot (identified by 'robot') | 13 | 60.24 KB | 30 Sep 2020 - 10:52 |
Common Crawl | 12 | 34.85 KB | 24 Sep 2020 - 10:28 |
twitterbot | 12 | 152.10 MB | 29 Sep 2020 - 17:40 |
DotBot, Open Site Explorer | 11 | 264.00 MB | 16 Sep 2020 - 03:36 |
FavIconizer | 8 | 26.04 KB | 28 Sep 2020 - 11:38 |
Suspected bot masqurading as Mozilla | 7 | 11.75 KB | 26 Sep 2020 - 16:21 |
Googlebot-Image | 3 | 2.28 KB | 14 Sep 2020 - 13:54 |
Unknown robot (identified by 'spider') | 2 | 5.52 KB | 25 Sep 2020 - 01:53 |
SeznamBot | 2 | 6.64 KB | 29 Sep 2020 - 09:35 |
Bing Preview bot | 1 | 2.20 KB | 04 Sep 2020 - 03:57 |
Netcraft | 1 | 3.32 KB | 02 Sep 2020 - 12:59 |
Web Core / Roots | 1 | 0 | 11 Sep 2020 - 18:41 |
|