27 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 33,113 | 58.18 GB | 31 May 2020 - 23:59 |
AhrefsBot | 5,242 | 16.89 GB | 31 May 2020 - 23:58 |
DotBot, Open Site Explorer | 3,829 | 9.35 GB | 31 May 2020 - 23:39 |
Yandex Bot | 284 | 995.62 KB | 31 May 2020 - 22:21 |
Googlebot | 71 | 285.35 KB | 31 May 2020 - 22:01 |
SeznamBot | 8 | 32.92 KB | 31 May 2020 - 19:46 |
WGet tools | 143 | 5.77 GB | 31 May 2020 - 16:03 |
Common *nix tool for automating web document retireval. Most likely a bot. | 77 | 2.95 GB | 31 May 2020 - 04:09 |
Grabber (SDSC) | 1 | 24.43 MB | 31 May 2020 - 03:54 |
MJ12bot | 6,546 | 31.62 GB | 31 May 2020 - 00:41 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 133 | 412.43 KB | 30 May 2020 - 17:04 |
Netcraft | 1 | 0 | 29 May 2020 - 23:37 |
Python-urllib | 7 | 22.29 KB | 29 May 2020 - 17:53 |
twitterbot | 10 | 139.87 MB | 29 May 2020 - 17:53 |
Unknown robot (identified by empty user agent string) | 22 | 6.26 KB | 29 May 2020 - 17:01 |
Alexa (IA Archiver) | 8 | 30.72 KB | 29 May 2020 - 16:44 |
Unknown robot (identified by 'robot') | 20 | 73.68 KB | 29 May 2020 - 16:44 |
Suspected bot masqurading as Mozilla | 35 | 58.96 KB | 29 May 2020 - 15:28 |
Unknown robot (identified by 'crawl') | 444 | 1015.38 MB | 27 May 2020 - 15:24 |
Common Crawl | 29 | 93.22 KB | 26 May 2020 - 21:46 |
FavIconizer | 6 | 21.30 KB | 25 May 2020 - 10:54 |
Bingbot | 9 | 29.15 KB | 25 May 2020 - 10:05 |
MSNBot-media | 1 | 3.00 KB | 16 May 2020 - 00:35 |
Bing Preview bot | 1 | 3.00 KB | 16 May 2020 - 00:35 |
ltx71 | 9 | 146.26 MB | 11 May 2020 - 21:53 |
Web Core / Roots | 5 | 119.90 MB | 08 May 2020 - 23:54 |
Java (Often spam bot) | 1 | 3.13 KB | 06 May 2020 - 17:28 |
|