35 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 36,082 | 235.46 MB | 29 Feb 2020 - 23:08 |
SemrushBot | 8,266 | 437.62 MB | 29 Feb 2020 - 23:08 |
AhrefsBot | 5,865 | 1.19 GB | 29 Feb 2020 - 22:04 |
Unknown robot (identified by 'crawl') | 1,623 | 36.46 MB | 29 Feb 2020 - 21:05 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,166 | 36.43 MB | 29 Feb 2020 - 19:00 |
Turn It In | 992 | 122.72 MB | 18 Feb 2020 - 10:15 |
WGet tools | 595 | 461.95 MB | 29 Feb 2020 - 21:28 |
DotBot, Open Site Explorer | 337 | 38.31 MB | 29 Feb 2020 - 19:19 |
Googlebot | 174 | 13.10 MB | 29 Feb 2020 - 20:26 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 166 | 3.02 MB | 25 Feb 2020 - 05:24 |
Java (Often spam bot) | 154 | 2.37 MB | 29 Feb 2020 - 08:15 |
Bingbot | 152 | 6.11 MB | 29 Feb 2020 - 17:42 |
Yandex Bot | 128 | 15.69 MB | 29 Feb 2020 - 20:24 |
Alexa (IA Archiver) | 27 | 2.21 MB | 17 Feb 2020 - 21:45 |
MJ12bot | 20 | 254.29 KB | 28 Feb 2020 - 22:34 |
Common Crawl | 19 | 223.48 KB | 27 Feb 2020 - 21:15 |
Unknown robot (identified by empty user agent string) | 14 | 313.58 KB | 27 Feb 2020 - 03:02 |
Sift | 10 | 309.05 KB | 26 Feb 2020 - 22:04 |
SeznamBot | 9 | 27.03 KB | 22 Feb 2020 - 09:19 |
InternetArchive | 9 | 0 | 28 Feb 2020 - 00:39 |
ltx71 | 9 | 2.18 MB | 24 Feb 2020 - 16:48 |
SEOkicks Webcrawler | 8 | 33.41 KB | 22 Feb 2020 - 10:11 |
Unknown robot (identified by 'spider') | 6 | 19.07 KB | 24 Feb 2020 - 19:57 |
twitterbot | 5 | 9.10 KB | 27 Feb 2020 - 03:02 |
Googlebot-Image | 3 | 256.76 KB | 20 Feb 2020 - 18:07 |
WordPress | 3 | 59.99 KB | 08 Feb 2020 - 03:07 |
Mail.ru bot | 3 | 2.40 KB | 29 Feb 2020 - 23:10 |
MSNBot | 3 | 240.77 KB | 18 Feb 2020 - 05:19 |
Fish search | 2 | 3.64 KB | 17 Feb 2020 - 22:07 |
YaCy | 2 | 61.81 KB | 07 Feb 2020 - 01:17 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2 | 6.36 KB | 11 Feb 2020 - 00:22 |
LinkBot | 2 | 2.81 KB | 18 Feb 2020 - 04:11 |
MojeekBot | 1 | 3.89 KB | 01 Feb 2020 - 16:39 |
Web Core / Roots | 1 | 3.84 KB | 16 Feb 2020 - 19:33 |
Python-urllib | 1 | 1.44 MB | 21 Feb 2020 - 08:29 |
|