35 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 9,208 | 583.11 MB | 31 Jan 2020 - 23:10 |
Common *nix tool for automating web document retireval. Most likely a bot. | 42,465 | 286.46 MB | 31 Jan 2020 - 23:10 |
AhrefsBot | 3,974 | 937.56 MB | 31 Jan 2020 - 22:49 |
DotBot, Open Site Explorer | 689 | 65.58 MB | 31 Jan 2020 - 22:38 |
Unknown robot (identified by 'crawl') | 697 | 13.46 MB | 31 Jan 2020 - 21:58 |
WGet tools | 632 | 421.78 MB | 31 Jan 2020 - 21:53 |
Yandex Bot | 100 | 4.35 MB | 31 Jan 2020 - 21:48 |
Googlebot | 636 | 7.88 MB | 31 Jan 2020 - 21:37 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 143 | 1.34 MB | 31 Jan 2020 - 21:37 |
Bingbot | 144 | 7.24 MB | 31 Jan 2020 - 21:16 |
Sift | 20 | 618.10 KB | 31 Jan 2020 - 15:38 |
SeznamBot | 6 | 9.53 KB | 30 Jan 2020 - 18:22 |
Turn It In | 1,845 | 2.79 MB | 30 Jan 2020 - 17:18 |
MojeekBot | 12 | 43.46 KB | 30 Jan 2020 - 06:48 |
MJ12bot | 50 | 617.28 KB | 30 Jan 2020 - 04:32 |
yeti | 2 | 61.81 KB | 29 Jan 2020 - 21:18 |
Alexa (IA Archiver) | 49 | 969.33 KB | 29 Jan 2020 - 18:47 |
YaCy | 3 | 66.15 KB | 29 Jan 2020 - 17:33 |
Mail.ru bot | 4 | 3.20 KB | 28 Jan 2020 - 20:53 |
InternetArchive | 8 | 0 | 28 Jan 2020 - 09:46 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 23 | 220.43 KB | 28 Jan 2020 - 01:41 |
Nutch | 4 | 20.32 KB | 26 Jan 2020 - 23:14 |
ltx71 | 3 | 13.03 KB | 26 Jan 2020 - 01:04 |
Common Crawl | 21 | 634.43 KB | 25 Jan 2020 - 09:47 |
Java (Often spam bot) | 144 | 3.92 MB | 25 Jan 2020 - 09:27 |
HTTrack off-line browser | 1 | 68.43 KB | 20 Jan 2020 - 18:53 |
Python-urllib | 4 | 68.17 KB | 16 Jan 2020 - 01:39 |
Unknown robot (identified by empty user agent string) | 1 | 3.18 KB | 15 Jan 2020 - 21:50 |
twitterbot | 1 | 59.99 KB | 15 Jan 2020 - 19:08 |
Heritrix | 2 | 61.81 KB | 13 Jan 2020 - 05:48 |
SEOkicks Webcrawler | 170 | 2.54 MB | 11 Jan 2020 - 03:14 |
Unknown robot (identified by 'spider') | 1 | 4.34 KB | 08 Jan 2020 - 17:27 |
BBot | 1 | 59.99 KB | 05 Jan 2020 - 03:49 |
Googlebot-Image | 2 | 59.68 KB | 03 Jan 2020 - 21:26 |
Web Core / Roots | 7 | 2.00 MB | 03 Jan 2020 - 15:04 |
|