33 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 24,227 | 959.09 MB | 30 Sep 2021 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 16,094 | 157.68 MB | 30 Sep 2021 - 23:55 |
AhrefsBot | 9,410 | 1.41 GB | 30 Sep 2021 - 22:34 |
Unknown robot (identified by 'spider') | 6,234 | 2.50 GB | 29 Sep 2021 - 21:02 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 5,603 | 1.07 GB | 30 Sep 2021 - 23:59 |
Bingbot | 4,370 | 2.38 GB | 30 Sep 2021 - 23:11 |
Nutch | 1,390 | 170.78 MB | 26 Sep 2021 - 17:54 |
DotBot, Open Site Explorer | 1,378 | 299.63 MB | 30 Sep 2021 - 23:58 |
Yandex Bot | 1,127 | 44.20 MB | 30 Sep 2021 - 18:32 |
Unknown robot (identified by 'crawl') | 1,005 | 13.26 MB | 30 Sep 2021 - 16:10 |
Googlebot | 612 | 41.21 MB | 30 Sep 2021 - 23:30 |
WGet tools | 265 | 229.50 MB | 30 Sep 2021 - 23:05 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 86 | 987.94 KB | 30 Sep 2021 - 18:57 |
Common Crawl | 49 | 925.61 KB | 30 Sep 2021 - 14:27 |
MJ12bot | 40 | 199.10 KB | 28 Sep 2021 - 13:19 |
MojeekBot | 32 | 863.29 KB | 26 Sep 2021 - 04:43 |
Unknown robot (identified by empty user agent string) | 15 | 220.80 KB | 25 Sep 2021 - 19:19 |
SeznamBot | 14 | 43.47 KB | 30 Sep 2021 - 17:19 |
Python-urllib | 13 | 12.93 MB | 25 Sep 2021 - 16:52 |
Web Core / Roots | 9 | 3.57 MB | 27 Sep 2021 - 09:36 |
BaiDuSpider | 8 | 28.95 KB | 28 Sep 2021 - 12:35 |
Java (Often spam bot) | 7 | 82.13 KB | 24 Sep 2021 - 02:55 |
Googlebot-Image | 6 | 246.53 KB | 28 Sep 2021 - 21:26 |
Mail.ru bot | 3 | 2.40 KB | 10 Sep 2021 - 14:09 |
FaceBook bot | 2 | 608.48 KB | 24 Sep 2021 - 01:08 |
InternetArchive | 2 | 0 | 23 Sep 2021 - 22:29 |
ltx71 | 2 | 1.01 MB | 10 Sep 2021 - 06:14 |
Heritrix | 1 | 59.99 KB | 19 Sep 2021 - 18:54 |
BBot | 1 | 3.18 KB | 25 Sep 2021 - 19:22 |
yeti | 1 | 59.99 KB | 10 Sep 2021 - 21:39 |
HTTrack off-line browser | 1 | 59.99 KB | 05 Sep 2021 - 21:02 |
SEOkicks Webcrawler | 1 | 3.18 KB | 05 Sep 2021 - 21:07 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 3.30 KB | 12 Sep 2021 - 04:44 |
|