34 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by empty user agent string) | 544,331 | 8.06 GB | 30 Sep 2021 - 23:57 |
SemrushBot | 19,331 | 583.33 GB | 30 Sep 2021 - 23:56 |
AhrefsBot | 5,164 | 163.07 GB | 30 Sep 2021 - 22:26 |
Bingbot | 3,774 | 79.43 GB | 30 Sep 2021 - 23:31 |
WGet tools | 2,307 | 167.46 MB | 30 Sep 2021 - 23:08 |
Yandex Bot | 1,990 | 40.97 GB | 30 Sep 2021 - 22:16 |
DotBot, Open Site Explorer | 1,349 | 20.37 GB | 30 Sep 2021 - 23:58 |
Unknown robot (identified by 'crawl') | 1,097 | 6.18 GB | 30 Sep 2021 - 16:14 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 302 | 19.19 GB | 30 Sep 2021 - 20:56 |
Googlebot | 276 | 1.22 GB | 30 Sep 2021 - 20:59 |
CFNetwork | 235 | 25.83 GB | 30 Sep 2021 - 12:27 |
Googlebot-Image | 120 | 164.22 MB | 30 Sep 2021 - 17:03 |
LinkChecker | 84 | 0 | 30 Sep 2021 - 04:07 |
Unknown robot (identified by 'spider') | 80 | 4.66 GB | 30 Sep 2021 - 17:11 |
MJ12bot | 65 | 250.05 MB | 29 Sep 2021 - 04:37 |
BaiDuSpider | 57 | 6.46 GB | 30 Sep 2021 - 08:23 |
Java (Often spam bot) | 38 | 1.73 GB | 30 Sep 2021 - 18:09 |
Python-urllib | 34 | 6.32 MB | 28 Sep 2021 - 23:19 |
SEOkicks Webcrawler | 34 | 15.11 GB | 05 Sep 2021 - 20:27 |
Nutch | 30 | 160.79 MB | 26 Sep 2021 - 09:29 |
Web Core / Roots | 28 | 360.26 MB | 30 Sep 2021 - 12:49 |
Mail.ru bot | 27 | 1.31 MB | 24 Sep 2021 - 19:07 |
Suspected bot masqurading as Mozilla | 25 | 0 | 27 Sep 2021 - 02:54 |
WordPress | 25 | 1.01 MB | 28 Sep 2021 - 20:33 |
Common Crawl | 22 | 151.17 KB | 28 Sep 2021 - 05:17 |
ltx71 | 22 | 551.62 MB | 30 Sep 2021 - 03:17 |
Bing Preview bot | 15 | 8.17 GB | 30 Sep 2021 - 00:39 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 14 | 120.46 KB | 30 Sep 2021 - 19:20 |
FeedValidator | 11 | 0 | 23 Sep 2021 - 17:19 |
SeznamBot | 4 | 0 | 30 Sep 2021 - 05:28 |
Heritrix | 1 | 448.18 KB | 15 Sep 2021 - 08:08 |
twitterbot | 1 | 126.11 MB | 21 Sep 2021 - 22:54 |
FaceBook bot | 1 | 429.25 KB | 27 Sep 2021 - 19:51 |
Phantom | 1 | 7.84 KB | 06 Sep 2021 - 03:49 |
|