39 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 20,066 | 819.36 MB | 31 Mar 2021 - 23:07 |
Common *nix tool for automating web document retireval. Most likely a bot. | 16,426 | 156.74 MB | 31 Mar 2021 - 23:05 |
AhrefsBot | 9,493 | 844.70 MB | 31 Mar 2021 - 22:55 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,185 | 667.86 MB | 31 Mar 2021 - 23:07 |
Bingbot | 3,256 | 699.99 MB | 31 Mar 2021 - 23:03 |
Yandex Bot | 1,959 | 147.19 MB | 31 Mar 2021 - 22:03 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,834 | 53.97 MB | 31 Mar 2021 - 13:01 |
DotBot, Open Site Explorer | 1,656 | 119.86 MB | 31 Mar 2021 - 22:58 |
Unknown robot (identified by 'crawl') | 794 | 22.28 MB | 31 Mar 2021 - 17:40 |
Googlebot | 554 | 68.37 MB | 31 Mar 2021 - 23:06 |
WGet tools | 266 | 235.64 MB | 31 Mar 2021 - 20:28 |
Unknown robot (identified by 'spider') | 219 | 4.10 MB | 31 Mar 2021 - 22:28 |
Web Core / Roots | 203 | 116.29 MB | 31 Mar 2021 - 19:33 |
Nutch | 36 | 7.74 MB | 31 Mar 2021 - 20:38 |
Java (Often spam bot) | 26 | 2.01 MB | 26 Mar 2021 - 18:48 |
MojeekBot | 24 | 91.16 KB | 29 Mar 2021 - 13:19 |
MJ12bot | 21 | 168.28 KB | 31 Mar 2021 - 08:49 |
SeznamBot | 13 | 70.77 KB | 31 Mar 2021 - 02:01 |
Unknown robot (identified by empty user agent string) | 12 | 4.52 MB | 30 Mar 2021 - 19:16 |
Unknown robot (identified by 'robot') | 9 | 42.13 KB | 30 Mar 2021 - 09:18 |
ltx71 | 8 | 4.00 MB | 30 Mar 2021 - 07:05 |
Sift | 7 | 361.76 KB | 30 Mar 2021 - 09:58 |
Python-urllib | 6 | 4.32 MB | 29 Mar 2021 - 13:05 |
InternetArchive | 5 | 0 | 31 Mar 2021 - 12:34 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 4 | 183.15 KB | 28 Mar 2021 - 05:37 |
WordPress | 3 | 0 | 18 Mar 2021 - 05:13 |
Mail.ru bot | 3 | 2.40 KB | 31 Mar 2021 - 00:50 |
BaiDuSpider | 3 | 102.24 KB | 28 Mar 2021 - 14:36 |
yeti | 2 | 119.98 KB | 23 Mar 2021 - 15:40 |
YaCy | 2 | 119.98 KB | 14 Mar 2021 - 02:35 |
Unknown robot (identified by 'checker') | 2 | 1.18 MB | 25 Mar 2021 - 18:59 |
FaceBook bot | 2 | 63.17 KB | 19 Mar 2021 - 20:23 |
SEOkicks Webcrawler | 2 | 6.36 KB | 19 Mar 2021 - 19:46 |
FavIconizer | 2 | 6.36 KB | 16 Mar 2021 - 07:41 |
HTTrack off-line browser | 1 | 59.99 KB | 29 Mar 2021 - 05:47 |
twitterbot | 1 | 59.99 KB | 01 Mar 2021 - 13:23 |
Yahoo Slurp | 1 | 605.30 KB | 19 Mar 2021 - 08:46 |
Common Crawl | 1 | 3.18 KB | 01 Mar 2021 - 16:23 |
Unknown robot (identified by 'discovery') | 1 | 3.18 KB | 03 Mar 2021 - 09:14 |
|