37 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 20,904 | 998.04 MB | 31 May 2021 - 22:09 |
Common *nix tool for automating web document retireval. Most likely a bot. | 16,532 | 178.90 MB | 31 May 2021 - 22:05 |
WGet tools | 14,408 | 4.25 GB | 31 May 2021 - 21:10 |
AhrefsBot | 8,064 | 771.70 MB | 31 May 2021 - 19:09 |
Bingbot | 3,966 | 1.33 GB | 31 May 2021 - 22:09 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,120 | 331.16 MB | 31 May 2021 - 21:31 |
Unknown robot (identified by 'crawl') | 2,241 | 52.81 MB | 31 May 2021 - 18:50 |
DotBot, Open Site Explorer | 824 | 35.85 MB | 31 May 2021 - 20:02 |
Googlebot | 285 | 21.29 MB | 31 May 2021 - 21:00 |
Unknown robot (identified by 'spider') | 244 | 2.62 MB | 31 May 2021 - 21:49 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 177 | 2.63 MB | 31 May 2021 - 18:06 |
Yandex Bot | 169 | 10.63 MB | 31 May 2021 - 05:12 |
Common Crawl | 108 | 1.00 MB | 18 May 2021 - 14:47 |
Web Core / Roots | 106 | 62.66 MB | 31 May 2021 - 19:16 |
Java (Often spam bot) | 69 | 1.46 MB | 27 May 2021 - 03:29 |
MojeekBot | 26 | 110.12 KB | 30 May 2021 - 01:46 |
Python-urllib | 24 | 11.11 MB | 31 May 2021 - 06:20 |
MJ12bot | 21 | 539.02 KB | 25 May 2021 - 05:30 |
Unknown robot (identified by 'robot') | 18 | 1.03 MB | 29 May 2021 - 09:35 |
Unknown robot (identified by empty user agent string) | 10 | 4.14 MB | 30 May 2021 - 06:19 |
SeznamBot | 8 | 24.93 KB | 30 May 2021 - 11:51 |
InternetArchive | 6 | 0 | 26 May 2021 - 16:45 |
FaceBook bot | 5 | 1.84 MB | 29 May 2021 - 16:11 |
Sift | 4 | 181.79 KB | 11 May 2021 - 09:50 |
BaiDuSpider | 3 | 133.03 KB | 14 May 2021 - 00:46 |
Suspected bot masqurading as Mozilla | 2 | 1.18 MB | 18 May 2021 - 20:30 |
Mail.ru bot | 2 | 1.60 KB | 13 May 2021 - 04:25 |
YaCy | 2 | 119.98 KB | 23 May 2021 - 12:08 |
ltx71 | 2 | 1.01 MB | 03 May 2021 - 18:20 |
SEOkicks Webcrawler | 2 | 6.48 KB | 16 May 2021 - 19:28 |
Yahoo Slurp | 2 | 1.18 MB | 18 May 2021 - 09:03 |
yeti | 2 | 119.98 KB | 23 May 2021 - 15:56 |
WordPress | 1 | 0 | 18 May 2021 - 17:02 |
twitterbot | 1 | 59.99 KB | 19 May 2021 - 08:15 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 59.99 KB | 02 May 2021 - 12:23 |
JBot Java Web Robot | 1 | 148.61 KB | 11 May 2021 - 19:51 |
ning | 1 | 0 | 14 May 2021 - 22:28 |
|