42 different robots | Hits | Bandwidth | Last visit |
WGet tools | 980,446 | 612.21 GB | 31 Dec 2019 - 23:59 |
Unknown robot (identified by 'crawl') | 121,762 | 2.56 GB | 23 Dec 2019 - 00:38 |
Suspected bot masqurading as Mozilla | 58,745 | 135.04 MB | 31 Dec 2019 - 23:59 |
SemrushBot | 52,092 | 2.96 GB | 31 Dec 2019 - 23:56 |
Perl tool | 12,009 | 9.36 GB | 31 Dec 2019 - 23:27 |
AhrefsBot | 11,662 | 2.75 GB | 31 Dec 2019 - 01:12 |
SEOkicks Webcrawler | 10,306 | 1.17 GB | 26 Dec 2019 - 00:45 |
Common *nix tool for automating web document retireval. Most likely a bot. | 7,600 | 826.43 MB | 31 Dec 2019 - 23:57 |
Unknown robot (identified by empty user agent string) | 7,281 | 1.49 GB | 31 Dec 2019 - 23:54 |
DotBot, Open Site Explorer | 4,970 | 629.32 MB | 31 Dec 2019 - 19:54 |
Googlebot | 4,352 | 59.71 MB | 31 Dec 2019 - 23:59 |
Python-urllib | 4,318 | 4.91 GB | 31 Dec 2019 - 10:45 |
Yandex Bot | 4,067 | 5.75 GB | 31 Dec 2019 - 22:46 |
Bingbot | 2,218 | 444.14 MB | 31 Dec 2019 - 23:53 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2,034 | 27.68 MB | 30 Dec 2019 - 19:27 |
BaiDuSpider | 1,969 | 25.89 MB | 31 Dec 2019 - 23:49 |
Java (Often spam bot) | 1,661 | 56.20 MB | 31 Dec 2019 - 23:07 |
Alexa (IA Archiver) | 544 | 616.97 MB | 31 Dec 2019 - 04:09 |
FaceBook bot | 173 | 725.70 KB | 31 Dec 2019 - 14:11 |
MJ12bot | 172 | 677.95 MB | 25 Dec 2019 - 15:36 |
WordPress | 138 | 411.73 KB | 31 Dec 2019 - 20:14 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 112 | 10.44 MB | 31 Dec 2019 - 17:40 |
Sogou Spider | 105 | 25.27 MB | 31 Dec 2019 - 02:07 |
Suspected bot masqurading as Mozilla | 88 | 8.28 MB | 27 Dec 2019 - 19:32 |
Web Core / Roots | 63 | 2.50 MB | 31 Dec 2019 - 23:53 |
Common Crawl | 37 | 108.80 KB | 06 Dec 2019 - 01:44 |
FavIconizer | 34 | 133.93 KB | 30 Dec 2019 - 16:36 |
SMTBot | 24 | 71.02 KB | 01 Dec 2019 - 12:36 |
Unknown robot (identified by 'spider') | 23 | 7.29 MB | 29 Dec 2019 - 06:31 |
MSNBot | 13 | 2.11 MB | 30 Dec 2019 - 18:17 |
Unknown robot (identified by 'robot') | 13 | 54.88 KB | 24 Dec 2019 - 09:03 |
Bing Preview bot | 7 | 29.65 MB | 24 Dec 2019 - 06:37 |
Turn It In | 6 | 23.57 KB | 31 Dec 2019 - 14:10 |
Mail.ru bot | 6 | 22.74 KB | 30 Dec 2019 - 00:11 |
Sift | 6 | 25.32 KB | 26 Dec 2019 - 01:27 |
MojeekBot | 5 | 14.50 KB | 31 Dec 2019 - 20:27 |
twitterbot | 3 | 2.28 MB | 18 Dec 2019 - 03:20 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 3 | 2.39 MB | 20 Dec 2019 - 08:52 |
Jakarta commons-httpclient | 3 | 12.69 KB | 13 Dec 2019 - 01:29 |
Cliqzbot | 2 | 9.19 KB | 09 Dec 2019 - 17:25 |
LinkBot | 2 | 4.71 KB | 25 Dec 2019 - 06:00 |
Custo | 1 | 4.23 KB | 24 Dec 2019 - 03:49 |
|