41 different robots | Hits | Bandwidth | Last visit |
WGet tools | 1,164,733 | 906.91 GB | 31 May 2020 - 23:59 |
WebCopy | 234,006 | 24.31 GB | 23 May 2020 - 12:30 |
Suspected bot masqurading as Mozilla | 82,564 | 569.41 MB | 31 May 2020 - 23:59 |
SemrushBot | 79,847 | 5.27 GB | 31 May 2020 - 23:59 |
Unknown robot (identified by 'crawl') | 63,095 | 1.99 GB | 28 May 2020 - 19:08 |
DotBot, Open Site Explorer | 36,633 | 24.97 GB | 31 May 2020 - 23:58 |
Python-urllib | 21,016 | 24.75 GB | 31 May 2020 - 23:51 |
Common *nix tool for automating web document retireval. Most likely a bot. | 11,470 | 4.31 GB | 31 May 2020 - 23:57 |
Unknown robot (identified by empty user agent string) | 6,416 | 626.30 MB | 31 May 2020 - 22:42 |
Perl tool | 4,916 | 4.52 GB | 31 May 2020 - 23:40 |
Yandex Bot | 3,511 | 2.25 GB | 31 May 2020 - 23:31 |
Bingbot | 1,422 | 180.37 MB | 31 May 2020 - 23:21 |
BaiDuSpider | 1,161 | 11.46 MB | 31 May 2020 - 22:23 |
Java (Often spam bot) | 1,121 | 23.81 MB | 31 May 2020 - 23:15 |
Alexa (IA Archiver) | 961 | 234.87 MB | 16 May 2020 - 12:57 |
Googlebot | 854 | 41.62 MB | 31 May 2020 - 22:57 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 760 | 561.77 MB | 31 May 2020 - 23:52 |
AhrefsBot | 589 | 496.67 MB | 31 May 2020 - 12:15 |
Web Core / Roots | 455 | 116.39 MB | 31 May 2020 - 06:05 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 398 | 80.55 MB | 31 May 2020 - 23:28 |
Sogou Spider | 146 | 34.06 MB | 30 May 2020 - 16:55 |
WordPress | 128 | 501.97 KB | 31 May 2020 - 04:00 |
FaceBook bot | 124 | 13.42 MB | 31 May 2020 - 21:01 |
MJ12bot | 117 | 284.99 MB | 30 May 2020 - 08:19 |
FavIconizer | 44 | 12.92 MB | 31 May 2020 - 13:01 |
Turn It In | 35 | 140.25 KB | 31 May 2020 - 21:43 |
Unknown robot (identified by 'robot') | 24 | 102.26 KB | 29 May 2020 - 17:45 |
Mail.ru bot | 24 | 241.68 KB | 29 May 2020 - 06:14 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 21 | 9.42 MB | 25 May 2020 - 21:55 |
SMTBot | 21 | 58.20 KB | 04 May 2020 - 10:13 |
Common Crawl | 20 | 61.80 KB | 28 May 2020 - 13:17 |
twitterbot | 13 | 2.55 MB | 26 May 2020 - 15:22 |
MSNBot | 11 | 2.63 MB | 29 May 2020 - 19:01 |
Sift | 11 | 81.81 KB | 24 May 2020 - 07:05 |
SEOkicks Webcrawler | 7 | 16.88 KB | 21 May 2020 - 00:06 |
Unknown robot (identified by 'spider') | 5 | 2.41 MB | 16 May 2020 - 04:15 |
A PHP script | 3 | 58.56 KB | 07 May 2020 - 03:57 |
Bing Preview bot | 3 | 5.57 MB | 28 May 2020 - 13:27 |
SeznamBot | 2 | 8.46 KB | 12 May 2020 - 06:47 |
I, Robot | 1 | 4.23 KB | 06 May 2020 - 04:57 |
Custo | 1 | 4.10 KB | 31 May 2020 - 00:44 |
|