43 different robots | Hits | Bandwidth | Last visit |
WGet tools | 999,192 | 637.96 GB | 29 Feb 2020 - 23:10 |
Unknown robot (identified by 'crawl') | 125,054 | 2.62 GB | 23 Feb 2020 - 20:02 |
Suspected bot masqurading as Mozilla | 52,180 | 191.84 MB | 29 Feb 2020 - 23:08 |
SemrushBot | 44,711 | 3.05 GB | 29 Feb 2020 - 23:08 |
Perl tool | 25,989 | 31.88 GB | 29 Feb 2020 - 16:23 |
Common *nix tool for automating web document retireval. Most likely a bot. | 9,887 | 520.45 MB | 29 Feb 2020 - 22:57 |
AhrefsBot | 9,327 | 2.18 GB | 29 Feb 2020 - 23:05 |
Unknown robot (identified by empty user agent string) | 5,104 | 1008.79 MB | 29 Feb 2020 - 22:54 |
Python-urllib | 3,225 | 5.68 GB | 29 Feb 2020 - 15:21 |
Yandex Bot | 3,001 | 5.58 GB | 29 Feb 2020 - 17:47 |
DotBot, Open Site Explorer | 1,978 | 540.90 MB | 29 Feb 2020 - 23:09 |
Bingbot | 1,095 | 151.83 MB | 29 Feb 2020 - 20:04 |
Java (Often spam bot) | 746 | 27.68 MB | 29 Feb 2020 - 22:42 |
Googlebot | 598 | 58.38 MB | 29 Feb 2020 - 19:58 |
Alexa (IA Archiver) | 379 | 347.95 MB | 27 Feb 2020 - 12:59 |
MJ12bot | 312 | 1.75 GB | 27 Feb 2020 - 20:34 |
BaiDuSpider | 212 | 36.85 MB | 29 Feb 2020 - 22:51 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 140 | 22.84 MB | 29 Feb 2020 - 19:23 |
FaceBook bot | 126 | 3.99 MB | 29 Feb 2020 - 16:28 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 112 | 8.34 MB | 29 Feb 2020 - 18:47 |
Sogou Spider | 90 | 20.62 MB | 29 Feb 2020 - 00:21 |
WordPress | 86 | 4.88 MB | 28 Feb 2020 - 18:51 |
Web Core / Roots | 81 | 103.69 MB | 28 Feb 2020 - 17:16 |
FavIconizer | 77 | 5.93 MB | 29 Feb 2020 - 12:54 |
SMTBot | 25 | 75.41 KB | 02 Feb 2020 - 15:56 |
Unknown robot (identified by 'robot') | 24 | 1.97 MB | 27 Feb 2020 - 06:24 |
Suspected bot masqurading as Mozilla | 23 | 2.73 MB | 28 Feb 2020 - 06:23 |
Mail.ru bot | 18 | 176.73 KB | 28 Feb 2020 - 17:11 |
ltx71 | 15 | 49.11 KB | 25 Feb 2020 - 04:57 |
Common Crawl | 8 | 23.55 KB | 24 Feb 2020 - 13:16 |
Sift | 7 | 29.70 KB | 26 Feb 2020 - 11:10 |
Nutch | 5 | 3.10 MB | 09 Feb 2020 - 21:16 |
MSNBot | 5 | 14.38 KB | 29 Feb 2020 - 21:20 |
Unknown robot (identified by 'spider') | 4 | 13.10 KB | 26 Feb 2020 - 18:36 |
Turn It In | 4 | 16.67 KB | 26 Feb 2020 - 05:59 |
SEOkicks Webcrawler | 4 | 11.57 KB | 24 Feb 2020 - 18:20 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 4 | 162.33 KB | 25 Feb 2020 - 19:53 |
Cliqzbot | 3 | 13.77 KB | 16 Feb 2020 - 16:06 |
Bing Preview bot | 2 | 9.74 MB | 21 Feb 2020 - 13:15 |
LinkBot | 2 | 4.34 KB | 28 Feb 2020 - 23:36 |
YaCy | 2 | 8.46 KB | 27 Feb 2020 - 13:28 |
twitterbot | 1 | 4.30 KB | 25 Feb 2020 - 15:05 |
ning | 1 | 4.60 KB | 03 Feb 2020 - 19:55 |
|