42 different robots | Hits | Bandwidth | Last visit |
WGet tools | 1,056,041 | 481.23 GB | 31 Mar 2019 - 23:54 |
Unknown robot (identified by 'crawl') | 275,593 | 52.88 GB | 31 Mar 2019 - 23:59 |
Perl tool | 69,304 | 38.01 GB | 31 Mar 2019 - 23:37 |
Suspected bot masqurading as Mozilla | 30,253 | 255.44 MB | 31 Mar 2019 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 13,088 | 915.77 MB | 31 Mar 2019 - 23:46 |
Yandex Bot | 11,154 | 18.55 GB | 31 Mar 2019 - 23:59 |
SemrushBot | 6,671 | 554.42 MB | 31 Mar 2019 - 23:45 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 6,039 | 4.63 GB | 31 Mar 2019 - 22:51 |
Python-urllib | 4,322 | 8.12 GB | 31 Mar 2019 - 20:31 |
Bingbot | 3,852 | 729.04 MB | 31 Mar 2019 - 23:40 |
Java (Often spam bot) | 2,856 | 86.02 MB | 31 Mar 2019 - 23:36 |
Unknown robot (identified by empty user agent string) | 1,465 | 265.57 MB | 31 Mar 2019 - 23:54 |
DotBot, Open Site Explorer | 420 | 28.42 MB | 31 Mar 2019 - 17:05 |
Web Core / Roots | 338 | 160.32 MB | 29 Mar 2019 - 16:11 |
Googlebot | 334 | 68.20 MB | 31 Mar 2019 - 21:30 |
BaiDuSpider | 272 | 49.56 MB | 31 Mar 2019 - 19:36 |
WordPress | 179 | 358.15 KB | 31 Mar 2019 - 14:58 |
Sogou Spider | 89 | 37.47 MB | 29 Mar 2019 - 12:45 |
Alexa (IA Archiver) | 88 | 23.47 MB | 31 Mar 2019 - 06:42 |
ltx71 | 60 | 3.09 MB | 09 Mar 2019 - 16:20 |
FavIconizer | 36 | 14.56 MB | 27 Mar 2019 - 06:13 |
Unknown robot (identified by 'robot') | 25 | 103.75 KB | 28 Mar 2019 - 03:23 |
Jakarta commons-httpclient | 24 | 100.78 KB | 29 Mar 2019 - 09:53 |
Common Crawl | 21 | 65.27 KB | 25 Mar 2019 - 00:02 |
Cliqzbot | 18 | 102.53 KB | 31 Mar 2019 - 17:01 |
SMTBot | 16 | 42.59 KB | 28 Mar 2019 - 13:29 |
Mail.ru bot | 15 | 89.46 KB | 22 Mar 2019 - 15:12 |
FaceBook bot | 13 | 54.37 KB | 28 Mar 2019 - 05:39 |
Bing Preview bot | 13 | 50.96 MB | 31 Mar 2019 - 22:00 |
Unknown robot (identified by 'spider') | 10 | 13.40 MB | 28 Mar 2019 - 18:58 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 9 | 3.37 MB | 20 Mar 2019 - 16:43 |
SEOkicks Webcrawler | 6 | 17.30 KB | 28 Mar 2019 - 20:13 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 17.80 KB | 22 Mar 2019 - 05:32 |
Exabot | 5 | 2.09 MB | 26 Mar 2019 - 20:42 |
Turn It In | 3 | 12.57 KB | 29 Mar 2019 - 02:42 |
Sift | 3 | 12.69 KB | 19 Mar 2019 - 08:35 |
Phantom | 2 | 6.72 KB | 28 Mar 2019 - 19:42 |
twitterbot | 1 | 4.42 KB | 27 Mar 2019 - 11:14 |
Motor | 1 | 4.23 KB | 19 Mar 2019 - 14:42 |
AhrefsBot | 1 | 6.72 KB | 04 Mar 2019 - 16:08 |
Digimarc MarcSpider | 1 | 4.23 KB | 03 Mar 2019 - 05:45 |
YaCy | 1 | 4.23 KB | 06 Mar 2019 - 14:41 |
|