62 different robots | Hits | Bandwidth | Last visit |
WGet tools | 1,815,417 | 11062.44 GB | 31 Mar 2019 - 23:59 |
Python-urllib | 11,650 | 34.06 GB | 31 Mar 2019 - 23:59 |
check_http (nagios) | 5,932 | 19.04 MB | 31 Mar 2019 - 23:58 |
Googlebot | 5,276 | 49.93 GB | 31 Mar 2019 - 23:58 |
SemrushBot | 12,167 | 67.67 GB | 31 Mar 2019 - 23:53 |
Common *nix tool for automating web document retireval. Most likely a bot. | 10,055 | 95.92 GB | 31 Mar 2019 - 23:46 |
Bingbot | 9,268 | 199.99 GB | 31 Mar 2019 - 23:45 |
BaiDuSpider | 2,281 | 101.24 GB | 31 Mar 2019 - 23:37 |
Cliqzbot | 53 | 341.56 MB | 31 Mar 2019 - 23:18 |
AhrefsBot | 475 | 6.39 GB | 31 Mar 2019 - 23:15 |
Unknown robot (identified by empty user agent string) | 8,794 | 238.24 GB | 31 Mar 2019 - 23:12 |
Suspected bot masqurading as Mozilla | 160 | 309.51 MB | 31 Mar 2019 - 22:56 |
FavIconizer | 195 | 153.48 MB | 31 Mar 2019 - 22:37 |
Yandex Bot | 11,365 | 671.75 GB | 31 Mar 2019 - 22:04 |
Unknown robot (identified by 'spider') | 60 | 16.50 GB | 31 Mar 2019 - 21:15 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,778 | 195.10 GB | 31 Mar 2019 - 20:45 |
SeznamBot | 183 | 4.59 GB | 31 Mar 2019 - 19:03 |
Sogou Spider | 221 | 439.37 MB | 31 Mar 2019 - 18:58 |
Unknown robot (identified by 'crawl') | 64,531 | 527.52 GB | 31 Mar 2019 - 17:59 |
Exabot | 183 | 2.27 GB | 31 Mar 2019 - 17:48 |
Googlebot-Image | 92 | 221.13 KB | 31 Mar 2019 - 17:08 |
Bing Preview bot | 137 | 17.83 GB | 31 Mar 2019 - 14:44 |
Java (Often spam bot) | 825 | 9.76 GB | 31 Mar 2019 - 13:05 |
Perl tool | 674 | 8.68 GB | 31 Mar 2019 - 11:59 |
DotBot, Open Site Explorer | 244 | 14.28 GB | 31 Mar 2019 - 09:13 |
ning | 27 | 1.37 GB | 31 Mar 2019 - 08:36 |
MJ12bot | 39 | 8.27 GB | 31 Mar 2019 - 03:53 |
Suspected bot masqurading as Mozilla | 178 | 7.19 GB | 31 Mar 2019 - 01:47 |
YaCy | 29 | 899.74 MB | 30 Mar 2019 - 19:19 |
ltx71 | 167 | 23.29 GB | 30 Mar 2019 - 17:15 |
Alexa (IA Archiver) | 125 | 28.08 MB | 30 Mar 2019 - 16:25 |
CFNetwork | 9 | 1023.78 MB | 30 Mar 2019 - 15:13 |
LinkBot | 2 | 0 | 30 Mar 2019 - 10:56 |
Web Core / Roots | 84 | 9.26 GB | 30 Mar 2019 - 03:51 |
twitterbot | 4 | 743.76 MB | 29 Mar 2019 - 07:51 |
Nutch | 8 | 1.01 GB | 29 Mar 2019 - 03:24 |
SEOkicks Webcrawler | 88 | 122.16 MB | 28 Mar 2019 - 18:00 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 195 | 23.98 GB | 28 Mar 2019 - 17:22 |
MagpieRSS | 314 | 67.89 GB | 28 Mar 2019 - 11:08 |
MojeekBot | 18 | 13.76 MB | 28 Mar 2019 - 10:50 |
Mail.ru bot | 103 | 502.94 MB | 28 Mar 2019 - 07:57 |
Google AdSense | 3 | 3.57 MB | 28 Mar 2019 - 05:27 |
LinkChecker | 3 | 0 | 28 Mar 2019 - 01:07 |
WordPress | 12 | 49.67 MB | 27 Mar 2019 - 07:15 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 268 | 10.70 GB | 27 Mar 2019 - 01:05 |
Jakarta commons-httpclient | 8 | 33.43 MB | 26 Mar 2019 - 00:14 |
FaceBook bot | 10 | 51.12 KB | 25 Mar 2019 - 21:27 |
Y!J Yahoo Japan | 3 | 9.57 KB | 25 Mar 2019 - 10:21 |
Suspected bot masqurading as Mozilla | 1 | 14.14 MB | 24 Mar 2019 - 01:33 |
360spider | 38 | 7.01 MB | 23 Mar 2019 - 18:31 |
Common Crawl | 95 | 754.31 MB | 23 Mar 2019 - 13:21 |
Sift | 3 | 100.37 MB | 17 Mar 2019 - 19:26 |
Phantom | 4 | 4.64 MB | 16 Mar 2019 - 00:15 |
A PHP script | 1 | 484.35 KB | 15 Mar 2019 - 01:21 |
SMTBot | 64 | 2.57 GB | 11 Mar 2019 - 09:09 |
Unknown robot (identified by 'robot') | 1 | 9.55 KB | 07 Mar 2019 - 17:30 |
IstellaBot | 1 | 3.35 KB | 06 Mar 2019 - 13:31 |
Netcraft | 6 | 19.85 KB | 05 Mar 2019 - 15:00 |
MS Search 6.0 Robot (MS SharePoint Portal Server?) | 6 | 39.84 KB | 05 Mar 2019 - 13:21 |
Digimarc MarcSpider | 1 | 3.22 KB | 03 Mar 2019 - 10:45 |
archive.org bot | 2 | 5.42 KB | 01 Mar 2019 - 23:27 |
Google Web Preview | 1 | 216.36 MB | 01 Mar 2019 - 09:33 |
|