58 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 13,580 | 96.41 GB | 31 Dec 2018 - 23:49 |
Web Core / Roots | 6,053 | 616.28 GB | 31 Dec 2018 - 23:38 |
CFNetwork | 2,160 | 12.09 GB | 31 Dec 2018 - 22:02 |
SemrushBot | 2,044 | 53.16 GB | 31 Dec 2018 - 23:40 |
Yandex Bot | 1,186 | 99.96 GB | 31 Dec 2018 - 21:57 |
Googlebot | 1,165 | 40.23 GB | 31 Dec 2018 - 23:50 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 885 | 460.53 MB | 31 Dec 2018 - 12:48 |
Bingbot | 709 | 12.96 GB | 31 Dec 2018 - 20:38 |
BaiDuSpider | 528 | 27.46 GB | 31 Dec 2018 - 21:39 |
AhrefsBot | 525 | 9.91 GB | 31 Dec 2018 - 22:25 |
Unknown robot (identified by 'crawl') | 506 | 18.24 GB | 31 Dec 2018 - 17:40 |
Perl tool | 329 | 77.89 MB | 31 Dec 2018 - 03:36 |
Unknown robot (identified by empty user agent string) | 213 | 11.10 GB | 31 Dec 2018 - 09:22 |
Feedfetcher-Google | 163 | 931.00 KB | 31 Dec 2018 - 23:09 |
Python-urllib | 115 | 13.56 GB | 31 Dec 2018 - 01:11 |
Bing Preview bot | 103 | 3.02 GB | 31 Dec 2018 - 22:04 |
Exabot | 102 | 2.43 GB | 27 Dec 2018 - 01:25 |
Google Web Preview | 97 | 7.39 GB | 31 Dec 2018 - 08:34 |
Java (Often spam bot) | 97 | 812.22 MB | 31 Dec 2018 - 21:51 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 84 | 5.43 GB | 31 Dec 2018 - 11:41 |
ning | 78 | 182.27 MB | 31 Dec 2018 - 15:56 |
FavIconizer | 67 | 253.43 MB | 31 Dec 2018 - 20:45 |
WGet tools | 65 | 1.65 GB | 31 Dec 2018 - 03:36 |
Sogou Spider | 40 | 113.19 MB | 28 Dec 2018 - 18:15 |
Suspected bot masqurading as Mozilla | 38 | 0 | 31 Dec 2018 - 12:27 |
MJ12bot | 38 | 76.30 MB | 29 Dec 2018 - 03:56 |
rpt-httpclient | 33 | 761.05 MB | 31 Dec 2018 - 18:28 |
ltx71 | 32 | 641.51 MB | 31 Dec 2018 - 19:50 |
Alexa (IA Archiver) | 30 | 1.83 GB | 18 Dec 2018 - 09:57 |
Y!J Yahoo Japan | 29 | 159.78 KB | 25 Dec 2018 - 16:14 |
DotBot, Open Site Explorer | 23 | 524.29 MB | 31 Dec 2018 - 06:06 |
SEOkicks Webcrawler | 21 | 108.86 KB | 28 Dec 2018 - 10:12 |
WordPress | 21 | 191.53 MB | 29 Dec 2018 - 06:41 |
Suspected bot masqurading as Mozilla | 20 | 266.03 MB | 31 Dec 2018 - 10:26 |
FaceBook bot | 17 | 36.48 MB | 30 Dec 2018 - 09:17 |
Common Crawl | 17 | 116.95 MB | 19 Dec 2018 - 16:17 |
Unknown robot (identified by 'spider') | 11 | 546.57 MB | 30 Dec 2018 - 19:24 |
SeznamBot | 11 | 12.17 MB | 29 Dec 2018 - 11:40 |
Cliqzbot | 11 | 207.73 MB | 31 Dec 2018 - 19:57 |
Google AdSense | 11 | 653.76 MB | 28 Dec 2018 - 13:50 |
007ac9 Crawler, seems to belong to SISTRIX | 8 | 28.89 KB | 22 Dec 2018 - 10:05 |
Turn It In | 8 | 92.57 KB | 10 Dec 2018 - 02:20 |
twitterbot | 7 | 490.10 MB | 26 Dec 2018 - 10:29 |
Mail.ru bot | 6 | 14.48 MB | 26 Dec 2018 - 22:25 |
ZumBot | 5 | 29.24 MB | 24 Dec 2018 - 23:08 |
Xenu's Link Sleuth (TM), see Wikipedia | 4 | 0 | 02 Dec 2018 - 17:02 |
LinkChecker | 4 | 0 | 30 Dec 2018 - 14:44 |
yie8 | 4 | 179.00 MB | 01 Dec 2018 - 16:08 |
Custo | 1 | 78.73 MB | 16 Dec 2018 - 09:09 |
SMTBot | 1 | 7.13 MB | 18 Dec 2018 - 19:45 |
MojeekBot | 1 | 2.84 KB | 08 Dec 2018 - 02:03 |
yeti | 1 | 7.64 MB | 19 Dec 2018 - 06:04 |
Googlebot-Image | 1 | 7.13 MB | 13 Dec 2018 - 01:25 |
HTTrack off-line browser | 1 | 7.13 MB | 13 Dec 2018 - 22:06 |
A PHP script | 1 | 95.40 MB | 30 Dec 2018 - 19:51 |
360spider | 1 | 10.00 KB | 19 Dec 2018 - 14:03 |
YaCy | 1 | 3.64 KB | 09 Dec 2018 - 01:43 |
Nutch | 1 | 3.46 KB | 04 Dec 2018 - 07:32 |