59 different robots | Hits | Bandwidth | Last visit |
WGet tools | 1,211,274 | 7051.93 GB | 31 Oct 2018 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 348,073 | 808.18 GB | 31 Oct 2018 - 23:59 |
Yandex Bot | 10,297 | 501.11 GB | 31 Oct 2018 - 23:59 |
Bingbot | 5,859 | 101.11 GB | 31 Oct 2018 - 23:37 |
Python-urllib | 4,360 | 50.07 GB | 31 Oct 2018 - 23:50 |
Unknown robot (identified by empty user agent string) | 4,029 | 36.13 GB | 31 Oct 2018 - 23:55 |
check_http (nagios) | 3,841 | 12.71 MB | 31 Oct 2018 - 23:58 |
SemrushBot | 3,505 | 35.68 GB | 31 Oct 2018 - 23:58 |
BaiDuSpider | 2,555 | 48.10 GB | 31 Oct 2018 - 23:51 |
Googlebot | 953 | 6.53 GB | 31 Oct 2018 - 23:55 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 799 | 3.75 GB | 30 Oct 2018 - 08:20 |
Java (Often spam bot) | 549 | 3.97 GB | 31 Oct 2018 - 17:46 |
DotBot, Open Site Explorer | 420 | 18.95 GB | 31 Oct 2018 - 23:44 |
Suspected bot masqurading as Mozilla | 361 | 111.77 MB | 31 Oct 2018 - 23:50 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 308 | 11.56 GB | 31 Oct 2018 - 23:05 |
Unknown robot (identified by 'crawl') | 263 | 5.50 GB | 29 Oct 2018 - 17:59 |
MagpieRSS | 244 | 48.80 GB | 31 Oct 2018 - 15:45 |
AhrefsBot | 217 | 149.81 MB | 31 Oct 2018 - 22:55 |
Alexa (IA Archiver) | 200 | 1.70 GB | 31 Oct 2018 - 15:47 |
Exabot | 199 | 30.54 MB | 31 Oct 2018 - 20:09 |
Sogou Spider | 140 | 92.12 MB | 31 Oct 2018 - 04:08 |
Suspected bot masqurading as Mozilla | 137 | 4.96 GB | 28 Oct 2018 - 20:16 |
Bing Preview bot | 136 | 32.26 GB | 31 Oct 2018 - 11:45 |
Mail.ru bot | 119 | 192.58 MB | 31 Oct 2018 - 23:19 |
ltx71 | 100 | 3.71 GB | 31 Oct 2018 - 21:35 |
Common Crawl | 87 | 56.03 MB | 22 Oct 2018 - 04:19 |
SeznamBot | 85 | 7.57 GB | 27 Oct 2018 - 00:02 |
FavIconizer | 79 | 298.41 KB | 31 Oct 2018 - 19:40 |
Web Core / Roots | 61 | 15.55 GB | 31 Oct 2018 - 05:53 |
ning | 57 | 1.10 GB | 30 Oct 2018 - 10:06 |
SEOkicks Webcrawler | 48 | 78.14 MB | 24 Oct 2018 - 18:48 |
Unknown robot (identified by 'spider') | 48 | 18.81 GB | 31 Oct 2018 - 11:54 |
CFNetwork | 44 | 0 | 31 Oct 2018 - 07:19 |
YaCy | 40 | 2.26 GB | 30 Oct 2018 - 19:45 |
IDMARCH | 38 | 2.24 GB | 30 Oct 2018 - 00:41 |
oBot | 37 | 207.61 MB | 22 Oct 2018 - 22:24 |
MJ12bot | 29 | 105.34 KB | 26 Oct 2018 - 02:58 |
Cliqzbot | 24 | 32.21 MB | 30 Oct 2018 - 05:50 |
Google Web Preview | 17 | 44.93 KB | 30 Oct 2018 - 11:16 |
Perl tool | 16 | 2.54 GB | 31 Oct 2018 - 18:15 |
MojeekBot | 16 | 70.50 KB | 31 Oct 2018 - 01:42 |
360spider | 13 | 19.01 MB | 28 Oct 2018 - 09:37 |
yeti | 9 | 13.45 MB | 27 Oct 2018 - 20:14 |
FaceBook bot | 9 | 22.04 KB | 30 Oct 2018 - 14:20 |
archive.org bot | 8 | 28.62 KB | 29 Oct 2018 - 07:23 |
Aport | 7 | 17.49 KB | 26 Oct 2018 - 16:21 |
twitterbot | 7 | 3.04 GB | 30 Oct 2018 - 21:05 |
Linkdex | 5 | 1.03 MB | 31 Oct 2018 - 16:25 |
ScoutJet crawler for Blekko. | 2 | 9.09 KB | 26 Oct 2018 - 18:19 |
Googlebot-Image | 2 | 1.94 MB | 23 Oct 2018 - 21:08 |
LinkChecker | 2 | 0 | 31 Oct 2018 - 00:50 |
Sift | 2 | 6.85 KB | 26 Oct 2018 - 21:31 |
IstellaBot | 1 | 3.30 KB | 27 Oct 2018 - 12:02 |
lwp-trivial | 1 | 3.43 KB | 24 Oct 2018 - 19:01 |
Nutch | 1 | 3.43 KB | 29 Oct 2018 - 16:40 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 24 Oct 2018 - 23:51 |
ComputingSite Robi/1.0 | 1 | 189.04 MB | 25 Oct 2018 - 01:21 |
Netcraft | 1 | 0 | 31 Oct 2018 - 15:09 |
Google AdSense | 1 | 479.24 KB | 30 Oct 2018 - 04:40 |
|