50 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 6,476 | 41.61 GB | 31 Oct 2018 - 23:28 |
CFNetwork | 1,414 | 7.24 GB | 31 Oct 2018 - 23:55 |
Googlebot | 1,005 | 46.92 GB | 31 Oct 2018 - 23:57 |
SemrushBot | 955 | 25.98 GB | 31 Oct 2018 - 23:52 |
BaiDuSpider | 778 | 43.07 GB | 31 Oct 2018 - 23:59 |
Yandex Bot | 514 | 34.25 GB | 31 Oct 2018 - 23:52 |
Bingbot | 359 | 4.19 GB | 31 Oct 2018 - 23:02 |
Unknown robot (identified by 'crawl') | 291 | 153.45 MB | 31 Oct 2018 - 21:04 |
AhrefsBot | 211 | 1.82 GB | 31 Oct 2018 - 22:48 |
Perl tool | 196 | 806.31 KB | 31 Oct 2018 - 03:34 |
Python-urllib | 195 | 22.96 GB | 30 Oct 2018 - 14:50 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 178 | 864.87 KB | 31 Oct 2018 - 16:25 |
Java (Often spam bot) | 151 | 5.84 GB | 31 Oct 2018 - 21:00 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 148 | 9.27 GB | 31 Oct 2018 - 11:53 |
Google Web Preview | 148 | 11.38 GB | 31 Oct 2018 - 21:01 |
Unknown robot (identified by empty user agent string) | 131 | 6.56 GB | 31 Oct 2018 - 20:54 |
Feedfetcher-Google | 111 | 699.34 KB | 31 Oct 2018 - 23:42 |
DotBot, Open Site Explorer | 88 | 3.33 GB | 31 Oct 2018 - 20:24 |
FavIconizer | 67 | 323.23 MB | 31 Oct 2018 - 06:49 |
Bing Preview bot | 64 | 1.67 GB | 31 Oct 2018 - 21:04 |
Web Core / Roots | 62 | 4.51 GB | 31 Oct 2018 - 21:11 |
Exabot | 35 | 33.01 MB | 30 Oct 2018 - 08:43 |
rpt-httpclient | 31 | 1.26 GB | 31 Oct 2018 - 19:44 |
Common Crawl | 29 | 21.97 MB | 24 Oct 2018 - 00:42 |
Sogou Spider | 29 | 126.49 MB | 31 Oct 2018 - 03:11 |
Suspected bot masqurading as Mozilla | 27 | 23.24 KB | 31 Oct 2018 - 21:11 |
WGet tools | 25 | 1.27 GB | 31 Oct 2018 - 03:34 |
ning | 19 | 196.08 KB | 31 Oct 2018 - 20:13 |
Unknown robot (identified by 'spider') | 16 | 1.21 GB | 25 Oct 2018 - 00:10 |
Google AdSense | 15 | 601.28 MB | 30 Oct 2018 - 16:04 |
Suspected bot masqurading as Mozilla | 15 | 0 | 31 Oct 2018 - 08:28 |
ltx71 | 14 | 1.39 GB | 31 Oct 2018 - 15:57 |
FaceBook bot | 11 | 14.67 MB | 28 Oct 2018 - 03:21 |
Mail.ru bot | 3 | 7.05 MB | 24 Oct 2018 - 17:37 |
SeznamBot | 3 | 12.40 KB | 27 Oct 2018 - 19:58 |
Cliqzbot | 2 | 20.78 KB | 19 Oct 2018 - 16:07 |
LinkChecker | 2 | 0 | 28 Oct 2018 - 01:15 |
SMTBot | 2 | 14.10 MB | 29 Oct 2018 - 17:33 |
WWWC Ver 0.2.5 | 1 | 10.30 KB | 28 Oct 2018 - 14:46 |
MJ12bot | 1 | 7.56 MB | 22 Oct 2018 - 09:30 |
twitterbot | 1 | 117.06 MB | 20 Oct 2018 - 08:07 |
yeti | 1 | 7.56 MB | 22 Oct 2018 - 06:24 |
microsoft-webdav-miniredir | 1 | 0 | 21 Oct 2018 - 17:44 |
Custo | 1 | 112.13 MB | 29 Oct 2018 - 06:33 |
Unknown robot (identified by 'scanner') | 1 | 54.58 MB | 31 Oct 2018 - 17:41 |
ScoutJet crawler for Blekko. | 1 | 3.77 KB | 19 Oct 2018 - 07:24 |
Turn It In | 1 | 13.99 KB | 23 Oct 2018 - 02:45 |
arks | 1 | 69.44 MB | 21 Oct 2018 - 00:33 |
Alexa (IA Archiver) | 1 | 10.30 KB | 26 Oct 2018 - 01:32 |
360spider | 1 | 10.37 KB | 22 Oct 2018 - 04:38 |