56 different robots | Hits | Bandwidth | Last visit |
Common *nix tool for automating web document retireval. Most likely a bot. | 17,833 | 115.23 GB | 30 Nov 2018 - 23:55 |
CFNetwork | 2,907 | 17.76 GB | 30 Nov 2018 - 23:21 |
SemrushBot | 1,911 | 28.21 GB | 30 Nov 2018 - 23:56 |
Googlebot | 1,642 | 63.88 GB | 30 Nov 2018 - 22:58 |
Yandex Bot | 1,050 | 77.37 GB | 30 Nov 2018 - 23:54 |
Bingbot | 822 | 13.99 GB | 30 Nov 2018 - 23:44 |
Unknown robot (identified by 'crawl') | 774 | 14.13 GB | 30 Nov 2018 - 22:59 |
AhrefsBot | 717 | 14.67 GB | 30 Nov 2018 - 22:20 |
BaiDuSpider | 498 | 19.16 GB | 30 Nov 2018 - 23:47 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 454 | 230.44 MB | 30 Nov 2018 - 19:38 |
Java (Often spam bot) | 439 | 11.67 GB | 30 Nov 2018 - 18:10 |
Perl tool | 404 | 118.68 MB | 30 Nov 2018 - 03:35 |
Web Core / Roots | 367 | 23.65 GB | 30 Nov 2018 - 22:22 |
Google Web Preview | 319 | 24.38 GB | 29 Nov 2018 - 20:38 |
Unknown robot (identified by empty user agent string) | 305 | 12.66 GB | 30 Nov 2018 - 22:29 |
Feedfetcher-Google | 236 | 1.42 MB | 30 Nov 2018 - 21:58 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 180 | 11.47 GB | 30 Nov 2018 - 11:04 |
Bing Preview bot | 155 | 4.22 GB | 30 Nov 2018 - 23:29 |
FavIconizer | 135 | 686.39 MB | 30 Nov 2018 - 14:47 |
DotBot, Open Site Explorer | 116 | 3.94 GB | 30 Nov 2018 - 13:33 |
ning | 113 | 463.08 MB | 30 Nov 2018 - 16:02 |
ltx71 | 98 | 6.53 GB | 30 Nov 2018 - 15:29 |
WGet tools | 74 | 2.77 GB | 30 Nov 2018 - 03:35 |
rpt-httpclient | 66 | 2.97 GB | 30 Nov 2018 - 18:29 |
Python-urllib | 62 | 5.54 GB | 30 Nov 2018 - 09:23 |
MJ12bot | 55 | 166.01 MB | 30 Nov 2018 - 20:35 |
Turn It In | 49 | 401.90 MB | 25 Nov 2018 - 07:13 |
Suspected bot masqurading as Mozilla | 48 | 20.16 KB | 29 Nov 2018 - 19:06 |
Alexa (IA Archiver) | 47 | 3.79 GB | 30 Nov 2018 - 15:56 |
Sogou Spider | 43 | 144.38 MB | 30 Nov 2018 - 16:10 |
Common Crawl | 42 | 12.78 MB | 21 Nov 2018 - 20:14 |
FaceBook bot | 28 | 14.91 MB | 27 Nov 2018 - 06:53 |
Google AdSense | 24 | 1.14 GB | 30 Nov 2018 - 17:42 |
007ac9 Crawler, seems to belong to SISTRIX | 10 | 36.23 KB | 27 Nov 2018 - 20:26 |
Suspected bot masqurading as Mozilla | 9 | 169.29 MB | 29 Nov 2018 - 02:52 |
Unknown robot (identified by 'robot') | 8 | 7.41 MB | 26 Nov 2018 - 20:52 |
ZumBot | 8 | 29.24 MB | 17 Nov 2018 - 07:51 |
LinkChecker | 8 | 0 | 30 Nov 2018 - 23:02 |
Exabot | 8 | 28.92 KB | 16 Nov 2018 - 05:14 |
SeznamBot | 5 | 14.14 MB | 30 Nov 2018 - 19:33 |
Mail.ru bot | 5 | 7.98 MB | 23 Nov 2018 - 09:49 |
Xenu's Link Sleuth (TM), see Wikipedia | 5 | 0 | 04 Nov 2018 - 20:08 |
Unknown robot (identified by 'spider') | 3 | 17.35 KB | 21 Nov 2018 - 05:15 |
yeti | 2 | 83.61 MB | 29 Nov 2018 - 02:25 |
MSNBot | 1 | 51.41 MB | 30 Nov 2018 - 13:16 |
Custo | 1 | 78.73 MB | 04 Nov 2018 - 15:25 |
twitterbot | 1 | 7.13 MB | 16 Nov 2018 - 22:46 |
Nutch | 1 | 81.80 MB | 03 Nov 2018 - 07:01 |
InternetArchive | 1 | 0 | 16 Nov 2018 - 18:19 |
microsoft-webdav-miniredir | 1 | 0 | 10 Nov 2018 - 03:52 |
HTTrack off-line browser | 1 | 7.06 MB | 11 Nov 2018 - 19:55 |
360spider | 1 | 10.05 KB | 21 Nov 2018 - 08:39 |
Yahoo Slurp | 1 | 7.27 MB | 11 Nov 2018 - 21:04 |
SMTBot | 1 | 7.13 MB | 17 Nov 2018 - 20:17 |
Cliqzbot | 1 | 3.60 KB | 13 Nov 2018 - 06:38 |
YaCy | 1 | 3.64 KB | 19 Nov 2018 - 02:32 |