48 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 1,670 | 41.26 GB | 30 Apr 2019 - 23:59 |
Unknown robot (identified by empty user agent string) | 109 | 5.52 GB | 30 Apr 2019 - 23:51 |
Bingbot | 1,036 | 14.52 GB | 30 Apr 2019 - 23:49 |
Yandex Bot | 1,472 | 111.47 GB | 30 Apr 2019 - 23:25 |
Bing Preview bot | 148 | 2.72 GB | 30 Apr 2019 - 23:16 |
Googlebot | 1,253 | 31.81 GB | 30 Apr 2019 - 22:57 |
AhrefsBot | 505 | 24.02 GB | 30 Apr 2019 - 22:42 |
Sogou Spider | 42 | 209.42 MB | 30 Apr 2019 - 22:17 |
Common *nix tool for automating web document retireval. Most likely a bot. | 7,016 | 47.56 GB | 30 Apr 2019 - 22:08 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 177 | 1.98 GB | 30 Apr 2019 - 21:29 |
Java (Often spam bot) | 168 | 2.23 GB | 30 Apr 2019 - 20:44 |
Web Core / Roots | 246 | 29.08 GB | 30 Apr 2019 - 20:26 |
Suspected bot masqurading as Mozilla | 22 | 452.48 MB | 30 Apr 2019 - 19:49 |
SemrushBot | 522 | 8.35 GB | 30 Apr 2019 - 19:19 |
rpt-httpclient | 55 | 0 | 30 Apr 2019 - 18:35 |
Google Web Preview | 63 | 4.81 GB | 30 Apr 2019 - 17:50 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 1,261 | 212.36 MB | 30 Apr 2019 - 16:39 |
CFNetwork | 1,247 | 1.58 GB | 30 Apr 2019 - 15:44 |
Python-urllib | 37 | 2.90 GB | 30 Apr 2019 - 13:43 |
DotBot, Open Site Explorer | 57 | 781.71 MB | 30 Apr 2019 - 13:35 |
BaiDuSpider | 393 | 13.52 GB | 30 Apr 2019 - 12:49 |
Suspected bot masqurading as Mozilla | 27 | 0 | 30 Apr 2019 - 03:54 |
Alexa (IA Archiver) | 16 | 160.83 KB | 30 Apr 2019 - 00:34 |
FavIconizer | 89 | 544.05 MB | 29 Apr 2019 - 19:11 |
ning | 64 | 272.79 KB | 29 Apr 2019 - 13:37 |
SeznamBot | 32 | 140.72 MB | 29 Apr 2019 - 12:26 |
microsoft-webdav-miniredir | 1 | 0 | 29 Apr 2019 - 09:15 |
FaceBook bot | 12 | 415.87 MB | 28 Apr 2019 - 16:21 |
WGet tools | 40 | 2.49 GB | 28 Apr 2019 - 14:40 |
Exabot | 11 | 7.18 MB | 27 Apr 2019 - 19:57 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 76 | 2.84 GB | 27 Apr 2019 - 15:02 |
WordPress | 5 | 0 | 27 Apr 2019 - 11:41 |
Google AdSense | 12 | 727.80 MB | 27 Apr 2019 - 01:37 |
YaCy | 3 | 10.44 KB | 27 Apr 2019 - 01:34 |
Unknown robot (identified by 'spider') | 6 | 419.63 MB | 27 Apr 2019 - 00:13 |
Common Crawl | 83 | 4.76 GB | 25 Apr 2019 - 18:48 |
LinkChecker | 4 | 0 | 23 Apr 2019 - 17:39 |
Mail.ru bot | 7 | 14.67 MB | 23 Apr 2019 - 12:31 |
twitterbot | 3 | 398.32 MB | 23 Apr 2019 - 08:55 |
MJ12bot | 5 | 60.09 MB | 22 Apr 2019 - 05:34 |
ltx71 | 126 | 12.42 GB | 19 Apr 2019 - 16:57 |
HTTrack off-line browser | 5 | 918.08 MB | 19 Apr 2019 - 11:05 |
Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 19 Apr 2019 - 05:21 |
ZumBot | 2 | 6.90 KB | 15 Apr 2019 - 17:21 |
Nutch | 1 | 10.55 KB | 12 Apr 2019 - 22:50 |
Y!J Yahoo Japan | 122 | 4.08 GB | 11 Apr 2019 - 10:52 |
Motor | 1 | 69.44 MB | 10 Apr 2019 - 01:51 |
Cliqzbot | 1 | 3.97 KB | 02 Apr 2019 - 17:05 |