48 different robots | Hits | Bandwidth | Last visit |
DotBot, Open Site Explorer | 2,103 | 24.26 GB | 31 Mar 2020 - 23:59 |
Yandex Bot | 2,182 | 23.67 GB | 31 Mar 2020 - 23:58 |
SemrushBot | 8,863 | 27.96 GB | 31 Mar 2020 - 23:57 |
FaceBook bot | 31 | 32.21 MB | 31 Mar 2020 - 23:43 |
AhrefsBot | 8,926 | 318.69 GB | 31 Mar 2020 - 23:35 |
WGet tools | 6,840 | 774.42 GB | 31 Mar 2020 - 23:29 |
Perl tool | 297 | 8.03 MB | 31 Mar 2020 - 23:27 |
Python-urllib | 1,252 | 279.20 GB | 31 Mar 2020 - 23:02 |
Unknown robot (identified by empty user agent string) | 1,618 | 134.86 GB | 31 Mar 2020 - 23:00 |
Unknown robot (identified by 'crawl') | 2,125 | 34.02 GB | 31 Mar 2020 - 22:36 |
CFNetwork | 258 | 7.69 GB | 31 Mar 2020 - 22:34 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4,400 | 684.15 GB | 31 Mar 2020 - 22:00 |
Googlebot | 868 | 34.51 GB | 31 Mar 2020 - 21:16 |
Java (Often spam bot) | 1,086 | 38.48 GB | 31 Mar 2020 - 20:37 |
LinkChecker | 263 | 0 | 31 Mar 2020 - 20:36 |
Bingbot | 301 | 117.17 MB | 31 Mar 2020 - 18:47 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 24,863+1 | 445.45 GB | 31 Mar 2020 - 17:52 |
SeznamBot | 16 | 76.83 KB | 31 Mar 2020 - 15:27 |
BaiDuSpider | 31 | 27.93 MB | 31 Mar 2020 - 14:08 |
Jakarta commons-httpclient | 50 | 800 Bytes | 31 Mar 2020 - 14:01 |
archive.org bot | 10 | 296.11 MB | 31 Mar 2020 - 11:36 |
ning | 5 | 137.86 MB | 31 Mar 2020 - 06:00 |
Google AdSense | 1 | 30.55 MB | 29 Mar 2020 - 19:41 |
Common Crawl | 3 | 16.88 KB | 29 Mar 2020 - 09:57 |
A PHP script | 2 | 1.45 MB | 29 Mar 2020 - 07:45 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 199 | 31.22 MB | 29 Mar 2020 - 01:30 |
yie8 | 16 | 8.17 MB | 28 Mar 2020 - 21:06 |
Sogou Spider | 22 | 43.10 MB | 26 Mar 2020 - 14:22 |
Bing Preview bot | 2 | 30.55 MB | 25 Mar 2020 - 23:10 |
twitterbot | 2 | 28.68 MB | 25 Mar 2020 - 12:36 |
BBot | 7 | 189.85 MB | 24 Mar 2020 - 22:01 |
MJ12bot | 49 | 109.56 MB | 24 Mar 2020 - 14:16 |
Web Core / Roots | 17 | 514.78 MB | 23 Mar 2020 - 10:02 |
ltx71 | 26 | 133.90 MB | 21 Mar 2020 - 09:29 |
LinkWalker | 1 | 3.46 KB | 20 Mar 2020 - 19:59 |
WordPress | 3 | 0 | 19 Mar 2020 - 07:43 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 18 Mar 2020 - 22:04 |
Cliqzbot | 4 | 88.31 KB | 16 Mar 2020 - 04:07 |
Alexa (IA Archiver) | 69 | 28.58 MB | 15 Mar 2020 - 22:15 |
FavIconizer | 1 | 28.67 MB | 14 Mar 2020 - 22:46 |
Turn It In | 29 | 193.74 MB | 14 Mar 2020 - 13:42 |
YaCy | 2 | 9.49 KB | 13 Mar 2020 - 18:14 |
Unknown robot (identified by 'robot') | 1 | 8.04 KB | 12 Mar 2020 - 10:15 |
HTTrack off-line browser | 2 | 904.00 KB | 08 Mar 2020 - 21:24 |
Vagabondo | 1 | 7.00 KB | 08 Mar 2020 - 08:23 |
MSNBot | 3 | 7.22 MB | 07 Mar 2020 - 20:12 |
Unknown robot (identified by 'spider') | 1 | 2.61 KB | 05 Mar 2020 - 20:14 |
Nutch | 2 | 9.74 KB | 02 Mar 2020 - 10:07 |
|