46 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 8,767 | 36.78 GB | 30 Sep 2019 - 23:58 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 6,574+3 | 656.44 MB | 29 Sep 2019 - 04:27 |
AhrefsBot | 5,759 | 232.69 GB | 30 Sep 2019 - 23:58 |
Common *nix tool for automating web document retireval. Most likely a bot. | 4,445 | 706.98 GB | 30 Sep 2019 - 23:32 |
Yandex Bot | 3,992 | 331.85 GB | 30 Sep 2019 - 23:45 |
WGet tools | 2,409 | 764.20 GB | 30 Sep 2019 - 23:55 |
Unknown robot (identified by empty user agent string) | 2,098 | 252.56 GB | 30 Sep 2019 - 23:00 |
Java (Often spam bot) | 1,733 | 52.06 GB | 30 Sep 2019 - 02:12 |
Unknown robot (identified by 'crawl') | 1,654 | 2.59 GB | 30 Sep 2019 - 03:18 |
Python-urllib | 1,059 | 186.86 GB | 30 Sep 2019 - 14:00 |
Bingbot | 684 | 180.41 MB | 30 Sep 2019 - 22:22 |
CFNetwork | 401 | 10.91 GB | 30 Sep 2019 - 22:28 |
DotBot, Open Site Explorer | 300 | 861.79 MB | 30 Sep 2019 - 22:21 |
Googlebot | 252 | 1.44 GB | 30 Sep 2019 - 20:19 |
Perl tool | 221 | 4.76 MB | 30 Sep 2019 - 23:02 |
LinkChecker | 196 | 0 | 30 Sep 2019 - 23:36 |
MJ12bot | 82 | 375.86 MB | 30 Sep 2019 - 05:04 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 63 | 264.28 MB | 30 Sep 2019 - 23:57 |
Jakarta commons-httpclient | 45 | 720 Bytes | 30 Sep 2019 - 14:01 |
ltx71 | 43 | 294.64 MB | 26 Sep 2019 - 18:08 |
Web Core / Roots | 33 | 795.65 MB | 28 Sep 2019 - 04:23 |
BaiDuSpider | 25 | 11.13 MB | 26 Sep 2019 - 22:27 |
Alexa (IA Archiver) | 22 | 225.31 KB | 30 Sep 2019 - 23:03 |
SeznamBot | 19 | 86.62 KB | 29 Sep 2019 - 19:13 |
Sogou Spider | 16 | 24.41 MB | 27 Sep 2019 - 23:49 |
WordPress | 15 | 0 | 21 Sep 2019 - 06:54 |
Turn It In | 12 | 18.55 KB | 30 Sep 2019 - 08:15 |
FavIconizer | 9 | 84.29 MB | 20 Sep 2019 - 18:35 |
Common Crawl | 8 | 123.20 KB | 23 Sep 2019 - 13:05 |
archive.org bot | 8 | 210.73 MB | 26 Sep 2019 - 21:14 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 1.09 MB | 27 Sep 2019 - 05:22 |
Bing Preview bot | 4 | 37.78 MB | 12 Sep 2019 - 16:42 |
Google AdSense | 4 | 59.67 MB | 29 Sep 2019 - 07:14 |
GigaBot | 2 | 715.61 KB | 11 Sep 2019 - 12:03 |
SEOkicks Webcrawler | 2 | 9.74 KB | 02 Sep 2019 - 01:50 |
FaceBook bot | 2 | 21.58 MB | 10 Sep 2019 - 17:10 |
DragonBot | 2 | 7.04 KB | 28 Sep 2019 - 18:36 |
360spider | 2 | 9.62 KB | 08 Sep 2019 - 01:13 |
twitterbot | 1 | 8.04 KB | 12 Sep 2019 - 08:55 |
yeti | 1 | 27.12 MB | 08 Sep 2019 - 19:59 |
Unknown robot (identified by 'robot') | 1 | 3.46 KB | 16 Sep 2019 - 21:24 |
Unknown robot (identified by 'spider') | 1 | 3.58 KB | 11 Sep 2019 - 12:36 |
Vagabondo | 1 | 7.00 KB | 27 Sep 2019 - 16:30 |
yie8 | 1 | 0 | 18 Sep 2019 - 08:18 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 09 Sep 2019 - 21:18 |
ning | 1 | 28.57 MB | 18 Sep 2019 - 09:13 |
|