52 different robots | Hits | Bandwidth | Last visit |
SEOkicks Webcrawler | 28,413 | 118.40 GB | 30 Jun 2020 - 17:28 |
Unknown robot (identified by 'crawl') | 22,779+1 | 193.93 GB | 30 Jun 2020 - 21:50 |
AhrefsBot | 16,213 | 2746.71 GB | 30 Jun 2020 - 23:58 |
SemrushBot | 9,452 | 49.59 GB | 30 Jun 2020 - 23:46 |
DotBot, Open Site Explorer | 4,515 | 33.93 GB | 30 Jun 2020 - 23:24 |
WGet tools | 3,494 | 711.81 GB | 30 Jun 2020 - 23:49 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 3,456+2 | 313.41 MB | 29 Jun 2020 - 05:06 |
Common *nix tool for automating web document retireval. Most likely a bot. | 3,065 | 663.63 GB | 30 Jun 2020 - 23:54 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,760 | 36.03 GB | 30 Jun 2020 - 23:31 |
Unknown robot (identified by empty user agent string) | 1,690 | 106.36 GB | 30 Jun 2020 - 23:00 |
Java (Often spam bot) | 1,193 | 4.28 GB | 30 Jun 2020 - 21:14 |
Bingbot | 1,177 | 1.04 GB | 30 Jun 2020 - 23:58 |
Python-urllib | 647 | 281.77 GB | 30 Jun 2020 - 23:02 |
MJ12bot | 593 | 202.65 GB | 28 Jun 2020 - 04:36 |
Yandex Bot | 418 | 708.38 MB | 30 Jun 2020 - 23:44 |
Perl tool | 270 | 7.48 MB | 30 Jun 2020 - 23:04 |
LinkChecker | 268 | 0 | 30 Jun 2020 - 23:13 |
Googlebot | 191 | 179.63 MB | 30 Jun 2020 - 22:17 |
FaceBook bot | 95 | 36.01 MB | 29 Jun 2020 - 12:42 |
Unknown robot (identified by 'spider') | 66 | 161.31 MB | 30 Jun 2020 - 17:44 |
Alexa (IA Archiver) | 54 | 268.26 KB | 27 Jun 2020 - 23:07 |
CFNetwork | 50 | 1.50 GB | 30 Jun 2020 - 07:26 |
Jakarta commons-httpclient | 30 | 480 Bytes | 30 Jun 2020 - 14:01 |
BaiDuSpider | 23 | 26.33 MB | 30 Jun 2020 - 10:04 |
ltx71 | 23 | 250.54 MB | 27 Jun 2020 - 12:48 |
SeznamBot | 20 | 87.61 KB | 29 Jun 2020 - 20:01 |
ning | 13 | 169.43 MB | 30 Jun 2020 - 19:39 |
Web Core / Roots | 12 | 344.31 MB | 30 Jun 2020 - 17:26 |
WordPress | 8 | 0 | 21 Jun 2020 - 21:49 |
archive.org bot | 8 | 237.87 MB | 27 Jun 2020 - 01:07 |
Google AdSense | 7 | 80.23 MB | 30 Jun 2020 - 11:22 |
FavIconizer | 6 | 116.86 MB | 28 Jun 2020 - 13:56 |
Powermarks | 6 | 31.22 KB | 23 Jun 2020 - 17:33 |
Mail.ru bot | 5 | 24.51 KB | 27 Jun 2020 - 12:18 |
Heritrix | 4 | 52.37 MB | 30 Jun 2020 - 23:38 |
Bing Preview bot | 4 | 4.36 MB | 16 Jun 2020 - 02:41 |
Suspected bot masqurading as Mozilla | 2 | 0 | 02 Jun 2020 - 16:09 |
Unknown robot (identified by 'checker') | 2 | 9.74 KB | 30 Jun 2020 - 13:38 |
microsoft-webdav-miniredir | 2 | 0 | 21 Jun 2020 - 08:38 |
Common Crawl | 2 | 62.02 KB | 04 Jun 2020 - 18:52 |
360spider | 2 | 9.74 KB | 12 Jun 2020 - 20:53 |
Phantom | 2 | 18.79 MB | 05 Jun 2020 - 03:25 |
Motor | 2 | 369.61 MB | 08 Jun 2020 - 17:03 |
MojeekBot | 1 | 58.81 KB | 25 Jun 2020 - 10:31 |
twitterbot | 1 | 28.69 MB | 04 Jun 2020 - 05:02 |
Cliqzbot | 1 | 2.96 KB | 28 Jun 2020 - 01:48 |
yie8 | 1 | 0 | 28 Jun 2020 - 15:44 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 13 Jun 2020 - 13:21 |
Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 20.33 MB | 02 Jun 2020 - 12:23 |
Turn It In | 1 | 777.78 KB | 03 Jun 2020 - 12:27 |
Unknown robot (identified by 'robot') | 1 | 8.04 KB | 22 Jun 2020 - 14:29 |
Sogou Spider | 1 | 58.81 KB | 09 Jun 2020 - 05:14 |
|