44 different robots | Hits | Bandwidth | Last visit |
BaiDuSpider | 2,111 | 4.76 GB | 31 Dec 2018 - 23:59 |
Common *nix tool for automating web document retireval. Most likely a bot. | 1,485 | 94.79 GB | 31 Dec 2018 - 23:57 |
SemrushBot | 3,276 | 7.78 GB | 31 Dec 2018 - 23:55 |
Perl tool | 288 | 6.17 MB | 31 Dec 2018 - 23:43 |
ltx71 | 311 | 2.66 GB | 31 Dec 2018 - 23:11 |
WGet tools | 20,290+1 | 756.87 GB | 31 Dec 2018 - 22:57 |
Exabot | 102 | 148.70 MB | 31 Dec 2018 - 21:23 |
Unknown robot (identified by empty user agent string) | 837 | 52.18 GB | 31 Dec 2018 - 21:20 |
AhrefsBot | 6,084 | 667.46 GB | 31 Dec 2018 - 20:38 |
Yandex Bot | 325 | 22.03 GB | 31 Dec 2018 - 19:13 |
CFNetwork | 63 | 1.29 GB | 31 Dec 2018 - 18:45 |
Python-urllib | 653 | 104.05 GB | 31 Dec 2018 - 18:29 |
Unknown robot (identified by 'crawl') | 348 | 25.37 GB | 31 Dec 2018 - 17:40 |
Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,482 | 210.44 GB | 31 Dec 2018 - 16:08 |
Cliqzbot | 7 | 8.44 MB | 31 Dec 2018 - 15:40 |
Bingbot | 251 | 111.98 MB | 31 Dec 2018 - 15:12 |
Java (Often spam bot) | 114 | 40.05 GB | 31 Dec 2018 - 14:06 |
BLEXBot, seems to belong to the WebMeUp backlink tool | 2,175 | 577.18 MB | 31 Dec 2018 - 12:48 |
DotBot, Open Site Explorer | 26 | 204.53 GB | 31 Dec 2018 - 09:36 |
Googlebot | 158 | 2.39 GB | 31 Dec 2018 - 09:13 |
Jakarta commons-httpclient | 34 | 544 Bytes | 30 Dec 2018 - 23:06 |
LinkChecker | 31 | 0 | 30 Dec 2018 - 16:43 |
Alexa (IA Archiver) | 11 | 71.26 KB | 29 Dec 2018 - 11:25 |
FavIconizer | 1 | 41.06 KB | 29 Dec 2018 - 02:26 |
SEOkicks Webcrawler | 31 | 185.96 KB | 28 Dec 2018 - 13:27 |
MJ12bot | 69 | 246.44 MB | 28 Dec 2018 - 05:57 |
Web Core / Roots | 18 | 222.33 MB | 27 Dec 2018 - 06:33 |
archive.org bot | 3 | 63.84 MB | 26 Dec 2018 - 03:16 |
WordPress | 2 | 0 | 25 Dec 2018 - 15:31 |
Google AdSense | 6 | 109.03 MB | 24 Dec 2018 - 15:35 |
Suspected bot masqurading as Mozilla | 8 | 16 Bytes | 24 Dec 2018 - 15:01 |
Y!J Yahoo Japan | 1 | 6.76 KB | 23 Dec 2018 - 07:58 |
007ac9 Crawler, seems to belong to SISTRIX | 8 | 38.30 KB | 22 Dec 2018 - 10:05 |
Common Crawl | 5 | 1.71 MB | 17 Dec 2018 - 18:02 |
Sogou Spider | 8 | 12.33 MB | 17 Dec 2018 - 13:37 |
SeznamBot | 4 | 20.12 KB | 16 Dec 2018 - 21:35 |
yeti | 2 | 32.97 MB | 16 Dec 2018 - 20:19 |
360spider | 1 | 2.69 KB | 16 Dec 2018 - 17:03 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 14 Dec 2018 - 14:58 |
Phantom | 1 | 20.76 MB | 11 Dec 2018 - 11:18 |
Turn It In | 1 | 30 Bytes | 07 Dec 2018 - 18:38 |
Zend Http Client | 1 | 0 | 05 Dec 2018 - 14:38 |
Mail.ru bot | 1 | 2.82 KB | 05 Dec 2018 - 06:44 |
FaceBook bot | 2 | 9.45 KB | 02 Dec 2018 - 16:19 |
|