| 44 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 20,290+1 | 756.87 GB | 31 Dec 2018 - 22:57 |
| AhrefsBot | 6,084 | 667.46 GB | 31 Dec 2018 - 20:38 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,482 | 210.44 GB | 31 Dec 2018 - 16:08 |
| SemrushBot | 3,276 | 7.78 GB | 31 Dec 2018 - 23:55 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 2,175 | 577.18 MB | 31 Dec 2018 - 12:48 |
| BaiDuSpider | 2,111 | 4.76 GB | 31 Dec 2018 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 1,485 | 94.79 GB | 31 Dec 2018 - 23:57 |
| Unknown robot (identified by empty user agent string) | 837 | 52.18 GB | 31 Dec 2018 - 21:20 |
| Python-urllib | 653 | 104.05 GB | 31 Dec 2018 - 18:29 |
| Unknown robot (identified by 'crawl') | 348 | 25.37 GB | 31 Dec 2018 - 17:40 |
| Yandex Bot | 325 | 22.03 GB | 31 Dec 2018 - 19:13 |
| ltx71 | 311 | 2.66 GB | 31 Dec 2018 - 23:11 |
| Perl tool | 288 | 6.17 MB | 31 Dec 2018 - 23:43 |
| Bingbot | 251 | 111.98 MB | 31 Dec 2018 - 15:12 |
| Googlebot | 158 | 2.39 GB | 31 Dec 2018 - 09:13 |
| Java (Often spam bot) | 114 | 40.05 GB | 31 Dec 2018 - 14:06 |
| Exabot | 102 | 148.70 MB | 31 Dec 2018 - 21:23 |
| MJ12bot | 69 | 246.44 MB | 28 Dec 2018 - 05:57 |
| CFNetwork | 63 | 1.29 GB | 31 Dec 2018 - 18:45 |
| Jakarta commons-httpclient | 34 | 544 Bytes | 30 Dec 2018 - 23:06 |
| SEOkicks Webcrawler | 31 | 185.96 KB | 28 Dec 2018 - 13:27 |
| LinkChecker | 31 | 0 | 30 Dec 2018 - 16:43 |
| DotBot, Open Site Explorer | 26 | 204.53 GB | 31 Dec 2018 - 09:36 |
| Web Core / Roots | 18 | 222.33 MB | 27 Dec 2018 - 06:33 |
| Alexa (IA Archiver) | 11 | 71.26 KB | 29 Dec 2018 - 11:25 |
| 007ac9 Crawler, seems to belong to SISTRIX | 8 | 38.30 KB | 22 Dec 2018 - 10:05 |
| Sogou Spider | 8 | 12.33 MB | 17 Dec 2018 - 13:37 |
| Suspected bot masqurading as Mozilla | 8 | 16 Bytes | 24 Dec 2018 - 15:01 |
| Cliqzbot | 7 | 8.44 MB | 31 Dec 2018 - 15:40 |
| Google AdSense | 6 | 109.03 MB | 24 Dec 2018 - 15:35 |
| Common Crawl | 5 | 1.71 MB | 17 Dec 2018 - 18:02 |
| SeznamBot | 4 | 20.12 KB | 16 Dec 2018 - 21:35 |
| archive.org bot | 3 | 63.84 MB | 26 Dec 2018 - 03:16 |
| WordPress | 2 | 0 | 25 Dec 2018 - 15:31 |
| yeti | 2 | 32.97 MB | 16 Dec 2018 - 20:19 |
| FaceBook bot | 2 | 9.45 KB | 02 Dec 2018 - 16:19 |
| FavIconizer | 1 | 41.06 KB | 29 Dec 2018 - 02:26 |
| Y!J Yahoo Japan | 1 | 6.76 KB | 23 Dec 2018 - 07:58 |
| Zend Http Client | 1 | 0 | 05 Dec 2018 - 14:38 |
| Phantom | 1 | 20.76 MB | 11 Dec 2018 - 11:18 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 14 Dec 2018 - 14:58 |
| Mail.ru bot | 1 | 2.82 KB | 05 Dec 2018 - 06:44 |
| 360spider | 1 | 2.69 KB | 16 Dec 2018 - 17:03 |
| Turn It In | 1 | 30 Bytes | 07 Dec 2018 - 18:38 |
|