| 38 different robots | Hits | Bandwidth | Last visit |
|---|
| AhrefsBot | 6,689 | 513.27 GB | 31 May 2019 - 23:59 |
| WGet tools | 35,666+1 | 976.26 GB | 31 May 2019 - 23:58 |
| SemrushBot | 805 | 1.86 GB | 31 May 2019 - 23:57 |
| Unknown robot (identified by 'crawl') | 8,479 | 37.22 GB | 31 May 2019 - 23:52 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 1,199 | 154.66 GB | 31 May 2019 - 23:49 |
| Bingbot | 1,412 | 16.90 GB | 31 May 2019 - 23:46 |
| Perl tool | 196 | 4.15 MB | 31 May 2019 - 23:27 |
| Yandex Bot | 2,488 | 325.53 GB | 31 May 2019 - 23:07 |
| Java (Often spam bot) | 2,623 | 49.14 GB | 31 May 2019 - 22:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 436 | 8.26 GB | 31 May 2019 - 22:33 |
| LinkChecker | 45 | 0 | 31 May 2019 - 22:33 |
| Exabot | 29 | 18.98 MB | 31 May 2019 - 21:08 |
| Python-urllib | 294 | 109.07 GB | 31 May 2019 - 21:00 |
| Unknown robot (identified by empty user agent string) | 740 | 51.15 GB | 31 May 2019 - 20:43 |
| BaiDuSpider | 444 | 415.95 MB | 31 May 2019 - 20:15 |
| DotBot, Open Site Explorer | 190 | 8.35 GB | 31 May 2019 - 15:50 |
| Googlebot | 96 | 78.18 MB | 31 May 2019 - 13:59 |
| Alexa (IA Archiver) | 12 | 129.16 KB | 31 May 2019 - 12:35 |
| SeznamBot | 6 | 23.14 KB | 31 May 2019 - 12:08 |
| Jakarta commons-httpclient | 28 | 448 Bytes | 31 May 2019 - 08:01 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,962+3 | 331.98 MB | 31 May 2019 - 02:03 |
| Unknown robot (identified by 'spider') | 9 | 19.53 KB | 29 May 2019 - 15:37 |
| MJ12bot | 206 | 50.21 MB | 29 May 2019 - 01:33 |
| ltx71 | 112 | 450.01 GB | 26 May 2019 - 00:15 |
| CFNetwork | 16 | 3.17 GB | 25 May 2019 - 20:19 |
| Cliqzbot | 3 | 1.46 MB | 25 May 2019 - 14:32 |
| Xenu's Link Sleuth (TM), see Wikipedia | 2 | 9.77 KB | 25 May 2019 - 13:38 |
| Common Crawl | 7 | 12.12 MB | 24 May 2019 - 23:23 |
| Web Core / Roots | 1 | 27.12 MB | 23 May 2019 - 16:15 |
| Sogou Spider | 7 | 12.17 MB | 23 May 2019 - 05:25 |
| archive.org bot | 6 | 145.96 MB | 22 May 2019 - 04:26 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 21 May 2019 - 13:40 |
| FaceBook bot | 4 | 21.73 MB | 20 May 2019 - 13:59 |
| Nutch | 2 | 7.17 KB | 20 May 2019 - 06:17 |
| twitterbot | 2 | 11.02 KB | 08 May 2019 - 15:07 |
| Phantom | 3 | 35.48 MB | 08 May 2019 - 05:13 |
| Bing Preview bot | 3 | 42.53 MB | 07 May 2019 - 00:13 |
| 360spider | 2 | 16.76 MB | 04 May 2019 - 00:21 |
|