| 32 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 17,031 | 166.66 MB | 31 May 2019 - 23:55 |
| AhrefsBot | 2,590 | 404.21 MB | 31 May 2019 - 23:52 |
| SemrushBot | 3,957 | 269.56 MB | 31 May 2019 - 23:52 |
| Unknown robot (identified by 'crawl') | 630 | 8.37 MB | 31 May 2019 - 23:51 |
| WGet tools | 953 | 888.61 MB | 31 May 2019 - 23:36 |
| Bingbot | 711 | 86.04 MB | 31 May 2019 - 23:02 |
| Yandex Bot | 206 | 17.40 MB | 31 May 2019 - 23:02 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 437 | 57.94 MB | 31 May 2019 - 22:40 |
| DotBot, Open Site Explorer | 160 | 3.44 MB | 31 May 2019 - 22:27 |
| BaiDuSpider | 339 | 25.64 MB | 31 May 2019 - 21:23 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,893 | 53.47 MB | 31 May 2019 - 09:09 |
| Googlebot | 75 | 1.83 MB | 31 May 2019 - 06:12 |
| ltx71 | 11 | 42.16 KB | 30 May 2019 - 18:30 |
| MJ12bot | 76 | 1.14 MB | 30 May 2019 - 02:19 |
| Java (Often spam bot) | 172 | 4.27 MB | 29 May 2019 - 15:22 |
| Unknown robot (identified by 'robot') | 12 | 370.86 KB | 29 May 2019 - 03:53 |
| Python-urllib | 9 | 4.37 MB | 28 May 2019 - 15:47 |
| Mail.ru bot | 4 | 3.20 KB | 28 May 2019 - 03:34 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 3.18 KB | 25 May 2019 - 13:38 |
| Cliqzbot | 5 | 179.24 KB | 25 May 2019 - 03:08 |
| Unknown robot (identified by empty user agent string) | 5 | 1.27 MB | 24 May 2019 - 02:34 |
| SeznamBot | 6 | 16.21 KB | 23 May 2019 - 06:47 |
| Perl tool | 1 | 3.18 KB | 23 May 2019 - 05:14 |
| Common Crawl | 24 | 54.42 KB | 20 May 2019 - 21:23 |
| Sift | 4 | 123.62 KB | 20 May 2019 - 02:55 |
| Fish search | 1 | 3.18 KB | 18 May 2019 - 17:32 |
| Sogou Spider | 2 | 4.75 KB | 18 May 2019 - 13:21 |
| Alexa (IA Archiver) | 11 | 102.95 KB | 16 May 2019 - 21:02 |
| Unknown robot (identified by 'spider') | 4 | 10.82 KB | 15 May 2019 - 02:53 |
| Web Core / Roots | 3 | 18.15 KB | 14 May 2019 - 09:17 |
| yeti | 2 | 8.69 KB | 12 May 2019 - 22:39 |
| HTTrack off-line browser | 1 | 59.99 KB | 12 May 2019 - 16:21 |