| 38 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 905,894 | 716.94 GB | 31 Jan 2020 - 23:05 |
| Perl tool | 78,529 | 67.30 GB | 31 Jan 2020 - 16:42 |
| SemrushBot | 45,967 | 2.66 GB | 31 Jan 2020 - 23:09 |
| Suspected bot masqurading as Mozilla | 44,643 | 172.72 MB | 31 Jan 2020 - 23:10 |
| Unknown robot (identified by empty user agent string) | 9,799 | 1.24 GB | 31 Jan 2020 - 22:23 |
| Python-urllib | 8,913 | 12.72 GB | 31 Jan 2020 - 23:05 |
| Googlebot | 8,581 | 397.70 MB | 31 Jan 2020 - 22:29 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 6,147 | 497.33 MB | 31 Jan 2020 - 22:57 |
| Yandex Bot | 3,408 | 4.01 GB | 31 Jan 2020 - 23:02 |
| AhrefsBot | 3,008 | 1.35 GB | 31 Jan 2020 - 01:23 |
| DotBot, Open Site Explorer | 1,932 | 380.39 MB | 31 Jan 2020 - 21:47 |
| Bingbot | 1,429 | 220.80 MB | 31 Jan 2020 - 23:01 |
| Java (Often spam bot) | 1,235 | 53.67 MB | 31 Jan 2020 - 22:31 |
| BaiDuSpider | 946 | 19.76 MB | 31 Jan 2020 - 22:06 |
| Alexa (IA Archiver) | 871 | 529.80 MB | 31 Jan 2020 - 12:40 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 483 | 35.56 MB | 31 Jan 2020 - 15:55 |
| Suspected bot masqurading as Mozilla | 297 | 95.09 MB | 31 Jan 2020 - 14:12 |
| MJ12bot | 233 | 1.33 GB | 28 Jan 2020 - 18:49 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 145 | 9.82 MB | 31 Jan 2020 - 19:06 |
| FaceBook bot | 139 | 577.60 KB | 31 Jan 2020 - 21:24 |
| Sogou Spider | 87 | 18.96 MB | 30 Jan 2020 - 22:38 |
| WordPress | 69 | 263.72 KB | 31 Jan 2020 - 21:36 |
| Web Core / Roots | 60 | 1005.79 KB | 31 Jan 2020 - 13:16 |
| SMTBot | 48 | 137.16 KB | 23 Jan 2020 - 16:16 |
| FavIconizer | 48 | 251.06 KB | 31 Jan 2020 - 11:39 |
| Common Crawl | 35 | 105.15 KB | 21 Jan 2020 - 03:59 |
| Unknown robot (identified by 'robot') | 20 | 1.94 MB | 28 Jan 2020 - 20:44 |
| Mail.ru bot | 16 | 117.76 KB | 29 Jan 2020 - 05:56 |
| Sift | 14 | 56.06 KB | 31 Jan 2020 - 09:44 |
| ltx71 | 12 | 2.20 MB | 28 Jan 2020 - 13:39 |
| SEOkicks Webcrawler | 7 | 20.10 KB | 25 Jan 2020 - 05:21 |
| Unknown robot (identified by 'spider') | 5 | 3.21 MB | 26 Jan 2020 - 02:14 |
| Phantom | 5 | 21.09 KB | 16 Jan 2020 - 11:11 |
| MSNBot | 5 | 415.20 KB | 28 Jan 2020 - 00:42 |
| Turn It In | 2 | 8.33 KB | 16 Jan 2020 - 04:26 |
| twitterbot | 2 | 2.30 MB | 26 Jan 2020 - 17:15 |
| Bing Preview bot | 2 | 4.03 MB | 10 Jan 2020 - 20:00 |
| CFNetwork | 1 | 0 | 01 Jan 2020 - 13:29 |
|