| 37 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 511,909 | 641.48 GB | 28 Feb 2021 - 23:59 |
| Python-urllib | 272,248 | 90.13 GB | 28 Feb 2021 - 23:58 |
| Suspected bot masqurading as Mozilla | 132,281 | 178.14 MB | 28 Feb 2021 - 23:59 |
| Bingbot | 47,996 | 12.61 GB | 28 Feb 2021 - 23:58 |
| DotBot, Open Site Explorer | 30,689 | 5.66 GB | 28 Feb 2021 - 23:48 |
| Unknown robot (identified by 'crawl') | 14,685 | 1.07 GB | 16 Feb 2021 - 17:30 |
| Perl tool | 12,343 | 19.54 GB | 28 Feb 2021 - 23:57 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 10,753 | 17.95 GB | 28 Feb 2021 - 23:57 |
| SemrushBot | 8,967 | 1.96 GB | 28 Feb 2021 - 23:58 |
| Yandex Bot | 7,157 | 4.68 GB | 28 Feb 2021 - 23:50 |
| Unknown robot (identified by empty user agent string) | 4,283 | 546.78 MB | 28 Feb 2021 - 23:35 |
| Java (Often spam bot) | 1,012 | 5.86 MB | 28 Feb 2021 - 22:38 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 559 | 1.64 GB | 28 Feb 2021 - 18:32 |
| Googlebot | 421 | 27.22 MB | 28 Feb 2021 - 22:28 |
| Web Core / Roots | 415 | 109.24 MB | 28 Feb 2021 - 02:38 |
| MJ12bot | 272 | 30.38 MB | 28 Feb 2021 - 22:55 |
| SEOkicks Webcrawler | 96 | 305.63 KB | 18 Feb 2021 - 22:01 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 94 | 27.52 MB | 25 Feb 2021 - 02:40 |
| AhrefsBot | 84 | 12.31 MB | 28 Feb 2021 - 04:54 |
| FaceBook bot | 66 | 277.20 KB | 28 Feb 2021 - 04:44 |
| BaiDuSpider | 57 | 8.67 MB | 28 Feb 2021 - 11:36 |
| ltx71 | 55 | 414.40 KB | 25 Feb 2021 - 03:30 |
| Unknown robot (identified by 'robot') | 39 | 5.49 MB | 24 Feb 2021 - 15:50 |
| WordPress | 36 | 151.24 KB | 27 Feb 2021 - 13:29 |
| MSNBot | 35 | 10.42 MB | 28 Feb 2021 - 09:21 |
| Common Crawl | 33 | 98.92 KB | 28 Feb 2021 - 01:28 |
| Unknown robot (identified by 'spider') | 28 | 2.33 MB | 27 Feb 2021 - 17:35 |
| Mail.ru bot | 28 | 211.87 KB | 27 Feb 2021 - 20:30 |
| SMTBot | 23 | 65.68 KB | 01 Feb 2021 - 08:02 |
| FavIconizer | 12 | 50.14 KB | 26 Feb 2021 - 07:37 |
| SeznamBot | 8 | 30.75 KB | 26 Feb 2021 - 08:44 |
| Sift | 6 | 25.52 KB | 24 Feb 2021 - 05:07 |
| Bing Preview bot | 6 | 28.26 MB | 27 Feb 2021 - 13:14 |
| twitterbot | 3 | 13.15 KB | 15 Feb 2021 - 11:18 |
| yeti | 2 | 8.46 KB | 23 Feb 2021 - 09:33 |
| Sogou Spider | 1 | 4.50 KB | 02 Feb 2021 - 13:32 |
| A PHP script | 1 | 4.23 KB | 08 Feb 2021 - 11:19 |
|