| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 500,158 | 804.52 GB | 31 Oct 2021 - 21:06 |
| DotBot, Open Site Explorer | 178,655 | 122.65 GB | 31 Oct 2021 - 21:07 |
| Python-urllib | 126,993 | 25.84 GB | 31 Oct 2021 - 21:07 |
| Bingbot | 68,296 | 8.39 GB | 31 Oct 2021 - 21:10 |
| Suspected bot masqurading as Mozilla | 58,652 | 263.41 MB | 31 Oct 2021 - 21:08 |
| Unknown robot (identified by 'spider') | 31,250 | 1.21 GB | 31 Oct 2021 - 21:10 |
| Perl tool | 21,839 | 29.98 GB | 31 Oct 2021 - 20:56 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 16,406 | 31.71 GB | 31 Oct 2021 - 21:10 |
| SemrushBot | 11,787 | 2.86 GB | 31 Oct 2021 - 21:06 |
| Unknown robot (identified by empty user agent string) | 4,886 | 451.98 MB | 31 Oct 2021 - 20:58 |
| Common Crawl | 3,875 | 3.22 GB | 28 Oct 2021 - 00:16 |
| Nutch | 2,534 | 189.73 MB | 18 Oct 2021 - 20:40 |
| Yandex Bot | 1,680 | 3.08 GB | 31 Oct 2021 - 20:58 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,544 | 1.46 GB | 31 Oct 2021 - 20:58 |
| AhrefsBot | 464 | 307.56 MB | 31 Oct 2021 - 19:43 |
| Java (Often spam bot) | 439 | 3.56 MB | 31 Oct 2021 - 18:09 |
| Web Core / Roots | 360 | 37.81 MB | 31 Oct 2021 - 20:15 |
| Googlebot | 231 | 4.25 MB | 31 Oct 2021 - 19:04 |
| FaceBook bot | 148 | 640.27 KB | 31 Oct 2021 - 16:52 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 135 | 29.95 MB | 31 Oct 2021 - 13:30 |
| SEOkicks Webcrawler | 95 | 300.49 KB | 05 Oct 2021 - 16:39 |
| Unknown robot (identified by 'robot') | 74 | 322.71 KB | 29 Oct 2021 - 16:41 |
| WordPress | 55 | 224.96 KB | 31 Oct 2021 - 16:03 |
| MJ12bot | 33 | 53.26 MB | 31 Oct 2021 - 18:03 |
| BaiDuSpider | 31 | 6.63 MB | 22 Oct 2021 - 07:50 |
| twitterbot | 14 | 3.25 MB | 26 Oct 2021 - 13:38 |
| Mail.ru bot | 11 | 50.39 KB | 30 Oct 2021 - 17:53 |
| FavIconizer | 6 | 32.85 KB | 14 Oct 2021 - 12:17 |
| Unknown robot (identified by 'crawl') | 6 | 2.01 MB | 29 Oct 2021 - 05:50 |
| LinkChecker | 4 | 16.80 KB | 25 Oct 2021 - 13:15 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 3 | 13.21 KB | 23 Oct 2021 - 05:05 |
| Suspected bot masqurading as Mozilla | 2 | 8.46 KB | 01 Oct 2021 - 02:05 |
| Bing Preview bot | 2 | 714.79 KB | 13 Oct 2021 - 20:34 |
| microsoft-webdav-miniredir | 1 | 0 | 31 Oct 2021 - 08:29 |
| Facebot (Facebook bot?) | 1 | 4.23 KB | 09 Oct 2021 - 10:18 |
| ltx71 | 1 | 1.14 KB | 31 Oct 2021 - 02:20 |
|