| 33 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 63,756 | 45.55 GB | 31 Oct 2021 - 23:53 |
| AhrefsBot | 41,221 | 181.24 GB | 31 Oct 2021 - 23:53 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 34,346 | 114.51 MB | 31 Oct 2021 - 10:44 |
| SemrushBot | 19,388 | 115.90 GB | 31 Oct 2021 - 23:58 |
| MJ12bot | 13,148 | 225.93 GB | 31 Oct 2021 - 21:58 |
| Yandex Bot | 7,002 | 36.46 GB | 31 Oct 2021 - 23:33 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 6,512 | 36.47 GB | 31 Oct 2021 - 23:56 |
| Bingbot | 1,967 | 2.85 GB | 31 Oct 2021 - 23:06 |
| Unknown robot (identified by 'crawl') | 1,663 | 33.68 MB | 22 Oct 2021 - 18:31 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 1,006 | 32.63 GB | 31 Oct 2021 - 06:30 |
| Unknown robot (identified by 'robot') | 926 | 3.41 MB | 29 Oct 2021 - 12:44 |
| DotBot, Open Site Explorer | 867 | 1.04 GB | 31 Oct 2021 - 21:43 |
| Googlebot | 243 | 272.86 MB | 31 Oct 2021 - 07:08 |
| Nutch | 177 | 7.05 MB | 18 Oct 2021 - 00:33 |
| Grabber (SDSC) | 165 | 4.77 GB | 29 Oct 2021 - 11:54 |
| InfoBot | 102 | 596.42 KB | 14 Oct 2021 - 03:34 |
| SMTBot | 86 | 312.55 KB | 13 Oct 2021 - 15:32 |
| Common Crawl | 50 | 278.19 KB | 19 Oct 2021 - 22:37 |
| Unknown robot (identified by empty user agent string) | 49 | 9.09 GB | 28 Oct 2021 - 13:03 |
| Custo | 40 | 130.97 KB | 30 Oct 2021 - 04:39 |
| Googlebot-Image | 39 | 7.77 KB | 30 Oct 2021 - 10:48 |
| Suspected bot masqurading as Mozilla | 22 | 0 | 30 Oct 2021 - 06:44 |
| FavIconizer | 14 | 45.83 KB | 29 Oct 2021 - 21:03 |
| Python-urllib | 5 | 16.47 KB | 29 Oct 2021 - 03:32 |
| Perl tool | 5 | 235.87 MB | 27 Oct 2021 - 22:26 |
| LinkChecker | 4 | 0 | 26 Oct 2021 - 10:17 |
| MojeekBot | 4 | 63.51 KB | 13 Oct 2021 - 09:22 |
| twitterbot | 4 | 86.26 MB | 13 Oct 2021 - 09:50 |
| Unknown robot (identified by 'discovery') | 3 | 9.58 KB | 15 Oct 2021 - 11:37 |
| Alexa (IA Archiver) | 1 | 3.19 KB | 03 Oct 2021 - 07:34 |
| SeznamBot | 1 | 3.32 KB | 24 Oct 2021 - 05:18 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 3.32 KB | 11 Oct 2021 - 01:24 |
| Netcraft | 1 | 3.19 KB | 30 Oct 2021 - 14:47 |
|