| 28 different robots | Hits | Bandwidth | Last visit |
|---|
| SemrushBot | 30,787 | 98.51 GB | 31 Oct 2020 - 23:10 |
| AhrefsBot | 17,863 | 57.63 GB | 31 Oct 2020 - 23:09 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 15,264 | 96.25 GB | 31 Oct 2020 - 02:54 |
| MJ12bot | 10,082 | 79.81 GB | 31 Oct 2020 - 22:44 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 3,568 | 11.57 MB | 31 Oct 2020 - 15:16 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 775 | 60.77 GB | 31 Oct 2020 - 05:58 |
| Unknown robot (identified by 'crawl') | 767 | 2.69 MB | 30 Oct 2020 - 06:19 |
| Alexa (IA Archiver) | 578 | 2.04 MB | 28 Oct 2020 - 07:37 |
| WGet tools | 560 | 17.94 GB | 31 Oct 2020 - 09:11 |
| Yandex Bot | 342 | 593.48 MB | 27 Oct 2020 - 11:00 |
| Bingbot | 208 | 738.67 KB | 31 Oct 2020 - 22:18 |
| Googlebot | 81 | 345.32 KB | 31 Oct 2020 - 18:21 |
| Python-urllib | 62 | 1.45 GB | 31 Oct 2020 - 15:00 |
| Common Crawl | 23 | 80.31 KB | 27 Oct 2020 - 13:08 |
| Unknown robot (identified by 'robot') | 20 | 78.37 KB | 30 Oct 2020 - 13:01 |
| Suspected bot masqurading as Mozilla | 9 | 5.82 KB | 29 Oct 2020 - 19:35 |
| Grabber (SDSC) | 9 | 254.54 MB | 30 Oct 2020 - 13:54 |
| Unknown robot (identified by empty user agent string) | 5 | 170.93 MB | 26 Oct 2020 - 08:08 |
| FavIconizer | 5 | 16.47 KB | 30 Oct 2020 - 10:00 |
| twitterbot | 4 | 15.26 KB | 23 Oct 2020 - 18:43 |
| Perl tool | 2 | 37.81 MB | 29 Oct 2020 - 22:29 |
| archive.org bot | 2 | 7.10 KB | 31 Oct 2020 - 18:08 |
| Web Core / Roots | 2 | 0 | 15 Oct 2020 - 10:53 |
| CFNetwork | 1 | 3.52 KB | 14 Oct 2020 - 10:31 |
| Bing Preview bot | 1 | 2.20 KB | 07 Oct 2020 - 04:00 |
| Googlebot-Image | 1 | 229 Bytes | 11 Oct 2020 - 20:48 |
| SeznamBot | 1 | 3.32 KB | 19 Oct 2020 - 13:38 |
| Netcraft | 1 | 3.32 KB | 05 Oct 2020 - 17:50 |
|