| 34 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 16,065 | 256.78 MB | 31 Aug 2020 - 21:05 |
| AhrefsBot | 14,854 | 1.84 GB | 31 Aug 2020 - 20:15 |
| SemrushBot | 8,224 | 521.48 MB | 31 Aug 2020 - 21:07 |
| Bingbot | 2,151 | 415.97 MB | 31 Aug 2020 - 20:44 |
| Unknown robot (identified by 'crawl') | 2,015 | 61.61 MB | 31 Aug 2020 - 20:56 |
| DotBot, Open Site Explorer | 1,332 | 107.33 MB | 31 Aug 2020 - 21:08 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,056 | 14.16 MB | 29 Aug 2020 - 05:04 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 928 | 72.20 MB | 31 Aug 2020 - 19:58 |
| Googlebot | 331 | 20.54 MB | 31 Aug 2020 - 18:27 |
| WGet tools | 303 | 280.42 MB | 31 Aug 2020 - 20:58 |
| Yandex Bot | 146 | 1.51 MB | 31 Aug 2020 - 16:39 |
| Unknown robot (identified by 'spider') | 130 | 4.39 MB | 31 Aug 2020 - 21:09 |
| MJ12bot | 88 | 819.38 KB | 30 Aug 2020 - 17:37 |
| Java (Often spam bot) | 32 | 0 | 30 Aug 2020 - 19:27 |
| Common Crawl | 15 | 54.36 KB | 15 Aug 2020 - 12:06 |
| SeznamBot | 11 | 38.08 KB | 31 Aug 2020 - 04:23 |
| ltx71 | 10 | 2.99 MB | 26 Aug 2020 - 07:09 |
| Sift | 9 | 365.40 KB | 29 Aug 2020 - 01:51 |
| Unknown robot (identified by empty user agent string) | 9 | 323.02 KB | 15 Aug 2020 - 11:57 |
| Alexa (IA Archiver) | 8 | 32.66 KB | 27 Aug 2020 - 12:14 |
| Mail.ru bot | 6 | 9.55 KB | 27 Aug 2020 - 09:44 |
| FaceBook bot | 6 | 189.50 KB | 08 Aug 2020 - 18:01 |
| Perl tool | 4 | 239.96 KB | 30 Aug 2020 - 16:15 |
| InternetArchive | 4 | 0 | 10 Aug 2020 - 15:15 |
| Web Core / Roots | 4 | 520.17 KB | 19 Aug 2020 - 08:31 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 4 | 12.71 KB | 27 Aug 2020 - 08:07 |
| Python-urllib | 2 | 6.36 KB | 13 Aug 2020 - 16:32 |
| Yahoo Slurp | 2 | 8.69 KB | 22 Aug 2020 - 19:10 |
| Suspected bot masqurading as Mozilla | 2 | 9.22 KB | 21 Aug 2020 - 03:31 |
| MojeekBot | 2 | 7.52 KB | 22 Aug 2020 - 11:32 |
| archive.org bot | 1 | 59.99 KB | 06 Aug 2020 - 16:56 |
| Bing Preview bot | 1 | 3.18 KB | 26 Aug 2020 - 01:19 |
| Unknown robot (identified by 'checker') | 1 | 3.30 KB | 18 Aug 2020 - 10:54 |
| yeti | 1 | 59.99 KB | 17 Aug 2020 - 08:31 |
|