| 31 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 16,765 | 140.70 MB | 31 Jul 2020 - 23:05 |
| AhrefsBot | 9,419 | 765.59 MB | 31 Jul 2020 - 23:07 |
| SemrushBot | 9,148 | 510.14 MB | 31 Jul 2020 - 23:07 |
| Bingbot | 2,416 | 339.22 MB | 31 Jul 2020 - 23:06 |
| Unknown robot (identified by 'crawl') | 1,551 | 52.34 MB | 30 Jul 2020 - 17:28 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,251 | 138.82 MB | 31 Jul 2020 - 23:06 |
| WGet tools | 887 | 694.85 MB | 31 Jul 2020 - 20:46 |
| DotBot, Open Site Explorer | 690 | 104.84 MB | 31 Jul 2020 - 22:06 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 627 | 6.33 MB | 31 Jul 2020 - 22:57 |
| Googlebot | 247 | 9.62 MB | 31 Jul 2020 - 20:43 |
| SEOkicks Webcrawler | 234 | 3.59 MB | 05 Jul 2020 - 14:38 |
| Yandex Bot | 119 | 907.24 KB | 31 Jul 2020 - 10:18 |
| Unknown robot (identified by 'spider') | 115 | 16.13 MB | 29 Jul 2020 - 22:22 |
| Java (Often spam bot) | 87 | 833.35 KB | 27 Jul 2020 - 11:53 |
| Python-urllib | 68 | 16.63 MB | 30 Jul 2020 - 08:46 |
| CFNetwork | 62 | 269.25 KB | 12 Jul 2020 - 15:39 |
| SeznamBot | 28 | 100.14 KB | 30 Jul 2020 - 02:05 |
| MJ12bot | 24 | 664.07 KB | 25 Jul 2020 - 03:28 |
| Common Crawl | 18 | 82.05 KB | 16 Jul 2020 - 16:49 |
| Alexa (IA Archiver) | 10 | 40.02 KB | 12 Jul 2020 - 21:54 |
| Unknown robot (identified by empty user agent string) | 9 | 199.66 KB | 27 Jul 2020 - 18:27 |
| InternetArchive | 9 | 0 | 26 Jul 2020 - 22:27 |
| Sift | 9 | 365.40 KB | 31 Jul 2020 - 18:40 |
| FaceBook bot | 8 | 479.91 KB | 21 Jul 2020 - 10:16 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 3 | 9.53 KB | 21 Jul 2020 - 11:33 |
| Mail.ru bot | 3 | 4.78 KB | 19 Jul 2020 - 16:31 |
| yeti | 3 | 121.80 KB | 30 Jul 2020 - 21:04 |
| Heritrix | 1 | 4.34 KB | 01 Jul 2020 - 01:34 |
| VSE | 1 | 59.99 KB | 30 Jul 2020 - 06:23 |
| Bing Preview bot | 1 | 4.34 KB | 12 Jul 2020 - 00:05 |
| Perl tool | 1 | 7.14 KB | 12 Jul 2020 - 23:30 |
|