| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 17,317 | 1.14 GB | 31 May 2022 - 22:05 |
| SemrushBot | 15,671 | 764.80 MB | 31 May 2022 - 22:10 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 10,199 | 2.59 GB | 31 May 2022 - 22:04 |
| AhrefsBot | 7,395 | 121.41 MB | 31 May 2022 - 22:07 |
| WGet tools | 6,441 | 2.09 GB | 31 May 2022 - 20:33 |
| Bingbot | 2,177 | 115.63 MB | 31 May 2022 - 21:46 |
| Yandex Bot | 1,531 | 282.94 MB | 31 May 2022 - 21:00 |
| Unknown robot (identified by 'crawl') | 890 | 13.33 MB | 31 May 2022 - 19:20 |
| Common Crawl | 686 | 17.68 MB | 29 May 2022 - 09:57 |
| MJ12bot | 591 | 74.25 MB | 30 May 2022 - 13:14 |
| DotBot, Open Site Explorer | 573 | 102.85 MB | 31 May 2022 - 19:01 |
| Googlebot | 321 | 19.04 MB | 31 May 2022 - 14:55 |
| WordPress | 147 | 0 | 31 May 2022 - 02:15 |
| Unknown robot (identified by 'robot') | 96 | 441.53 KB | 22 May 2022 - 17:33 |
| Java (Often spam bot) | 53 | 456.03 KB | 30 May 2022 - 03:25 |
| Unknown robot (identified by 'spider') | 45 | 596.78 KB | 30 May 2022 - 08:26 |
| Unknown robot (identified by empty user agent string) | 42 | 27.86 MB | 19 May 2022 - 05:16 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 37 | 205.84 KB | 31 May 2022 - 16:02 |
| MojeekBot | 34 | 1.09 MB | 30 May 2022 - 21:56 |
| Python-urllib | 13 | 153.58 KB | 31 May 2022 - 03:44 |
| SeznamBot | 11 | 31.36 KB | 28 May 2022 - 19:38 |
| Perl tool | 6 | 1.62 MB | 25 May 2022 - 10:55 |
| YaCy | 6 | 187.95 KB | 24 May 2022 - 17:52 |
| Custo | 5 | 15.89 KB | 30 May 2022 - 11:16 |
| BaiDuSpider | 3 | 12.27 KB | 26 May 2022 - 16:29 |
| Feedfetcher-Google | 3 | 9.66 KB | 27 May 2022 - 08:44 |
| InternetArchive | 2 | 0 | 11 May 2022 - 11:38 |
| Googlebot-Image | 2 | 85.86 KB | 30 May 2022 - 00:19 |
| yeti | 2 | 119.98 KB | 31 May 2022 - 04:10 |
| Mail.ru bot | 2 | 1.60 KB | 05 May 2022 - 22:54 |
| Yahoo Slurp | 1 | 3.30 KB | 26 May 2022 - 17:28 |
| SEOkicks Webcrawler | 1 | 3.30 KB | 29 May 2022 - 06:02 |
| JBot Java Web Robot | 1 | 148.61 KB | 10 May 2022 - 15:33 |
| A PHP script | 1 | 3.30 KB | 20 May 2022 - 18:44 |
| archive.org bot | 1 | 59.99 KB | 31 May 2022 - 05:38 |
| MSNBot | 1 | 3.30 KB | 07 May 2022 - 20:43 |
| Suspected bot masquerading as M$ IE | 1 | 3.18 KB | 13 May 2022 - 08:28 |
| Motor | 1 | 3.30 KB | 16 May 2022 - 13:56 |
| W3C jigsaw CSS Validator | 1 | 3.30 KB | 28 May 2022 - 18:45 |
| MSNBot-media | 1 | 3.30 KB | 07 May 2022 - 20:42 |
| W3C Validator | 1 | 3.30 KB | 06 May 2022 - 07:42 |
| Heritrix | 1 | 59.99 KB | 04 May 2022 - 11:57 |
| Linkdex | 1 | 59.99 KB | 06 May 2022 - 08:39 |
|