| 54 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 3,071,893 | 12970.98 GB | 30 Sep 2022 - 23:59 |
| Unknown robot (identified by 'crawl') | 140,438 | 780.48 GB | 30 Sep 2022 - 23:59 |
| SemrushBot | 68,318 | 109.20 GB | 30 Sep 2022 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 41,290 | 822.75 GB | 30 Sep 2022 - 23:56 |
| AhrefsBot | 40,705 | 374.47 GB | 30 Sep 2022 - 10:00 |
| Bingbot | 19,587 | 575.83 GB | 30 Sep 2022 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 9,823 | 121.71 GB | 30 Sep 2022 - 23:47 |
| check_http (nagios) | 8,424 | 27.22 MB | 30 Sep 2022 - 23:55 |
| Unknown robot (identified by empty user agent string) | 7,118 | 78.59 GB | 30 Sep 2022 - 23:35 |
| DotBot, Open Site Explorer | 6,979 | 74.70 GB | 30 Sep 2022 - 23:59 |
| Googlebot | 5,514 | 113.81 GB | 30 Sep 2022 - 23:47 |
| Common Crawl | 3,770 | 7.11 GB | 29 Sep 2022 - 21:58 |
| Python-urllib | 2,888 | 37.45 GB | 30 Sep 2022 - 23:54 |
| MJ12bot | 2,408 | 45.70 GB | 30 Sep 2022 - 21:49 |
| Suspected bot masqurading as Mozilla | 1,305 | 260.38 MB | 30 Sep 2022 - 23:55 |
| Unknown robot (identified by 'spider') | 1,249 | 20.52 GB | 30 Sep 2022 - 23:46 |
| Yandex Bot | 968 | 39.24 GB | 30 Sep 2022 - 22:54 |
| Java (Often spam bot) | 891 | 3.22 KB | 30 Sep 2022 - 20:02 |
| SEOkicks Webcrawler | 348 | 4.05 GB | 17 Sep 2022 - 10:50 |
| Suspected bot masqurading as Mozilla | 347 | 9.47 GB | 30 Sep 2022 - 10:29 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 337 | 78.81 MB | 22 Sep 2022 - 16:31 |
| BaiDuSpider | 302 | 36.40 GB | 30 Sep 2022 - 23:17 |
| Custo | 289 | 955.44 KB | 30 Sep 2022 - 23:47 |
| Unknown robot (identified by 'robot') | 279 | 3.87 GB | 21 Sep 2022 - 17:11 |
| Bing Preview bot | 204 | 41.27 GB | 30 Sep 2022 - 16:18 |
| Googlebot-Image | 162 | 136.53 MB | 30 Sep 2022 - 23:58 |
| FavIconizer | 121 | 398.75 KB | 30 Sep 2022 - 16:41 |
| Perl tool | 110 | 14.20 GB | 28 Sep 2022 - 15:23 |
| MojeekBot | 104 | 3.82 MB | 30 Sep 2022 - 15:24 |
| FaceBook bot | 103 | 12.51 GB | 28 Sep 2022 - 18:14 |
| SeznamBot | 92 | 8.07 MB | 30 Sep 2022 - 15:50 |
| Mail.ru bot | 85 | 592.27 MB | 24 Sep 2022 - 15:35 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 74 | 129.33 MB | 29 Sep 2022 - 08:13 |
| Feedburner | 69 | 0 | 28 Sep 2022 - 13:49 |
| yeti | 63 | 3.13 GB | 30 Sep 2022 - 11:50 |
| LinkChecker | 60 | 317.21 MB | 28 Sep 2022 - 23:22 |
| Web Core / Roots | 35 | 891.28 MB | 26 Sep 2022 - 09:55 |
| Fish search | 20 | 65.74 KB | 27 Sep 2022 - 08:18 |
| Sogou Spider | 13 | 43.29 KB | 30 Sep 2022 - 19:07 |
| YaCy | 9 | 175.56 KB | 24 Sep 2022 - 16:04 |
| twitterbot | 8 | 4.71 GB | 28 Sep 2022 - 02:40 |
| 360spider | 5 | 4.81 MB | 12 Sep 2022 - 10:24 |
| Netcraft | 5 | 16.62 KB | 10 Sep 2022 - 08:22 |
| Alexa (IA Archiver) | 2 | 425.05 MB | 20 Sep 2022 - 16:43 |
| Unknown robot (identified by 'discovery') | 2 | 44.00 KB | 12 Sep 2022 - 03:54 |
| LinkBot | 2 | 2.82 KB | 28 Sep 2022 - 16:02 |
| Motor | 2 | 338.37 MB | 10 Sep 2022 - 02:24 |
| CFNetwork | 2 | 4.24 GB | 22 Sep 2022 - 15:45 |
| WordPress | 1 | 3.22 KB | 08 Sep 2022 - 17:22 |
| Language Tools Bot (ltbot) | 1 | 3.35 KB | 01 Sep 2022 - 21:50 |
| Exabot | 1 | 191.20 MB | 11 Sep 2022 - 16:43 |
| GigablastOpenSource, an Open Source Search Engine(Wiki) | 1 | 3.35 KB | 10 Sep 2022 - 23:03 |
| Yahoo Slurp | 1 | 4.83 MB | 01 Sep 2022 - 20:44 |
| HTTrack off-line browser | 1 | 47.42 MB | 29 Sep 2022 - 05:46 |
|