| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 4,913,614 | 9984.27 GB | 30 Jun 2021 - 23:59 |
| Unknown robot (identified by empty user agent string) | 173,523 | 829.88 GB | 30 Jun 2021 - 23:35 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 102,228 | 730.49 GB | 30 Jun 2021 - 23:59 |
| Unknown robot (identified by 'crawl') | 101,096 | 416.17 GB | 30 Jun 2021 - 18:59 |
| Bingbot | 90,932 | 674.89 GB | 30 Jun 2021 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 23,491 | 158.94 GB | 30 Jun 2021 - 23:59 |
| SemrushBot | 15,305 | 98.04 GB | 30 Jun 2021 - 23:57 |
| AhrefsBot | 11,338 | 151.81 GB | 30 Jun 2021 - 23:44 |
| check_http (nagios) | 8,356 | 27.01 MB | 30 Jun 2021 - 23:55 |
| Googlebot | 5,329 | 33.42 GB | 30 Jun 2021 - 23:38 |
| Python-urllib | 2,958 | 17.49 GB | 30 Jun 2021 - 21:11 |
| DotBot, Open Site Explorer | 2,534 | 22.63 GB | 30 Jun 2021 - 22:50 |
| Common Crawl | 1,079 | 1.76 GB | 25 Jun 2021 - 11:06 |
| MJ12bot | 941 | 32.17 GB | 30 Jun 2021 - 21:35 |
| Unknown robot (identified by 'spider') | 885 | 7.30 GB | 30 Jun 2021 - 23:56 |
| Java (Often spam bot) | 771 | 9.80 GB | 30 Jun 2021 - 23:33 |
| Yandex Bot | 737 | 10.34 GB | 30 Jun 2021 - 20:53 |
| SEOkicks Webcrawler | 572 | 7.65 GB | 17 Jun 2021 - 09:51 |
| Perl tool | 499 | 11.57 GB | 30 Jun 2021 - 09:02 |
| Suspected bot masqurading as Mozilla | 477 | 16.00 MB | 30 Jun 2021 - 23:51 |
| Web Core / Roots | 398 | 4.90 GB | 28 Jun 2021 - 18:17 |
| Suspected bot masqurading as Mozilla | 371 | 2.16 GB | 30 Jun 2021 - 16:52 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 352 | 124.21 MB | 13 Jun 2021 - 15:44 |
| ltx71 | 308 | 30.42 GB | 30 Jun 2021 - 11:28 |
| Mail.ru bot | 206 | 2.07 GB | 30 Jun 2021 - 16:48 |
| Custo | 201 | 668.04 KB | 30 Jun 2021 - 14:54 |
| FavIconizer | 181 | 544.18 MB | 30 Jun 2021 - 14:21 |
| Bing Preview bot | 151 | 11.66 GB | 30 Jun 2021 - 23:19 |
| YaCy | 131 | 11.42 GB | 29 Jun 2021 - 12:23 |
| LinkChecker | 113 | 267.69 MB | 29 Jun 2021 - 15:06 |
| SeznamBot | 111 | 189.20 MB | 30 Jun 2021 - 19:32 |
| Unknown robot (identified by 'robot') | 110 | 25.88 GB | 25 Jun 2021 - 09:23 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 104 | 29.37 GB | 29 Jun 2021 - 21:54 |
| Googlebot-Image | 95 | 19.28 MB | 30 Jun 2021 - 16:26 |
| FaceBook bot | 76 | 9.67 GB | 30 Jun 2021 - 21:54 |
| BaiDuSpider | 57 | 2.61 GB | 30 Jun 2021 - 08:51 |
| ning | 48 | 18.24 MB | 23 Jun 2021 - 08:27 |
| MojeekBot | 25 | 2.54 MB | 29 Jun 2021 - 05:56 |
| Netcraft | 19 | 59.03 KB | 29 Jun 2021 - 13:34 |
| yeti | 17 | 60.75 KB | 29 Jun 2021 - 13:22 |
| Sogou Spider | 16 | 53.22 KB | 25 Jun 2021 - 21:46 |
| Motor | 15 | 1.27 GB | 12 Jun 2021 - 20:02 |
| Anthill | 12 | 8.28 MB | 28 Jun 2021 - 11:27 |
| Yahoo Slurp | 12 | 2.41 GB | 18 Jun 2021 - 20:11 |
| TestBot | 10 | 16.87 MB | 29 Jun 2021 - 13:10 |
| WordPress | 9 | 18.86 KB | 16 Jun 2021 - 11:44 |
| twitterbot | 9 | 1.32 GB | 27 Jun 2021 - 23:54 |
| 360spider | 7 | 72.83 MB | 30 Jun 2021 - 22:37 |
| archive.org bot | 7 | 20.04 KB | 04 Jun 2021 - 05:15 |
| Sift | 7 | 2.77 MB | 04 Jun 2021 - 02:34 |
| MSIECrawler | 3 | 10.05 KB | 03 Jun 2021 - 21:16 |
| CFNetwork | 3 | 1.05 GB | 26 Jun 2021 - 09:03 |
| Xenu's Link Sleuth (TM), see Wikipedia | 3 | 51.74 KB | 13 Jun 2021 - 09:57 |
| GigaBot | 2 | 14.60 KB | 10 Jun 2021 - 15:32 |
| Unknown robot (identified by 'scanner') | 2 | 7.17 KB | 03 Jun 2021 - 12:36 |
| GetBot | 1 | 115.66 MB | 29 Jun 2021 - 15:02 |
| Cfetch | 1 | 537.00 MB | 23 Jun 2021 - 04:51 |
| Nutch | 1 | 3.35 KB | 30 Jun 2021 - 05:42 |
| Simmany Robot Ver1.0 | 1 | 614.00 MB | 08 Jun 2021 - 14:18 |
| InfoBot | 1 | 5.30 KB | 07 Jun 2021 - 04:23 |
|