| 55 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 3,491,246 | 7324.95 GB | 31 Oct 2021 - 23:59 |
| Bingbot | 37,987 | 606.57 GB | 31 Oct 2021 - 23:59 |
| Unknown robot (identified by 'crawl') | 41,704 | 106.34 GB | 31 Oct 2021 - 23:59 |
| check_http (nagios) | 8,684 | 28.06 MB | 31 Oct 2021 - 23:59 |
| SemrushBot | 30,812 | 68.70 GB | 31 Oct 2021 - 23:59 |
| Googlebot | 7,564 | 282.81 GB | 31 Oct 2021 - 23:58 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 28,555 | 173.23 GB | 31 Oct 2021 - 23:52 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 35,700 | 145.15 GB | 31 Oct 2021 - 23:51 |
| Python-urllib | 2,835 | 202.84 GB | 31 Oct 2021 - 23:32 |
| Unknown robot (identified by 'spider') | 997 | 25.91 GB | 31 Oct 2021 - 23:29 |
| Yandex Bot | 3,557 | 122.60 GB | 31 Oct 2021 - 23:26 |
| Suspected bot masqurading as Mozilla | 441 | 135.36 MB | 31 Oct 2021 - 23:19 |
| SEOkicks Webcrawler | 486 | 9.56 GB | 31 Oct 2021 - 23:09 |
| SeznamBot | 105 | 1.42 MB | 31 Oct 2021 - 23:05 |
| Unknown robot (identified by empty user agent string) | 8,034 | 97.80 GB | 31 Oct 2021 - 22:50 |
| AhrefsBot | 14,840 | 212.39 GB | 31 Oct 2021 - 21:57 |
| ltx71 | 57 | 4.47 GB | 31 Oct 2021 - 21:54 |
| LinkChecker | 125 | 267.64 MB | 31 Oct 2021 - 21:39 |
| FaceBook bot | 124 | 10.11 GB | 31 Oct 2021 - 21:35 |
| MJ12bot | 386 | 13.93 GB | 31 Oct 2021 - 21:01 |
| DotBot, Open Site Explorer | 11,539 | 254.92 GB | 31 Oct 2021 - 20:41 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 819 | 79.72 MB | 31 Oct 2021 - 20:12 |
| Mail.ru bot | 268 | 729.98 MB | 31 Oct 2021 - 20:02 |
| FavIconizer | 236 | 202.53 MB | 31 Oct 2021 - 19:37 |
| Bing Preview bot | 146 | 28.84 GB | 31 Oct 2021 - 18:21 |
| BaiDuSpider | 211 | 18.54 GB | 31 Oct 2021 - 18:17 |
| MojeekBot | 104 | 2.31 MB | 31 Oct 2021 - 17:20 |
| archive.org bot | 86 | 2.23 GB | 31 Oct 2021 - 14:51 |
| Suspected bot masqurading as Mozilla | 174 | 1.34 GB | 31 Oct 2021 - 14:21 |
| Netcraft | 6 | 19.85 KB | 31 Oct 2021 - 13:46 |
| Web Core / Roots | 113 | 3.57 GB | 31 Oct 2021 - 10:41 |
| twitterbot | 5 | 1.65 GB | 31 Oct 2021 - 10:40 |
| Java (Often spam bot) | 25 | 5.75 MB | 31 Oct 2021 - 08:15 |
| Googlebot-Image | 44 | 415.06 KB | 30 Oct 2021 - 17:46 |
| Sogou Spider | 12 | 39.57 KB | 30 Oct 2021 - 09:27 |
| Custo | 185 | 607.51 KB | 30 Oct 2021 - 04:47 |
| Perl tool | 216 | 6.62 GB | 29 Oct 2021 - 19:59 |
| Yahoo Slurp | 10 | 1.52 GB | 28 Oct 2021 - 13:34 |
| Alexa (IA Archiver) | 103 | 2.16 GB | 28 Oct 2021 - 04:19 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 20 | 61.67 MB | 28 Oct 2021 - 04:03 |
| Common Crawl | 13,301 | 63.96 GB | 28 Oct 2021 - 00:14 |
| YaCy | 1,747 | 258.54 GB | 27 Oct 2021 - 04:10 |
| Google Web Preview | 39 | 133.68 KB | 26 Oct 2021 - 15:58 |
| Simmany Robot Ver1.0 | 5 | 75.72 KB | 26 Oct 2021 - 04:43 |
| yeti | 8 | 67.85 KB | 25 Oct 2021 - 08:25 |
| HTTrack off-line browser | 3 | 27.98 KB | 23 Oct 2021 - 06:24 |
| Unknown robot (identified by 'robot') | 3 | 31.89 KB | 21 Oct 2021 - 02:16 |
| Nutch | 1,722 | 4.74 GB | 19 Oct 2021 - 18:02 |
| LinkBot | 4 | 23.35 KB | 17 Oct 2021 - 21:24 |
| Unknown robot (identified by 'discovery') | 7 | 22.57 KB | 15 Oct 2021 - 11:37 |
| ning | 3 | 620.81 MB | 14 Oct 2021 - 11:33 |
| CFNetwork | 1 | 0 | 13 Oct 2021 - 10:06 |
| Phantom | 5 | 48.05 KB | 11 Oct 2021 - 22:19 |
| InfoBot | 4 | 17.67 KB | 09 Oct 2021 - 22:26 |
| Motor | 11 | 433.02 MB | 08 Oct 2021 - 20:51 |
|