| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 2,991,781 | 7681.24 GB | 31 Aug 2021 - 23:59 |
| Unknown robot (identified by 'crawl') | 159,723 | 848.24 GB | 31 Aug 2021 - 23:25 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 54,727 | 177.62 GB | 31 Aug 2021 - 23:59 |
| Bingbot | 50,987 | 595.28 GB | 31 Aug 2021 - 23:58 |
| SemrushBot | 21,626 | 81.56 GB | 31 Aug 2021 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 15,923 | 94.87 GB | 31 Aug 2021 - 23:51 |
| check_http (nagios) | 8,153 | 26.36 MB | 31 Aug 2021 - 23:55 |
| Googlebot | 7,488 | 137.60 GB | 31 Aug 2021 - 23:31 |
| Unknown robot (identified by empty user agent string) | 4,684 | 57.95 GB | 31 Aug 2021 - 23:15 |
| Unknown robot (identified by 'spider') | 3,673 | 18.94 GB | 31 Aug 2021 - 23:27 |
| AhrefsBot | 3,490 | 47.22 GB | 31 Aug 2021 - 23:49 |
| Common Crawl | 3,381 | 25.77 GB | 31 Aug 2021 - 23:30 |
| Nutch | 3,321 | 27.70 GB | 31 Aug 2021 - 22:05 |
| Python-urllib | 2,591 | 17.13 GB | 31 Aug 2021 - 20:45 |
| DotBot, Open Site Explorer | 2,075 | 29.86 GB | 31 Aug 2021 - 23:36 |
| Yandex Bot | 1,428 | 90.48 GB | 31 Aug 2021 - 22:59 |
| MJ12bot | 828 | 22.85 GB | 31 Aug 2021 - 23:55 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 700 | 86.38 MB | 29 Aug 2021 - 16:52 |
| Java (Often spam bot) | 514 | 6.70 GB | 31 Aug 2021 - 23:52 |
| YaCy | 512 | 68.86 GB | 31 Aug 2021 - 21:22 |
| SEOkicks Webcrawler | 453 | 5.26 GB | 07 Aug 2021 - 06:21 |
| Suspected bot masqurading as Mozilla | 440 | 7.27 KB | 31 Aug 2021 - 23:56 |
| Perl tool | 377 | 5.30 GB | 31 Aug 2021 - 08:39 |
| Mail.ru bot | 358 | 1.79 GB | 30 Aug 2021 - 15:20 |
| FaceBook bot | 273 | 32.72 GB | 30 Aug 2021 - 20:01 |
| ltx71 | 265 | 46.64 GB | 31 Aug 2021 - 22:47 |
| Bing Preview bot | 244 | 40.61 GB | 31 Aug 2021 - 21:03 |
| Yahoo Slurp | 196 | 33.82 GB | 28 Aug 2021 - 15:44 |
| Custo | 189 | 625.01 KB | 31 Aug 2021 - 20:58 |
| BaiDuSpider | 183 | 20.96 GB | 31 Aug 2021 - 13:20 |
| FavIconizer | 177 | 559.57 MB | 31 Aug 2021 - 20:50 |
| Suspected bot masqurading as Mozilla | 151 | 1.67 GB | 31 Aug 2021 - 17:17 |
| LinkChecker | 117 | 330.48 MB | 30 Aug 2021 - 22:07 |
| Web Core / Roots | 103 | 1.50 GB | 28 Aug 2021 - 11:16 |
| SeznamBot | 100 | 17.54 MB | 31 Aug 2021 - 22:10 |
| MojeekBot | 97 | 10.69 MB | 31 Aug 2021 - 07:02 |
| Googlebot-Image | 75 | 6.06 MB | 31 Aug 2021 - 02:10 |
| Exabot | 39 | 3.71 GB | 29 Aug 2021 - 15:22 |
| Unknown robot (identified by 'checker') | 30 | 4.79 GB | 26 Aug 2021 - 12:47 |
| Sogou Spider | 21 | 69.46 KB | 27 Aug 2021 - 19:29 |
| twitterbot | 14 | 1.85 GB | 31 Aug 2021 - 21:07 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 13 | 209.36 MB | 18 Aug 2021 - 17:21 |
| WordPress | 12 | 2.08 GB | 31 Aug 2021 - 15:23 |
| yeti | 12 | 33.61 KB | 23 Aug 2021 - 05:23 |
| Suspected bot masqurading as Mozilla | 11 | 612.03 MB | 27 Aug 2021 - 18:31 |
| Feedfetcher-Google | 10 | 395.27 KB | 09 Aug 2021 - 00:49 |
| Motor | 10 | 33.34 KB | 20 Aug 2021 - 18:13 |
| Google Web Preview | 9 | 31.30 KB | 15 Aug 2021 - 17:25 |
| Netcraft | 8 | 26.42 KB | 09 Aug 2021 - 07:51 |
| TITAN | 8 | 18.74 KB | 01 Aug 2021 - 03:14 |
| InfoBot | 7 | 28.98 KB | 24 Aug 2021 - 12:07 |
| HTTrack off-line browser | 7 | 234.31 MB | 31 Aug 2021 - 19:31 |
| Unknown robot (identified by 'robot') | 6 | 15.10 KB | 26 Aug 2021 - 22:04 |
| Simmany Robot Ver1.0 | 4 | 3.21 MB | 19 Aug 2021 - 07:33 |
| Feedburner | 4 | 0 | 09 Aug 2021 - 00:47 |
| Powermarks | 3 | 10.05 KB | 31 Aug 2021 - 01:38 |
| 360spider | 3 | 18.15 MB | 29 Aug 2021 - 01:56 |
| CFNetwork | 2 | 3.35 KB | 21 Aug 2021 - 00:31 |
| ning | 1 | 6.02 KB | 20 Aug 2021 - 00:33 |
|