| 57 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 3,271,150 | 13761.40 GB | 30 Apr 2023 - 23:59 |
| SemrushBot | 132,179 | 54.38 GB | 30 Apr 2023 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 70,216 | 557.26 GB | 30 Apr 2023 - 23:30 |
| Unknown robot (identified by 'crawl') | 50,996 | 280.15 GB | 29 Apr 2023 - 02:23 |
| Bingbot | 45,368 | 1464.94 GB | 30 Apr 2023 - 23:59 |
| AhrefsBot | 20,963 | 9.91 GB | 30 Apr 2023 - 23:30 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 14,442 | 177.34 GB | 30 Apr 2023 - 23:50 |
| check_http (nagios) | 8,253 | 28.82 MB | 30 Apr 2023 - 23:52 |
| DotBot, Open Site Explorer | 8,102 | 207.94 GB | 30 Apr 2023 - 23:13 |
| Python-urllib | 7,474 | 94.58 GB | 30 Apr 2023 - 23:41 |
| Unknown robot (identified by empty user agent string) | 5,996 | 120.99 GB | 30 Apr 2023 - 23:35 |
| Googlebot | 5,866 | 217.55 GB | 30 Apr 2023 - 23:53 |
| Yandex Bot | 1,715 | 85.78 GB | 30 Apr 2023 - 23:04 |
| Unknown robot (identified by 'spider') | 1,378 | 60.29 GB | 30 Apr 2023 - 23:57 |
| MJ12bot | 1,262 | 51.74 GB | 30 Apr 2023 - 15:32 |
| Suspected bot masqurading as Mozilla | 1,145 | 1.65 GB | 30 Apr 2023 - 23:39 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,005 | 203.79 MB | 24 Apr 2023 - 15:00 |
| Common Crawl | 445 | 1.11 GB | 02 Apr 2023 - 00:25 |
| Suspected bot masqurading as Mozilla | 442 | 3.17 GB | 29 Apr 2023 - 21:24 |
| GigablastOpenSource, an Open Source Search Engine(Wiki) | 349 | 10.62 GB | 30 Apr 2023 - 08:48 |
| Java (Often spam bot) | 304 | 16.79 KB | 30 Apr 2023 - 22:36 |
| Googlebot-Image | 297 | 6.58 MB | 30 Apr 2023 - 23:29 |
| BaiDuSpider | 197 | 42.42 GB | 30 Apr 2023 - 19:21 |
| Custo | 157 | 550.55 KB | 29 Apr 2023 - 04:42 |
| Feedburner | 142 | 0 | 30 Apr 2023 - 19:03 |
| FavIconizer | 125 | 446.27 KB | 30 Apr 2023 - 21:17 |
| FaceBook bot | 109 | 2.07 GB | 29 Apr 2023 - 23:57 |
| SeznamBot | 107 | 1.07 MB | 30 Apr 2023 - 23:55 |
| MojeekBot | 89 | 29.14 MB | 30 Apr 2023 - 23:24 |
| Perl tool | 80 | 9.02 GB | 30 Apr 2023 - 22:53 |
| LinkChecker | 71 | 258.43 MB | 30 Apr 2023 - 16:51 |
| Bing Preview bot | 53 | 3.81 GB | 29 Apr 2023 - 16:24 |
| Heritrix | 30 | 1.47 GB | 10 Apr 2023 - 10:16 |
| yeti | 19 | 62.60 KB | 28 Apr 2023 - 12:05 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 18 | 40.63 MB | 30 Apr 2023 - 15:53 |
| Motor | 18 | 454.34 MB | 29 Apr 2023 - 15:55 |
| twitterbot | 13 | 5.75 GB | 28 Apr 2023 - 10:15 |
| Nutch | 11 | 54.78 KB | 15 Apr 2023 - 13:09 |
| Sogou Spider | 9 | 32.31 KB | 28 Apr 2023 - 19:08 |
| WordPress | 8 | 1.78 MB | 09 Apr 2023 - 01:19 |
| YaCy | 8 | 14.15 MB | 27 Apr 2023 - 18:04 |
| CFNetwork | 7 | 150.58 KB | 07 Apr 2023 - 08:45 |
| Netcraft | 5 | 17.97 KB | 08 Apr 2023 - 03:28 |
| Web Core / Roots | 5 | 7.53 GB | 30 Apr 2023 - 15:26 |
| Xenu's Link Sleuth (TM), see Wikipedia | 2 | 7.11 KB | 26 Apr 2023 - 20:52 |
| A PHP script | 2 | 251.24 MB | 29 Apr 2023 - 04:22 |
| HTTrack off-line browser | 1 | 70.80 KB | 18 Apr 2023 - 11:44 |
| gazz | 1 | 3.49 KB | 05 Apr 2023 - 00:41 |
| Emacs-w3 Search Engine | 1 | 387.96 MB | 01 Apr 2023 - 12:19 |
| Unknown robot (identified by 'robot') | 1 | 3.62 KB | 25 Apr 2023 - 14:49 |
| Yahoo Slurp | 1 | 563.99 MB | 29 Apr 2023 - 22:34 |
| Radian 6 Crawler | 1 | 6.19 KB | 10 Apr 2023 - 21:23 |
| Phantom | 1 | 3.49 KB | 07 Apr 2023 - 03:08 |
| ning | 1 | 559.58 MB | 05 Apr 2023 - 22:39 |
| Gaisbot | 1 | 3.62 KB | 29 Apr 2023 - 06:10 |
| WWWC Ver 0.2.5 | 1 | 6.06 KB | 28 Apr 2023 - 09:47 |
| sohu agent | 1 | 6.19 KB | 22 Apr 2023 - 21:07 |
|