| 68 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 2,675,894 | 10622.41 GB | 31 May 2022 - 23:59 |
| Unknown robot (identified by 'crawl') | 72,527 | 471.51 GB | 31 May 2022 - 21:44 |
| SemrushBot | 43,324 | 145.00 GB | 31 May 2022 - 23:59 |
| Bingbot | 32,274 | 426.47 GB | 31 May 2022 - 23:55 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 25,832 | 118.19 GB | 31 May 2022 - 23:11 |
| AhrefsBot | 19,298 | 16.26 GB | 31 May 2022 - 23:56 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 15,557 | 211.54 GB | 31 May 2022 - 23:14 |
| DotBot, Open Site Explorer | 7,679 | 90.23 GB | 31 May 2022 - 23:49 |
| Unknown robot (identified by empty user agent string) | 7,033 | 100.12 GB | 31 May 2022 - 23:35 |
| Googlebot | 5,702 | 75.69 GB | 31 May 2022 - 23:55 |
| HTTrack off-line browser | 5,226 | 22.50 GB | 13 May 2022 - 10:13 |
| check_http (nagios) | 4,122 | 13.31 MB | 15 May 2022 - 15:57 |
| Python-urllib | 3,165 | 31.35 GB | 31 May 2022 - 22:02 |
| Common Crawl | 2,881 | 15.45 GB | 28 May 2022 - 17:56 |
| MJ12bot | 2,493 | 63.77 GB | 31 May 2022 - 20:09 |
| Unknown robot (identified by 'spider') | 1,295 | 42.31 GB | 31 May 2022 - 23:50 |
| Yandex Bot | 1,214 | 131.39 GB | 31 May 2022 - 21:14 |
| YaCy | 978 | 40.72 GB | 22 May 2022 - 03:09 |
| Suspected bot masqurading as Mozilla | 911 | 598.77 MB | 31 May 2022 - 23:46 |
| Java (Often spam bot) | 831 | 605.99 MB | 31 May 2022 - 23:47 |
| Suspected bot masqurading as Mozilla | 486 | 19.29 GB | 31 May 2022 - 21:05 |
| SEOkicks Webcrawler | 380 | 5.50 GB | 29 May 2022 - 11:28 |
| BaiDuSpider | 313 | 34.04 GB | 31 May 2022 - 07:37 |
| Custo | 290 | 960.17 KB | 31 May 2022 - 23:05 |
| Mail.ru bot | 268 | 68.70 MB | 31 May 2022 - 14:05 |
| Googlebot-Image | 238 | 45.60 MB | 31 May 2022 - 23:51 |
| Unknown robot (identified by 'robot') | 190 | 6.94 GB | 19 May 2022 - 22:03 |
| Perl tool | 133 | 39.96 GB | 30 May 2022 - 20:31 |
| LinkChecker | 119 | 266.87 MB | 31 May 2022 - 21:57 |
| FavIconizer | 119 | 393.56 KB | 31 May 2022 - 18:02 |
| MojeekBot | 117 | 20.26 MB | 31 May 2022 - 22:22 |
| SeznamBot | 115 | 774.09 MB | 31 May 2022 - 21:04 |
| Bing Preview bot | 110 | 17.17 GB | 31 May 2022 - 13:36 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 82 | 70.41 MB | 29 May 2022 - 13:26 |
| FaceBook bot | 76 | 6.16 GB | 30 May 2022 - 19:02 |
| Web Core / Roots | 35 | 26.22 GB | 30 May 2022 - 06:03 |
| Sogou Spider | 27 | 89.81 KB | 31 May 2022 - 07:43 |
| archive.org bot | 15 | 2.70 GB | 26 May 2022 - 02:30 |
| Yahoo Slurp | 12 | 960.52 MB | 30 May 2022 - 14:39 |
| Google AdSense | 12 | 16.81 MB | 22 May 2022 - 12:01 |
| yeti | 12 | 76.38 KB | 29 May 2022 - 16:32 |
| CFNetwork | 8 | 951.18 MB | 15 May 2022 - 22:49 |
| twitterbot | 7 | 1.84 GB | 24 May 2022 - 13:41 |
| Netcraft | 6 | 19.72 KB | 21 May 2022 - 14:57 |
| Suspected bot masqurading as Mozilla | 5 | 44.00 MB | 03 May 2022 - 09:30 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 422.41 MB | 24 May 2022 - 15:08 |
| HKU WWW Octopus | 3 | 1.79 MB | 29 May 2022 - 21:53 |
| A PHP script | 3 | 53.28 MB | 16 May 2022 - 13:21 |
| Motor | 3 | 806.01 KB | 06 May 2022 - 00:51 |
| HTMLParser | 3 | 9.92 KB | 25 May 2022 - 06:52 |
| Google Web Preview | 2 | 3.88 KB | 03 May 2022 - 07:40 |
| MSNBot | 2 | 99 Bytes | 03 May 2022 - 07:40 |
| ning | 2 | 357.02 MB | 15 May 2022 - 14:38 |
| WordPress | 2 | 24.45 KB | 30 May 2022 - 14:06 |
| Unknown robot (identified by 'discovery') | 1 | 21.88 KB | 26 May 2022 - 07:31 |
| 360spider | 1 | 16.62 MB | 16 May 2022 - 16:39 |
| Gulper Bot | 1 | 2.94 KB | 03 May 2022 - 07:39 |
| Feedfetcher-Google | 1 | 6.20 KB | 03 May 2022 - 07:40 |
| InternetArchive | 1 | 12.10 KB | 21 May 2022 - 10:31 |
| BBot | 1 | 3.35 KB | 16 May 2022 - 09:29 |
| Spry Wizard Robot | 1 | 3.35 KB | 30 May 2022 - 17:31 |
| AdsBot-Google | 1 | 3.35 KB | 31 May 2022 - 07:36 |
| Language Tools Bot (ltbot) | 1 | 3.22 KB | 28 May 2022 - 00:29 |
| Monster | 1 | 4.36 KB | 22 May 2022 - 11:05 |
| Grub.org | 1 | 2.94 KB | 03 May 2022 - 07:39 |
| Bloglines | 1 | 3.22 KB | 16 May 2022 - 10:41 |
| SuperBot | 1 | 3.35 KB | 24 May 2022 - 17:07 |
| LinkBot | 1 | 2.20 MB | 26 May 2022 - 18:11 |
|