| 47 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 30,253+2 | 174.90 GB | 31 Aug 2019 - 23:02 |
| WGet tools | 8,556 | 4552.16 GB | 31 Aug 2019 - 23:33 |
| SemrushBot | 7,587 | 33.08 GB | 31 Aug 2019 - 23:47 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 4,614+3 | 509.26 MB | 31 Aug 2019 - 23:10 |
| Yandex Bot | 3,809 | 440.32 GB | 31 Aug 2019 - 20:54 |
| AhrefsBot | 2,612 | 852.40 GB | 31 Aug 2019 - 23:25 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 2,183 | 396.68 GB | 31 Aug 2019 - 23:50 |
| Java (Often spam bot) | 1,581 | 78.27 GB | 31 Aug 2019 - 12:00 |
| Unknown robot (identified by empty user agent string) | 1,116 | 119.94 GB | 31 Aug 2019 - 23:57 |
| BaiDuSpider | 904 | 1021.81 MB | 31 Aug 2019 - 08:23 |
| Googlebot | 382 | 5.83 GB | 31 Aug 2019 - 23:54 |
| Bingbot | 325 | 1.22 GB | 31 Aug 2019 - 14:07 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 268 | 165.57 MB | 31 Aug 2019 - 19:00 |
| Python-urllib | 200 | 173.37 GB | 31 Aug 2019 - 14:00 |
| LinkChecker | 167 | 0 | 31 Aug 2019 - 13:26 |
| DotBot, Open Site Explorer | 141 | 70.53 MB | 31 Aug 2019 - 23:42 |
| Perl tool | 134 | 1.91 MB | 30 Aug 2019 - 20:48 |
| Jakarta commons-httpclient | 58 | 928 Bytes | 31 Aug 2019 - 15:00 |
| CFNetwork | 49 | 1.03 GB | 30 Aug 2019 - 02:01 |
| ltx71 | 46 | 24.49 GB | 31 Aug 2019 - 02:55 |
| Alexa (IA Archiver) | 42 | 312.03 KB | 30 Aug 2019 - 22:59 |
| Common Crawl | 26 | 217.92 KB | 24 Aug 2019 - 07:48 |
| Web Core / Roots | 13 | 325.46 MB | 31 Aug 2019 - 12:59 |
| FavIconizer | 12 | 108.52 MB | 31 Aug 2019 - 11:31 |
| Unknown robot (identified by 'spider') | 11 | 21.62 MB | 28 Aug 2019 - 11:55 |
| SeznamBot | 10 | 46.30 KB | 30 Aug 2019 - 18:40 |
| Sogou Spider | 10 | 12.19 MB | 30 Aug 2019 - 16:10 |
| Google AdSense | 8 | 11.59 MB | 29 Aug 2019 - 16:35 |
| archive.org bot | 8 | 194.61 MB | 28 Aug 2019 - 12:14 |
| Cliqzbot | 7 | 1.53 MB | 09 Aug 2019 - 23:53 |
| Exabot | 7 | 78.86 KB | 05 Aug 2019 - 02:09 |
| MJ12bot | 5 | 5.97 KB | 16 Aug 2019 - 16:02 |
| Motor | 4 | 17.28 KB | 06 Aug 2019 - 12:40 |
| Wotbox | 4 | 18.98 KB | 20 Aug 2019 - 09:50 |
| Mail.ru bot | 3 | 21.01 KB | 22 Aug 2019 - 19:05 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 3 | 17.44 KB | 23 Aug 2019 - 17:57 |
| yeti | 2 | 54.24 MB | 25 Aug 2019 - 19:52 |
| Suspected bot masqurading as Mozilla | 2 | 54.24 MB | 26 Aug 2019 - 23:39 |
| GigaBot | 2 | 9.77 KB | 10 Aug 2019 - 21:59 |
| Nutch | 1 | 1.45 MB | 24 Aug 2019 - 05:04 |
| 360spider | 1 | 6.88 KB | 20 Aug 2019 - 01:21 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 10 Aug 2019 - 17:09 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 27 Aug 2019 - 14:57 |
| twitterbot | 1 | 2.94 GB | 22 Aug 2019 - 20:36 |
| Vagabondo | 1 | 7.00 KB | 16 Aug 2019 - 05:38 |
| Bing Preview bot | 1 | 1.10 GB | 01 Aug 2019 - 03:55 |
| DragonBot | 1 | 3.46 KB | 27 Aug 2019 - 18:29 |
|