| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| AhrefsBot | 10,005 | 420.45 GB | 31 Oct 2018 - 23:57 |
| SemrushBot | 1,714 | 4.73 GB | 31 Oct 2018 - 23:55 |
| BaiDuSpider | 1,444 | 1.81 GB | 31 Oct 2018 - 23:59 |
| DotBot, Open Site Explorer | 1,241 | 12.34 GB | 31 Oct 2018 - 22:53 |
| Unknown robot (identified by empty user agent string) | 957 | 27.93 GB | 31 Oct 2018 - 23:18 |
| WGet tools | 818 | 450.03 GB | 31 Oct 2018 - 20:02 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 783 | 57.63 GB | 31 Oct 2018 - 23:59 |
| Python-urllib | 659 | 83.13 GB | 31 Oct 2018 - 23:15 |
| Unknown robot (identified by 'crawl') | 655 | 2.42 GB | 30 Oct 2018 - 06:28 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 305 | 111.77 MB | 31 Oct 2018 - 17:03 |
| Yandex Bot | 269 | 3.09 GB | 31 Oct 2018 - 23:40 |
| Java (Often spam bot) | 196 | 30.95 GB | 31 Oct 2018 - 22:30 |
| Bingbot | 175 | 93.15 MB | 31 Oct 2018 - 23:56 |
| ltx71 | 164 | 13.98 GB | 30 Oct 2018 - 00:47 |
| Perl tool | 149 | 2.90 MB | 31 Oct 2018 - 23:44 |
| Googlebot | 149 | 1.26 GB | 31 Oct 2018 - 14:50 |
| Exabot | 88 | 3.72 GB | 31 Oct 2018 - 19:47 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 57 | 1.11 GB | 31 Oct 2018 - 12:33 |
| Common Crawl | 30 | 10.69 MB | 23 Oct 2018 - 20:49 |
| Jakarta commons-httpclient | 26 | 416 Bytes | 31 Oct 2018 - 08:01 |
| LinkChecker | 20 | 0 | 31 Oct 2018 - 00:43 |
| Alexa (IA Archiver) | 15 | 1.50 MB | 29 Oct 2018 - 13:51 |
| Sogou Spider | 13 | 266.37 KB | 27 Oct 2018 - 02:33 |
| archive.org bot | 12 | 156.81 MB | 30 Oct 2018 - 22:12 |
| CFNetwork | 9 | 186.86 MB | 29 Oct 2018 - 12:37 |
| IDMARCH | 8 | 101.48 MB | 27 Oct 2018 - 11:10 |
| Web Core / Roots | 4 | 65.94 MB | 31 Oct 2018 - 07:45 |
| Turn It In | 3 | 4.25 MB | 23 Oct 2018 - 02:45 |
| 360spider | 3 | 20.87 MB | 24 Oct 2018 - 15:36 |
| SeznamBot | 3 | 13.36 KB | 23 Oct 2018 - 15:29 |
| MJ12bot | 3 | 32.98 MB | 25 Oct 2018 - 19:08 |
| Nutch | 1 | 10.37 KB | 29 Oct 2018 - 04:19 |
| YaCy | 1 | 6.88 KB | 22 Oct 2018 - 03:58 |
| yeti | 1 | 16.49 MB | 21 Oct 2018 - 20:19 |
| Suspected bot masqurading as Mozilla | 1 | 7.51 KB | 19 Oct 2018 - 14:03 |
| Mail.ru bot | 1 | 3.66 KB | 25 Oct 2018 - 06:13 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 18 Oct 2018 - 05:56 |
| Google AdSense | 1 | 16.49 MB | 25 Oct 2018 - 07:09 |
| twitterbot | 1 | 7.64 KB | 24 Oct 2018 - 01:44 |
| Bing Preview bot | 1 | 4.10 MB | 25 Oct 2018 - 14:02 |