| 48 different robots | Hits | Bandwidth | Last visit |
|---|
| AhrefsBot | 7,813 | 290.01 GB | 31 Jan 2020 - 23:03 |
| Python-urllib | 1,564 | 299.71 GB | 31 Jan 2020 - 23:02 |
| Unknown robot (identified by empty user agent string) | 1,562 | 171.24 GB | 31 Jan 2020 - 23:00 |
| SemrushBot | 9,293 | 34.92 GB | 31 Jan 2020 - 22:59 |
| DotBot, Open Site Explorer | 7,007 | 20.05 GB | 31 Jan 2020 - 22:53 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 3,657 | 941.34 GB | 31 Jan 2020 - 22:25 |
| Googlebot | 579 | 13.06 GB | 31 Jan 2020 - 22:06 |
| Unknown robot (identified by 'crawl') | 3,292 | 27.01 GB | 31 Jan 2020 - 21:11 |
| BaiDuSpider | 42 | 71.85 MB | 31 Jan 2020 - 21:06 |
| WGet tools | 3,717 | 889.53 GB | 31 Jan 2020 - 21:00 |
| Yandex Bot | 487 | 73.69 GB | 31 Jan 2020 - 20:50 |
| Bingbot | 184 | 21.17 MB | 31 Jan 2020 - 19:52 |
| Java (Often spam bot) | 1,143 | 30.88 GB | 31 Jan 2020 - 19:16 |
| Perl tool | 277 | 7.49 MB | 31 Jan 2020 - 18:01 |
| LinkChecker | 210 | 0 | 31 Jan 2020 - 15:41 |
| Jakarta commons-httpclient | 43 | 688 Bytes | 31 Jan 2020 - 15:01 |
| FaceBook bot | 104 | 5.29 MB | 31 Jan 2020 - 12:19 |
| Alexa (IA Archiver) | 282 | 356.22 MB | 31 Jan 2020 - 11:55 |
| Suspected bot masqurading as Mozilla | 2 | 59.64 MB | 31 Jan 2020 - 09:26 |
| ltx71 | 35 | 38.84 GB | 30 Jan 2020 - 23:34 |
| CFNetwork | 32 | 952.55 MB | 30 Jan 2020 - 22:00 |
| Turn It In | 40 | 4.19 GB | 30 Jan 2020 - 17:18 |
| Unknown robot (identified by 'robot') | 5 | 17.79 KB | 29 Jan 2020 - 22:15 |
| W3C Validator | 3 | 15.21 KB | 29 Jan 2020 - 19:49 |
| Common Crawl | 108 | 294.58 KB | 29 Jan 2020 - 14:11 |
| YaCy | 8 | 114.25 MB | 29 Jan 2020 - 12:46 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 117 | 721.19 KB | 29 Jan 2020 - 09:05 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,115+1 | 236.93 MB | 28 Jan 2020 - 18:31 |
| Sogou Spider | 7 | 12.24 MB | 28 Jan 2020 - 06:57 |
| archive.org bot | 8 | 233.70 MB | 28 Jan 2020 - 06:25 |
| Bing Preview bot | 4 | 78.53 MB | 28 Jan 2020 - 03:36 |
| Unknown robot (identified by hit on 'robots.txt') | 0+4 | 24.96 KB | 27 Jan 2020 - 14:58 |
| Motor | 1 | 10.37 KB | 27 Jan 2020 - 12:18 |
| SeznamBot | 15 | 81.53 KB | 27 Jan 2020 - 07:50 |
| MJ12bot | 26 | 332.22 KB | 27 Jan 2020 - 03:09 |
| Unknown robot (identified by 'spider') | 3 | 28.34 MB | 26 Jan 2020 - 14:54 |
| Nutch | 5 | 22.26 KB | 26 Jan 2020 - 01:35 |
| microsoft-webdav-miniredir | 1 | 0 | 23 Jan 2020 - 17:09 |
| Google AdSense | 3 | 28.58 MB | 23 Jan 2020 - 16:22 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 10 | 38.85 KB | 21 Jan 2020 - 04:07 |
| Vagabondo | 1 | 6.88 KB | 18 Jan 2020 - 19:23 |
| yie8 | 2 | 0 | 17 Jan 2020 - 17:00 |
| FavIconizer | 11 | 73.37 KB | 16 Jan 2020 - 17:29 |
| Mail.ru bot | 2 | 104.19 KB | 15 Jan 2020 - 04:12 |
| MSNBot | 3 | 62.72 MB | 13 Jan 2020 - 12:55 |
| SEOkicks Webcrawler | 12,979 | 29.84 GB | 10 Jan 2020 - 19:21 |
| Web Core / Roots | 8 | 200.23 MB | 10 Jan 2020 - 12:48 |
| NG 2.x (Exalead) | 1 | 9.49 MB | 05 Jan 2020 - 21:06 |
|