| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 89,114+1 | 890.55 GB | 31 Aug 2020 - 20:11 |
| AhrefsBot | 24,965 | 1773.98 GB | 31 Aug 2020 - 21:08 |
| Bingbot | 10,058 | 7.78 GB | 31 Aug 2020 - 21:07 |
| SemrushBot | 9,101 | 62.25 GB | 31 Aug 2020 - 21:07 |
| Unknown robot (identified by 'crawl') | 8,443+1 | 191.83 GB | 31 Aug 2020 - 21:09 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 8,059 | 885.75 GB | 31 Aug 2020 - 21:04 |
| DotBot, Open Site Explorer | 3,256+1 | 15.52 GB | 31 Aug 2020 - 18:47 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 2,928 | 323.97 MB | 28 Aug 2020 - 10:01 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,280 | 82.59 GB | 31 Aug 2020 - 21:00 |
| Unknown robot (identified by empty user agent string) | 2,049 | 125.05 GB | 31 Aug 2020 - 21:00 |
| Yandex Bot | 736 | 1.27 GB | 31 Aug 2020 - 20:59 |
| CFNetwork | 734 | 21.91 GB | 31 Aug 2020 - 17:25 |
| Python-urllib | 669 | 237.39 GB | 31 Aug 2020 - 14:00 |
| Unknown robot (identified by 'spider') | 574 | 4.65 GB | 31 Aug 2020 - 20:55 |
| MJ12bot | 558 | 112.72 GB | 31 Aug 2020 - 18:56 |
| Googlebot | 425 | 3.98 GB | 31 Aug 2020 - 16:37 |
| LinkChecker | 292 | 0 | 31 Aug 2020 - 20:57 |
| Perl tool | 281 | 9.21 MB | 31 Aug 2020 - 17:00 |
| Java (Often spam bot) | 172 | 640.60 MB | 31 Aug 2020 - 13:39 |
| Alexa (IA Archiver) | 81 | 53.01 MB | 27 Aug 2020 - 12:16 |
| Web Core / Roots | 71 | 1.73 GB | 30 Aug 2020 - 11:02 |
| ltx71 | 70 | 77.56 GB | 27 Aug 2020 - 22:08 |
| FaceBook bot | 62 | 96.38 MB | 31 Aug 2020 - 16:54 |
| Common Crawl | 53 | 46.52 MB | 11 Aug 2020 - 10:46 |
| Suspected bot masqurading as Mozilla | 50 | 10.03 GB | 26 Aug 2020 - 10:33 |
| Jakarta commons-httpclient | 31 | 496 Bytes | 31 Aug 2020 - 14:01 |
| Google AdSense | 28 | 694.35 MB | 31 Aug 2020 - 18:16 |
| Suspected bot masqurading as Mozilla | 22 | 640.37 MB | 28 Aug 2020 - 07:05 |
| FavIconizer | 16 | 3.35 GB | 18 Aug 2020 - 02:49 |
| WordPress | 15 | 0 | 23 Aug 2020 - 17:43 |
| yie8 | 12 | 33.09 MB | 28 Aug 2020 - 10:21 |
| SeznamBot | 11 | 50.08 KB | 30 Aug 2020 - 19:14 |
| archive.org bot | 10 | 299.52 MB | 30 Aug 2020 - 14:32 |
| Motor | 6 | 23.27 KB | 03 Aug 2020 - 22:23 |
| MSIECrawler | 6 | 31.48 KB | 05 Aug 2020 - 08:44 |
| Powermarks | 6 | 25.74 KB | 09 Aug 2020 - 21:19 |
| BaiDuSpider | 4 | 957.70 KB | 24 Aug 2020 - 18:01 |
| Sogou Spider | 3 | 190.06 KB | 05 Aug 2020 - 11:23 |
| Unknown robot (identified by 'checker') | 2 | 9.74 KB | 18 Aug 2020 - 10:54 |
| ning | 2 | 29.18 MB | 24 Aug 2020 - 11:09 |
| Suspected bot masqurading as Mozilla | 2 | 16.09 KB | 07 Aug 2020 - 15:24 |
| Yahoo Slurp | 1 | 3.58 KB | 22 Aug 2020 - 19:04 |
| Bing Preview bot | 1 | 9.45 MB | 04 Aug 2020 - 08:01 |
|