| 46 different robots | Hits | Bandwidth | Last visit |
|---|
| SEOkicks Webcrawler | 28,145 | 217.50 GB | 28 Dec 2019 - 14:12 |
| AhrefsBot | 15,485 | 177.85 GB | 31 Dec 2019 - 23:56 |
| SemrushBot | 9,255 | 38.38 GB | 31 Dec 2019 - 23:54 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 3,452 | 758.57 GB | 31 Dec 2019 - 23:11 |
| WGet tools | 2,839 | 981.58 GB | 31 Dec 2019 - 22:40 |
| Unknown robot (identified by 'crawl') | 2,664 | 67.37 GB | 31 Dec 2019 - 19:30 |
| DotBot, Open Site Explorer | 2,655+1 | 122.32 GB | 31 Dec 2019 - 23:28 |
| Unknown robot (identified by empty user agent string) | 1,642 | 95.12 GB | 31 Dec 2019 - 23:00 |
| Python-urllib | 1,417 | 166.02 GB | 31 Dec 2019 - 14:00 |
| Java (Often spam bot) | 941 | 36.03 GB | 30 Dec 2019 - 09:07 |
| Googlebot | 539 | 4.94 GB | 31 Dec 2019 - 22:16 |
| Yandex Bot | 480 | 2.40 GB | 31 Dec 2019 - 23:59 |
| Perl tool | 317 | 9.97 GB | 31 Dec 2019 - 23:46 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 313 | 42.90 MB | 17 Dec 2019 - 14:13 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 300 | 768.11 MB | 31 Dec 2019 - 22:41 |
| Bingbot | 255 | 70.77 MB | 31 Dec 2019 - 19:06 |
| FaceBook bot | 205 | 10.42 MB | 30 Dec 2019 - 14:17 |
| Alexa (IA Archiver) | 193 | 858.72 KB | 31 Dec 2019 - 17:07 |
| LinkChecker | 178 | 0 | 31 Dec 2019 - 23:08 |
| CFNetwork | 90 | 2.62 GB | 31 Dec 2019 - 07:01 |
| MJ12bot | 77 | 112.59 MB | 26 Dec 2019 - 12:46 |
| Turn It In | 46 | 5.46 MB | 22 Dec 2019 - 21:15 |
| Jakarta commons-httpclient | 46 | 736 Bytes | 31 Dec 2019 - 15:01 |
| BaiDuSpider | 37 | 130.04 MB | 31 Dec 2019 - 13:54 |
| Common Crawl | 33 | 172.08 KB | 16 Dec 2019 - 06:13 |
| ltx71 | 31 | 6.04 MB | 27 Dec 2019 - 06:54 |
| SeznamBot | 17 | 77.56 KB | 31 Dec 2019 - 19:46 |
| Web Core / Roots | 11 | 286.04 MB | 24 Dec 2019 - 05:22 |
| archive.org bot | 8 | 233.70 MB | 29 Dec 2019 - 10:46 |
| Bing Preview bot | 5 | 67.60 MB | 25 Dec 2019 - 18:02 |
| Suspected bot masqurading as Mozilla | 4 | 0 | 27 Dec 2019 - 15:06 |
| Mail.ru bot | 4 | 110.98 KB | 22 Dec 2019 - 11:27 |
| MSNBot | 4 | 37.78 MB | 18 Dec 2019 - 01:13 |
| Unknown robot (identified by 'spider') | 4 | 51.75 MB | 25 Dec 2019 - 06:43 |
| yie8 | 3 | 0 | 28 Dec 2019 - 14:53 |
| Google AdSense | 3 | 58.59 MB | 20 Dec 2019 - 21:43 |
| FavIconizer | 3 | 28.61 MB | 19 Dec 2019 - 06:58 |
| Unknown robot (identified by hit on 'robots.txt') | 0+3 | 18.72 KB | 07 Dec 2019 - 10:16 |
| Exabot | 2 | 13.76 KB | 23 Dec 2019 - 06:18 |
| ning | 2 | 57.21 MB | 27 Dec 2019 - 10:17 |
| LinkBot | 2 | 5.62 KB | 13 Dec 2019 - 13:35 |
| HTTrack off-line browser | 1 | 1.60 MB | 20 Dec 2019 - 14:05 |
| Unknown robot (identified by 'robot') | 1 | 3.46 KB | 12 Dec 2019 - 10:44 |
| Sogou Spider | 1 | 7.00 KB | 12 Dec 2019 - 12:20 |
| DragonBot | 1 | 3.58 KB | 01 Dec 2019 - 18:36 |
| Suspected bot masqurading as Mozilla | 1 | 174.64 MB | 17 Dec 2019 - 22:40 |
|