| 48 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 68,833+3 | 335.27 GB | 31 Oct 2019 - 22:41 |
| SemrushBot | 9,058 | 35.10 GB | 31 Oct 2019 - 23:52 |
| AhrefsBot | 7,265 | 239.22 GB | 31 Oct 2019 - 23:54 |
| WGet tools | 6,447 | 794.87 GB | 31 Oct 2019 - 20:00 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 6,078+1 | 453.50 MB | 30 Oct 2019 - 08:25 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 4,125 | 661.76 GB | 31 Oct 2019 - 23:18 |
| GigaBot | 3,303 | 1.24 GB | 06 Oct 2019 - 14:59 |
| Googlebot | 3,003 | 2.76 GB | 31 Oct 2019 - 23:22 |
| DotBot, Open Site Explorer | 2,426 | 9.29 GB | 31 Oct 2019 - 23:05 |
| Unknown robot (identified by empty user agent string) | 2,285 | 114.17 GB | 31 Oct 2019 - 23:00 |
| Unknown robot (identified by 'crawl') | 1,687 | 66.43 GB | 29 Oct 2019 - 12:49 |
| Yandex Bot | 1,619 | 51.30 GB | 31 Oct 2019 - 23:27 |
| Java (Often spam bot) | 1,519 | 51.71 GB | 31 Oct 2019 - 18:35 |
| Python-urllib | 1,377 | 188.06 GB | 31 Oct 2019 - 14:00 |
| CFNetwork | 389 | 9.01 GB | 31 Oct 2019 - 07:21 |
| Alexa (IA Archiver) | 317 | 237.34 MB | 31 Oct 2019 - 21:19 |
| Bingbot | 312 | 197.81 MB | 31 Oct 2019 - 18:44 |
| FaceBook bot | 291 | 14.10 MB | 31 Oct 2019 - 09:56 |
| Perl tool | 279 | 6.94 MB | 31 Oct 2019 - 23:47 |
| LinkChecker | 235 | 0 | 31 Oct 2019 - 22:20 |
| ltx71 | 170 | 13.36 GB | 26 Oct 2019 - 22:55 |
| Jakarta commons-httpclient | 47 | 752 Bytes | 31 Oct 2019 - 14:01 |
| Common Crawl | 21 | 1.32 MB | 22 Oct 2019 - 12:14 |
| Web Core / Roots | 18 | 458.88 MB | 31 Oct 2019 - 11:45 |
| Turn It In | 16 | 52.94 KB | 20 Oct 2019 - 11:53 |
| MJ12bot | 13 | 115.50 MB | 29 Oct 2019 - 13:05 |
| Sogou Spider | 11 | 12.29 MB | 30 Oct 2019 - 16:26 |
| BaiDuSpider | 11 | 6.90 MB | 14 Oct 2019 - 16:15 |
| SeznamBot | 10 | 52.15 KB | 30 Oct 2019 - 23:41 |
| archive.org bot | 8 | 226.10 MB | 28 Oct 2019 - 20:32 |
| Google AdSense | 7 | 37.26 MB | 28 Oct 2019 - 07:11 |
| Unknown robot (identified by 'spider') | 5 | 63.06 MB | 31 Oct 2019 - 20:12 |
| yie8 | 5 | 0 | 30 Oct 2019 - 11:48 |
| 360spider | 4 | 2.06 MB | 20 Oct 2019 - 10:38 |
| Simmany Robot Ver1.0 | 4 | 27.90 MB | 18 Oct 2019 - 13:50 |
| Unknown robot (identified by 'robot') | 3 | 13.96 KB | 31 Oct 2019 - 10:38 |
| HTTrack off-line browser | 3 | 1.23 MB | 23 Oct 2019 - 10:54 |
| ning | 3 | 85.75 MB | 27 Oct 2019 - 12:33 |
| WordPress | 3 | 0 | 09 Oct 2019 - 13:43 |
| twitterbot | 3 | 47.56 MB | 19 Oct 2019 - 16:57 |
| YaCy | 2 | 9.62 KB | 28 Oct 2019 - 12:58 |
| Heritrix | 2 | 48.65 MB | 08 Oct 2019 - 23:54 |
| Nutch | 2 | 9.74 KB | 29 Oct 2019 - 15:53 |
| FavIconizer | 2 | 28.59 MB | 24 Oct 2019 - 13:03 |
| Mail.ru bot | 2 | 7.04 KB | 04 Oct 2019 - 19:09 |
| DragonBot | 2 | 7.17 KB | 30 Oct 2019 - 18:04 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 10.42 KB | 18 Oct 2019 - 05:41 |
| Bing Preview bot | 1 | 28.59 MB | 31 Oct 2019 - 01:55 |
|