| 52 different robots | Hits | Bandwidth | Last visit |
|---|
| Bingbot | 1,177 | 1.04 GB | 30 Jun 2020 - 23:58 |
| AhrefsBot | 16,213 | 2746.71 GB | 30 Jun 2020 - 23:58 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 3,065 | 663.63 GB | 30 Jun 2020 - 23:54 |
| WGet tools | 3,494 | 711.81 GB | 30 Jun 2020 - 23:49 |
| SemrushBot | 9,452 | 49.59 GB | 30 Jun 2020 - 23:46 |
| Yandex Bot | 418 | 708.38 MB | 30 Jun 2020 - 23:44 |
| Heritrix | 4 | 52.37 MB | 30 Jun 2020 - 23:38 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,760 | 36.03 GB | 30 Jun 2020 - 23:31 |
| DotBot, Open Site Explorer | 4,515 | 33.93 GB | 30 Jun 2020 - 23:24 |
| LinkChecker | 268 | 0 | 30 Jun 2020 - 23:13 |
| Perl tool | 270 | 7.48 MB | 30 Jun 2020 - 23:04 |
| Python-urllib | 647 | 281.77 GB | 30 Jun 2020 - 23:02 |
| Unknown robot (identified by empty user agent string) | 1,690 | 106.36 GB | 30 Jun 2020 - 23:00 |
| Googlebot | 191 | 179.63 MB | 30 Jun 2020 - 22:17 |
| Unknown robot (identified by 'crawl') | 22,779+1 | 193.93 GB | 30 Jun 2020 - 21:50 |
| Java (Often spam bot) | 1,193 | 4.28 GB | 30 Jun 2020 - 21:14 |
| ning | 13 | 169.43 MB | 30 Jun 2020 - 19:39 |
| Unknown robot (identified by 'spider') | 66 | 161.31 MB | 30 Jun 2020 - 17:44 |
| SEOkicks Webcrawler | 28,413 | 118.40 GB | 30 Jun 2020 - 17:28 |
| Web Core / Roots | 12 | 344.31 MB | 30 Jun 2020 - 17:26 |
| Jakarta commons-httpclient | 30 | 480 Bytes | 30 Jun 2020 - 14:01 |
| Unknown robot (identified by 'checker') | 2 | 9.74 KB | 30 Jun 2020 - 13:38 |
| Google AdSense | 7 | 80.23 MB | 30 Jun 2020 - 11:22 |
| BaiDuSpider | 23 | 26.33 MB | 30 Jun 2020 - 10:04 |
| CFNetwork | 50 | 1.50 GB | 30 Jun 2020 - 07:26 |
| SeznamBot | 20 | 87.61 KB | 29 Jun 2020 - 20:01 |
| FaceBook bot | 95 | 36.01 MB | 29 Jun 2020 - 12:42 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 3,456+2 | 313.41 MB | 29 Jun 2020 - 05:06 |
| yie8 | 1 | 0 | 28 Jun 2020 - 15:44 |
| FavIconizer | 6 | 116.86 MB | 28 Jun 2020 - 13:56 |
| MJ12bot | 593 | 202.65 GB | 28 Jun 2020 - 04:36 |
| Cliqzbot | 1 | 2.96 KB | 28 Jun 2020 - 01:48 |
| Alexa (IA Archiver) | 54 | 268.26 KB | 27 Jun 2020 - 23:07 |
| ltx71 | 23 | 250.54 MB | 27 Jun 2020 - 12:48 |
| Mail.ru bot | 5 | 24.51 KB | 27 Jun 2020 - 12:18 |
| archive.org bot | 8 | 237.87 MB | 27 Jun 2020 - 01:07 |
| MojeekBot | 1 | 58.81 KB | 25 Jun 2020 - 10:31 |
| Powermarks | 6 | 31.22 KB | 23 Jun 2020 - 17:33 |
| Unknown robot (identified by 'robot') | 1 | 8.04 KB | 22 Jun 2020 - 14:29 |
| WordPress | 8 | 0 | 21 Jun 2020 - 21:49 |
| microsoft-webdav-miniredir | 2 | 0 | 21 Jun 2020 - 08:38 |
| Bing Preview bot | 4 | 4.36 MB | 16 Jun 2020 - 02:41 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 13 Jun 2020 - 13:21 |
| 360spider | 2 | 9.74 KB | 12 Jun 2020 - 20:53 |
| Sogou Spider | 1 | 58.81 KB | 09 Jun 2020 - 05:14 |
| Motor | 2 | 369.61 MB | 08 Jun 2020 - 17:03 |
| Phantom | 2 | 18.79 MB | 05 Jun 2020 - 03:25 |
| Common Crawl | 2 | 62.02 KB | 04 Jun 2020 - 18:52 |
| twitterbot | 1 | 28.69 MB | 04 Jun 2020 - 05:02 |
| Turn It In | 1 | 777.78 KB | 03 Jun 2020 - 12:27 |
| Suspected bot masqurading as Mozilla | 2 | 0 | 02 Jun 2020 - 16:09 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 20.33 MB | 02 Jun 2020 - 12:23 |
|