| 45 different robots | Hits | Bandwidth | Last visit |
|---|
| SemrushBot | 7,300 | 320.19 GB | 31 Aug 2021 - 21:10 |
| Unknown robot (identified by empty user agent string) | 741 | 36.40 GB | 31 Aug 2021 - 21:09 |
| DotBot, Open Site Explorer | 4,528 | 38.03 GB | 31 Aug 2021 - 21:08 |
| Unknown robot (identified by 'crawl') | 4,314 | 19.17 GB | 31 Aug 2021 - 21:08 |
| AhrefsBot | 14,698 | 282.36 GB | 31 Aug 2021 - 21:06 |
| Bingbot | 20,942 | 62.56 GB | 31 Aug 2021 - 21:03 |
| Suspected bot masqurading as Mozilla | 162 | 4.60 GB | 31 Aug 2021 - 21:02 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 2,699 | 754.76 GB | 31 Aug 2021 - 20:11 |
| Unknown robot (identified by 'spider') | 402 | 271.93 MB | 31 Aug 2021 - 20:09 |
| WGet tools | 3,351 | 813.94 GB | 31 Aug 2021 - 20:02 |
| Python-urllib | 584 | 369.14 GB | 31 Aug 2021 - 19:42 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,969 | 21.65 GB | 31 Aug 2021 - 19:11 |
| LinkChecker | 330 | 0 | 31 Aug 2021 - 17:16 |
| Perl tool | 258 | 11.93 MB | 31 Aug 2021 - 16:47 |
| Googlebot | 17,096 | 2.67 GB | 31 Aug 2021 - 16:43 |
| Nutch | 1,566 | 75.94 GB | 31 Aug 2021 - 15:23 |
| Yandex Bot | 474 | 4.39 GB | 31 Aug 2021 - 15:09 |
| Web Core / Roots | 20 | 486.53 MB | 31 Aug 2021 - 14:47 |
| Jakarta commons-httpclient | 31 | 496 Bytes | 31 Aug 2021 - 14:01 |
| Java (Often spam bot) | 442 | 242.84 GB | 31 Aug 2021 - 13:46 |
| CFNetwork | 21 | 705.84 MB | 30 Aug 2021 - 22:18 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 595 | 106.90 MB | 30 Aug 2021 - 21:18 |
| ltx71 | 65 | 926.33 MB | 30 Aug 2021 - 18:06 |
| WordPress | 8 | 87.26 MB | 30 Aug 2021 - 16:43 |
| SeznamBot | 10 | 37.95 KB | 30 Aug 2021 - 16:20 |
| SEOkicks Webcrawler | 38 | 291.49 KB | 30 Aug 2021 - 03:27 |
| MJ12bot | 1,389 | 510.60 MB | 29 Aug 2021 - 21:54 |
| YaCy | 3 | 1.23 MB | 27 Aug 2021 - 23:55 |
| Google AdSense | 5 | 90.16 MB | 27 Aug 2021 - 23:46 |
| Unknown robot (identified by 'robot') | 3 | 16.49 KB | 26 Aug 2021 - 18:56 |
| Mail.ru bot | 3 | 119.48 KB | 26 Aug 2021 - 15:12 |
| Xenu's Link Sleuth (TM), see Wikipedia | 4 | 0 | 26 Aug 2021 - 11:40 |
| archive.org bot | 9 | 279.89 MB | 25 Aug 2021 - 08:59 |
| BaiDuSpider | 8 | 168.05 MB | 21 Aug 2021 - 22:00 |
| FaceBook bot | 5 | 33.63 MB | 21 Aug 2021 - 06:16 |
| FavIconizer | 2 | 58.18 MB | 20 Aug 2021 - 12:36 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 20 | 108.84 MB | 18 Aug 2021 - 05:33 |
| MojeekBot | 1 | 3.58 KB | 16 Aug 2021 - 11:18 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 12 Aug 2021 - 02:51 |
| Bing Preview bot | 1 | 4.03 MB | 08 Aug 2021 - 02:12 |
| twitterbot | 3 | 114.40 MB | 07 Aug 2021 - 04:26 |
| Steeler | 1 | 0 | 06 Aug 2021 - 15:25 |
| Common Crawl | 175 | 2.06 MB | 05 Aug 2021 - 22:59 |
| microsoft-webdav-miniredir | 1 | 0 | 05 Aug 2021 - 16:44 |
| Motor | 1 | 29.09 MB | 05 Aug 2021 - 14:53 |
|