| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 3,963 | 793.63 GB | 31 May 2021 - 22:09 |
| Bingbot | 24,417+2 | 264.64 GB | 31 May 2021 - 22:09 |
| SemrushBot | 8,963 | 25.97 GB | 31 May 2021 - 22:06 |
| Unknown robot (identified by 'crawl') | 16,249 | 35.51 GB | 31 May 2021 - 22:06 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 17,912 | 152.15 GB | 31 May 2021 - 22:03 |
| Unknown robot (identified by empty user agent string) | 1,206 | 238.18 GB | 31 May 2021 - 22:00 |
| Suspected bot masqurading as Mozilla | 783 | 22.24 GB | 31 May 2021 - 22:00 |
| DotBot, Open Site Explorer | 1,245 | 455.71 MB | 31 May 2021 - 21:51 |
| LinkChecker | 366 | 58.20 MB | 31 May 2021 - 20:50 |
| AhrefsBot | 14,115 | 681.33 GB | 31 May 2021 - 19:04 |
| Python-urllib | 643 | 254.52 GB | 31 May 2021 - 18:29 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 559 | 109.34 MB | 31 May 2021 - 18:18 |
| Googlebot | 289 | 68.92 MB | 31 May 2021 - 17:26 |
| Perl tool | 276 | 12.96 MB | 31 May 2021 - 17:02 |
| Jakarta commons-httpclient | 31 | 496 Bytes | 31 May 2021 - 14:01 |
| WGet tools | 93,169+1 | 940.10 GB | 31 May 2021 - 11:48 |
| Java (Often spam bot) | 1,932 | 72.48 GB | 31 May 2021 - 11:00 |
| Web Core / Roots | 37 | 809.74 MB | 31 May 2021 - 10:29 |
| Yandex Bot | 274 | 851.94 MB | 31 May 2021 - 06:22 |
| MJ12bot | 140 | 8.21 MB | 31 May 2021 - 04:42 |
| CFNetwork | 179 | 5.97 GB | 30 May 2021 - 22:57 |
| archive.org bot | 12 | 380.68 MB | 30 May 2021 - 20:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+4 | 24.96 KB | 29 May 2021 - 21:25 |
| Unknown robot (identified by 'robot') | 28 | 367.89 MB | 29 May 2021 - 18:09 |
| Simmany Robot Ver1.0 | 4 | 124.69 KB | 28 May 2021 - 15:40 |
| ltx71 | 89 | 27.19 GB | 28 May 2021 - 12:44 |
| Unknown robot (identified by 'spider') | 99 | 114.46 MB | 27 May 2021 - 20:52 |
| SeznamBot | 6 | 28.24 KB | 27 May 2021 - 10:28 |
| Xenu's Link Sleuth (TM), see Wikipedia | 3 | 0 | 25 May 2021 - 18:00 |
| Mail.ru bot | 1 | 3.58 KB | 19 May 2021 - 18:27 |
| Common Crawl | 206 | 389.68 MB | 18 May 2021 - 13:13 |
| BaiDuSpider | 5 | 164.28 MB | 18 May 2021 - 01:45 |
| Google AdSense | 3 | 84.98 MB | 17 May 2021 - 23:08 |
| SEOkicks Webcrawler | 4 | 19.23 KB | 17 May 2021 - 01:52 |
| FavIconizer | 2 | 58.17 MB | 16 May 2021 - 08:11 |
| Drupal Site | 1 | 3.58 KB | 15 May 2021 - 18:49 |
| Bing Preview bot | 7 | 75.75 MB | 12 May 2021 - 11:53 |
| HTTrack off-line browser | 5 | 161.25 MB | 12 May 2021 - 02:23 |
| Suspected bot masqurading as Mozilla | 1 | 0 | 10 May 2021 - 14:08 |
| WordPress | 6 | 0 | 08 May 2021 - 17:07 |
| FaceBook bot | 9 | 261.78 MB | 06 May 2021 - 12:36 |
|