| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 90,267+1 | 804.28 GB | 30 Sep 2021 - 23:59 |
| AhrefsBot | 26,532 | 201.84 GB | 30 Sep 2021 - 23:59 |
| Bingbot | 10,848 | 63.54 GB | 30 Sep 2021 - 23:57 |
| DotBot, Open Site Explorer | 4,195 | 37.32 GB | 30 Sep 2021 - 23:48 |
| SemrushBot | 7,313 | 29.71 GB | 30 Sep 2021 - 23:41 |
| Perl tool | 263 | 12.31 MB | 30 Sep 2021 - 23:25 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 494 | 2.42 GB | 30 Sep 2021 - 23:19 |
| Unknown robot (identified by empty user agent string) | 980 | 213.83 GB | 30 Sep 2021 - 23:14 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 2,465 | 1079.28 GB | 30 Sep 2021 - 22:00 |
| Unknown robot (identified by 'crawl') | 5,407 | 14.59 GB | 30 Sep 2021 - 21:36 |
| Yandex Bot | 929 | 5.24 GB | 30 Sep 2021 - 21:25 |
| Suspected bot masqurading as Mozilla | 210 | 5.97 GB | 30 Sep 2021 - 21:15 |
| LinkChecker | 337 | 349.21 MB | 30 Sep 2021 - 20:01 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 345 | 51.91 MB | 30 Sep 2021 - 19:04 |
| Common Crawl | 409 | 5.90 MB | 30 Sep 2021 - 14:57 |
| Unknown robot (identified by 'robot') | 1 | 7.92 KB | 30 Sep 2021 - 14:07 |
| Jakarta commons-httpclient | 30 | 480 Bytes | 30 Sep 2021 - 14:01 |
| Python-urllib | 511 | 285.54 GB | 30 Sep 2021 - 14:00 |
| MJ12bot | 511 | 782.73 MB | 30 Sep 2021 - 12:33 |
| Googlebot | 229 | 332.51 MB | 30 Sep 2021 - 11:21 |
| Java (Often spam bot) | 1,474 | 69.38 GB | 30 Sep 2021 - 11:00 |
| SeznamBot | 14 | 56.81 KB | 30 Sep 2021 - 06:28 |
| Nutch | 830 | 73.10 GB | 30 Sep 2021 - 01:49 |
| BaiDuSpider | 19 | 160.19 MB | 29 Sep 2021 - 17:46 |
| CFNetwork | 19 | 638.62 MB | 28 Sep 2021 - 16:04 |
| Suspected bot masqurading as Mozilla | 3 | 29.09 MB | 28 Sep 2021 - 12:09 |
| Unknown robot (identified by 'spider') | 74 | 224.20 MB | 28 Sep 2021 - 08:51 |
| WordPress | 12 | 29.09 MB | 28 Sep 2021 - 08:42 |
| archive.org bot | 14 | 438.90 MB | 27 Sep 2021 - 19:14 |
| Web Core / Roots | 13 | 266.45 MB | 27 Sep 2021 - 11:33 |
| MojeekBot | 2 | 1.47 MB | 24 Sep 2021 - 19:51 |
| FavIconizer | 1 | 112.44 KB | 23 Sep 2021 - 20:49 |
| Xenu's Link Sleuth (TM), see Wikipedia | 4 | 0 | 23 Sep 2021 - 19:06 |
| Mail.ru bot | 6 | 357.95 KB | 21 Sep 2021 - 13:15 |
| ltx71 | 72 | 3.15 GB | 19 Sep 2021 - 17:25 |
| Unknown robot (identified by hit on 'robots.txt') | 0+2 | 12.48 KB | 15 Sep 2021 - 03:30 |
| FaceBook bot | 1 | 3.58 KB | 14 Sep 2021 - 13:08 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 12 | 49.00 KB | 14 Sep 2021 - 04:53 |
| twitterbot | 2 | 8.87 KB | 13 Sep 2021 - 14:57 |
| SEOkicks Webcrawler | 549 | 9.21 GB | 06 Sep 2021 - 01:14 |
| Bing Preview bot | 1 | 42.93 MB | 05 Sep 2021 - 07:40 |