| 45 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 19,643 | 126.55 GB | 30 Apr 2021 - 22:57 |
| Unknown robot (identified by 'crawl') | 10,623 | 700.43 GB | 30 Apr 2021 - 21:56 |
| AhrefsBot | 5,961 | 161.40 GB | 30 Apr 2021 - 22:53 |
| Bingbot | 4,198 | 59.33 GB | 30 Apr 2021 - 23:09 |
| SemrushBot | 4,173 | 314.03 GB | 30 Apr 2021 - 23:01 |
| Web Core / Roots | 1,373 | 2.63 GB | 30 Apr 2021 - 23:08 |
| Googlebot | 866 | 10.32 GB | 30 Apr 2021 - 23:03 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 793 | 38.22 GB | 30 Apr 2021 - 23:03 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 450 | 346.95 MB | 30 Apr 2021 - 22:04 |
| Unknown robot (identified by 'spider') | 397 | 4.10 GB | 30 Apr 2021 - 21:14 |
| DotBot, Open Site Explorer | 363 | 1.12 GB | 30 Apr 2021 - 22:56 |
| Unknown robot (identified by empty user agent string) | 269 | 19.75 GB | 30 Apr 2021 - 08:12 |
| MJ12bot | 264 | 8.75 GB | 30 Apr 2021 - 18:54 |
| Google Web Preview | 204 | 4.19 GB | 30 Apr 2021 - 17:54 |
| Yandex Bot | 160 | 7.46 GB | 30 Apr 2021 - 21:53 |
| LinkChecker | 132 | 0 | 29 Apr 2021 - 20:38 |
| Unknown robot (identified by 'checker') | 96 | 3.57 GB | 30 Apr 2021 - 22:39 |
| Unknown robot (identified by 'robot') | 90 | 2.08 GB | 09 Apr 2021 - 02:48 |
| WGet tools | 64 | 4.90 GB | 29 Apr 2021 - 22:07 |
| ltx71 | 61 | 5.58 GB | 29 Apr 2021 - 02:59 |
| Common Crawl | 59 | 272.86 MB | 22 Apr 2021 - 02:34 |
| FaceBook bot | 58 | 490.04 MB | 30 Apr 2021 - 07:23 |
| Bing Preview bot | 43 | 2.45 GB | 28 Apr 2021 - 09:08 |
| yeti | 29 | 292.09 MB | 25 Apr 2021 - 20:27 |
| Java (Often spam bot) | 26 | 582.98 MB | 29 Apr 2021 - 00:00 |
| CFNetwork | 22 | 526.29 MB | 28 Apr 2021 - 19:36 |
| FavIconizer | 19 | 756.61 MB | 30 Apr 2021 - 03:49 |
| Python-urllib | 17 | 1.69 GB | 20 Apr 2021 - 05:11 |
| BaiDuSpider | 14 | 316.05 MB | 28 Apr 2021 - 09:18 |
| GetURL | 13 | 583.27 MB | 26 Apr 2021 - 18:08 |
| Motor | 10 | 656.94 MB | 30 Apr 2021 - 04:06 |
| SeznamBot | 9 | 15.81 MB | 30 Apr 2021 - 20:19 |
| SEOkicks Webcrawler | 8 | 52.87 KB | 16 Apr 2021 - 05:01 |
| WordPress | 8 | 0 | 13 Apr 2021 - 05:07 |
| ning | 7 | 550.55 MB | 25 Apr 2021 - 20:03 |
| Sogou Spider | 7 | 5.57 MB | 27 Apr 2021 - 21:50 |
| Nutch | 6 | 31.65 MB | 09 Apr 2021 - 20:27 |
| twitterbot | 5 | 254.86 MB | 24 Apr 2021 - 14:59 |
| rpt-httpclient | 5 | 380.53 MB | 19 Apr 2021 - 20:01 |
| Mail.ru bot | 4 | 30.11 MB | 28 Apr 2021 - 08:32 |
| archive.org bot | 4 | 40.67 KB | 13 Apr 2021 - 15:27 |
| Suspected bot masqurading as Mozilla | 3 | 0 | 24 Apr 2021 - 02:22 |
| Perl tool | 3 | 7.93 MB | 06 Apr 2021 - 09:49 |
| 360spider | 3 | 10.93 KB | 14 Apr 2021 - 19:13 |
| ichiro | 2 | 6.04 KB | 09 Apr 2021 - 03:25 |
|