| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| SemrushBot | 4,673 | 397.01 GB | 30 Sep 2021 - 23:57 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 508 | 17.87 GB | 30 Sep 2021 - 23:52 |
| AhrefsBot | 3,459 | 65.28 GB | 30 Sep 2021 - 23:49 |
| DotBot, Open Site Explorer | 482 | 18.01 GB | 30 Sep 2021 - 23:46 |
| Yandex Bot | 1,320 | 32.60 GB | 30 Sep 2021 - 23:41 |
| Web Core / Roots | 1,434 | 2.22 GB | 30 Sep 2021 - 23:15 |
| Unknown robot (identified by empty user agent string) | 221 | 15.86 GB | 30 Sep 2021 - 23:15 |
| Bingbot | 2,132 | 57.58 GB | 30 Sep 2021 - 23:09 |
| WGet tools | 125 | 2.16 GB | 30 Sep 2021 - 23:05 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 18,137 | 121.36 GB | 30 Sep 2021 - 22:50 |
| Googlebot | 1,364 | 13.16 GB | 30 Sep 2021 - 22:10 |
| LinkChecker | 124 | 0 | 30 Sep 2021 - 21:53 |
| Google Web Preview | 168 | 4.15 GB | 30 Sep 2021 - 20:49 |
| SeznamBot | 14 | 83.75 KB | 30 Sep 2021 - 20:36 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 265 | 169.20 MB | 30 Sep 2021 - 19:38 |
| Unknown robot (identified by 'spider') | 364 | 22.34 GB | 30 Sep 2021 - 19:35 |
| rpt-httpclient | 44 | 304.42 MB | 30 Sep 2021 - 18:17 |
| Perl tool | 751 | 3.01 MB | 30 Sep 2021 - 18:07 |
| Mail.ru bot | 10 | 57.49 MB | 30 Sep 2021 - 16:50 |
| Unknown robot (identified by 'crawl') | 3,096 | 138.06 GB | 30 Sep 2021 - 16:11 |
| Common Crawl | 93 | 33.73 MB | 30 Sep 2021 - 15:02 |
| MojeekBot | 19 | 71.60 KB | 30 Sep 2021 - 13:37 |
| Bing Preview bot | 12 | 989.95 MB | 30 Sep 2021 - 13:02 |
| Python-urllib | 128 | 2.01 GB | 30 Sep 2021 - 11:57 |
| MJ12bot | 332 | 16.72 GB | 30 Sep 2021 - 04:41 |
| Nutch | 271 | 25.99 GB | 30 Sep 2021 - 03:45 |
| FaceBook bot | 165 | 870.81 MB | 30 Sep 2021 - 02:15 |
| yeti | 20 | 154.71 MB | 30 Sep 2021 - 02:00 |
| twitterbot | 1 | 2.47 KB | 29 Sep 2021 - 09:58 |
| BaiDuSpider | 12 | 333.93 MB | 28 Sep 2021 - 10:39 |
| Cfetch | 1 | 7.92 MB | 27 Sep 2021 - 17:14 |
| Motor | 1 | 7.46 MB | 23 Sep 2021 - 22:22 |
| Sogou Spider | 7 | 4.65 MB | 22 Sep 2021 - 18:29 |
| CFNetwork | 11 | 297.82 MB | 21 Sep 2021 - 09:15 |
| Suspected bot masqurading as Mozilla | 4 | 0 | 21 Sep 2021 - 03:15 |
| Unknown robot (identified by 'sucker') | 4 | 32.55 MB | 18 Sep 2021 - 07:57 |
| Y!J Yahoo Japan | 1 | 8.11 MB | 18 Sep 2021 - 00:01 |
| ltx71 | 22 | 2.65 GB | 17 Sep 2021 - 05:50 |
| Java (Often spam bot) | 18 | 958.55 MB | 16 Sep 2021 - 22:08 |
| Emacs-w3 Search Engine | 2 | 15.84 MB | 16 Sep 2021 - 07:05 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 2 | 6.17 KB | 15 Sep 2021 - 07:26 |
| LinkBot | 1 | 0 | 08 Sep 2021 - 16:42 |
| SEOkicks Webcrawler | 9 | 30.24 KB | 05 Sep 2021 - 21:50 |
|