| 33 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 15,795 | 133.43 MB | 30 Sep 2020 - 23:55 |
| SemrushBot | 12,990 | 796.82 MB | 30 Sep 2020 - 23:59 |
| AhrefsBot | 11,293 | 1.47 GB | 30 Sep 2020 - 23:49 |
| Unknown robot (identified by empty user agent string) | 3,576 | 980.93 KB | 27 Sep 2020 - 18:36 |
| Bingbot | 2,914 | 885.55 MB | 30 Sep 2020 - 23:40 |
| Unknown robot (identified by 'crawl') | 2,119 | 156.95 MB | 30 Sep 2020 - 16:52 |
| DotBot, Open Site Explorer | 1,593 | 111.88 MB | 30 Sep 2020 - 21:46 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 904 | 60.03 MB | 30 Sep 2020 - 23:47 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 662 | 18.85 MB | 30 Sep 2020 - 10:21 |
| WGet tools | 364 | 308.50 MB | 30 Sep 2020 - 21:05 |
| Googlebot | 327 | 12.91 MB | 30 Sep 2020 - 22:43 |
| Y!J Yahoo Japan | 244 | 10.42 MB | 30 Sep 2020 - 23:57 |
| Unknown robot (identified by 'spider') | 206 | 6.39 MB | 30 Sep 2020 - 12:00 |
| Yandex Bot | 125 | 1.31 MB | 30 Sep 2020 - 19:24 |
| MJ12bot | 73 | 1.95 MB | 29 Sep 2020 - 04:24 |
| ltx71 | 30 | 3.62 MB | 28 Sep 2020 - 09:12 |
| MojeekBot | 26 | 134.69 KB | 14 Sep 2020 - 11:55 |
| Common Crawl | 21 | 162.13 KB | 23 Sep 2020 - 16:54 |
| Java (Often spam bot) | 16 | 0 | 29 Sep 2020 - 21:03 |
| Alexa (IA Archiver) | 11 | 1.94 MB | 09 Sep 2020 - 18:39 |
| SeznamBot | 10 | 38.08 KB | 29 Sep 2020 - 11:46 |
| Python-urllib | 7 | 7.18 MB | 28 Sep 2020 - 12:33 |
| InternetArchive | 6 | 0 | 28 Sep 2020 - 00:22 |
| yeti | 4 | 181.79 KB | 29 Sep 2020 - 09:47 |
| Mail.ru bot | 3 | 2.40 KB | 27 Sep 2020 - 11:22 |
| YaCy | 3 | 121.80 KB | 19 Sep 2020 - 09:24 |
| Sift | 3 | 121.80 KB | 02 Sep 2020 - 20:03 |
| FaceBook bot | 2 | 119.98 KB | 26 Sep 2020 - 20:03 |
| ning | 2 | 119.98 KB | 28 Sep 2020 - 18:47 |
| Heritrix | 2 | 61.81 KB | 23 Sep 2020 - 19:02 |
| Nutch | 2 | 8.69 KB | 05 Sep 2020 - 15:45 |
| BaiDuSpider | 2 | 62.93 KB | 19 Sep 2020 - 20:49 |
| SEOkicks Webcrawler | 1 | 3.30 KB | 27 Sep 2020 - 02:40 |
|