| 40 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 17,927 | 358.48 MB | 31 Dec 2018 - 23:55 |
| SemrushBot | 17,826 | 1.25 GB | 31 Dec 2018 - 23:57 |
| WGet tools | 4,201 | 2.01 GB | 31 Dec 2018 - 22:00 |
| Yandex Bot | 1,329 | 20.87 MB | 31 Dec 2018 - 22:01 |
| AhrefsBot | 1,216 | 255.20 MB | 31 Dec 2018 - 23:42 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,014 | 11.29 MB | 31 Dec 2018 - 16:26 |
| BaiDuSpider | 778 | 220.97 MB | 31 Dec 2018 - 20:43 |
| Unknown robot (identified by 'crawl') | 428 | 7.12 MB | 31 Dec 2018 - 17:40 |
| Googlebot | 356 | 31.25 MB | 31 Dec 2018 - 21:33 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 323 | 102.70 MB | 31 Dec 2018 - 19:33 |
| Bingbot | 229 | 5.00 MB | 31 Dec 2018 - 21:09 |
| Sogou Spider | 109 | 3.74 MB | 31 Dec 2018 - 07:20 |
| Python-urllib | 81 | 106.13 MB | 31 Dec 2018 - 20:25 |
| Common Crawl | 67 | 903.18 KB | 19 Dec 2018 - 13:23 |
| MJ12bot | 55 | 876.43 KB | 20 Dec 2018 - 10:00 |
| Alexa (IA Archiver) | 34 | 1.79 MB | 29 Dec 2018 - 03:42 |
| Turn It In | 25 | 552.25 KB | 16 Dec 2018 - 20:41 |
| Nutch | 20 | 88.92 KB | 25 Dec 2018 - 18:55 |
| Web Core / Roots | 20 | 6.24 MB | 29 Dec 2018 - 12:25 |
| Java (Often spam bot) | 13 | 0 | 23 Dec 2018 - 15:29 |
| DotBot, Open Site Explorer | 12 | 1.13 MB | 29 Dec 2018 - 23:48 |
| SEOkicks Webcrawler | 8 | 33.15 KB | 25 Dec 2018 - 04:23 |
| Sift | 8 | 247.24 KB | 23 Dec 2018 - 08:26 |
| WordPress | 8 | 119.98 KB | 22 Dec 2018 - 01:44 |
| Unknown robot (identified by empty user agent string) | 7 | 1.50 MB | 20 Dec 2018 - 22:45 |
| Y!J Yahoo Japan | 6 | 22.30 KB | 26 Dec 2018 - 18:26 |
| yeti | 6 | 79.49 KB | 23 Dec 2018 - 22:49 |
| Mail.ru bot | 5 | 6.45 KB | 30 Dec 2018 - 04:12 |
| SeznamBot | 5 | 7.67 KB | 27 Dec 2018 - 17:41 |
| ltx71 | 5 | 81.57 KB | 30 Dec 2018 - 05:14 |
| 007ac9 Crawler, seems to belong to SISTRIX | 4 | 13.27 KB | 22 Dec 2018 - 10:05 |
| FaceBook bot | 3 | 12.22 KB | 05 Dec 2018 - 15:17 |
| InternetArchive | 2 | 0 | 29 Dec 2018 - 11:33 |
| HTTrack off-line browser | 2 | 119.98 KB | 14 Dec 2018 - 18:47 |
| LinkBot | 2 | 157.17 KB | 06 Dec 2018 - 21:19 |
| Suspected bot masqurading as Mozilla | 1 | 0 | 17 Dec 2018 - 07:20 |
| Cliqzbot | 1 | 157.17 KB | 01 Dec 2018 - 09:00 |
| MojeekBot | 1 | 4.42 KB | 04 Dec 2018 - 15:22 |
| Unknown robot (identified by 'spider') | 1 | 4.42 KB | 25 Dec 2018 - 04:52 |
| Phantom | 1 | 3.25 KB | 19 Dec 2018 - 00:35 |
|