| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 1,594 | 124.45 GB | 30 Nov 2018 - 23:59 |
| Yandex Bot | 349 | 15.43 GB | 30 Nov 2018 - 23:59 |
| Unknown robot (identified by empty user agent string) | 949 | 48.12 GB | 30 Nov 2018 - 23:48 |
| SemrushBot | 2,935 | 6.43 GB | 30 Nov 2018 - 23:47 |
| AhrefsBot | 9,238 | 315.36 GB | 30 Nov 2018 - 23:46 |
| Perl tool | 336 | 7.77 MB | 30 Nov 2018 - 23:44 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,806 | 11.48 GB | 30 Nov 2018 - 23:29 |
| WGet tools | 86,470+1 | 979.07 GB | 30 Nov 2018 - 23:25 |
| Python-urllib | 1,588 | 172.93 GB | 30 Nov 2018 - 23:15 |
| Unknown robot (identified by 'crawl') | 1,288 | 2.35 GB | 30 Nov 2018 - 23:00 |
| Bingbot | 675 | 3.80 GB | 30 Nov 2018 - 22:45 |
| BaiDuSpider | 2,282 | 3.90 GB | 30 Nov 2018 - 21:49 |
| MJ12bot | 105 | 35.85 MB | 30 Nov 2018 - 20:37 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 950+1 | 428.13 MB | 30 Nov 2018 - 19:38 |
| ltx71 | 259 | 4.83 GB | 30 Nov 2018 - 19:07 |
| Googlebot | 210 | 20.27 GB | 30 Nov 2018 - 18:53 |
| CFNetwork | 19 | 3.06 GB | 30 Nov 2018 - 17:01 |
| Exabot | 50 | 901.57 KB | 30 Nov 2018 - 16:28 |
| FaceBook bot | 80 | 551.53 KB | 30 Nov 2018 - 14:25 |
| DotBot, Open Site Explorer | 353 | 3.82 GB | 30 Nov 2018 - 13:33 |
| Jakarta commons-httpclient | 41 | 656 Bytes | 30 Nov 2018 - 09:01 |
| Java (Often spam bot) | 1,510 | 40.83 GB | 30 Nov 2018 - 05:56 |
| Alexa (IA Archiver) | 68 | 300.96 KB | 30 Nov 2018 - 00:51 |
| Google AdSense | 6 | 98.91 MB | 29 Nov 2018 - 02:37 |
| Unknown robot (identified by 'robot') | 3 | 18.67 KB | 29 Nov 2018 - 01:58 |
| Web Core / Roots | 13 | 164.86 MB | 28 Nov 2018 - 05:37 |
| archive.org bot | 8 | 148.99 MB | 28 Nov 2018 - 00:53 |
| 007ac9 Crawler, seems to belong to SISTRIX | 10 | 48.00 KB | 27 Nov 2018 - 20:26 |
| GigaBot | 6 | 19.82 KB | 27 Nov 2018 - 11:49 |
| LinkChecker | 30 | 0 | 24 Nov 2018 - 00:44 |
| Unknown robot (identified by 'spider') | 5 | 47.23 MB | 23 Nov 2018 - 15:55 |
| FavIconizer | 2 | 33.01 MB | 23 Nov 2018 - 11:14 |
| Xenu's Link Sleuth (TM), see Wikipedia | 2 | 0 | 23 Nov 2018 - 09:53 |
| Turn It In | 28 | 26.47 MB | 22 Nov 2018 - 09:16 |
| Sogou Spider | 10 | 12.24 MB | 22 Nov 2018 - 06:59 |
| ComputingSite Robi/1.0 | 2 | 5.26 MB | 21 Nov 2018 - 19:55 |
| Common Crawl | 38 | 161.86 KB | 21 Nov 2018 - 10:19 |
| yeti | 2 | 32.97 MB | 18 Nov 2018 - 20:15 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1 | 6.24 KB | 16 Nov 2018 - 07:19 |
| lwp-request | 1 | 7.64 KB | 10 Nov 2018 - 19:24 |
| microsoft-webdav-miniredir | 1 | 0 | 04 Nov 2018 - 12:08 |
| Sift | 1 | 3.66 KB | 03 Nov 2018 - 22:18 |
|