| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 275,593 | 52.88 GB | 31 Mar 2019 - 23:59 |
| Suspected bot masqurading as Mozilla | 30,253 | 255.44 MB | 31 Mar 2019 - 23:59 |
| Yandex Bot | 11,154 | 18.55 GB | 31 Mar 2019 - 23:59 |
| WGet tools | 1,056,041 | 481.23 GB | 31 Mar 2019 - 23:54 |
| Unknown robot (identified by empty user agent string) | 1,465 | 265.57 MB | 31 Mar 2019 - 23:54 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 13,088 | 915.77 MB | 31 Mar 2019 - 23:46 |
| SemrushBot | 6,671 | 554.42 MB | 31 Mar 2019 - 23:45 |
| Bingbot | 3,852 | 729.04 MB | 31 Mar 2019 - 23:40 |
| Perl tool | 69,304 | 38.01 GB | 31 Mar 2019 - 23:37 |
| Java (Often spam bot) | 2,856 | 86.02 MB | 31 Mar 2019 - 23:36 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 6,039 | 4.63 GB | 31 Mar 2019 - 22:51 |
| Bing Preview bot | 13 | 50.96 MB | 31 Mar 2019 - 22:00 |
| Googlebot | 334 | 68.20 MB | 31 Mar 2019 - 21:30 |
| Python-urllib | 4,322 | 8.12 GB | 31 Mar 2019 - 20:31 |
| BaiDuSpider | 272 | 49.56 MB | 31 Mar 2019 - 19:36 |
| DotBot, Open Site Explorer | 420 | 28.42 MB | 31 Mar 2019 - 17:05 |
| Cliqzbot | 18 | 102.53 KB | 31 Mar 2019 - 17:01 |
| WordPress | 179 | 358.15 KB | 31 Mar 2019 - 14:58 |
| Alexa (IA Archiver) | 88 | 23.47 MB | 31 Mar 2019 - 06:42 |
| Web Core / Roots | 338 | 160.32 MB | 29 Mar 2019 - 16:11 |
| Sogou Spider | 89 | 37.47 MB | 29 Mar 2019 - 12:45 |
| Jakarta commons-httpclient | 24 | 100.78 KB | 29 Mar 2019 - 09:53 |
| Turn It In | 3 | 12.57 KB | 29 Mar 2019 - 02:42 |
| SEOkicks Webcrawler | 6 | 17.30 KB | 28 Mar 2019 - 20:13 |
| Phantom | 2 | 6.72 KB | 28 Mar 2019 - 19:42 |
| Unknown robot (identified by 'spider') | 10 | 13.40 MB | 28 Mar 2019 - 18:58 |
| SMTBot | 16 | 42.59 KB | 28 Mar 2019 - 13:29 |
| FaceBook bot | 13 | 54.37 KB | 28 Mar 2019 - 05:39 |
| Unknown robot (identified by 'robot') | 25 | 103.75 KB | 28 Mar 2019 - 03:23 |
| twitterbot | 1 | 4.42 KB | 27 Mar 2019 - 11:14 |
| FavIconizer | 36 | 14.56 MB | 27 Mar 2019 - 06:13 |
| Exabot | 5 | 2.09 MB | 26 Mar 2019 - 20:42 |
| Common Crawl | 21 | 65.27 KB | 25 Mar 2019 - 00:02 |
| Mail.ru bot | 15 | 89.46 KB | 22 Mar 2019 - 15:12 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 17.80 KB | 22 Mar 2019 - 05:32 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 9 | 3.37 MB | 20 Mar 2019 - 16:43 |
| Motor | 1 | 4.23 KB | 19 Mar 2019 - 14:42 |
| Sift | 3 | 12.69 KB | 19 Mar 2019 - 08:35 |
| ltx71 | 60 | 3.09 MB | 09 Mar 2019 - 16:20 |
| YaCy | 1 | 4.23 KB | 06 Mar 2019 - 14:41 |
| AhrefsBot | 1 | 6.72 KB | 04 Mar 2019 - 16:08 |
| Digimarc MarcSpider | 1 | 4.23 KB | 03 Mar 2019 - 05:45 |
|