| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 1,046,760 | 664.34 GB | 30 Nov 2019 - 23:59 |
| Suspected bot masqurading as Mozilla | 63,581 | 109.32 MB | 30 Nov 2019 - 23:59 |
| SemrushBot | 54,331 | 2.93 GB | 30 Nov 2019 - 23:59 |
| Yandex Bot | 26,643 | 33.72 GB | 30 Nov 2019 - 23:44 |
| Perl tool | 15,865 | 21.52 GB | 30 Nov 2019 - 23:24 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 7,270 | 949.11 MB | 30 Nov 2019 - 23:57 |
| BaiDuSpider | 6,353 | 460.36 MB | 30 Nov 2019 - 23:45 |
| Unknown robot (identified by empty user agent string) | 6,150 | 1.85 GB | 30 Nov 2019 - 23:54 |
| Python-urllib | 4,318 | 3.04 GB | 30 Nov 2019 - 08:58 |
| Bingbot | 2,694 | 437.74 MB | 30 Nov 2019 - 22:57 |
| Java (Often spam bot) | 1,751 | 54.45 MB | 30 Nov 2019 - 23:40 |
| AhrefsBot | 1,544 | 1.20 GB | 24 Nov 2019 - 13:53 |
| DotBot, Open Site Explorer | 1,279 | 486.46 MB | 30 Nov 2019 - 23:47 |
| Alexa (IA Archiver) | 991 | 715.00 MB | 30 Nov 2019 - 11:01 |
| Googlebot | 754 | 70.97 MB | 30 Nov 2019 - 23:06 |
| MJ12bot | 203 | 328.68 MB | 28 Nov 2019 - 13:04 |
| FaceBook bot | 202 | 848.05 KB | 30 Nov 2019 - 14:15 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 156 | 2.64 MB | 30 Nov 2019 - 21:32 |
| Web Core / Roots | 146 | 12.43 MB | 30 Nov 2019 - 08:12 |
| WordPress | 100 | 394.48 KB | 29 Nov 2019 - 06:50 |
| Sogou Spider | 74 | 15.09 MB | 27 Nov 2019 - 17:08 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 63 | 11.12 MB | 30 Nov 2019 - 14:35 |
| FavIconizer | 58 | 215.56 KB | 27 Nov 2019 - 15:52 |
| Suspected bot masqurading as Mozilla | 40 | 1.37 MB | 30 Nov 2019 - 15:43 |
| Unknown robot (identified by 'crawl') | 37 | 111.97 KB | 29 Nov 2019 - 16:53 |
| Unknown robot (identified by 'robot') | 33 | 139.95 KB | 28 Nov 2019 - 13:56 |
| SMTBot | 25 | 76.67 KB | 15 Nov 2019 - 16:47 |
| Unknown robot (identified by 'spider') | 24 | 10.33 MB | 30 Nov 2019 - 13:33 |
| Turn It In | 19 | 72.26 KB | 28 Nov 2019 - 13:49 |
| Heritrix | 15 | 313.62 KB | 15 Nov 2019 - 12:26 |
| Common Crawl | 10 | 29.11 KB | 15 Nov 2019 - 13:57 |
| MSNBot | 9 | 367.67 KB | 29 Nov 2019 - 21:30 |
| Sift | 9 | 37.70 KB | 29 Nov 2019 - 09:11 |
| MojeekBot | 4 | 11.45 KB | 22 Nov 2019 - 12:42 |
| Bing Preview bot | 4 | 20.93 MB | 25 Nov 2019 - 22:32 |
| twitterbot | 3 | 9.68 KB | 14 Nov 2019 - 14:27 |
| SEOkicks Webcrawler | 3 | 8.52 KB | 21 Nov 2019 - 05:51 |
| Mail.ru bot | 2 | 8.33 KB | 19 Nov 2019 - 13:34 |
| YaCy | 1 | 4.23 KB | 08 Nov 2019 - 03:44 |
| Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 22 Nov 2019 - 07:51 |
| NewsGator Online | 1 | 1.62 KB | 22 Nov 2019 - 16:24 |
| 360spider | 1 | 4.10 KB | 06 Nov 2019 - 15:01 |
|