| 43 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 999,192 | 637.96 GB | 29 Feb 2020 - 23:10 |
| DotBot, Open Site Explorer | 1,978 | 540.90 MB | 29 Feb 2020 - 23:09 |
| SemrushBot | 44,711 | 3.05 GB | 29 Feb 2020 - 23:08 |
| Suspected bot masqurading as Mozilla | 52,180 | 191.84 MB | 29 Feb 2020 - 23:08 |
| AhrefsBot | 9,327 | 2.18 GB | 29 Feb 2020 - 23:05 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 9,887 | 520.45 MB | 29 Feb 2020 - 22:57 |
| Unknown robot (identified by empty user agent string) | 5,104 | 1008.79 MB | 29 Feb 2020 - 22:54 |
| BaiDuSpider | 212 | 36.85 MB | 29 Feb 2020 - 22:51 |
| Java (Often spam bot) | 746 | 27.68 MB | 29 Feb 2020 - 22:42 |
| MSNBot | 5 | 14.38 KB | 29 Feb 2020 - 21:20 |
| Bingbot | 1,095 | 151.83 MB | 29 Feb 2020 - 20:04 |
| Googlebot | 598 | 58.38 MB | 29 Feb 2020 - 19:58 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 140 | 22.84 MB | 29 Feb 2020 - 19:23 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 112 | 8.34 MB | 29 Feb 2020 - 18:47 |
| Yandex Bot | 3,001 | 5.58 GB | 29 Feb 2020 - 17:47 |
| FaceBook bot | 126 | 3.99 MB | 29 Feb 2020 - 16:28 |
| Perl tool | 25,989 | 31.88 GB | 29 Feb 2020 - 16:23 |
| Python-urllib | 3,225 | 5.68 GB | 29 Feb 2020 - 15:21 |
| FavIconizer | 77 | 5.93 MB | 29 Feb 2020 - 12:54 |
| Sogou Spider | 90 | 20.62 MB | 29 Feb 2020 - 00:21 |
| LinkBot | 2 | 4.34 KB | 28 Feb 2020 - 23:36 |
| WordPress | 86 | 4.88 MB | 28 Feb 2020 - 18:51 |
| Web Core / Roots | 81 | 103.69 MB | 28 Feb 2020 - 17:16 |
| Mail.ru bot | 18 | 176.73 KB | 28 Feb 2020 - 17:11 |
| Suspected bot masqurading as Mozilla | 23 | 2.73 MB | 28 Feb 2020 - 06:23 |
| MJ12bot | 312 | 1.75 GB | 27 Feb 2020 - 20:34 |
| YaCy | 2 | 8.46 KB | 27 Feb 2020 - 13:28 |
| Alexa (IA Archiver) | 379 | 347.95 MB | 27 Feb 2020 - 12:59 |
| Unknown robot (identified by 'robot') | 24 | 1.97 MB | 27 Feb 2020 - 06:24 |
| Unknown robot (identified by 'spider') | 4 | 13.10 KB | 26 Feb 2020 - 18:36 |
| Sift | 7 | 29.70 KB | 26 Feb 2020 - 11:10 |
| Turn It In | 4 | 16.67 KB | 26 Feb 2020 - 05:59 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 4 | 162.33 KB | 25 Feb 2020 - 19:53 |
| twitterbot | 1 | 4.30 KB | 25 Feb 2020 - 15:05 |
| ltx71 | 15 | 49.11 KB | 25 Feb 2020 - 04:57 |
| SEOkicks Webcrawler | 4 | 11.57 KB | 24 Feb 2020 - 18:20 |
| Common Crawl | 8 | 23.55 KB | 24 Feb 2020 - 13:16 |
| Unknown robot (identified by 'crawl') | 125,054 | 2.62 GB | 23 Feb 2020 - 20:02 |
| Bing Preview bot | 2 | 9.74 MB | 21 Feb 2020 - 13:15 |
| Cliqzbot | 3 | 13.77 KB | 16 Feb 2020 - 16:06 |
| Nutch | 5 | 3.10 MB | 09 Feb 2020 - 21:16 |
| ning | 1 | 4.60 KB | 03 Feb 2020 - 19:55 |
| SMTBot | 25 | 75.41 KB | 02 Feb 2020 - 15:56 |
|