| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 812,283 | 1457.44 GB | 30 Jun 2020 - 21:11 |
| Unknown robot (identified by 'crawl') | 396,445 | 141.96 GB | 30 Jun 2020 - 00:22 |
| SemrushBot | 78,614 | 4.71 GB | 30 Jun 2020 - 21:10 |
| Suspected bot masqurading as Mozilla | 56,353 | 407.11 MB | 30 Jun 2020 - 21:07 |
| Unknown robot (identified by empty user agent string) | 37,160 | 17.27 GB | 30 Jun 2020 - 21:09 |
| Python-urllib | 20,123 | 26.17 GB | 30 Jun 2020 - 20:42 |
| Perl tool | 19,773 | 29.06 GB | 30 Jun 2020 - 19:16 |
| SEOkicks Webcrawler | 10,499 | 1004.53 MB | 18 Jun 2020 - 18:57 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 7,616 | 3.70 GB | 30 Jun 2020 - 21:09 |
| DotBot, Open Site Explorer | 7,256 | 4.44 GB | 30 Jun 2020 - 19:38 |
| Bingbot | 3,982 | 907.67 MB | 30 Jun 2020 - 21:06 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,247 | 571.25 MB | 30 Jun 2020 - 21:07 |
| Yandex Bot | 1,652 | 305.42 MB | 30 Jun 2020 - 08:11 |
| BaiDuSpider | 1,108 | 31.49 MB | 30 Jun 2020 - 14:45 |
| Web Core / Roots | 945 | 100.27 MB | 30 Jun 2020 - 16:31 |
| Java (Often spam bot) | 925 | 33.65 MB | 30 Jun 2020 - 20:31 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 720 | 143.88 MB | 24 Jun 2020 - 02:56 |
| Googlebot | 617 | 68.11 MB | 30 Jun 2020 - 18:22 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 589 | 50.73 MB | 30 Jun 2020 - 21:08 |
| AhrefsBot | 452 | 428.91 MB | 30 Jun 2020 - 20:37 |
| Alexa (IA Archiver) | 367 | 872.29 MB | 19 Jun 2020 - 12:57 |
| MJ12bot | 220 | 426.50 MB | 29 Jun 2020 - 04:32 |
| WordPress | 140 | 461.90 KB | 30 Jun 2020 - 15:15 |
| FavIconizer | 112 | 193.67 MB | 27 Jun 2020 - 21:47 |
| Sogou Spider | 110 | 33.63 MB | 30 Jun 2020 - 15:50 |
| FaceBook bot | 66 | 2.26 MB | 30 Jun 2020 - 12:44 |
| Mail.ru bot | 43 | 277.42 KB | 24 Jun 2020 - 02:27 |
| Unknown robot (identified by 'robot') | 34 | 241.21 KB | 30 Jun 2020 - 16:11 |
| Sift | 24 | 102.51 KB | 29 Jun 2020 - 15:26 |
| Unknown robot (identified by 'spider') | 18 | 2.47 MB | 29 Jun 2020 - 18:28 |
| Bing Preview bot | 9 | 27.47 MB | 25 Jun 2020 - 17:31 |
| Common Crawl | 8 | 19.93 KB | 30 Jun 2020 - 19:58 |
| ltx71 | 6 | 25.36 KB | 17 Jun 2020 - 08:21 |
| MSNBot | 5 | 1.60 MB | 20 Jun 2020 - 17:10 |
| WebCopy | 4 | 8.33 KB | 17 Jun 2020 - 21:22 |
| SeznamBot | 3 | 12.57 KB | 27 Jun 2020 - 12:53 |
| Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 2 | 0 | 19 Jun 2020 - 12:01 |
| Turn It In | 2 | 8.46 KB | 05 Jun 2020 - 13:33 |
| twitterbot | 2 | 8.72 KB | 24 Jun 2020 - 06:38 |
| MojeekBot | 2 | 5.72 KB | 15 Jun 2020 - 04:10 |
| yeti | 2 | 8.33 KB | 24 Jun 2020 - 08:57 |
|