| 42 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 954,666 | 1218.66 GB | 31 Mar 2020 - 21:00 |
| Unknown robot (identified by 'crawl') | 121,603 | 1.86 GB | 25 Mar 2020 - 20:04 |
| Suspected bot masqurading as Mozilla | 55,547 | 298.12 MB | 31 Mar 2020 - 21:10 |
| SemrushBot | 48,178 | 1.83 GB | 31 Mar 2020 - 21:09 |
| Perl tool | 28,264 | 47.04 GB | 31 Mar 2020 - 15:29 |
| Unknown robot (identified by empty user agent string) | 9,171 | 1.67 GB | 31 Mar 2020 - 17:17 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 8,466 | 1.30 GB | 31 Mar 2020 - 20:57 |
| Python-urllib | 6,001 | 7.89 GB | 31 Mar 2020 - 18:30 |
| Yandex Bot | 3,763 | 4.73 GB | 31 Mar 2020 - 21:09 |
| DotBot, Open Site Explorer | 2,924 | 808.84 MB | 31 Mar 2020 - 17:37 |
| Bingbot | 2,083 | 200.77 MB | 31 Mar 2020 - 20:35 |
| AhrefsBot | 1,812 | 1.49 GB | 31 Mar 2020 - 20:39 |
| Googlebot | 1,129 | 84.63 MB | 31 Mar 2020 - 20:29 |
| Java (Often spam bot) | 932 | 54.82 MB | 31 Mar 2020 - 20:27 |
| BaiDuSpider | 654 | 21.83 MB | 31 Mar 2020 - 20:51 |
| MJ12bot | 365 | 1.43 GB | 30 Mar 2020 - 12:01 |
| Web Core / Roots | 329 | 178.93 MB | 31 Mar 2020 - 21:08 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 227 | 2.71 MB | 31 Mar 2020 - 13:05 |
| WordPress | 142 | 555.93 KB | 31 Mar 2020 - 15:14 |
| FaceBook bot | 115 | 472.79 KB | 31 Mar 2020 - 14:11 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 111 | 24.84 MB | 30 Mar 2020 - 20:12 |
| Sogou Spider | 89 | 14.39 MB | 31 Mar 2020 - 00:43 |
| FavIconizer | 54 | 4.01 MB | 30 Mar 2020 - 12:18 |
| MSNBot | 41 | 9.99 MB | 29 Mar 2020 - 21:35 |
| Mail.ru bot | 29 | 223.69 KB | 31 Mar 2020 - 20:44 |
| Suspected bot masqurading as Mozilla | 25 | 2.01 MB | 17 Mar 2020 - 12:13 |
| Unknown robot (identified by 'robot') | 25 | 104.70 KB | 30 Mar 2020 - 11:26 |
| Sift | 10 | 39.05 KB | 20 Mar 2020 - 16:00 |
| SeznamBot | 8 | 33.59 KB | 29 Mar 2020 - 15:00 |
| Common Crawl | 8 | 20.06 KB | 26 Mar 2020 - 17:49 |
| Cliqzbot | 6 | 29.06 KB | 15 Mar 2020 - 22:26 |
| Unknown robot (identified by 'spider') | 6 | 2.40 MB | 16 Mar 2020 - 06:02 |
| ltx71 | 6 | 141.81 MB | 08 Mar 2020 - 09:39 |
| twitterbot | 5 | 2.30 MB | 27 Mar 2020 - 21:58 |
| Turn It In | 4 | 16.80 KB | 31 Mar 2020 - 12:07 |
| SEOkicks Webcrawler | 4 | 11.57 KB | 28 Mar 2020 - 09:20 |
| Jakarta commons-httpclient | 4 | 17.50 KB | 30 Mar 2020 - 13:24 |
| Bing Preview bot | 3 | 8.40 MB | 31 Mar 2020 - 07:44 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 2 | 8.33 KB | 18 Mar 2020 - 15:42 |
| MojeekBot | 2 | 5.85 KB | 31 Mar 2020 - 11:15 |
| yeti | 1 | 4.10 KB | 16 Mar 2020 - 15:34 |
| Alexa (IA Archiver) | 1 | 4.41 KB | 28 Mar 2020 - 06:59 |
|