| 38 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'spider') | 69,205 | 59.05 GB | 30 Nov 2021 - 20:10 |
| Suspected bot masqurading as Mozilla | 55,772 | 202.67 MB | 30 Nov 2021 - 20:10 |
| Python-urllib | 488,573 | 455.97 GB | 30 Nov 2021 - 20:10 |
| Bingbot | 54,293 | 5.50 GB | 30 Nov 2021 - 20:09 |
| WGet tools | 510,399 | 768.28 GB | 30 Nov 2021 - 20:09 |
| SemrushBot | 11,533 | 1.53 GB | 30 Nov 2021 - 20:04 |
| DotBot, Open Site Explorer | 15,763 | 7.63 GB | 30 Nov 2021 - 20:01 |
| Perl tool | 41,143 | 69.39 GB | 30 Nov 2021 - 19:56 |
| BaiDuSpider | 137 | 24.67 MB | 30 Nov 2021 - 19:37 |
| Unknown robot (identified by empty user agent string) | 2,572 | 101.88 MB | 30 Nov 2021 - 19:15 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 7,738 | 16.48 GB | 30 Nov 2021 - 18:55 |
| Yandex Bot | 2,121 | 1.24 GB | 30 Nov 2021 - 18:51 |
| Java (Often spam bot) | 333 | 0 | 30 Nov 2021 - 18:11 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 20,731 | 1011.42 MB | 30 Nov 2021 - 17:55 |
| Web Core / Roots | 431 | 90.60 MB | 30 Nov 2021 - 17:52 |
| AhrefsBot | 470 | 561.77 MB | 30 Nov 2021 - 17:42 |
| FaceBook bot | 87 | 366.59 KB | 30 Nov 2021 - 16:45 |
| Googlebot | 253 | 213.46 MB | 30 Nov 2021 - 16:21 |
| Common Crawl | 310 | 278.89 MB | 30 Nov 2021 - 16:18 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 88 | 12.28 MB | 30 Nov 2021 - 05:32 |
| WordPress | 142 | 6.22 MB | 30 Nov 2021 - 03:41 |
| ltx71 | 36 | 2.23 MB | 30 Nov 2021 - 02:15 |
| MJ12bot | 306 | 41.61 MB | 30 Nov 2021 - 01:16 |
| Unknown robot (identified by 'robot') | 68 | 2.67 MB | 29 Nov 2021 - 19:15 |
| LinkChecker | 5 | 20.90 KB | 29 Nov 2021 - 13:22 |
| Alexa (IA Archiver) | 9 | 20.58 KB | 26 Nov 2021 - 20:36 |
| Mail.ru bot | 20 | 165.25 KB | 25 Nov 2021 - 10:35 |
| Phantom | 3 | 12.83 KB | 24 Nov 2021 - 06:32 |
| twitterbot | 5 | 20.26 KB | 23 Nov 2021 - 15:38 |
| Nutch | 4,198 | 1.08 GB | 22 Nov 2021 - 15:07 |
| MojeekBot | 3 | 11.14 KB | 15 Nov 2021 - 10:11 |
| SeznamBot | 2 | 8.46 KB | 15 Nov 2021 - 09:44 |
| YaCy | 1 | 1.14 KB | 14 Nov 2021 - 17:11 |
| CFNetwork | 1 | 4.30 KB | 08 Nov 2021 - 05:20 |
| Bing Preview bot | 2 | 6.45 KB | 06 Nov 2021 - 00:37 |
| Suspected bot masqurading as Mozilla | 2 | 5.78 KB | 03 Nov 2021 - 17:04 |
| Unknown robot (identified by 'crawl') | 14 | 35.97 KB | 03 Nov 2021 - 08:54 |
| SEOkicks Webcrawler | 48 | 151.22 KB | 02 Nov 2021 - 16:17 |
|