| 46 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 244,491+3 | 2330.04 GB | 29 Feb 2020 - 22:49 |
| Unknown robot (identified by 'crawl') | 17,165+1 | 276.48 GB | 29 Feb 2020 - 21:25 |
| AhrefsBot | 12,944 | 287.68 GB | 29 Feb 2020 - 23:03 |
| SemrushBot | 8,731 | 33.52 GB | 29 Feb 2020 - 23:05 |
| DotBot, Open Site Explorer | 4,646 | 59.00 GB | 29 Feb 2020 - 23:06 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 4,497 | 666.77 GB | 29 Feb 2020 - 23:09 |
| Java (Often spam bot) | 2,330 | 30.66 GB | 29 Feb 2020 - 09:01 |
| Python-urllib | 1,717 | 324.95 GB | 29 Feb 2020 - 23:02 |
| Unknown robot (identified by empty user agent string) | 1,613 | 117.35 GB | 29 Feb 2020 - 23:03 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 939 | 46.16 GB | 28 Feb 2020 - 09:57 |
| Yandex Bot | 784 | 10.75 GB | 29 Feb 2020 - 22:40 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 436 | 83.08 MB | 26 Feb 2020 - 10:12 |
| CFNetwork | 373 | 11.21 GB | 29 Feb 2020 - 22:52 |
| Googlebot | 267 | 10.99 GB | 29 Feb 2020 - 22:07 |
| Perl tool | 252 | 7.37 MB | 29 Feb 2020 - 18:08 |
| LinkChecker | 208 | 0 | 29 Feb 2020 - 15:50 |
| Bingbot | 186 | 21.54 MB | 29 Feb 2020 - 21:33 |
| Alexa (IA Archiver) | 126 | 13.14 MB | 27 Feb 2020 - 23:21 |
| MJ12bot | 84 | 202.88 MB | 29 Feb 2020 - 15:49 |
| ltx71 | 60 | 9.36 GB | 29 Feb 2020 - 13:27 |
| FaceBook bot | 53 | 63.53 MB | 29 Feb 2020 - 19:13 |
| Jakarta commons-httpclient | 40 | 640 Bytes | 29 Feb 2020 - 15:01 |
| BaiDuSpider | 33 | 41.05 MB | 29 Feb 2020 - 15:43 |
| Common Crawl | 33 | 28.18 MB | 28 Feb 2020 - 10:00 |
| SEOkicks Webcrawler | 32 | 203.35 KB | 22 Feb 2020 - 20:18 |
| Turn It In | 21 | 6.73 GB | 18 Feb 2020 - 10:15 |
| Web Core / Roots | 18 | 404.15 MB | 29 Feb 2020 - 15:23 |
| SeznamBot | 8 | 40.36 KB | 24 Feb 2020 - 19:49 |
| archive.org bot | 8 | 204.69 MB | 25 Feb 2020 - 08:38 |
| yie8 | 7 | 0 | 23 Feb 2020 - 20:10 |
| MSNBot | 6 | 120.01 MB | 13 Feb 2020 - 10:44 |
| Sogou Spider | 5 | 68.91 KB | 28 Feb 2020 - 04:57 |
| Bing Preview bot | 4 | 58.16 MB | 18 Feb 2020 - 04:52 |
| Unknown robot (identified by 'robot') | 4 | 18.67 KB | 20 Feb 2020 - 16:29 |
| ning | 4 | 95.43 MB | 29 Feb 2020 - 08:26 |
| Unknown robot (identified by 'spider') | 3 | 12.10 KB | 25 Feb 2020 - 21:34 |
| Vagabondo | 2 | 5.35 KB | 16 Feb 2020 - 04:34 |
| WordPress | 2 | 0 | 28 Feb 2020 - 10:30 |
| FavIconizer | 2 | 58.43 MB | 14 Feb 2020 - 19:21 |
| Heritrix | 2 | 5.35 MB | 29 Feb 2020 - 07:31 |
| Google AdSense | 2 | 30.12 MB | 23 Feb 2020 - 22:04 |
| GigaBot | 1 | 3.58 KB | 03 Feb 2020 - 06:19 |
| Cliqzbot | 1 | 5.11 KB | 09 Feb 2020 - 21:30 |
| MagpieRSS | 1 | 3.58 KB | 24 Feb 2020 - 07:51 |
| Mail.ru bot | 1 | 7.00 KB | 28 Feb 2020 - 04:56 |
| YaCy | 1 | 3.08 MB | 16 Feb 2020 - 06:40 |
|