| 69 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 4,747,146 | 21948.30 GB | 31 Oct 2019 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 201,834 | 533.14 GB | 31 Oct 2019 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 136,393 | 864.03 GB | 31 Oct 2019 - 23:41 |
| SemrushBot | 39,944 | 175.11 GB | 31 Oct 2019 - 23:59 |
| YaCy | 35,105 | 8876.40 GB | 28 Oct 2019 - 11:34 |
| Python-urllib | 31,149 | 12.39 GB | 31 Oct 2019 - 23:59 |
| Unknown robot (identified by 'crawl') | 19,960 | 228.15 GB | 30 Oct 2019 - 09:20 |
| Yandex Bot | 18,407 | 2754.87 GB | 31 Oct 2019 - 23:54 |
| Unknown robot (identified by empty user agent string) | 11,192 | 262.92 GB | 31 Oct 2019 - 23:47 |
| check_http (nagios) | 8,719 | 28.16 MB | 31 Oct 2019 - 23:58 |
| Googlebot | 5,511 | 59.37 GB | 31 Oct 2019 - 23:59 |
| Bingbot | 5,361 | 84.58 GB | 31 Oct 2019 - 23:50 |
| AhrefsBot | 2,361 | 38.19 GB | 31 Oct 2019 - 23:55 |
| Java (Often spam bot) | 2,162 | 28.57 GB | 31 Oct 2019 - 22:50 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,603 | 14.11 GB | 26 Oct 2019 - 07:22 |
| MagpieRSS | 1,406 | 338.85 GB | 31 Oct 2019 - 22:14 |
| BaiDuSpider | 1,272 | 94.04 GB | 31 Oct 2019 - 23:57 |
| Alexa (IA Archiver) | 691 | 20.73 GB | 31 Oct 2019 - 10:43 |
| Perl tool | 495 | 7.77 GB | 31 Oct 2019 - 07:10 |
| MJ12bot | 364 | 37.58 GB | 31 Oct 2019 - 16:52 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 360 | 121.52 MB | 14 Oct 2019 - 13:21 |
| FavIconizer | 319 | 53.90 MB | 31 Oct 2019 - 21:16 |
| DotBot, Open Site Explorer | 315 | 18.02 GB | 31 Oct 2019 - 22:14 |
| SeznamBot | 288 | 12.31 GB | 31 Oct 2019 - 23:34 |
| Common Crawl | 242 | 26.88 MB | 22 Oct 2019 - 15:06 |
| Suspected bot masqurading as Mozilla | 178 | 165.83 MB | 31 Oct 2019 - 23:24 |
| Web Core / Roots | 176 | 10.93 GB | 30 Oct 2019 - 12:29 |
| Suspected bot masqurading as Mozilla | 171 | 8.56 GB | 31 Oct 2019 - 16:15 |
| ltx71 | 158 | 17.98 GB | 31 Oct 2019 - 13:44 |
| Sogou Spider | 119 | 827.30 MB | 31 Oct 2019 - 19:43 |
| SMTBot | 117 | 109.54 MB | 26 Oct 2019 - 21:44 |
| Bing Preview bot | 109 | 44.00 GB | 31 Oct 2019 - 21:22 |
| SEOkicks Webcrawler | 106 | 4.38 GB | 24 Oct 2019 - 18:41 |
| ning | 102 | 1.89 GB | 28 Oct 2019 - 17:07 |
| Unknown robot (identified by 'spider') | 77 | 14.13 GB | 31 Oct 2019 - 01:17 |
| LinkChecker | 52 | 0 | 31 Oct 2019 - 16:16 |
| CFNetwork | 50 | 928.84 MB | 29 Oct 2019 - 18:46 |
| FaceBook bot | 37 | 118.73 KB | 31 Oct 2019 - 23:41 |
| Googlebot-Image | 33 | 2.42 MB | 30 Oct 2019 - 18:39 |
| lwp-request | 22 | 0 | 31 Oct 2019 - 22:39 |
| Netcraft | 21 | 39.69 KB | 31 Oct 2019 - 21:45 |
| GigaBot | 18 | 16.89 MB | 03 Oct 2019 - 16:11 |
| Sift | 17 | 418.54 MB | 31 Oct 2019 - 11:55 |
| Mail.ru bot | 16 | 698.61 KB | 17 Oct 2019 - 17:56 |
| WordPress | 14 | 20.60 KB | 26 Oct 2019 - 13:07 |
| Nutch | 13 | 421.60 MB | 29 Oct 2019 - 17:09 |
| twitterbot | 13 | 2.77 GB | 28 Oct 2019 - 08:09 |
| yeti | 11 | 27.05 KB | 31 Oct 2019 - 01:14 |
| Simmany Robot Ver1.0 | 9 | 1.59 GB | 25 Oct 2019 - 09:58 |
| Motor | 8 | 43.88 KB | 06 Oct 2019 - 01:11 |
| 360spider | 7 | 12.30 MB | 29 Oct 2019 - 23:26 |
| MojeekBot | 5 | 25.44 KB | 30 Oct 2019 - 22:19 |
| Unknown robot (identified by 'scanner') | 5 | 130.33 KB | 26 Oct 2019 - 21:29 |
| MSNBot | 4 | 29.09 KB | 24 Oct 2019 - 11:55 |
| Unknown robot (identified by 'robot') | 4 | 98.81 KB | 28 Oct 2019 - 05:57 |
| InternetArchive | 2 | 0 | 11 Oct 2019 - 14:02 |
| HTTrack off-line browser | 2 | 331 Bytes | 12 Oct 2019 - 19:01 |
| Emacs-w3 Search Engine | 2 | 700.00 MB | 22 Oct 2019 - 20:23 |
| CMS Crawler | 2 | 6.45 KB | 07 Oct 2019 - 02:20 |
| Cfetch | 1 | 338.90 MB | 26 Oct 2019 - 03:40 |
| Suspected bot masquerading as M$ IE | 1 | 0 | 06 Oct 2019 - 15:15 |
| Google AdSense | 1 | 2.80 GB | 07 Oct 2019 - 18:11 |
| Exabot | 1 | 3.22 KB | 04 Oct 2019 - 09:26 |
| ParaSite | 1 | 262.22 MB | 05 Oct 2019 - 12:22 |
| Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 16 Oct 2019 - 06:06 |
| Unknown robot (identified by 'discovery') | 1 | 3.22 KB | 20 Oct 2019 - 03:09 |
| Turn It In | 1 | 376.20 KB | 15 Oct 2019 - 11:32 |
| WebCopy | 1 | 0 | 28 Oct 2019 - 20:16 |
| MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 3.35 KB | 29 Oct 2019 - 07:46 |
|