| 69 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 3,331,251 | 20269.04 GB | 30 Nov 2019 - 23:59 |
| SemrushBot | 40,254 | 195.80 GB | 30 Nov 2019 - 23:58 |
| Unknown robot (identified by 'crawl') | 35,148 | 344.58 GB | 30 Nov 2019 - 23:11 |
| Python-urllib | 28,494 | 47.63 GB | 30 Nov 2019 - 23:50 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 24,830 | 213.82 GB | 30 Nov 2019 - 23:56 |
| Unknown robot (identified by empty user agent string) | 11,798 | 367.34 GB | 30 Nov 2019 - 23:57 |
| Yandex Bot | 11,592 | 1705.44 GB | 30 Nov 2019 - 23:56 |
| check_http (nagios) | 8,527 | 27.55 MB | 30 Nov 2019 - 23:58 |
| YaCy | 7,349 | 2017.56 GB | 29 Nov 2019 - 02:54 |
| Bingbot | 4,542 | 98.85 GB | 30 Nov 2019 - 23:58 |
| AhrefsBot | 4,241 | 51.45 GB | 30 Nov 2019 - 23:38 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 3,576 | 37.93 GB | 30 Nov 2019 - 23:59 |
| Googlebot | 3,403 | 28.42 GB | 30 Nov 2019 - 23:50 |
| DotBot, Open Site Explorer | 2,284 | 69.76 GB | 30 Nov 2019 - 23:38 |
| BaiDuSpider | 1,730 | 129.03 GB | 30 Nov 2019 - 23:54 |
| Java (Often spam bot) | 1,637 | 23.40 GB | 30 Nov 2019 - 00:22 |
| MagpieRSS | 1,628 | 364.39 GB | 29 Nov 2019 - 02:48 |
| MJ12bot | 815 | 50.23 GB | 30 Nov 2019 - 20:46 |
| Alexa (IA Archiver) | 726 | 28.63 GB | 30 Nov 2019 - 20:47 |
| Perl tool | 592 | 7.06 GB | 30 Nov 2019 - 10:36 |
| FavIconizer | 290 | 7.03 MB | 30 Nov 2019 - 20:55 |
| Common Crawl | 271 | 60.15 MB | 21 Nov 2019 - 15:53 |
| SeznamBot | 238 | 3.65 GB | 30 Nov 2019 - 23:28 |
| Suspected bot masqurading as Mozilla | 214 | 806.28 MB | 30 Nov 2019 - 15:32 |
| SMTBot | 198 | 206.43 MB | 29 Nov 2019 - 17:28 |
| Nutch | 193 | 4.38 GB | 30 Nov 2019 - 22:29 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 192 | 71.01 MB | 30 Nov 2019 - 16:03 |
| Suspected bot masqurading as Mozilla | 175 | 5.57 GB | 30 Nov 2019 - 12:17 |
| ning | 148 | 6.05 GB | 29 Nov 2019 - 01:54 |
| Bing Preview bot | 144 | 63.50 GB | 30 Nov 2019 - 14:36 |
| GigablastOpenSource, an Open Source Search Engine(Wiki) | 134 | 19.21 GB | 30 Nov 2019 - 04:59 |
| Unknown robot (identified by 'spider') | 134 | 23.76 GB | 30 Nov 2019 - 06:45 |
| Web Core / Roots | 105 | 6.12 GB | 27 Nov 2019 - 07:56 |
| Sogou Spider | 102 | 215.68 MB | 29 Nov 2019 - 19:25 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 82 | 25.47 MB | 19 Nov 2019 - 17:12 |
| ltx71 | 77 | 3.99 GB | 30 Nov 2019 - 00:15 |
| SEOkicks Webcrawler | 74 | 4.64 GB | 21 Nov 2019 - 09:50 |
| LinkChecker | 70 | 0 | 30 Nov 2019 - 17:27 |
| WordPress | 69 | 3.35 GB | 19 Nov 2019 - 08:15 |
| 360spider | 58 | 44.27 MB | 28 Nov 2019 - 15:01 |
| Googlebot-Image | 54 | 374.62 KB | 28 Nov 2019 - 07:17 |
| Cliqzbot | 41 | 135.10 MB | 29 Nov 2019 - 23:22 |
| FaceBook bot | 34 | 203.58 MB | 30 Nov 2019 - 20:22 |
| InfoBot | 30 | 127.59 KB | 03 Nov 2019 - 04:27 |
| twitterbot | 28 | 5.67 GB | 30 Nov 2019 - 15:24 |
| MojeekBot | 24 | 18.72 MB | 28 Nov 2019 - 04:18 |
| MSNBot | 23 | 96.97 KB | 29 Nov 2019 - 01:40 |
| Custo | 23 | 3.13 GB | 23 Nov 2019 - 03:39 |
| Sift | 22 | 622.04 MB | 29 Nov 2019 - 23:56 |
| Motor | 20 | 76.89 KB | 05 Nov 2019 - 07:29 |
| yeti | 20 | 42.91 KB | 26 Nov 2019 - 09:35 |
| Mail.ru bot | 11 | 74.72 KB | 19 Nov 2019 - 22:08 |
| Unknown robot (identified by 'scanner') | 10 | 762.34 KB | 12 Nov 2019 - 22:32 |
| BBot | 7 | 10.27 GB | 20 Nov 2019 - 17:25 |
| Phantom | 5 | 15.54 KB | 21 Nov 2019 - 00:12 |
| Netcraft | 5 | 16.50 KB | 03 Nov 2019 - 22:14 |
| Turn It In | 3 | 17.39 MB | 14 Nov 2019 - 15:49 |
| InternetArchive | 3 | 0 | 27 Nov 2019 - 22:08 |
| archive.org bot | 3 | 230.13 MB | 12 Nov 2019 - 09:30 |
| Unknown robot (identified by 'robot') | 3 | 22.74 KB | 22 Nov 2019 - 14:14 |
| Google Web Preview | 3 | 39.33 KB | 22 Nov 2019 - 18:59 |
| Digimarc MarcSpider | 2 | 160.38 MB | 23 Nov 2019 - 16:40 |
| CFNetwork | 2 | 356.27 MB | 15 Nov 2019 - 12:24 |
| Monster | 1 | 4.48 KB | 18 Nov 2019 - 19:28 |
| CMS Crawler | 1 | 3.35 KB | 10 Nov 2019 - 06:28 |
| microsoft-webdav-miniredir | 1 | 0 | 18 Nov 2019 - 21:40 |
| Suspected bot masquerading as M$ IE | 1 | 0 | 20 Nov 2019 - 09:38 |
| LinkBot | 1 | 0 | 28 Nov 2019 - 18:21 |
| Simmany Robot Ver1.0 | 1 | 3.35 KB | 15 Nov 2019 - 10:23 |
|