| 59 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 1,211,274 | 7051.93 GB | 31 Oct 2018 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 348,073 | 808.18 GB | 31 Oct 2018 - 23:59 |
| Yandex Bot | 10,297 | 501.11 GB | 31 Oct 2018 - 23:59 |
| check_http (nagios) | 3,841 | 12.71 MB | 31 Oct 2018 - 23:58 |
| SemrushBot | 3,505 | 35.68 GB | 31 Oct 2018 - 23:58 |
| Unknown robot (identified by empty user agent string) | 4,029 | 36.13 GB | 31 Oct 2018 - 23:55 |
| Googlebot | 953 | 6.53 GB | 31 Oct 2018 - 23:55 |
| BaiDuSpider | 2,555 | 48.10 GB | 31 Oct 2018 - 23:51 |
| Suspected bot masqurading as Mozilla | 361 | 111.77 MB | 31 Oct 2018 - 23:50 |
| Python-urllib | 4,360 | 50.07 GB | 31 Oct 2018 - 23:50 |
| DotBot, Open Site Explorer | 420 | 18.95 GB | 31 Oct 2018 - 23:44 |
| Bingbot | 5,859 | 101.11 GB | 31 Oct 2018 - 23:37 |
| Mail.ru bot | 119 | 192.58 MB | 31 Oct 2018 - 23:19 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 308 | 11.56 GB | 31 Oct 2018 - 23:05 |
| AhrefsBot | 217 | 149.81 MB | 31 Oct 2018 - 22:55 |
| ltx71 | 100 | 3.71 GB | 31 Oct 2018 - 21:35 |
| Exabot | 199 | 30.54 MB | 31 Oct 2018 - 20:09 |
| FavIconizer | 79 | 298.41 KB | 31 Oct 2018 - 19:40 |
| Perl tool | 16 | 2.54 GB | 31 Oct 2018 - 18:15 |
| Java (Often spam bot) | 549 | 3.97 GB | 31 Oct 2018 - 17:46 |
| Linkdex | 5 | 1.03 MB | 31 Oct 2018 - 16:25 |
| Alexa (IA Archiver) | 200 | 1.70 GB | 31 Oct 2018 - 15:47 |
| MagpieRSS | 244 | 48.80 GB | 31 Oct 2018 - 15:45 |
| Netcraft | 1 | 0 | 31 Oct 2018 - 15:09 |
| Unknown robot (identified by 'spider') | 48 | 18.81 GB | 31 Oct 2018 - 11:54 |
| Bing Preview bot | 136 | 32.26 GB | 31 Oct 2018 - 11:45 |
| CFNetwork | 44 | 0 | 31 Oct 2018 - 07:19 |
| Web Core / Roots | 61 | 15.55 GB | 31 Oct 2018 - 05:53 |
| Sogou Spider | 140 | 92.12 MB | 31 Oct 2018 - 04:08 |
| MojeekBot | 16 | 70.50 KB | 31 Oct 2018 - 01:42 |
| LinkChecker | 2 | 0 | 31 Oct 2018 - 00:50 |
| twitterbot | 7 | 3.04 GB | 30 Oct 2018 - 21:05 |
| YaCy | 40 | 2.26 GB | 30 Oct 2018 - 19:45 |
| FaceBook bot | 9 | 22.04 KB | 30 Oct 2018 - 14:20 |
| Google Web Preview | 17 | 44.93 KB | 30 Oct 2018 - 11:16 |
| ning | 57 | 1.10 GB | 30 Oct 2018 - 10:06 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 799 | 3.75 GB | 30 Oct 2018 - 08:20 |
| Cliqzbot | 24 | 32.21 MB | 30 Oct 2018 - 05:50 |
| Google AdSense | 1 | 479.24 KB | 30 Oct 2018 - 04:40 |
| IDMARCH | 38 | 2.24 GB | 30 Oct 2018 - 00:41 |
| Unknown robot (identified by 'crawl') | 263 | 5.50 GB | 29 Oct 2018 - 17:59 |
| Nutch | 1 | 3.43 KB | 29 Oct 2018 - 16:40 |
| archive.org bot | 8 | 28.62 KB | 29 Oct 2018 - 07:23 |
| Suspected bot masqurading as Mozilla | 137 | 4.96 GB | 28 Oct 2018 - 20:16 |
| 360spider | 13 | 19.01 MB | 28 Oct 2018 - 09:37 |
| yeti | 9 | 13.45 MB | 27 Oct 2018 - 20:14 |
| IstellaBot | 1 | 3.30 KB | 27 Oct 2018 - 12:02 |
| SeznamBot | 85 | 7.57 GB | 27 Oct 2018 - 00:02 |
| Sift | 2 | 6.85 KB | 26 Oct 2018 - 21:31 |
| ScoutJet crawler for Blekko. | 2 | 9.09 KB | 26 Oct 2018 - 18:19 |
| Aport | 7 | 17.49 KB | 26 Oct 2018 - 16:21 |
| MJ12bot | 29 | 105.34 KB | 26 Oct 2018 - 02:58 |
| ComputingSite Robi/1.0 | 1 | 189.04 MB | 25 Oct 2018 - 01:21 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 24 Oct 2018 - 23:51 |
| lwp-trivial | 1 | 3.43 KB | 24 Oct 2018 - 19:01 |
| SEOkicks Webcrawler | 48 | 78.14 MB | 24 Oct 2018 - 18:48 |
| Googlebot-Image | 2 | 1.94 MB | 23 Oct 2018 - 21:08 |
| oBot | 37 | 207.61 MB | 22 Oct 2018 - 22:24 |
| Common Crawl | 87 | 56.03 MB | 22 Oct 2018 - 04:19 |
|