| 70 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 1,697,814 | 7689.79 GB | 31 Jan 2019 - 23:59 |
| SemrushBot | 4,857 | 26.57 GB | 31 Jan 2019 - 23:59 |
| Bingbot | 8,570 | 113.58 GB | 31 Jan 2019 - 23:57 |
| check_http (nagios) | 6,781 | 22.02 MB | 31 Jan 2019 - 23:54 |
| Unknown robot (identified by empty user agent string) | 6,059 | 67.80 GB | 31 Jan 2019 - 23:54 |
| BaiDuSpider | 3,054 | 112.79 GB | 31 Jan 2019 - 23:53 |
| Perl tool | 634 | 7.14 GB | 31 Jan 2019 - 23:52 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 5,222 | 92.58 GB | 31 Jan 2019 - 23:42 |
| Yandex Bot | 22,095 | 1318.46 GB | 31 Jan 2019 - 23:37 |
| Java (Often spam bot) | 426 | 8.33 MB | 31 Jan 2019 - 23:22 |
| Phantom | 13 | 32.72 KB | 31 Jan 2019 - 23:05 |
| Suspected bot masqurading as Mozilla | 227 | 52.48 MB | 31 Jan 2019 - 22:42 |
| ltx71 | 452 | 52.38 GB | 31 Jan 2019 - 22:35 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 15,400 | 304.59 GB | 31 Jan 2019 - 22:30 |
| Googlebot | 1,536 | 25.07 GB | 31 Jan 2019 - 21:29 |
| Cliqzbot | 26 | 54.97 MB | 31 Jan 2019 - 21:22 |
| Googlebot-Image | 17 | 665.49 KB | 31 Jan 2019 - 20:36 |
| FavIconizer | 187 | 17.67 MB | 31 Jan 2019 - 20:31 |
| ScoutJet crawler for Blekko. | 3 | 8.43 KB | 31 Jan 2019 - 18:03 |
| MojeekBot | 12 | 55.64 KB | 31 Jan 2019 - 15:26 |
| Alexa (IA Archiver) | 41 | 282.00 KB | 31 Jan 2019 - 14:28 |
| Web Core / Roots | 63 | 9.04 GB | 31 Jan 2019 - 12:42 |
| Python-urllib | 2,008 | 38.55 GB | 31 Jan 2019 - 12:12 |
| SeznamBot | 153 | 7.47 GB | 31 Jan 2019 - 12:09 |
| Exabot | 179 | 1.89 MB | 31 Jan 2019 - 09:41 |
| DotBot, Open Site Explorer | 124 | 17.27 GB | 31 Jan 2019 - 09:38 |
| Sogou Spider | 152 | 1.05 GB | 31 Jan 2019 - 09:10 |
| LinkChecker | 3 | 0 | 31 Jan 2019 - 01:24 |
| Bing Preview bot | 76 | 29.97 GB | 31 Jan 2019 - 01:14 |
| Unknown robot (identified by 'spider') | 71 | 9.41 GB | 31 Jan 2019 - 00:48 |
| SEOkicks Webcrawler | 112 | 172.00 MB | 30 Jan 2019 - 20:30 |
| FaceBook bot | 2 | 1.01 MB | 30 Jan 2019 - 14:18 |
| Mail.ru bot | 122 | 698.37 MB | 30 Jan 2019 - 06:06 |
| Unknown robot (identified by 'crawl') | 23,088 | 297.53 GB | 30 Jan 2019 - 03:24 |
| YaCy | 137 | 13.71 GB | 29 Jan 2019 - 21:51 |
| A PHP script | 2 | 514.00 MB | 29 Jan 2019 - 17:45 |
| archive.org bot | 8 | 17.89 KB | 29 Jan 2019 - 03:31 |
| Nutch | 22 | 3.40 GB | 29 Jan 2019 - 01:15 |
| Unknown robot (identified by 'robot') | 7 | 13.54 MB | 28 Jan 2019 - 09:40 |
| 360spider | 23 | 18.18 MB | 28 Jan 2019 - 06:42 |
| MagpieRSS | 79 | 16.31 GB | 28 Jan 2019 - 03:31 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 261 | 24.40 GB | 28 Jan 2019 - 01:09 |
| WordPress | 11 | 4.77 KB | 27 Jan 2019 - 21:29 |
| twitterbot | 4 | 943.17 MB | 27 Jan 2019 - 11:31 |
| ning | 79 | 3.97 GB | 27 Jan 2019 - 09:34 |
| AhrefsBot | 69 | 421.48 MB | 27 Jan 2019 - 04:29 |
| Google Web Preview | 19 | 378.32 MB | 26 Jan 2019 - 15:58 |
| Custo | 1 | 7.39 KB | 25 Jan 2019 - 18:18 |
| CFNetwork | 7 | 1.16 GB | 25 Jan 2019 - 17:05 |
| Turn It In | 1 | 271.94 KB | 25 Jan 2019 - 08:19 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 5 | 453.54 MB | 24 Jan 2019 - 09:00 |
| MJ12bot | 3 | 17.08 KB | 24 Jan 2019 - 04:23 |
| WebCopy | 6 | 43.91 MB | 22 Jan 2019 - 16:55 |
| oBot | 1 | 3.22 KB | 21 Jan 2019 - 08:53 |
| Common Crawl | 117 | 1.72 GB | 21 Jan 2019 - 08:22 |
| SMTBot | 69 | 263.41 MB | 20 Jan 2019 - 06:29 |
| Sift | 8 | 26.63 KB | 19 Jan 2019 - 21:51 |
| HTTrack off-line browser | 1 | 3.43 KB | 19 Jan 2019 - 00:26 |
| InfoBot | 18 | 74.05 KB | 18 Jan 2019 - 15:28 |
| Simmany Robot Ver1.0 | 4 | 896.01 MB | 17 Jan 2019 - 04:04 |
| lwp-trivial | 1 | 3.43 KB | 16 Jan 2019 - 21:25 |
| Google AdSense | 1 | 2.80 GB | 16 Jan 2019 - 20:20 |
| LinkBot | 1 | 0 | 14 Jan 2019 - 11:22 |
| VSE | 45 | 2.53 GB | 12 Jan 2019 - 03:50 |
| CMS Crawler | 1 | 3.43 KB | 09 Jan 2019 - 23:05 |
| Fish search | 2 | 5.52 KB | 07 Jan 2019 - 04:58 |
| Suke | 7 | 22.35 KB | 07 Jan 2019 - 04:57 |
| Netcraft | 3 | 10.03 KB | 06 Jan 2019 - 17:41 |
| Suspected bot masqurading as Mozilla | 6 | 34.49 MB | 04 Jan 2019 - 08:23 |
| microsoft-webdav-miniredir | 1 | 0 | 03 Jan 2019 - 22:47 |
|