| 67 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 1,646,518 | 8047.90 GB | 31 Dec 2018 - 23:59 |
| Yandex Bot | 28,973 | 1484.73 GB | 31 Dec 2018 - 23:48 |
| Bingbot | 7,161 | 84.59 GB | 31 Dec 2018 - 23:55 |
| SemrushBot | 7,009 | 55.62 GB | 31 Dec 2018 - 23:48 |
| Unknown robot (identified by empty user agent string) | 6,373 | 257.65 GB | 31 Dec 2018 - 23:10 |
| check_http (nagios) | 6,190 | 20.36 MB | 31 Dec 2018 - 23:58 |
| Unknown robot (identified by 'crawl') | 5,436 | 103.29 GB | 31 Dec 2018 - 20:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 4,590 | 73.61 GB | 31 Dec 2018 - 23:00 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 4,459 | 118.65 GB | 31 Dec 2018 - 22:48 |
| BaiDuSpider | 3,707 | 92.03 GB | 31 Dec 2018 - 23:35 |
| Python-urllib | 3,312 | 22.27 GB | 31 Dec 2018 - 04:26 |
| Googlebot | 1,239 | 13.73 GB | 31 Dec 2018 - 22:44 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 995 | 17.87 GB | 29 Dec 2018 - 01:21 |
| Y!J Yahoo Japan | 599 | 14.11 GB | 25 Dec 2018 - 18:51 |
| Suspected bot masqurading as Mozilla | 514 | 29.50 MB | 31 Dec 2018 - 21:07 |
| Java (Often spam bot) | 417 | 1.64 GB | 29 Dec 2018 - 12:45 |
| Perl tool | 336 | 4.92 GB | 31 Dec 2018 - 08:10 |
| Mail.ru bot | 233 | 1.37 GB | 31 Dec 2018 - 17:41 |
| Sogou Spider | 227 | 359.77 MB | 31 Dec 2018 - 16:15 |
| SeznamBot | 227 | 13.83 GB | 31 Dec 2018 - 23:00 |
| Exabot | 222 | 2.67 MB | 31 Dec 2018 - 06:05 |
| Alexa (IA Archiver) | 220 | 11.43 GB | 31 Dec 2018 - 22:31 |
| ltx71 | 184 | 24.39 GB | 30 Dec 2018 - 22:43 |
| Bing Preview bot | 153 | 29.90 GB | 31 Dec 2018 - 23:32 |
| Suspected bot masqurading as Mozilla | 144 | 6.27 GB | 30 Dec 2018 - 03:16 |
| MagpieRSS | 142 | 29.12 GB | 30 Dec 2018 - 16:14 |
| FavIconizer | 140 | 72.83 MB | 31 Dec 2018 - 23:49 |
| AhrefsBot | 107 | 491.68 MB | 31 Dec 2018 - 22:28 |
| Common Crawl | 105 | 371.64 MB | 19 Dec 2018 - 06:32 |
| SMTBot | 97 | 558.81 MB | 26 Dec 2018 - 19:22 |
| SEOkicks Webcrawler | 96 | 162.40 MB | 29 Dec 2018 - 23:54 |
| Web Core / Roots | 72 | 6.90 GB | 28 Dec 2018 - 07:59 |
| Unknown robot (identified by 'spider') | 63 | 19.68 GB | 31 Dec 2018 - 07:03 |
| Suspected bot masqurading as Mozilla | 51 | 1.37 MB | 26 Dec 2018 - 22:58 |
| Emacs-w3 Search Engine | 48 | 465.09 MB | 03 Dec 2018 - 07:13 |
| ning | 43 | 684.86 MB | 16 Dec 2018 - 11:11 |
| 360spider | 40 | 324.49 MB | 31 Dec 2018 - 08:18 |
| DotBot, Open Site Explorer | 31 | 5.01 GB | 31 Dec 2018 - 23:54 |
| YaCy | 27 | 52.04 MB | 14 Dec 2018 - 03:57 |
| Cliqzbot | 27 | 57.10 MB | 31 Dec 2018 - 19:36 |
| FaceBook bot | 26 | 6.81 MB | 06 Dec 2018 - 03:10 |
| WordPress | 23 | 987.49 MB | 26 Dec 2018 - 23:00 |
| Nutch | 16 | 2.57 GB | 30 Dec 2018 - 21:57 |
| Googlebot-Image | 10 | 75.19 KB | 29 Dec 2018 - 02:12 |
| Phantom | 8 | 20.79 KB | 19 Dec 2018 - 07:52 |
| MJ12bot | 7 | 92.75 KB | 31 Dec 2018 - 04:47 |
| CFNetwork | 6 | 3.31 GB | 16 Dec 2018 - 08:59 |
| ComputingSite Robi/1.0 | 6 | 15.45 KB | 01 Dec 2018 - 18:34 |
| MojeekBot | 5 | 17.84 KB | 24 Dec 2018 - 14:24 |
| Suke | 5 | 23.76 KB | 14 Dec 2018 - 10:21 |
| twitterbot | 5 | 1.02 GB | 13 Dec 2018 - 20:41 |
| Netcraft | 4 | 10.15 KB | 10 Dec 2018 - 11:58 |
| LinkChecker | 3 | 0 | 30 Dec 2018 - 01:11 |
| Unknown robot (identified by 'robot') | 3 | 10.15 KB | 13 Dec 2018 - 16:35 |
| archive.org bot | 2 | 6.73 KB | 31 Dec 2018 - 10:14 |
| WebCopy | 2 | 4.51 KB | 23 Dec 2018 - 16:56 |
| microsoft-webdav-miniredir | 2 | 0 | 31 Dec 2018 - 19:15 |
| Google AdSense | 2 | 2.80 GB | 31 Dec 2018 - 16:47 |
| Sift | 2 | 171.52 MB | 31 Dec 2018 - 22:00 |
| Monster | 1 | 0 | 14 Dec 2018 - 10:21 |
| HTTrack off-line browser | 1 | 1.22 MB | 12 Dec 2018 - 16:32 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 09 Dec 2018 - 13:54 |
| Turn It In | 1 | 1.37 MB | 16 Dec 2018 - 13:32 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 0 | 14 Dec 2018 - 10:21 |
| InternetArchive | 1 | 0 | 31 Dec 2018 - 02:07 |
| Fish search | 1 | 7.79 KB | 13 Dec 2018 - 13:52 |
| Jakarta commons-httpclient | 1 | 237.00 MB | 13 Dec 2018 - 13:08 |
|