| 63 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 1,548,368 | 8701.35 GB | 30 Apr 2019 - 23:59 |
| Unknown robot (identified by empty user agent string) | 9,110 | 237.40 GB | 30 Apr 2019 - 23:59 |
| check_http (nagios) | 5,715 | 18.34 MB | 30 Apr 2019 - 23:58 |
| FavIconizer | 165 | 47.11 MB | 30 Apr 2019 - 23:56 |
| Googlebot | 18,390 | 102.34 GB | 30 Apr 2019 - 23:56 |
| Bingbot | 12,448 | 226.12 GB | 30 Apr 2019 - 23:54 |
| SemrushBot | 13,610 | 70.73 GB | 30 Apr 2019 - 23:53 |
| Yandex Bot | 15,807 | 2010.72 GB | 30 Apr 2019 - 23:52 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 13,618 | 123.37 GB | 30 Apr 2019 - 23:45 |
| Python-urllib | 17,646 | 17.76 GB | 30 Apr 2019 - 23:40 |
| Googlebot-Image | 46 | 595.54 KB | 30 Apr 2019 - 23:20 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,466 | 44.74 GB | 30 Apr 2019 - 23:13 |
| Unknown robot (identified by 'spider') | 46 | 14.91 GB | 30 Apr 2019 - 22:52 |
| ltx71 | 259 | 40.36 GB | 30 Apr 2019 - 22:34 |
| Exabot | 178 | 3.66 MB | 30 Apr 2019 - 21:58 |
| BaiDuSpider | 1,914 | 97.90 GB | 30 Apr 2019 - 21:13 |
| YaCy | 118 | 10.35 GB | 30 Apr 2019 - 21:12 |
| 360spider | 39 | 28.23 MB | 30 Apr 2019 - 21:11 |
| Bing Preview bot | 144 | 22.94 GB | 30 Apr 2019 - 18:41 |
| Netcraft | 4 | 9.80 KB | 30 Apr 2019 - 18:05 |
| Java (Often spam bot) | 755 | 11.84 GB | 30 Apr 2019 - 16:40 |
| Unknown robot (identified by 'crawl') | 7,803 | 133.21 GB | 30 Apr 2019 - 15:55 |
| Suspected bot masqurading as Mozilla | 187 | 40.10 KB | 30 Apr 2019 - 14:31 |
| Suspected bot masqurading as Mozilla | 145 | 6.68 GB | 30 Apr 2019 - 13:47 |
| AhrefsBot | 281 | 2.40 GB | 30 Apr 2019 - 13:42 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 471 | 11.75 GB | 30 Apr 2019 - 13:14 |
| DotBot, Open Site Explorer | 92 | 8.65 GB | 30 Apr 2019 - 12:17 |
| Ruby script | 1 | 3.35 KB | 30 Apr 2019 - 11:55 |
| LinkChecker | 23 | 0 | 30 Apr 2019 - 10:21 |
| Alexa (IA Archiver) | 260 | 230.54 MB | 30 Apr 2019 - 09:27 |
| Sogou Spider | 158 | 246.39 MB | 30 Apr 2019 - 08:47 |
| Perl tool | 485 | 3.74 GB | 30 Apr 2019 - 07:10 |
| MagpieRSS | 1,008 | 229.23 GB | 30 Apr 2019 - 02:39 |
| Google AdSense | 5 | 14.02 GB | 29 Apr 2019 - 04:25 |
| Mail.ru bot | 90 | 189.05 MB | 28 Apr 2019 - 15:37 |
| SeznamBot | 92 | 23.88 MB | 28 Apr 2019 - 14:24 |
| Web Core / Roots | 22 | 2.19 GB | 28 Apr 2019 - 12:56 |
| Suspected bot masquerading as M$ IE | 1 | 6.32 KB | 28 Apr 2019 - 08:43 |
| SEOkicks Webcrawler | 120 | 206.69 MB | 28 Apr 2019 - 03:52 |
| MojeekBot | 8 | 52.50 KB | 28 Apr 2019 - 00:40 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 196 | 25.18 GB | 26 Apr 2019 - 12:10 |
| Cliqzbot | 23 | 118.28 MB | 25 Apr 2019 - 22:38 |
| CFNetwork | 5 | 1.09 GB | 25 Apr 2019 - 02:04 |
| oBot | 1 | 3.22 KB | 24 Apr 2019 - 17:29 |
| Fish search | 12 | 30.68 KB | 24 Apr 2019 - 03:08 |
| Jakarta commons-httpclient | 2 | 27.58 MB | 23 Apr 2019 - 11:11 |
| Common Crawl | 100 | 255.46 MB | 23 Apr 2019 - 04:53 |
| MJ12bot | 25 | 4.43 GB | 20 Apr 2019 - 17:53 |
| SMTBot | 46 | 993.85 MB | 20 Apr 2019 - 06:23 |
| twitterbot | 9 | 1.40 GB | 19 Apr 2019 - 11:29 |
| FaceBook bot | 1 | 261.13 MB | 19 Apr 2019 - 02:34 |
| Nutch | 11 | 1.88 GB | 17 Apr 2019 - 11:20 |
| ning | 259 | 835.42 MB | 16 Apr 2019 - 14:03 |
| InternetArchive | 1 | 0 | 15 Apr 2019 - 14:45 |
| Phantom | 1 | 1.28 KB | 13 Apr 2019 - 10:57 |
| Sift | 2 | 6.45 KB | 13 Apr 2019 - 04:32 |
| MS Search 6.0 Robot (MS SharePoint Portal Server?) | 1 | 3.22 KB | 10 Apr 2019 - 20:39 |
| LinkBot | 1 | 0 | 10 Apr 2019 - 06:42 |
| IstellaBot | 2 | 6.57 KB | 10 Apr 2019 - 00:13 |
| WordPress | 4 | 13.15 KB | 08 Apr 2019 - 18:03 |
| JoBo Java Web Robot | 1 | 3.22 KB | 08 Apr 2019 - 09:32 |
| ActiveBookmark | 1 | 5.24 KB | 08 Apr 2019 - 09:32 |
| InfoBot | 16 | 64.44 KB | 05 Apr 2019 - 12:08 |
|