| 68 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 5,915,382 | 30767.77 GB | 31 Aug 2020 - 23:59 |
| SemrushBot | 87,016 | 426.65 GB | 31 Aug 2020 - 23:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 147,708 | 301.53 GB | 31 Aug 2020 - 23:59 |
| Googlebot | 4,898 | 50.07 GB | 31 Aug 2020 - 23:59 |
| Unknown robot (identified by 'crawl') | 170,328 | 1168.80 GB | 31 Aug 2020 - 23:58 |
| AhrefsBot | 20,376 | 537.71 GB | 31 Aug 2020 - 23:57 |
| DotBot, Open Site Explorer | 8,353 | 76.29 GB | 31 Aug 2020 - 23:57 |
| Bingbot | 72,507 | 503.27 GB | 31 Aug 2020 - 23:56 |
| 360spider | 131 | 2.35 GB | 31 Aug 2020 - 23:54 |
| Java (Often spam bot) | 1,530 | 31.45 GB | 31 Aug 2020 - 23:52 |
| Yandex Bot | 4,160 | 62.55 GB | 31 Aug 2020 - 23:51 |
| Unknown robot (identified by empty user agent string) | 26,203 | 579.44 GB | 31 Aug 2020 - 23:50 |
| Python-urllib | 9,772 | 18.92 GB | 31 Aug 2020 - 23:50 |
| check_http (nagios) | 8,831 | 28.53 MB | 31 Aug 2020 - 23:49 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 6,131 | 67.52 GB | 31 Aug 2020 - 23:49 |
| Alexa (IA Archiver) | 302 | 2.89 GB | 31 Aug 2020 - 23:43 |
| Mail.ru bot | 328 | 81.70 MB | 31 Aug 2020 - 23:05 |
| YaCy | 1,258 | 2.71 GB | 31 Aug 2020 - 22:41 |
| Nutch | 2 | 6.70 KB | 31 Aug 2020 - 22:35 |
| MagpieRSS | 806 | 159.21 GB | 31 Aug 2020 - 22:17 |
| SEOkicks Webcrawler | 357 | 15.79 GB | 31 Aug 2020 - 21:47 |
| Unknown robot (identified by 'spider') | 269 | 4.52 GB | 31 Aug 2020 - 21:41 |
| Suspected bot masqurading as Mozilla | 112 | 50.80 KB | 31 Aug 2020 - 21:22 |
| FavIconizer | 304 | 3.97 MB | 31 Aug 2020 - 20:59 |
| MJ12bot | 874 | 7.62 GB | 31 Aug 2020 - 20:50 |
| MojeekBot | 87 | 8.45 MB | 31 Aug 2020 - 20:24 |
| BaiDuSpider | 189 | 10.05 GB | 31 Aug 2020 - 19:34 |
| Sift | 47 | 1.31 MB | 31 Aug 2020 - 18:36 |
| Googlebot-Image | 88 | 32.79 MB | 31 Aug 2020 - 12:18 |
| Cfetch | 19 | 2.94 GB | 31 Aug 2020 - 11:32 |
| Suspected bot masqurading as Mozilla | 314 | 10.43 GB | 31 Aug 2020 - 11:31 |
| LinkChecker | 118 | 0 | 31 Aug 2020 - 10:24 |
| Perl tool | 454 | 4.83 GB | 31 Aug 2020 - 07:10 |
| NG 1.x (Exalead) | 1 | 3.35 KB | 31 Aug 2020 - 05:25 |
| SeznamBot | 117 | 933.28 MB | 31 Aug 2020 - 05:16 |
| twitterbot | 18 | 1.93 GB | 31 Aug 2020 - 03:29 |
| FaceBook bot | 51 | 834.09 MB | 31 Aug 2020 - 00:42 |
| ltx71 | 215 | 4.76 GB | 29 Aug 2020 - 23:55 |
| Bing Preview bot | 22 | 828.14 MB | 29 Aug 2020 - 19:48 |
| Phantom | 32 | 239.24 KB | 29 Aug 2020 - 18:27 |
| LinkBot | 2 | 62.46 KB | 29 Aug 2020 - 17:42 |
| VSE | 7 | 58.94 KB | 29 Aug 2020 - 12:14 |
| ichiro | 4 | 13.31 KB | 29 Aug 2020 - 08:42 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 4,291 | 7.84 GB | 28 Aug 2020 - 20:02 |
| Sogou Spider | 170 | 343.80 MB | 28 Aug 2020 - 19:16 |
| Custo | 28 | 2.11 GB | 28 Aug 2020 - 10:50 |
| InfoBot | 2 | 8.71 KB | 28 Aug 2020 - 02:33 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 27 Aug 2020 - 11:10 |
| Netcraft | 24 | 56.06 KB | 26 Aug 2020 - 21:46 |
| Motor | 32 | 2.38 MB | 26 Aug 2020 - 15:38 |
| Web Core / Roots | 136 | 3.53 GB | 25 Aug 2020 - 15:27 |
| WordPress | 16 | 157.92 KB | 25 Aug 2020 - 13:36 |
| yeti | 1 | 3.35 KB | 24 Aug 2020 - 23:08 |
| Yahoo Slurp | 8 | 44.43 KB | 23 Aug 2020 - 04:56 |
| ning | 25 | 897.89 MB | 21 Aug 2020 - 21:12 |
| Unknown robot (identified by 'robot') | 1 | 2.75 KB | 20 Aug 2020 - 07:18 |
| A PHP script | 2 | 6.70 KB | 15 Aug 2020 - 04:03 |
| MSNBot | 446 | 6.68 GB | 14 Aug 2020 - 14:02 |
| W3C jigsaw CSS Validator | 1 | 245 Bytes | 14 Aug 2020 - 04:37 |
| Common Crawl | 1,055 | 2.01 GB | 13 Aug 2020 - 14:58 |
| archive.org bot | 9 | 18.00 KB | 09 Aug 2020 - 21:33 |
| Emacs-w3 Search Engine | 1 | 3.35 KB | 08 Aug 2020 - 11:19 |
| HTTrack off-line browser | 5 | 230.94 MB | 07 Aug 2020 - 16:04 |
| CMS Crawler | 1 | 3.35 KB | 07 Aug 2020 - 03:47 |
| Steeler | 39 | 3.53 MB | 06 Aug 2020 - 06:44 |
| Jakarta commons-httpclient | 3 | 45.86 MB | 04 Aug 2020 - 15:44 |
| SMTBot | 45 | 62.88 MB | 02 Aug 2020 - 22:47 |
| CFNetwork | 3 | 98.86 MB | 02 Aug 2020 - 03:00 |
|