| 56 different robots | Hits | Bandwidth | Last visit |
|---|
| SemrushBot | 1,911 | 28.21 GB | 30 Nov 2018 - 23:56 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 17,833 | 115.23 GB | 30 Nov 2018 - 23:55 |
| Yandex Bot | 1,050 | 77.37 GB | 30 Nov 2018 - 23:54 |
| BaiDuSpider | 498 | 19.16 GB | 30 Nov 2018 - 23:47 |
| Bingbot | 822 | 13.99 GB | 30 Nov 2018 - 23:44 |
| Bing Preview bot | 155 | 4.22 GB | 30 Nov 2018 - 23:29 |
| CFNetwork | 2,907 | 17.76 GB | 30 Nov 2018 - 23:21 |
| LinkChecker | 8 | 0 | 30 Nov 2018 - 23:02 |
| Unknown robot (identified by 'crawl') | 774 | 14.13 GB | 30 Nov 2018 - 22:59 |
| Googlebot | 1,642 | 63.88 GB | 30 Nov 2018 - 22:58 |
| Unknown robot (identified by empty user agent string) | 305 | 12.66 GB | 30 Nov 2018 - 22:29 |
| Web Core / Roots | 367 | 23.65 GB | 30 Nov 2018 - 22:22 |
| AhrefsBot | 717 | 14.67 GB | 30 Nov 2018 - 22:20 |
| Feedfetcher-Google | 236 | 1.42 MB | 30 Nov 2018 - 21:58 |
| MJ12bot | 55 | 166.01 MB | 30 Nov 2018 - 20:35 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 454 | 230.44 MB | 30 Nov 2018 - 19:38 |
| SeznamBot | 5 | 14.14 MB | 30 Nov 2018 - 19:33 |
| rpt-httpclient | 66 | 2.97 GB | 30 Nov 2018 - 18:29 |
| Java (Often spam bot) | 439 | 11.67 GB | 30 Nov 2018 - 18:10 |
| Google AdSense | 24 | 1.14 GB | 30 Nov 2018 - 17:42 |
| Sogou Spider | 43 | 144.38 MB | 30 Nov 2018 - 16:10 |
| ning | 113 | 463.08 MB | 30 Nov 2018 - 16:02 |
| Alexa (IA Archiver) | 47 | 3.79 GB | 30 Nov 2018 - 15:56 |
| ltx71 | 98 | 6.53 GB | 30 Nov 2018 - 15:29 |
| FavIconizer | 135 | 686.39 MB | 30 Nov 2018 - 14:47 |
| DotBot, Open Site Explorer | 116 | 3.94 GB | 30 Nov 2018 - 13:33 |
| MSNBot | 1 | 51.41 MB | 30 Nov 2018 - 13:16 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 180 | 11.47 GB | 30 Nov 2018 - 11:04 |
| Python-urllib | 62 | 5.54 GB | 30 Nov 2018 - 09:23 |
| Perl tool | 404 | 118.68 MB | 30 Nov 2018 - 03:35 |
| WGet tools | 74 | 2.77 GB | 30 Nov 2018 - 03:35 |
| Google Web Preview | 319 | 24.38 GB | 29 Nov 2018 - 20:38 |
| Suspected bot masqurading as Mozilla | 48 | 20.16 KB | 29 Nov 2018 - 19:06 |
| Suspected bot masqurading as Mozilla | 9 | 169.29 MB | 29 Nov 2018 - 02:52 |
| yeti | 2 | 83.61 MB | 29 Nov 2018 - 02:25 |
| 007ac9 Crawler, seems to belong to SISTRIX | 10 | 36.23 KB | 27 Nov 2018 - 20:26 |
| FaceBook bot | 28 | 14.91 MB | 27 Nov 2018 - 06:53 |
| Unknown robot (identified by 'robot') | 8 | 7.41 MB | 26 Nov 2018 - 20:52 |
| Turn It In | 49 | 401.90 MB | 25 Nov 2018 - 07:13 |
| Mail.ru bot | 5 | 7.98 MB | 23 Nov 2018 - 09:49 |
| Common Crawl | 42 | 12.78 MB | 21 Nov 2018 - 20:14 |
| 360spider | 1 | 10.05 KB | 21 Nov 2018 - 08:39 |
| Unknown robot (identified by 'spider') | 3 | 17.35 KB | 21 Nov 2018 - 05:15 |
| YaCy | 1 | 3.64 KB | 19 Nov 2018 - 02:32 |
| SMTBot | 1 | 7.13 MB | 17 Nov 2018 - 20:17 |
| ZumBot | 8 | 29.24 MB | 17 Nov 2018 - 07:51 |
| twitterbot | 1 | 7.13 MB | 16 Nov 2018 - 22:46 |
| InternetArchive | 1 | 0 | 16 Nov 2018 - 18:19 |
| Exabot | 8 | 28.92 KB | 16 Nov 2018 - 05:14 |
| Cliqzbot | 1 | 3.60 KB | 13 Nov 2018 - 06:38 |
| Yahoo Slurp | 1 | 7.27 MB | 11 Nov 2018 - 21:04 |
| HTTrack off-line browser | 1 | 7.06 MB | 11 Nov 2018 - 19:55 |
| microsoft-webdav-miniredir | 1 | 0 | 10 Nov 2018 - 03:52 |
| Xenu's Link Sleuth (TM), see Wikipedia | 5 | 0 | 04 Nov 2018 - 20:08 |
| Custo | 1 | 78.73 MB | 04 Nov 2018 - 15:25 |
| Nutch | 1 | 81.80 MB | 03 Nov 2018 - 07:01 |