| 55 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 18,063 | 115.29 GB | 29 Feb 2020 - 21:24 |
| SemrushBot | 6,687 | 387.73 GB | 29 Feb 2020 - 23:01 |
| Yandex Bot | 2,869 | 291.80 GB | 29 Feb 2020 - 23:03 |
| Unknown robot (identified by 'crawl') | 2,213 | 77.28 GB | 29 Feb 2020 - 21:25 |
| Googlebot | 1,623 | 23.31 GB | 29 Feb 2020 - 22:32 |
| CFNetwork | 1,464 | 1.90 GB | 29 Feb 2020 - 14:49 |
| AhrefsBot | 1,318 | 70.73 GB | 29 Feb 2020 - 22:10 |
| Bingbot | 1,070 | 5.80 GB | 29 Feb 2020 - 21:33 |
| Perl tool | 692 | 86.60 MB | 29 Feb 2020 - 23:00 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 679 | 14.08 GB | 29 Feb 2020 - 22:55 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 334 | 90.51 MB | 29 Feb 2020 - 12:51 |
| DotBot, Open Site Explorer | 323 | 11.60 GB | 29 Feb 2020 - 19:21 |
| Java (Often spam bot) | 297 | 8.35 GB | 29 Feb 2020 - 08:45 |
| Unknown robot (identified by empty user agent string) | 260 | 16.69 GB | 29 Feb 2020 - 21:15 |
| WGet tools | 252 | 5.56 GB | 29 Feb 2020 - 15:36 |
| Cliqzbot | 229 | 1.56 GB | 29 Feb 2020 - 07:32 |
| LinkChecker | 225 | 0 | 29 Feb 2020 - 13:56 |
| Web Core / Roots | 154 | 4.42 GB | 29 Feb 2020 - 20:51 |
| Sogou Spider | 122 | 614.01 MB | 29 Feb 2020 - 10:12 |
| Alexa (IA Archiver) | 104 | 11.21 GB | 25 Feb 2020 - 04:43 |
| rpt-httpclient | 101 | 1.41 GB | 29 Feb 2020 - 20:45 |
| MJ12bot | 80 | 2.89 GB | 29 Feb 2020 - 12:46 |
| MSNBot | 69 | 3.18 GB | 29 Feb 2020 - 19:51 |
| FaceBook bot | 63 | 241.78 MB | 29 Feb 2020 - 18:23 |
| BaiDuSpider | 45 | 1.34 GB | 29 Feb 2020 - 11:06 |
| FavIconizer | 42 | 482.07 MB | 29 Feb 2020 - 10:10 |
| Suspected bot masqurading as Mozilla | 36 | 44.71 MB | 29 Feb 2020 - 14:05 |
| Python-urllib | 34 | 3.56 GB | 29 Feb 2020 - 12:01 |
| SeznamBot | 31 | 126.57 MB | 27 Feb 2020 - 13:31 |
| Feedfetcher-Google | 29 | 9.32 KB | 29 Feb 2020 - 19:23 |
| Bing Preview bot | 28 | 1.80 GB | 27 Feb 2020 - 06:05 |
| ltx71 | 27 | 2.45 GB | 29 Feb 2020 - 04:26 |
| SEOkicks Webcrawler | 23 | 102.50 KB | 24 Feb 2020 - 20:13 |
| Common Crawl | 23 | 7.40 MB | 28 Feb 2020 - 06:28 |
| Suspected bot masqurading as Mozilla | 15 | 0 | 28 Feb 2020 - 23:54 |
| Mail.ru bot | 14 | 31.33 MB | 29 Feb 2020 - 15:19 |
| ning | 11 | 762.97 MB | 25 Feb 2020 - 07:53 |
| Unknown robot (identified by 'spider') | 10 | 37.07 MB | 28 Feb 2020 - 08:57 |
| Turn It In | 7 | 367.84 MB | 18 Feb 2020 - 10:15 |
| WordPress | 7 | 0 | 19 Feb 2020 - 17:03 |
| Nutch | 4 | 237.90 MB | 22 Feb 2020 - 19:35 |
| twitterbot | 3 | 93.81 MB | 22 Feb 2020 - 08:17 |
| Google AdSense | 3 | 108.46 MB | 29 Feb 2020 - 21:52 |
| SMTBot | 2 | 14.56 MB | 24 Feb 2020 - 12:39 |
| yeti | 2 | 83.60 MB | 20 Feb 2020 - 07:17 |
| Cfetch | 2 | 108.11 MB | 25 Feb 2020 - 09:56 |
| MojeekBot | 1 | 3.70 KB | 16 Feb 2020 - 22:13 |
| GigaBot | 1 | 3.50 KB | 06 Feb 2020 - 05:11 |
| InternetArchive | 1 | 0 | 19 Feb 2020 - 08:32 |
| Motor | 1 | 69.44 MB | 16 Feb 2020 - 20:34 |
| HTTrack off-line browser | 1 | 7.67 MB | 26 Feb 2020 - 17:34 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 19 Feb 2020 - 08:58 |
| Yahoo Slurp | 1 | 7.26 MB | 07 Feb 2020 - 17:32 |
| Google Web Preview | 1 | 76.11 MB | 13 Feb 2020 - 16:42 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 1 | 7.38 MB | 08 Feb 2020 - 01:33 |
|