| 47 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 24,234 | 145.48 GB | 31 Jul 2020 - 23:09 |
| AhrefsBot | 9,908 | 398.09 GB | 31 Jul 2020 - 23:05 |
| SemrushBot | 7,915 | 556.51 GB | 31 Jul 2020 - 23:09 |
| Unknown robot (identified by 'crawl') | 2,546 | 75.41 GB | 31 Jul 2020 - 12:45 |
| CFNetwork | 2,543 | 251.23 MB | 31 Jul 2020 - 12:40 |
| Googlebot | 2,072 | 35.46 GB | 31 Jul 2020 - 23:07 |
| Bingbot | 1,718 | 29.20 GB | 31 Jul 2020 - 22:52 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,418 | 28.96 GB | 31 Jul 2020 - 22:55 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 904 | 115.05 MB | 31 Jul 2020 - 22:57 |
| Yandex Bot | 834 | 29.99 GB | 31 Jul 2020 - 22:53 |
| Perl tool | 549 | 2.74 MB | 31 Jul 2020 - 22:00 |
| DotBot, Open Site Explorer | 374 | 11.47 GB | 31 Jul 2020 - 22:45 |
| Unknown robot (identified by empty user agent string) | 294 | 16.94 GB | 31 Jul 2020 - 22:05 |
| LinkChecker | 234 | 0 | 31 Jul 2020 - 13:59 |
| Java (Often spam bot) | 142 | 2.55 GB | 27 Jul 2020 - 22:49 |
| MJ12bot | 122 | 4.70 GB | 30 Jul 2020 - 13:37 |
| Unknown robot (identified by 'spider') | 96 | 6.47 GB | 31 Jul 2020 - 21:32 |
| SEOkicks Webcrawler | 94 | 416.02 KB | 03 Jul 2020 - 21:46 |
| FavIconizer | 79 | 439.17 MB | 31 Jul 2020 - 16:08 |
| WGet tools | 78 | 1.74 GB | 31 Jul 2020 - 02:41 |
| Web Core / Roots | 74 | 3.34 GB | 31 Jul 2020 - 00:20 |
| rpt-httpclient | 62 | 152.21 MB | 31 Jul 2020 - 19:07 |
| Bing Preview bot | 44 | 3.12 GB | 31 Jul 2020 - 21:39 |
| Common Crawl | 42 | 66.90 MB | 15 Jul 2020 - 08:07 |
| Google Web Preview | 42 | 299.23 MB | 31 Jul 2020 - 06:47 |
| FaceBook bot | 37 | 234.70 MB | 30 Jul 2020 - 19:05 |
| Feedfetcher-Google | 31 | 9.96 KB | 31 Jul 2020 - 19:51 |
| Suspected bot masqurading as Mozilla | 31 | 0 | 31 Jul 2020 - 16:01 |
| Python-urllib | 27 | 1.00 GB | 30 Jul 2020 - 07:10 |
| Alexa (IA Archiver) | 24 | 100.68 KB | 12 Jul 2020 - 21:55 |
| SeznamBot | 23 | 52.58 MB | 27 Jul 2020 - 12:44 |
| Sogou Spider | 17 | 20.01 MB | 30 Jul 2020 - 21:59 |
| Mail.ru bot | 12 | 43.40 MB | 16 Jul 2020 - 15:30 |
| BaiDuSpider | 12 | 386.18 MB | 31 Jul 2020 - 08:32 |
| Motor | 8 | 237.20 MB | 30 Jul 2020 - 23:56 |
| twitterbot | 6 | 146.24 MB | 28 Jul 2020 - 12:58 |
| Suspected bot masqurading as Mozilla | 6 | 6 Bytes | 28 Jul 2020 - 00:47 |
| ltx71 | 5 | 118.65 MB | 19 Jul 2020 - 16:37 |
| Fish search | 3 | 210.19 MB | 14 Jul 2020 - 11:00 |
| Cliqzbot | 3 | 21.73 MB | 19 Jul 2020 - 19:13 |
| ning | 3 | 22.42 MB | 31 Jul 2020 - 03:02 |
| MojeekBot | 2 | 6.47 KB | 29 Jul 2020 - 10:18 |
| Cfetch | 2 | 15.34 MB | 25 Jul 2020 - 20:15 |
| Unknown robot (identified by 'robot') | 2 | 8.52 KB | 21 Jul 2020 - 12:09 |
| InternetArchive | 1 | 0 | 07 Jul 2020 - 17:25 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 10 Jul 2020 - 09:28 |
| archive.org bot | 1 | 7.75 MB | 22 Jul 2020 - 18:21 |
|