| 48 different robots | Hits | Bandwidth | Last visit |
|---|
| Common *nix tool for automating web document retireval. Most likely a bot. | 18,106 | 120.21 GB | 31 Mar 2021 - 22:24 |
| AhrefsBot | 6,633 | 162.86 GB | 31 Mar 2021 - 23:07 |
| Bingbot | 3,955 | 55.73 GB | 31 Mar 2021 - 23:08 |
| SemrushBot | 3,892 | 275.56 GB | 31 Mar 2021 - 22:28 |
| Python-urllib | 3,336 | 288.31 GB | 29 Mar 2021 - 08:32 |
| Unknown robot (identified by 'crawl') | 2,074 | 101.61 GB | 31 Mar 2021 - 18:15 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 1,670 | 108.12 GB | 31 Mar 2021 - 22:28 |
| Web Core / Roots | 1,570 | 4.48 GB | 31 Mar 2021 - 23:02 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,454 | 144.15 MB | 31 Mar 2021 - 13:29 |
| Googlebot | 1,284 | 13.30 GB | 31 Mar 2021 - 21:33 |
| Yandex Bot | 792 | 27.96 GB | 31 Mar 2021 - 06:42 |
| DotBot, Open Site Explorer | 704 | 5.61 GB | 31 Mar 2021 - 18:49 |
| Unknown robot (identified by empty user agent string) | 324 | 18.32 GB | 31 Mar 2021 - 21:13 |
| Google Web Preview | 205 | 4.91 GB | 31 Mar 2021 - 18:47 |
| ltx71 | 151 | 17.22 GB | 31 Mar 2021 - 22:22 |
| LinkChecker | 129 | 0 | 31 Mar 2021 - 09:38 |
| Unknown robot (identified by 'spider') | 124 | 4.16 GB | 31 Mar 2021 - 23:06 |
| Common Crawl | 119 | 3.60 GB | 08 Mar 2021 - 19:06 |
| MJ12bot | 101 | 1.07 GB | 31 Mar 2021 - 18:14 |
| Java (Often spam bot) | 67 | 165.16 MB | 30 Mar 2021 - 21:38 |
| WGet tools | 62 | 2.52 GB | 29 Mar 2021 - 23:46 |
| rpt-httpclient | 61 | 608.84 MB | 31 Mar 2021 - 21:44 |
| Bing Preview bot | 56 | 3.16 GB | 31 Mar 2021 - 08:24 |
| FaceBook bot | 55 | 315.10 MB | 29 Mar 2021 - 01:55 |
| yeti | 28 | 216.93 MB | 22 Mar 2021 - 19:39 |
| HTTrack off-line browser | 27 | 433.57 MB | 21 Mar 2021 - 10:48 |
| FavIconizer | 21 | 1.38 GB | 31 Mar 2021 - 09:57 |
| BaiDuSpider | 20 | 721.55 MB | 30 Mar 2021 - 19:40 |
| SeznamBot | 20 | 40.54 MB | 31 Mar 2021 - 13:42 |
| Unknown robot (identified by 'robot') | 17 | 157.66 KB | 30 Mar 2021 - 11:33 |
| Mail.ru bot | 15 | 61.07 MB | 30 Mar 2021 - 15:21 |
| WordPress | 12 | 31.65 MB | 12 Mar 2021 - 10:05 |
| SEOkicks Webcrawler | 12 | 93.54 KB | 20 Mar 2021 - 08:07 |
| Sogou Spider | 11 | 34.59 MB | 31 Mar 2021 - 19:49 |
| GetURL | 9 | 57.52 KB | 28 Mar 2021 - 03:29 |
| WebCopy | 9 | 40.29 KB | 18 Mar 2021 - 06:28 |
| CFNetwork | 5 | 152.44 MB | 20 Mar 2021 - 00:15 |
| Nutch | 5 | 38.91 MB | 27 Mar 2021 - 11:29 |
| Motor | 4 | 31.66 MB | 31 Mar 2021 - 03:43 |
| Suspected bot masqurading as Mozilla | 3 | 0 | 25 Mar 2021 - 02:12 |
| 360spider | 3 | 141.82 MB | 04 Mar 2021 - 21:47 |
| Sift | 2 | 7.92 MB | 16 Mar 2021 - 14:08 |
| MS Search 6.0 Robot (MS SharePoint Portal Server?) | 2 | 6.04 KB | 05 Mar 2021 - 07:13 |
| twitterbot | 2 | 8.56 MB | 16 Mar 2021 - 19:07 |
| ning | 1 | 8.62 MB | 18 Mar 2021 - 07:55 |
| Googlebot-Image | 1 | 7.07 MB | 26 Mar 2021 - 13:54 |
| Cfetch | 1 | 7.92 MB | 31 Mar 2021 - 03:57 |
| Google AdSense | 1 | 7.11 MB | 05 Mar 2021 - 16:01 |
|