| 58 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 2,113 | 32.67 GB | 31 Oct 2019 - 23:09 |
| Unknown robot (identified by empty user agent string) | 128 | 6.32 GB | 31 Oct 2019 - 23:08 |
| SemrushBot | 6,996 | 378.04 GB | 31 Oct 2019 - 23:06 |
| Yandex Bot | 2,012 | 174.46 GB | 31 Oct 2019 - 23:02 |
| Perl tool | 19 | 370.88 KB | 31 Oct 2019 - 23:00 |
| WGet tools | 55 | 2.06 GB | 31 Oct 2019 - 23:00 |
| Java (Often spam bot) | 317 | 10.75 GB | 31 Oct 2019 - 22:59 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 10,558 | 66.23 GB | 31 Oct 2019 - 22:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 2,106 | 85.54 GB | 31 Oct 2019 - 22:57 |
| DotBot, Open Site Explorer | 179 | 2.89 GB | 31 Oct 2019 - 22:46 |
| Bing Preview bot | 268 | 4.10 GB | 31 Oct 2019 - 22:41 |
| Bingbot | 1,479 | 10.14 GB | 31 Oct 2019 - 22:41 |
| AhrefsBot | 1,143 | 52.94 GB | 31 Oct 2019 - 22:14 |
| Web Core / Roots | 381 | 30.01 GB | 31 Oct 2019 - 21:29 |
| Unknown robot (identified by 'crawl') | 798 | 4.75 GB | 31 Oct 2019 - 21:24 |
| rpt-httpclient | 99 | 608.84 MB | 31 Oct 2019 - 20:17 |
| FavIconizer | 96 | 680.06 MB | 31 Oct 2019 - 20:03 |
| Feedfetcher-Google | 9 | 8.93 KB | 31 Oct 2019 - 18:09 |
| WordPress | 17 | 72.34 MB | 31 Oct 2019 - 16:17 |
| CFNetwork | 742 | 1.04 GB | 31 Oct 2019 - 14:27 |
| Sogou Spider | 40 | 473.40 MB | 31 Oct 2019 - 14:00 |
| Suspected bot masqurading as Mozilla | 38 | 0 | 31 Oct 2019 - 12:11 |
| LinkChecker | 122 | 0 | 31 Oct 2019 - 11:45 |
| FaceBook bot | 37 | 437.89 MB | 31 Oct 2019 - 10:39 |
| Suspected bot masqurading as Mozilla | 20 | 7.19 MB | 31 Oct 2019 - 00:01 |
| SeznamBot | 23 | 426.72 MB | 30 Oct 2019 - 16:07 |
| Unknown robot (identified by 'spider') | 42 | 2.11 GB | 30 Oct 2019 - 09:24 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 1,205 | 181.60 MB | 30 Oct 2019 - 08:13 |
| MJ12bot | 22 | 256.40 MB | 30 Oct 2019 - 03:27 |
| Alexa (IA Archiver) | 149 | 13.84 GB | 30 Oct 2019 - 02:08 |
| WWWC Ver 0.2.5 | 1 | 0 | 29 Oct 2019 - 05:51 |
| Nutch | 10 | 90.94 MB | 29 Oct 2019 - 05:23 |
| Python-urllib | 19 | 2.42 GB | 28 Oct 2019 - 13:55 |
| YaCy | 2 | 7.14 KB | 28 Oct 2019 - 13:02 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 28 Oct 2019 - 09:44 |
| BaiDuSpider | 15 | 176.85 MB | 26 Oct 2019 - 07:12 |
| MSNBot | 25 | 371.68 MB | 24 Oct 2019 - 20:12 |
| LinkBot | 1 | 0 | 24 Oct 2019 - 15:46 |
| Common Crawl | 34 | 145.08 MB | 24 Oct 2019 - 05:52 |
| yeti | 2 | 14.24 MB | 24 Oct 2019 - 02:55 |
| Motor | 5 | 207.68 MB | 23 Oct 2019 - 21:12 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 138 | 2.13 GB | 23 Oct 2019 - 20:30 |
| ning | 6 | 164.52 MB | 21 Oct 2019 - 00:35 |
| HTTrack off-line browser | 10 | 448.97 MB | 20 Oct 2019 - 21:26 |
| Turn It In | 2 | 7.14 KB | 20 Oct 2019 - 11:53 |
| SMTBot | 1 | 7.04 MB | 19 Oct 2019 - 03:00 |
| Heritrix | 1 | 75.98 MB | 18 Oct 2019 - 10:45 |
| 360spider | 2 | 21.09 KB | 18 Oct 2019 - 03:38 |
| Microsoft Office Protocol Discovery/Microsoft Office Existence Discovery | 1 | 0 | 16 Oct 2019 - 12:05 |
| twitterbot | 1 | 4.33 KB | 15 Oct 2019 - 06:52 |
| Mail.ru bot | 5 | 21.69 MB | 15 Oct 2019 - 00:50 |
| ltx71 | 28 | 2.54 GB | 11 Oct 2019 - 00:36 |
| Exabot | 2 | 21.09 KB | 09 Oct 2019 - 17:17 |
| A PHP script | 2 | 7.04 MB | 08 Oct 2019 - 10:21 |
| Cliqzbot | 6 | 43.07 MB | 08 Oct 2019 - 05:16 |
| InternetArchive | 1 | 0 | 06 Oct 2019 - 05:47 |
| Yahoo Slurp | 2 | 14.05 KB | 05 Oct 2019 - 03:21 |
| Unknown robot (identified by 'robot') | 1 | 4.97 KB | 04 Oct 2019 - 09:26 |