| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| SemrushBot | 201 | 132.57 MB | 30 Jun 2021 - 23:55 |
| Sogou Spider | 1,722 | 81.51 MB | 30 Jun 2021 - 23:55 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 760 | 980.72 MB | 30 Jun 2021 - 23:50 |
| WGet tools | 8,484 | 24.42 GB | 30 Jun 2021 - 23:47 |
| Googlebot | 131 | 43.75 MB | 30 Jun 2021 - 23:33 |
| Python-urllib | 594 | 307.57 MB | 30 Jun 2021 - 23:27 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 3,545 | 7.24 GB | 30 Jun 2021 - 23:03 |
| Perl tool | 443 | 18.66 MB | 30 Jun 2021 - 22:26 |
| BaiDuSpider | 152 | 131.11 MB | 30 Jun 2021 - 22:09 |
| Bingbot | 287 | 141.67 MB | 30 Jun 2021 - 22:05 |
| Yandex Bot | 233 | 157.64 MB | 30 Jun 2021 - 20:45 |
| LinkChecker | 68 | 0 | 30 Jun 2021 - 20:20 |
| Suspected bot masqurading as Mozilla | 29 | 3.25 MB | 30 Jun 2021 - 19:38 |
| SeznamBot | 11 | 533.62 KB | 30 Jun 2021 - 19:32 |
| DotBot, Open Site Explorer | 27 | 14.23 MB | 30 Jun 2021 - 18:30 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 65 | 109.40 MB | 30 Jun 2021 - 18:18 |
| FavIconizer | 45 | 2.13 MB | 30 Jun 2021 - 17:38 |
| Unknown robot (identified by empty user agent string) | 91 | 46.17 MB | 30 Jun 2021 - 17:11 |
| twitterbot | 1 | 3.17 MB | 30 Jun 2021 - 16:02 |
| ltx71 | 79 | 152.18 MB | 30 Jun 2021 - 15:55 |
| Custo | 48 | 2.27 MB | 30 Jun 2021 - 15:11 |
| WordPress | 2 | 96.90 KB | 30 Jun 2021 - 13:43 |
| MJ12bot | 53 | 6.27 MB | 30 Jun 2021 - 08:51 |
| Googlebot-Image | 19 | 50.85 KB | 30 Jun 2021 - 08:11 |
| Yahoo Slurp | 2 | 2.35 MB | 29 Jun 2021 - 16:54 |
| Unknown robot (identified by 'crawl') | 957 | 1.28 GB | 29 Jun 2021 - 14:58 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 32 | 1.51 MB | 29 Jun 2021 - 11:12 |
| MSIECrawler | 6 | 291.06 KB | 29 Jun 2021 - 08:16 |
| Mail.ru bot | 16 | 11.36 MB | 28 Jun 2021 - 19:17 |
| Bing Preview bot | 18 | 39.62 KB | 28 Jun 2021 - 19:05 |
| Java (Often spam bot) | 759 | 1.22 GB | 28 Jun 2021 - 13:31 |
| yeti | 10 | 248.23 KB | 28 Jun 2021 - 07:50 |
| Motor | 5 | 52.11 KB | 26 Jun 2021 - 23:56 |
| Unknown robot (identified by 'robot') | 404 | 598.66 MB | 26 Jun 2021 - 14:58 |
| Google AdSense | 6 | 15.84 MB | 26 Jun 2021 - 10:49 |
| Web Core / Roots | 2 | 2.42 MB | 24 Jun 2021 - 15:46 |
| AhrefsBot | 332 | 584.39 MB | 24 Jun 2021 - 09:48 |
| Unknown robot (identified by 'spider') | 16 | 451.75 KB | 22 Jun 2021 - 16:20 |
| MojeekBot | 1 | 48.38 KB | 19 Jun 2021 - 08:20 |
| 360spider | 1 | 48.51 KB | 19 Jun 2021 - 03:37 |
| Common Crawl | 5 | 242.30 KB | 18 Jun 2021 - 05:15 |
| SEOkicks Webcrawler | 145 | 205.19 MB | 16 Jun 2021 - 23:39 |
| Xenu's Link Sleuth (TM), see Wikipedia | 1 | 0 | 16 Jun 2021 - 11:31 |
| YaCy | 1 | 48.38 KB | 16 Jun 2021 - 03:03 |
| InfoBot | 1 | 48.51 KB | 10 Jun 2021 - 06:02 |
| FaceBook bot | 3 | 145.53 KB | 09 Jun 2021 - 19:25 |
| Drupal Site | 2 | 0 | 07 Jun 2021 - 15:15 |
| archive.org bot | 222 | 396.45 MB | 03 Jun 2021 - 21:13 |
| Unknown robot (identified by 'discovery') | 1 | 48.38 KB | 02 Jun 2021 - 07:39 |
| Netcraft | 1 | 48.38 KB | 01 Jun 2021 - 17:05 |
| WebCopy | 2 | 0 | 01 Jun 2021 - 02:20 |