| 60 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 2,913,401 | 9812.85 GB | 31 Aug 2022 - 23:59 |
| SemrushBot | 35,867 | 120.65 GB | 31 Aug 2022 - 23:59 |
| Bing Preview bot | 194 | 59.24 GB | 31 Aug 2022 - 23:59 |
| AhrefsBot | 17,836 | 11.83 GB | 31 Aug 2022 - 23:59 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 14,657 | 142.49 GB | 31 Aug 2022 - 23:58 |
| Bingbot | 21,077 | 509.45 GB | 31 Aug 2022 - 23:56 |
| Googlebot | 4,318 | 114.11 GB | 31 Aug 2022 - 23:51 |
| check_http (nagios) | 8,520 | 27.52 MB | 31 Aug 2022 - 23:50 |
| DotBot, Open Site Explorer | 7,208 | 68.91 GB | 31 Aug 2022 - 23:42 |
| Suspected bot masqurading as Mozilla | 1,421 | 131.61 MB | 31 Aug 2022 - 23:37 |
| Unknown robot (identified by 'spider') | 2,409 | 48.86 GB | 31 Aug 2022 - 23:27 |
| Unknown robot (identified by empty user agent string) | 6,610 | 82.33 GB | 31 Aug 2022 - 23:25 |
| Unknown robot (identified by 'crawl') | 18,544 | 115.41 GB | 31 Aug 2022 - 23:02 |
| MJ12bot | 1,617 | 55.29 GB | 31 Aug 2022 - 22:43 |
| Python-urllib | 2,662 | 8.82 GB | 31 Aug 2022 - 22:42 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 9,711 | 130.84 GB | 31 Aug 2022 - 22:25 |
| Yandex Bot | 1,330 | 130.84 GB | 31 Aug 2022 - 22:11 |
| BaiDuSpider | 374 | 36.66 GB | 31 Aug 2022 - 20:32 |
| Perl tool | 181 | 15.06 GB | 31 Aug 2022 - 19:52 |
| FavIconizer | 127 | 419.48 KB | 31 Aug 2022 - 18:52 |
| Unknown robot (identified by 'robot') | 352 | 1.84 GB | 31 Aug 2022 - 18:31 |
| MojeekBot | 85 | 22.29 MB | 31 Aug 2022 - 16:47 |
| twitterbot | 18 | 10.70 GB | 31 Aug 2022 - 14:56 |
| LinkChecker | 108 | 264.95 MB | 31 Aug 2022 - 14:30 |
| Googlebot-Image | 182 | 83.50 MB | 31 Aug 2022 - 14:09 |
| Suspected bot masqurading as Mozilla | 10,985 | 13.09 GB | 31 Aug 2022 - 07:30 |
| FaceBook bot | 121 | 13.38 GB | 31 Aug 2022 - 04:22 |
| SeznamBot | 96 | 16.21 MB | 31 Aug 2022 - 04:14 |
| Custo | 159 | 526.16 KB | 31 Aug 2022 - 03:27 |
| Web Core / Roots | 21 | 13.74 GB | 31 Aug 2022 - 01:03 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 15 | 89.65 MB | 30 Aug 2022 - 20:41 |
| The Tweeted Times | 1 | 6.82 KB | 30 Aug 2022 - 20:34 |
| YaCy | 59 | 1.56 GB | 30 Aug 2022 - 03:14 |
| Mail.ru bot | 54 | 459.19 MB | 29 Aug 2022 - 19:03 |
| yeti | 115 | 13.69 GB | 29 Aug 2022 - 15:39 |
| microsoft-webdav-miniredir | 1 | 0 | 29 Aug 2022 - 06:09 |
| Motor | 26 | 11.29 GB | 28 Aug 2022 - 15:24 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 3,617 | 211.55 MB | 28 Aug 2022 - 14:10 |
| Sogou Spider | 8 | 26.80 KB | 27 Aug 2022 - 19:06 |
| Java (Often spam bot) | 647 | 26.04 KB | 25 Aug 2022 - 16:05 |
| SEOkicks Webcrawler | 643 | 15.45 GB | 24 Aug 2022 - 13:47 |
| WordPress | 2 | 575.38 KB | 20 Aug 2022 - 16:07 |
| HTTrack off-line browser | 1 | 3.34 KB | 19 Aug 2022 - 16:20 |
| Nutch | 29 | 45.49 MB | 18 Aug 2022 - 13:58 |
| Common Crawl | 852 | 3.90 GB | 18 Aug 2022 - 05:44 |
| The World Wide Web Worm | 1 | 3.35 KB | 16 Aug 2022 - 17:01 |
| archive.org bot | 23 | 217.02 MB | 15 Aug 2022 - 18:38 |
| Yahoo Slurp | 3 | 394.29 MB | 14 Aug 2022 - 18:58 |
| BUbiNG | 1 | 3.34 KB | 11 Aug 2022 - 17:03 |
| linkedinbot | 1 | 3.35 KB | 11 Aug 2022 - 14:44 |
| Proximic Spider | 1 | 3.35 KB | 11 Aug 2022 - 14:44 |
| Findlinks | 1 | 3.35 KB | 11 Aug 2022 - 14:43 |
| BBot | 1 | 3.35 KB | 11 Aug 2022 - 14:43 |
| LinkBot | 1 | 32.49 MB | 11 Aug 2022 - 09:25 |
| Netcraft | 5 | 16.50 KB | 11 Aug 2022 - 00:36 |
| 360spider | 3 | 45.14 MB | 08 Aug 2022 - 17:46 |
| WebCopy | 53 | 4.90 GB | 08 Aug 2022 - 12:47 |
| CFNetwork | 1 | 3.22 KB | 04 Aug 2022 - 14:54 |
| Alexa (IA Archiver) | 1 | 227.61 MB | 03 Aug 2022 - 08:21 |
| A PHP script | 1 | 3.35 KB | 01 Aug 2022 - 22:35 |
|