| 66 different robots | Hits | Bandwidth | Last visit |
|---|
| WGet tools | 2,159,886 | 13736.93 GB | 31 May 2019 - 23:59 |
| GigaBot | 16 | 33.51 KB | 31 May 2019 - 23:59 |
| SemrushBot | 24,429 | 119.63 GB | 31 May 2019 - 23:59 |
| check_http (nagios) | 5,903 | 18.95 MB | 31 May 2019 - 23:59 |
| Bingbot | 16,118 | 239.70 GB | 31 May 2019 - 23:58 |
| Common *nix tool for automating web document retireval. Most likely a bot. | 13,089 | 152.65 GB | 31 May 2019 - 23:57 |
| Yandex Bot | 37,496 | 3702.97 GB | 31 May 2019 - 23:54 |
| Python-urllib | 21,172 | 38.38 GB | 31 May 2019 - 23:50 |
| Googlebot | 2,349 | 29.37 GB | 31 May 2019 - 23:37 |
| AhrefsBot | 264 | 6.45 GB | 31 May 2019 - 23:37 |
| BaiDuSpider | 1,654 | 78.90 GB | 31 May 2019 - 23:32 |
| Java (Often spam bot) | 1,999 | 12.86 GB | 31 May 2019 - 23:26 |
| SeznamBot | 144 | 723.19 MB | 31 May 2019 - 23:23 |
| Unknown robot (identified by empty user agent string) | 12,028 | 319.01 GB | 31 May 2019 - 23:15 |
| Exabot | 178 | 6.34 MB | 31 May 2019 - 23:01 |
| Unknown robot (identified by 'bot' followed by a space or one of the following characters _+:,.;/\-) | 14,220 | 90.70 GB | 31 May 2019 - 22:59 |
| DotBot, Open Site Explorer | 145 | 3.80 GB | 31 May 2019 - 21:29 |
| FavIconizer | 185 | 39.80 MB | 31 May 2019 - 20:44 |
| ltx71 | 111 | 10.79 GB | 31 May 2019 - 17:04 |
| Unknown robot (identified by 'spider') | 60 | 8.00 GB | 31 May 2019 - 14:25 |
| Alexa (IA Archiver) | 75 | 38.93 MB | 31 May 2019 - 13:57 |
| Sogou Spider | 112 | 128.65 MB | 31 May 2019 - 13:56 |
| Web Core / Roots | 36 | 6.79 GB | 31 May 2019 - 13:14 |
| Sift | 12 | 5.67 MB | 31 May 2019 - 10:38 |
| MojeekBot | 12 | 56.00 KB | 31 May 2019 - 09:20 |
| MagpieRSS | 580 | 134.27 GB | 31 May 2019 - 08:24 |
| Perl tool | 545 | 3.18 GB | 31 May 2019 - 07:09 |
| SEOkicks Webcrawler | 352 | 595.76 MB | 31 May 2019 - 06:00 |
| 360spider | 125 | 45.35 MB | 31 May 2019 - 04:34 |
| LinkChecker | 31 | 0 | 31 May 2019 - 03:52 |
| Mail.ru bot | 112 | 81.73 MB | 31 May 2019 - 00:58 |
| Jakarta commons-httpclient | 4 | 856.01 MB | 30 May 2019 - 23:51 |
| Suspected bot masqurading as Mozilla | 107 | 4.82 MB | 30 May 2019 - 20:52 |
| Bing Preview bot | 109 | 38.91 GB | 30 May 2019 - 20:40 |
| Googlebot-Image | 20 | 95.00 KB | 30 May 2019 - 18:14 |
| BLEXBot, seems to belong to the WebMeUp backlink tool | 228 | 5.62 GB | 30 May 2019 - 13:53 |
| yeti | 3 | 9.00 KB | 30 May 2019 - 10:51 |
| Suspected bot masqurading as Mozilla | 181 | 8.07 GB | 30 May 2019 - 07:03 |
| CFNetwork | 4 | 856.00 MB | 29 May 2019 - 21:18 |
| ning | 52 | 2.18 GB | 29 May 2019 - 17:54 |
| MJ12bot | 6 | 3.43 GB | 29 May 2019 - 14:34 |
| archive.org bot | 6 | 14.03 KB | 29 May 2019 - 01:00 |
| FaceBook bot | 16 | 48.84 KB | 28 May 2019 - 23:22 |
| Nutch | 70 | 9.84 GB | 28 May 2019 - 20:54 |
| Unknown robot (identified by 'robot') | 4 | 22.02 KB | 28 May 2019 - 16:51 |
| Unknown robot (identified by 'crawl') | 5,769 | 116.82 GB | 28 May 2019 - 09:54 |
| YaCy | 88 | 9.67 GB | 28 May 2019 - 03:12 |
| Netcraft | 7 | 16.37 KB | 27 May 2019 - 14:24 |
| Phantom | 9 | 1.57 MB | 27 May 2019 - 11:18 |
| Google Web Preview | 7 | 19.84 KB | 27 May 2019 - 06:00 |
| Cliqzbot | 32 | 111.85 MB | 26 May 2019 - 21:02 |
| Xenu's Link Sleuth (TM), see Wikipedia | 16 | 14.03 MB | 25 May 2019 - 18:39 |
| Common Crawl | 85 | 1.61 GB | 25 May 2019 - 14:08 |
| HTTrack off-line browser | 1 | 7.39 KB | 22 May 2019 - 13:56 |
| twitterbot | 4 | 782.95 MB | 22 May 2019 - 08:17 |
| Cfetch | 1 | 0 | 21 May 2019 - 08:26 |
| Fish search | 13 | 285.03 MB | 21 May 2019 - 06:34 |
| SMTBot | 26 | 29.99 MB | 21 May 2019 - 01:19 |
| Site Explorer | 1 | 7.84 KB | 17 May 2019 - 20:08 |
| Wotbox | 279 | 1.49 GB | 15 May 2019 - 03:27 |
| Google AdSense | 1 | 2.80 GB | 15 May 2019 - 00:38 |
| IstellaBot | 2 | 6.57 KB | 14 May 2019 - 16:14 |
| CMS Crawler | 1 | 3.35 KB | 13 May 2019 - 17:42 |
| InternetArchive | 1 | 0 | 13 May 2019 - 08:31 |
| oBot | 120 | 340.52 MB | 07 May 2019 - 11:48 |
| Unknown robot (identified by a space or one of the characters _+:,.;/\- followed by 'bot') | 102 | 12.99 GB | 07 May 2019 - 10:07 |
|