| 27 different robots | Hits | Bandwidth | Last visit |
|---|
| Unknown robot (identified by 'crawl') | 33,194 | 49.13 GB | 31 Jul 2018 - 21:24 |
| Unknown robot (identified by 'robot') | 15,115 | 41.98 GB | 31 Jul 2018 - 23:58 |
| bot[+:,\.\;\/\\-] | 8,155 | 35.02 GB | 31 Jul 2018 - 23:49 |
| Heritrix | 6,169 | 1.45 GB | 26 Jul 2018 - 09:25 |
| java | 3,244 | 66.12 GB | 31 Jul 2018 - 21:14 |
| Python-urllib | 1,946 | 94.23 GB | 31 Jul 2018 - 23:15 |
| BaiDuSpider | 1,472 | 3.49 GB | 31 Jul 2018 - 22:09 |
| Unknown robot (identified by empty user agent string) | 1,240 | 58.00 GB | 31 Jul 2018 - 23:23 |
| Googlebot | 508 | 13.05 GB | 31 Jul 2018 - 23:16 |
| Yandex Bot | 394 | 482.20 MB | 31 Jul 2018 - 20:55 |
| MJ12bot | 76 | 454.15 MB | 31 Jul 2018 - 16:25 |
| Alexa (IA Archiver) | 52 | 274.66 KB | 31 Jul 2018 - 07:01 |
| Jakarta commons-httpclient | 48 | 768 Bytes | 31 Jul 2018 - 08:01 |
| CFNetwork | 47 | 879.66 MB | 31 Jul 2018 - 07:29 |
| LinkChecker | 40 | 0 | 31 Jul 2018 - 23:03 |
| Turn It In | 32 | 31.26 MB | 31 Jul 2018 - 09:43 |
| Sogou Spider | 19 | 24.34 MB | 29 Jul 2018 - 05:28 |
| Google AdSense | 15 | 231.35 MB | 31 Jul 2018 - 00:37 |
| Web Core / Roots | 15 | 142.61 MB | 30 Jul 2018 - 14:00 |
| SeznamBot | 12 | 77.69 KB | 29 Jul 2018 - 01:24 |
| Unknown robot (identified by 'spider') | 10 | 92.00 MB | 30 Jul 2018 - 12:31 |
| YaCy | 4 | 45.82 MB | 30 Jul 2018 - 10:47 |
| WordPress | 3 | 9.49 MB | 19 Jul 2018 - 13:26 |
| archive.org bot | 2 | 26.01 MB | 26 Jul 2018 - 00:57 |
| LinkBot | 2 | 6.68 KB | 30 Jul 2018 - 13:46 |
| Mail.ru bot | 1 | 777.78 KB | 23 Jul 2018 - 19:36 |
| Exabot | 1 | 23.78 KB | 26 Jul 2018 - 06:28 |
|