| 41 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 2350781 | 6722.64 GB | 31 Dec 2016 - 23:50 |
| Unknown robot (identified by empty user agent string) | 38648 | 76.82 GB | 31 Dec 2016 - 23:48 |
| Unknown robot (identified by 'bot*') | 25200 | 270.26 GB | 31 Dec 2016 - 23:54 |
| Unknown robot (identified by 'crawl') | 10932 | 215.82 GB | 31 Dec 2016 - 08:33 |
| Yahoo Slurp | 10503 | 263.32 GB | 31 Dec 2016 - 23:38 |
| Yandex bot | 7315 | 380.77 GB | 31 Dec 2016 - 21:37 |
| Googlebot | 5585 | 23.01 GB | 31 Dec 2016 - 23:56 |
| BaiDuSpider | 2894 | 55.18 GB | 31 Dec 2016 - 23:53 |
| archive.org bot | 2815 | 7.37 GB | 23 Dec 2016 - 14:01 |
| Unknown robot (identified by 'robot') | 1520 | 21.63 GB | 31 Dec 2016 - 23:13 |
| MJ12bot | 633 | 4.94 GB | 31 Dec 2016 - 20:07 |
| Sogou Spider | 422 | 1.15 GB | 31 Dec 2016 - 08:32 |
| Mail.ru bot | 351 | 842.69 MB | 24 Dec 2016 - 10:55 |
| SeznamBot | 169 | 19.15 GB | 31 Dec 2016 - 23:42 |
| Steeler | 168 | 1.30 MB | 31 Dec 2016 - 00:54 |
| Unknown robot (identified by 'spider') | 162 | 35.20 GB | 31 Dec 2016 - 15:23 |
| Web Core / Roots | 136 | 28.65 GB | 29 Dec 2016 - 23:31 |
| Exabot | 128 | 16.73 MB | 31 Dec 2016 - 22:42 |
| Java (Often spam bot) | 111 | 31.36 GB | 31 Dec 2016 - 23:38 |
| yacy | 78 | 7.10 GB | 30 Dec 2016 - 02:23 |
| MagpieRSS | 72 | 13.61 GB | 30 Dec 2016 - 19:22 |
| CFNetwork | 55 | 3.75 GB | 29 Dec 2016 - 11:34 |
| WordPress | 43 | 1.72 GB | 27 Dec 2016 - 12:37 |
| Alexa (IA Archiver) | 41 | 278.35 KB | 14 Dec 2016 - 09:37 |
| MojeekBot | 41 | 291.49 KB | 20 Dec 2016 - 16:57 |
| Phantom | 24 | 60.24 KB | 10 Dec 2016 - 10:58 |
| Jakarta commons-httpclient | 8 | 67.94 KB | 31 Dec 2016 - 11:44 |
| Turn It In | 3 | 10.15 KB | 29 Dec 2016 - 03:01 |
| Google AdSense | 3 | 15.66 KB | 05 Dec 2016 - 11:31 |
| Netcraft | 3 | 10.28 KB | 11 Dec 2016 - 18:25 |
| Monster | 2 | 6.85 KB | 05 Dec 2016 - 01:54 |
| Emacs-w3 Search Engine | 2 | 530.00 MB | 16 Dec 2016 - 12:32 |
| lwp-request | 2 | 0 | 22 Dec 2016 - 18:17 |
| Sven | 2 | 5.66 KB | 11 Dec 2016 - 11:28 |
| LinkBot | 1 | 13.56 KB | 18 Dec 2016 - 15:51 |
| Nutch | 1 | 3.30 KB | 02 Dec 2016 - 05:59 |
| W3C Link Checker | 1 | 0 | 20 Dec 2016 - 20:13 |
| arks | 1 | 6.00 KB | 10 Dec 2016 - 00:53 |
| Spiderman | 1 | 3.43 KB | 11 Dec 2016 - 23:23 |
| Heritrix | 1 | 3.43 KB | 02 Dec 2016 - 17:34 |
| VSE | 1 | 11.62 KB | 11 Dec 2016 - 17:34 |