| 37 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 145013 | 383.85 GB | 30 Apr 2017 - 23:50 |
| Yandex bot | 27676 | 320.79 GB | 30 Apr 2017 - 23:46 |
| Unknown robot (identified by 'crawl') | 22027 | 478.09 GB | 30 Apr 2017 - 18:59 |
| Unknown robot (identified by 'bot*') | 15436 | 658.39 GB | 30 Apr 2017 - 23:59 |
| Googlebot | 14974 | 50.30 GB | 30 Apr 2017 - 23:54 |
| BaiDuSpider | 8828 | 87.58 GB | 30 Apr 2017 - 23:50 |
| Yahoo Slurp | 7573 | 158.03 GB | 30 Apr 2017 - 22:38 |
| Unknown robot (identified by empty user agent string) | 6675 | 69.57 GB | 30 Apr 2017 - 23:39 |
| Unknown robot (identified by 'robot') | 989 | 11.78 GB | 30 Apr 2017 - 23:08 |
| MJ12bot | 779 | 22.22 GB | 30 Apr 2017 - 08:45 |
| Sogou Spider | 427 | 333.71 MB | 30 Apr 2017 - 09:53 |
| Nutch | 397 | 42.81 GB | 30 Apr 2017 - 23:59 |
| Mail.ru bot | 260 | 911.94 MB | 30 Apr 2017 - 01:03 |
| SeznamBot | 237 | 40.54 MB | 30 Apr 2017 - 23:46 |
| Exabot | 223 | 20.54 MB | 30 Apr 2017 - 20:19 |
| Web Core / Roots | 201 | 30.58 GB | 29 Apr 2017 - 12:36 |
| Unknown robot (identified by 'spider') | 147 | 14.92 GB | 30 Apr 2017 - 16:05 |
| Java (Often spam bot) | 136 | 17.65 GB | 30 Apr 2017 - 23:25 |
| MagpieRSS | 78 | 9.63 GB | 30 Apr 2017 - 19:58 |
| CFNetwork | 61 | 4.48 GB | 30 Apr 2017 - 07:20 |
| Phantom | 52 | 64.80 MB | 30 Apr 2017 - 09:21 |
| MSNBot-media | 49 | 5.52 GB | 26 Apr 2017 - 23:44 |
| WordPress | 42 | 2.29 GB | 27 Apr 2017 - 22:25 |
| Unknown robot (identified by '*bot') | 25 | 92.59 KB | 28 Apr 2017 - 06:40 |
| MojeekBot | 25 | 108.59 KB | 24 Apr 2017 - 07:29 |
| Alexa (IA Archiver) | 22 | 169.55 MB | 30 Apr 2017 - 20:00 |
| yacy | 16 | 530.89 MB | 28 Apr 2017 - 20:32 |
| archive.org bot | 16 | 19.40 MB | 30 Apr 2017 - 11:13 |
| Netcraft | 12 | 40.62 KB | 26 Apr 2017 - 22:46 |
| Fish search | 9 | 19.55 KB | 26 Apr 2017 - 19:37 |
| HTTrack off-line browser | 5 | 328.48 MB | 14 Apr 2017 - 19:35 |
| Sift | 4 | 468.69 MB | 24 Apr 2017 - 12:01 |
| Jakarta commons-httpclient | 3 | 14.02 KB | 02 Apr 2017 - 15:35 |
| Custo | 2 | 468.35 MB | 30 Apr 2017 - 18:52 |
| arks | 2 | 38.75 KB | 23 Apr 2017 - 07:58 |
| Google Sitemaps | 1 | 245 Bytes | 06 Apr 2017 - 15:05 |
| BBot | 1 | 4.41 KB | 05 Apr 2017 - 12:30 |