| 49 different robots | Hits | Bandwidth | Last visit |
|---|
| Python-urllib | 1656860 | 4405.99 GB | 31 Oct 2013 - 23:32 |
| Googlebot | 26271 | 58.71 GB | 31 Oct 2013 - 23:58 |
| Unknown robot (identified by 'bot*') | 21860 | 156.88 GB | 31 Oct 2013 - 23:56 |
| Unknown robot (identified by empty user agent string) | 4162 | 75.24 GB | 31 Oct 2013 - 22:22 |
| BaiDuSpider | 2674 | 22.87 GB | 31 Oct 2013 - 23:46 |
| Unknown robot (identified by 'robot') | 1961 | 9.87 GB | 31 Oct 2013 - 23:47 |
| Yandex bot | 1709 | 11.56 GB | 31 Oct 2013 - 23:56 |
| Unknown robot (identified by 'crawl') | 1319 | 8.67 MB | 31 Oct 2013 - 13:06 |
| Unknown robot (identified by 'spider') | 1191 | 19.72 GB | 31 Oct 2013 - 22:59 |
| MSNBot | 504 | 15.75 MB | 31 Oct 2013 - 20:38 |
| Mail.ru bot | 347 | 81.68 MB | 31 Oct 2013 - 23:31 |
| Exabot | 317 | 3.42 GB | 31 Oct 2013 - 23:40 |
| MJ12bot | 259 | 4.28 GB | 30 Oct 2013 - 17:33 |
| SeznamBot | 186 | 767.41 KB | 31 Oct 2013 - 19:33 |
| MSNBot-media | 176 | 271.24 KB | 23 Oct 2013 - 23:17 |
| Nutch | 157 | 1.72 GB | 31 Oct 2013 - 19:28 |
| Java (Often spam bot) | 129 | 3.42 GB | 31 Oct 2013 - 18:09 |
| Unknown robot (identified by '*bot') | 122 | 441.42 MB | 31 Oct 2013 - 21:21 |
| BSpider | 117 | 2.36 GB | 29 Oct 2013 - 22:01 |
| DoCoMo | 81 | 5.41 GB | 30 Oct 2013 - 20:48 |
| Voila | 79 | 3.84 MB | 31 Oct 2013 - 09:40 |
| NG 2.x (Exalead) | 75 | 8.17 MB | 19 Oct 2013 - 20:20 |
| Sogou Spider | 74 | 20.45 MB | 31 Oct 2013 - 14:56 |
| ichiro | 47 | 619.77 MB | 29 Oct 2013 - 00:16 |
| Netluchs | 45 | 875.87 MB | 22 Oct 2013 - 23:27 |
| yacy | 45 | 275.75 MB | 30 Oct 2013 - 11:35 |
| WordPress | 45 | 127.26 MB | 24 Oct 2013 - 22:16 |
| CFNetwork | 40 | 21.54 GB | 30 Oct 2013 - 18:44 |
| Alexa (IA Archiver) | 37 | 29.49 MB | 31 Oct 2013 - 17:11 |
| archive.org bot | 20 | 9.84 MB | 17 Oct 2013 - 16:42 |
| Web Core / Roots | 19 | 33.18 KB | 20 Oct 2013 - 05:46 |
| MojeekBot | 12 | 35.17 KB | 30 Oct 2013 - 16:02 |
| Yahoo Slurp | 12 | 25.83 KB | 15 Oct 2013 - 18:05 |
| larbin | 10 | 51.93 KB | 17 Oct 2013 - 14:04 |
| GigaBot | 9 | 26.84 KB | 28 Oct 2013 - 23:29 |
| Muncher | 8 | 11.58 KB | 11 Oct 2013 - 19:00 |
| MSIECrawler | 6 | 17.34 KB | 21 Oct 2013 - 23:43 |
| Feedfetcher-Google | 4 | 18.69 KB | 08 Oct 2013 - 05:47 |
| Netcraft | 4 | 11.88 KB | 29 Oct 2013 - 10:30 |
| Custo | 3 | 602 Bytes | 11 Oct 2013 - 11:54 |
| psbot | 3 | 8.05 KB | 15 Oct 2013 - 07:59 |
| MagpieRSS | 3 | 85.79 MB | 12 Oct 2013 - 17:09 |
| Google AdSense | 2 | 3.91 GB | 29 Oct 2013 - 20:03 |
| Emacs-w3 Search Engine | 2 | 7.66 KB | 14 Oct 2013 - 15:10 |
| HTTrack off-line browser | 2 | 5.66 KB | 29 Oct 2013 - 13:37 |
| lwp-request | 2 | 0 | 30 Oct 2013 - 17:50 |
| Jakarta commons-httpclient | 1 | 188.00 MB | 04 Oct 2013 - 19:56 |
| W3C Validator | 1 | 2.85 KB | 22 Oct 2013 - 17:44 |
| WebFilter | 1 | 5.29 KB | 19 Oct 2013 - 12:45 |