| 67 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 165291+187 | 6.92 GB | 31 Dec 2013 - 23:59 |
| BaiDuSpider | 4553+22 | 269.81 MB | 31 Dec 2013 - 23:59 |
| CFNetwork | 1659 | 157.43 MB | 31 Dec 2013 - 23:59 |
| MSNBot-media | 12592+10822 | 355.36 MB | 31 Dec 2013 - 23:59 |
| Unknown robot (identified by 'bot*') | 66556+1114 | 5.66 GB | 31 Dec 2013 - 23:58 |
| Unknown robot (identified by 'crawl') | 25372+2918 | 1.13 GB | 31 Dec 2013 - 23:58 |
| MagpieRSS | 21347+183 | 1.08 GB | 31 Dec 2013 - 23:52 |
| Yandex bot | 7635+68 | 529.92 MB | 31 Dec 2013 - 23:50 |
| Mail.ru bot | 699+220 | 47.64 MB | 31 Dec 2013 - 23:48 |
| Unknown robot (identified by 'robot') | 24324+5138 | 1.27 GB | 31 Dec 2013 - 23:48 |
| Yahoo Slurp | 877+11 | 48.90 MB | 31 Dec 2013 - 23:45 |
| Java (Often spam bot) | 6235+502 | 170.85 MB | 31 Dec 2013 - 23:11 |
| MJ12bot | 28535+1155 | 1.01 GB | 31 Dec 2013 - 23:05 |
| SeznamBot | 2269+26 | 358.02 MB | 31 Dec 2013 - 22:27 |
| Python-urllib | 1502+24 | 82.62 MB | 31 Dec 2013 - 22:16 |
| Unknown robot (identified by empty user agent string) | 6252+5 | 306.28 MB | 31 Dec 2013 - 22:10 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1121 | 351.41 KB | 31 Dec 2013 - 22:03 |
| WebFilter | 1279+150 | 59.37 MB | 31 Dec 2013 - 21:54 |
| Sogou Spider | 7864+212 | 472.51 MB | 31 Dec 2013 - 21:50 |
| Unknown robot (identified by 'spider') | 1342+118 | 66.02 MB | 31 Dec 2013 - 21:49 |
| Feedfetcher-Google | 163 | 16.99 MB | 31 Dec 2013 - 19:28 |
| WordPress | 1570 | 7.55 MB | 31 Dec 2013 - 19:21 |
| Exabot | 94+58 | 3.66 MB | 31 Dec 2013 - 18:59 |
| Nutch | 73+53 | 3.56 MB | 31 Dec 2013 - 18:27 |
| Alexa (IA Archiver) | 152+72 | 41.06 MB | 31 Dec 2013 - 18:11 |
| Phantom | 38773 | 629.95 MB | 31 Dec 2013 - 18:02 |
| MSNBot | 830+31 | 47.88 MB | 31 Dec 2013 - 11:53 |
| Jakarta commons-httpclient | 251+5 | 33.19 MB | 31 Dec 2013 - 07:25 |
| TITAN | 325 | 5.59 MB | 31 Dec 2013 - 07:00 |
| DoCoMo | 91+10 | 4.11 MB | 31 Dec 2013 - 06:54 |
| LinkScan | 32 | 1.44 MB | 31 Dec 2013 - 05:09 |
| Collective | 24 | 506.74 KB | 31 Dec 2013 - 05:07 |
| SuperBot | 19 | 268.98 KB | 31 Dec 2013 - 03:03 |
| Motor | 212 | 3.65 MB | 30 Dec 2013 - 21:02 |
| NG 1.x (Exalead) | 48 | 1.23 MB | 30 Dec 2013 - 17:19 |
| Google AdSense | 45 | 3.35 MB | 30 Dec 2013 - 05:47 |
| legs | 0+4 | 1.25 KB | 29 Dec 2013 - 20:02 |
| WallPaper (alias crawlpaper) | 9 | 280.85 KB | 29 Dec 2013 - 19:04 |
| archive.org bot | 20+22 | 596.16 KB | 29 Dec 2013 - 12:17 |
| LinkChecker | 6+8 | 112.91 KB | 29 Dec 2013 - 06:37 |
| BBot | 33+2 | 449.57 KB | 29 Dec 2013 - 05:13 |
| Y!J Yahoo Japan | 2 | 14.45 KB | 27 Dec 2013 - 19:41 |
| Fish search | 15 | 406.15 KB | 27 Dec 2013 - 18:40 |
| MojeekBot | 32+14 | 1.67 MB | 27 Dec 2013 - 18:14 |
| Web Core / Roots | 65 | 1.83 MB | 26 Dec 2013 - 19:39 |
| W3C Validator | 3 | 132.05 KB | 26 Dec 2013 - 19:14 |
| Unknown robot (identified by '*bot') | 226+107 | 13.42 MB | 26 Dec 2013 - 18:19 |
| Pioneer | 49 | 705.62 KB | 26 Dec 2013 - 15:14 |
| Voila | 4+3 | 146.37 KB | 23 Dec 2013 - 12:30 |
| psbot | 5+3 | 103.48 KB | 22 Dec 2013 - 10:58 |
| StackRambler | 34 | 479.86 KB | 22 Dec 2013 - 10:05 |
| SurveyBot | 8+2 | 291.53 KB | 21 Dec 2013 - 14:51 |
| HTTrack off-line browser | 288689+2 | 12.09 GB | 21 Dec 2013 - 07:22 |
| Raven Search | 1 | 0 | 20 Dec 2013 - 17:47 |
| Heritrix | 1+1 | 21.99 KB | 18 Dec 2013 - 18:19 |
| Custo | 41 | 802.30 KB | 17 Dec 2013 - 13:45 |
| VSE | 32+1 | 456.55 KB | 17 Dec 2013 - 10:21 |
| MSIECrawler | 3 | 131.39 KB | 14 Dec 2013 - 16:11 |
| VORTEX | 53 | 853.11 KB | 11 Dec 2013 - 02:00 |
| Netcraft | 2 | 72.73 KB | 11 Dec 2013 - 00:03 |
| XYLEME Robot | 17 | 197.16 KB | 10 Dec 2013 - 02:24 |
| yacy | 2+3 | 101.30 KB | 09 Dec 2013 - 09:00 |
| IlTrovatore-Setaccio | 12 | 790.99 KB | 06 Dec 2013 - 23:22 |
| arks | 1 | 0 | 06 Dec 2013 - 02:58 |
| GigaBot | 16 | 854.13 KB | 05 Dec 2013 - 21:00 |
| NG 2.x (Exalead) | 34 | 871.19 KB | 05 Dec 2013 - 01:19 |
| lmspider | 1+1 | 35.42 KB | 01 Dec 2013 - 13:58 |