| 65 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 106729+186 | 5.48 GB | 31 Jan 2013 - 22:09 |
| MSNBot-media | 2000+1840 | 49.88 MB | 31 Jan 2013 - 22:09 |
| Yandex bot | 27792+87 | 1.17 GB | 31 Jan 2013 - 22:08 |
| CFNetwork | 3336 | 118.08 MB | 31 Jan 2013 - 22:07 |
| Unknown robot (identified by empty user agent string) | 5861+39 | 221.60 MB | 31 Jan 2013 - 22:05 |
| MagpieRSS | 155101+79 | 7.34 GB | 31 Jan 2013 - 22:05 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1078 | 337.93 KB | 31 Jan 2013 - 22:04 |
| Python-urllib | 1151+25 | 35.71 MB | 31 Jan 2013 - 22:03 |
| BaiDuSpider | 10219 | 669.13 MB | 31 Jan 2013 - 22:02 |
| Unknown robot (identified by 'bot*') | 73351+561 | 4.75 GB | 31 Jan 2013 - 21:57 |
| OutfoxBot/YodaoBot | 178 | 5.52 MB | 31 Jan 2013 - 21:57 |
| Java (Often spam bot) | 10989+16 | 379.32 MB | 31 Jan 2013 - 21:52 |
| Unknown robot (identified by '*bot') | 20689+864 | 840.17 MB | 31 Jan 2013 - 21:51 |
| Unknown robot (identified by 'crawl') | 3398+205 | 184.14 MB | 31 Jan 2013 - 21:25 |
| WebFilter | 4402+57 | 214.36 MB | 31 Jan 2013 - 20:49 |
| MJ12bot | 6514+718 | 326.77 MB | 31 Jan 2013 - 20:37 |
| Unknown robot (identified by 'spider') | 15942+58 | 1002.58 MB | 31 Jan 2013 - 20:08 |
| BSpider | 1586+2 | 55.14 MB | 31 Jan 2013 - 20:06 |
| DoCoMo | 55+42 | 3.26 MB | 31 Jan 2013 - 20:00 |
| Jakarta commons-httpclient | 147 | 8.23 MB | 31 Jan 2013 - 18:53 |
| Yahoo Slurp | 2967+49 | 62.59 MB | 31 Jan 2013 - 18:42 |
| Sogou Spider | 365+38 | 24.98 MB | 31 Jan 2013 - 18:27 |
| Unknown robot (identified by 'robot') | 76222+485 | 4.06 GB | 31 Jan 2013 - 18:19 |
| Alexa (IA Archiver) | 309+102 | 16.49 MB | 31 Jan 2013 - 17:52 |
| Google AdSense | 15 | 609.40 KB | 31 Jan 2013 - 17:27 |
| Feedfetcher-Google | 133 | 2.66 MB | 31 Jan 2013 - 16:20 |
| archive.org bot | 92+9 | 3.78 MB | 31 Jan 2013 - 15:18 |
| Web Core / Roots | 4+4 | 2.75 MB | 31 Jan 2013 - 11:24 |
| SeznamBot | 3594+20 | 185.67 MB | 31 Jan 2013 - 10:44 |
| MSNBot | 93152+25 | 6.61 GB | 31 Jan 2013 - 08:41 |
| LinkScan | 39 | 1.26 MB | 31 Jan 2013 - 08:30 |
| Nutch | 49+40 | 1.68 MB | 31 Jan 2013 - 06:40 |
| Exabot | 43+42 | 1.28 MB | 31 Jan 2013 - 06:35 |
| VORTEX | 321 | 5.69 MB | 31 Jan 2013 - 01:58 |
| NG 1.x (Exalead) | 22 | 22.41 KB | 30 Jan 2013 - 14:58 |
| Motor | 213 | 4.21 MB | 30 Jan 2013 - 13:31 |
| Voila | 1+1 | 56.26 KB | 30 Jan 2013 - 11:09 |
| Findlinks | 5+7 | 160.21 KB | 30 Jan 2013 - 05:27 |
| Phantom | 323 | 7.34 MB | 30 Jan 2013 - 01:01 |
| Heritrix | 21+1 | 740.83 KB | 29 Jan 2013 - 22:15 |
| VSE | 32+2 | 587.18 KB | 29 Jan 2013 - 19:25 |
| WordPress | 221 | 15.65 MB | 29 Jan 2013 - 16:07 |
| Mail.ru bot | 79+12 | 4.82 MB | 29 Jan 2013 - 07:43 |
| Custo | 41+1 | 644.29 KB | 28 Jan 2013 - 12:04 |
| WebCollage | 9 | 317.50 KB | 27 Jan 2013 - 20:15 |
| StackRambler | 68 | 1.77 MB | 27 Jan 2013 - 16:40 |
| psbot | 11+6 | 252.03 KB | 27 Jan 2013 - 12:04 |
| LinkChecker | 2+17 | 36.98 KB | 26 Jan 2013 - 06:25 |
| W3C Validator | 2 | 63.64 KB | 26 Jan 2013 - 00:50 |
| Harvest | 134 | 17.93 MB | 24 Jan 2013 - 02:41 |
| MSIECrawler | 1 | 71 Bytes | 24 Jan 2013 - 02:30 |
| Fish search | 10 | 238.09 KB | 23 Jan 2013 - 13:46 |
| NimbleCrawler | 1 | 58.36 KB | 23 Jan 2013 - 07:48 |
| WallPaper (alias crawlpaper) | 7 | 192.24 KB | 23 Jan 2013 - 02:00 |
| SurveyBot | 4+1 | 127.92 KB | 22 Jan 2013 - 14:37 |
| fido | 32 | 583.72 KB | 20 Jan 2013 - 12:48 |
| IlTrovatore-Setaccio | 15 | 693.29 KB | 18 Jan 2013 - 07:02 |
| Vagabondo | 3+1 | 160.41 KB | 17 Jan 2013 - 17:26 |
| arks | 2 | 0 | 17 Jan 2013 - 02:37 |
| Y!J Yahoo Japan | 2 | 0 | 15 Jan 2013 - 09:58 |
| Ask | 1 | 43.84 KB | 14 Jan 2013 - 01:34 |
| Netcraft | 3 | 95.43 KB | 07 Jan 2013 - 16:54 |
| XYLEME Robot | 11 | 215.48 KB | 07 Jan 2013 - 05:22 |
| Turn It In | 55+1 | 3.67 MB | 06 Jan 2013 - 03:39 |
| MojeekBot | 1 | 52.06 KB | 01 Jan 2013 - 17:26 |