| 69 different robots | Hits | Bandwidth | Last visit |
|---|
| Feedfetcher-Google | 68 | 1.59 MB | 30 Nov 2012 - 19:13 |
| Googlebot | 166203+158 | 8.40 GB | 30 Nov 2012 - 19:13 |
| Yandex bot | 45315+73 | 2.69 GB | 30 Nov 2012 - 19:13 |
| Yahoo Slurp | 3896+28 | 71.77 MB | 30 Nov 2012 - 19:08 |
| BaiDuSpider | 14781+114 | 533.10 MB | 30 Nov 2012 - 19:08 |
| Unknown robot (identified by '*bot') | 21856+806 | 911.43 MB | 30 Nov 2012 - 19:07 |
| Unknown robot (identified by empty user agent string) | 10261+66 | 196.63 MB | 30 Nov 2012 - 19:06 |
| Unknown robot (identified by 'bot*') | 108163+550 | 6.64 GB | 30 Nov 2012 - 18:59 |
| Unknown robot (identified by hit on 'robots.txt') | 0+876 | 268.82 KB | 30 Nov 2012 - 18:57 |
| BSpider | 1069 | 37.97 MB | 30 Nov 2012 - 18:52 |
| Sogou Spider | 41+19 | 1.49 MB | 30 Nov 2012 - 18:50 |
| CFNetwork | 2615 | 82.66 MB | 30 Nov 2012 - 18:48 |
| WebFilter | 4236+33 | 181.40 MB | 30 Nov 2012 - 18:36 |
| Python-urllib | 3385+2 | 83.45 MB | 30 Nov 2012 - 18:29 |
| MSNBot-media | 4966+3251 | 110.39 MB | 30 Nov 2012 - 18:19 |
| Exabot | 129+27 | 3.26 MB | 30 Nov 2012 - 17:51 |
| Jakarta commons-httpclient | 285 | 25.71 MB | 30 Nov 2012 - 17:49 |
| Alexa (IA Archiver) | 187+113 | 8.43 MB | 30 Nov 2012 - 17:44 |
| OutfoxBot/YodaoBot | 157 | 4.81 MB | 30 Nov 2012 - 17:28 |
| Java (Often spam bot) | 6878+6 | 213.65 MB | 30 Nov 2012 - 16:33 |
| Unknown robot (identified by 'crawl') | 2109+106 | 105.86 MB | 30 Nov 2012 - 16:11 |
| MagpieRSS | 130194+81 | 6.14 GB | 30 Nov 2012 - 14:29 |
| MJ12bot | 11887+1024 | 494.69 MB | 30 Nov 2012 - 14:08 |
| Unknown robot (identified by 'robot') | 70866+391 | 4.37 GB | 30 Nov 2012 - 13:33 |
| Unknown robot (identified by 'spider') | 632+42 | 34.14 MB | 30 Nov 2012 - 12:07 |
| SeznamBot | 3059+29 | 164.45 MB | 30 Nov 2012 - 06:27 |
| WordPress | 295 | 22.58 MB | 30 Nov 2012 - 05:55 |
| DoCoMo | 120+28 | 5.90 MB | 30 Nov 2012 - 04:08 |
| WebCollage | 6 | 293.48 KB | 30 Nov 2012 - 00:52 |
| Phantom | 180 | 4.89 MB | 29 Nov 2012 - 19:42 |
| larbin | 42+4 | 1.04 MB | 29 Nov 2012 - 11:37 |
| Nutch | 208+41 | 9.41 MB | 29 Nov 2012 - 03:01 |
| MSNBot | 1073+22 | 56.65 MB | 29 Nov 2012 - 02:48 |
| LinkScan | 24 | 848.43 KB | 29 Nov 2012 - 01:16 |
| VSE | 31+2 | 526.41 KB | 28 Nov 2012 - 15:47 |
| LinkChecker | 0+14 | 4.32 KB | 27 Nov 2012 - 21:54 |
| Motor | 245 | 23.65 MB | 27 Nov 2012 - 04:18 |
| Web Core / Roots | 40 | 277.13 KB | 26 Nov 2012 - 15:37 |
| WallPaper (alias crawlpaper) | 4 | 82.68 KB | 25 Nov 2012 - 21:14 |
| Google AdSense | 4 | 125.38 KB | 25 Nov 2012 - 14:02 |
| Mail.ru bot | 262+4 | 12.27 MB | 24 Nov 2012 - 11:48 |
| Findlinks | 2+5 | 64.19 KB | 24 Nov 2012 - 03:36 |
| InfoSeek Robot 1.0 | 1 | 60.70 KB | 23 Nov 2012 - 01:51 |
| psbot | 5+6 | 220.32 KB | 22 Nov 2012 - 19:19 |
| archive.org bot | 96+3 | 5.52 MB | 22 Nov 2012 - 13:06 |
| Harvest | 180 | 20.20 MB | 22 Nov 2012 - 06:21 |
| StackRambler | 2 | 28.43 KB | 21 Nov 2012 - 12:06 |
| SurveyBot | 8+2 | 250.62 KB | 20 Nov 2012 - 10:59 |
| MSIECrawler | 32 | 277.28 KB | 20 Nov 2012 - 06:52 |
| yacy | 0+1 | 321 Bytes | 16 Nov 2012 - 16:57 |
| Custo | 80 | 1.17 MB | 15 Nov 2012 - 03:32 |
| Y!J Yahoo Japan | 29+27 | 1.77 MB | 13 Nov 2012 - 14:55 |
| HTTrack off-line browser | 1 | 14.15 KB | 11 Nov 2012 - 18:08 |
| VORTEX | 1 | 88.73 KB | 11 Nov 2012 - 14:18 |
| HTMLParser | 46 | 2.57 MB | 10 Nov 2012 - 19:02 |
| mnoGoSearch search engine software | 1 | 30.86 KB | 10 Nov 2012 - 17:03 |
| Scooter | 1 | 88.05 KB | 09 Nov 2012 - 15:03 |
| Voila | 0+1 | 297 Bytes | 09 Nov 2012 - 06:48 |
| GetURL | 1 | 70.45 KB | 07 Nov 2012 - 21:18 |
| legs | 1+1 | 31.91 KB | 07 Nov 2012 - 13:09 |
| Netluchs | 2+2 | 25.62 KB | 07 Nov 2012 - 05:24 |
| ichiro | 2+1 | 63.53 KB | 06 Nov 2012 - 18:13 |
| Heritrix | 1 | 47.99 KB | 06 Nov 2012 - 05:07 |
| ZyBorg | 1 | 50.58 KB | 05 Nov 2012 - 20:37 |
| Netcraft | 1 | 0 | 05 Nov 2012 - 15:08 |
| W3C Validator | 1 | 50.58 KB | 04 Nov 2012 - 05:42 |
| Feedburner | 2 | 0 | 04 Nov 2012 - 02:23 |
| GigaBot | 2 | 121.39 KB | 03 Nov 2012 - 23:42 |
| Bloglines | 1 | 56.24 KB | 02 Nov 2012 - 16:44 |