| 82 different robots | Hits | Bandwidth | Last visit |
|---|
| Googlebot | 747839 | 11.98 GB | 31 Aug 2011 - 23:59 |
| Yahoo Slurp | 194051 | 10.22 GB | 31 Aug 2011 - 23:59 |
| Unknown robot (identified by empty user agent string) | 116413 | 17.94 GB | 31 Aug 2011 - 23:59 |
| Yandex bot | 82495 | 1.23 GB | 31 Aug 2011 - 23:59 |
| Unknown robot (identified by 'bot*') | 73549 | 5.44 GB | 31 Aug 2011 - 23:59 |
| HTTrack off-line browser | 62937 | 853.38 MB | 29 Aug 2011 - 03:54 |
| BaiDuSpider | 34644 | 4.49 GB | 31 Aug 2011 - 23:55 |
| Nagios | 28980 | 655.70 MB | 31 Aug 2011 - 23:59 |
| Unknown robot (identified by 'robot') | 28794 | 1.17 GB | 31 Aug 2011 - 23:57 |
| Feedfetcher-Google | 23630 | 128.28 MB | 31 Aug 2011 - 23:56 |
| MSNBot | 21588 | 156.67 MB | 31 Aug 2011 - 23:51 |
| Unknown robot (identified by 'crawl') | 19792 | 2.04 GB | 31 Aug 2011 - 23:32 |
| Sogou Spider | 8179 | 30.06 MB | 31 Aug 2011 - 23:54 |
| NG 1.x (Exalead) | 8087 | 206.81 MB | 31 Aug 2011 - 23:32 |
| MJ12bot | 7343 | 107.68 MB | 31 Aug 2011 - 23:16 |
| Speedy Spider | 6595 | 36.65 MB | 31 Aug 2011 - 23:31 |
| VSE | 5798 | 58.95 MB | 31 Aug 2011 - 15:52 |
| Unknown robot (identified by '*bot') | 5793 | 100.51 MB | 31 Aug 2011 - 23:54 |
| Alexa (IA Archiver) | 4754 | 259.77 MB | 31 Aug 2011 - 16:46 |
| BSpider | 3570 | 30.75 MB | 31 Aug 2011 - 23:44 |
| UniversalFeedParser | 3309 | 10.97 MB | 31 Aug 2011 - 23:50 |
| CFNetwork | 2593 | 519.59 MB | 31 Aug 2011 - 23:47 |
| Voila | 2421 | 79.00 MB | 31 Aug 2011 - 20:59 |
| Unknown robot (identified by 'spider') | 2417 | 22.05 MB | 31 Aug 2011 - 22:37 |
| Custo | 1688 | 14.91 MB | 31 Aug 2011 - 05:39 |
| Nutch | 1180 | 16.35 MB | 31 Aug 2011 - 18:22 |
| Python-urllib | 1168 | 35.02 MB | 31 Aug 2011 - 22:00 |
| psbot | 1146 | 4.78 MB | 31 Aug 2011 - 23:17 |
| legs | 955 | 8.01 MB | 30 Aug 2011 - 04:37 |
| Exabot | 935 | 4.92 MB | 31 Aug 2011 - 17:36 |
| DoCoMo | 814 | 26.32 MB | 31 Aug 2011 - 03:59 |
| Motor | 810 | 20.87 MB | 31 Aug 2011 - 20:14 |
| Java (Often spam bot) | 798 | 21.96 MB | 31 Aug 2011 - 22:08 |
| WordPress | 739 | 22.99 MB | 30 Aug 2011 - 23:59 |
| MagpieRSS | 663 | 2.79 MB | 31 Aug 2011 - 23:57 |
| archive.org bot | 456 | 962.08 MB | 31 Aug 2011 - 13:48 |
| OutfoxBot/YodaoBot | 301 | 1.07 MB | 31 Aug 2011 - 09:56 |
| Fish search | 275 | 6.10 MB | 30 Aug 2011 - 14:59 |
| LinkChecker | 226 | 1.56 MB | 31 Aug 2011 - 18:49 |
| Ask | 204 | 6.82 MB | 31 Aug 2011 - 06:54 |
| Y!J Yahoo Japan | 162 | 3.03 MB | 31 Aug 2011 - 03:45 |
| MSIECrawler | 139 | 298.01 KB | 31 Aug 2011 - 10:10 |
| Google AdSense | 135 | 206.85 MB | 31 Aug 2011 - 16:36 |
| MSNBot-media | 125 | 645.11 KB | 31 Aug 2011 - 04:46 |
| Sunrise | 120 | 597.61 KB | 19 Aug 2011 - 05:19 |
| Heritrix | 115 | 1.14 MB | 25 Aug 2011 - 07:32 |
| W3C Validator | 108 | 708.29 KB | 29 Aug 2011 - 16:25 |
| WWWC Ver 0.2.5 | 108 | 4.79 MB | 31 Aug 2011 - 23:09 |
| Vagabondo | 102 | 3.30 MB | 30 Aug 2011 - 21:38 |
| FeedValidator | 100 | 530.20 KB | 28 Aug 2011 - 03:41 |
| Jakarta commons-httpclient | 95 | 1.93 MB | 30 Aug 2011 - 18:30 |
| SeznamBot | 83 | 444.17 KB | 30 Aug 2011 - 03:01 |
| VORTEX | 76 | 892.17 KB | 24 Aug 2011 - 20:00 |
| yacy | 65 | 377.66 KB | 29 Aug 2011 - 23:36 |
| Powermarks | 59 | 1.98 MB | 29 Aug 2011 - 12:35 |
| larbin | 52 | 1.27 MB | 29 Aug 2011 - 05:59 |
| Web Core / Roots | 38 | 5.28 MB | 27 Aug 2011 - 22:02 |
| IBM Almaden Research Center WebFountain™ | 36 | 164.44 KB | 23 Aug 2011 - 00:37 |
| Holmes | 29 | 139.34 KB | 30 Aug 2011 - 08:43 |
| NewsGator Online | 26 | 57.56 KB | 30 Aug 2011 - 21:37 |
| BBot | 22 | 74.64 KB | 25 Aug 2011 - 06:16 |
| Findlinks | 20 | 173.47 KB | 29 Aug 2011 - 10:27 |
| GigaBot | 20 | 276.81 KB | 31 Aug 2011 - 03:06 |
| Netcraft | 14 | 284.54 KB | 31 Aug 2011 - 09:47 |
| WallPaper (alias crawlpaper) | 14 | 35.35 KB | 09 Aug 2011 - 18:17 |
| arks | 14 | 127.85 KB | 31 Aug 2011 - 23:21 |
| Mail.ru bot | 12 | 434.38 KB | 30 Aug 2011 - 02:37 |
| Voyager | 12 | 402.39 KB | 29 Aug 2011 - 13:49 |
| Phantom | 10 | 138.97 KB | 26 Aug 2011 - 17:52 |
| FavOrg | 8 | 357.49 KB | 08 Aug 2011 - 11:32 |
| bender focused_crawler | 8 | 11.56 KB | 30 Aug 2011 - 05:21 |
| NetSprint | 8 | 23.39 KB | 29 Aug 2011 - 17:50 |
| MojeekBot | 6 | 46.54 KB | 29 Aug 2011 - 09:25 |
| Feedburner | 5 | 129.93 KB | 27 Aug 2011 - 20:13 |
| IlTrovatore-Setaccio | 3 | 49.72 KB | 05 Aug 2011 - 22:43 |
| InternetSeer | 3 | 114.11 KB | 15 Aug 2011 - 10:40 |
| lwp-request | 3 | 110.63 KB | 29 Aug 2011 - 07:00 |
| W3C Link Checker | 3 | 10.47 KB | 13 Aug 2011 - 12:17 |
| Cursor | 2 | 90.64 KB | 27 Aug 2011 - 11:55 |
| Atomz.com Search Robot | 2 | 3.11 KB | 23 Aug 2011 - 00:03 |
| Internet Shinchakubin | 1 | 31.53 KB | 29 Aug 2011 - 11:24 |
| Orbiter | 1 | 28.11 KB | 26 Aug 2011 - 16:15 |