| 92 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 1242001 | 29.24 GB | 31 Aug 2009 - 23:59 |
| Googlebot | 670138 | 10.14 GB | 31 Aug 2009 - 23:59 |
| Yahoo Slurp | 482732 | 10.21 GB | 31 Aug 2009 - 23:59 |
| Yandex bot | 107471 | 2.21 GB | 31 Aug 2009 - 23:59 |
| \wbot[\/\-] | 85998 | 2.17 GB | 21 Aug 2009 - 19:02 |
| Unknown robot (identified by 'robot') | 25503 | 377.96 MB | 31 Aug 2009 - 23:59 |
| twiceler | 16130 | 214.06 MB | 31 Aug 2009 - 23:59 |
| Ask | 9597 | 213.86 MB | 31 Aug 2009 - 23:40 |
| Unknown robot (identified by 'crawl') | 7043 | 119.72 MB | 31 Aug 2009 - 23:45 |
| Feedfetcher-Google | 7005 | 178.88 MB | 31 Aug 2009 - 23:59 |
| Unknown robot (identified by empty user agent string) | 6344 | 104.89 MB | 31 Aug 2009 - 23:37 |
| Voila | 6188 | 59.29 MB | 31 Aug 2009 - 23:54 |
| Mail.ru bot | 4552 | 90.76 MB | 31 Aug 2009 - 20:20 |
| Heritrix | 4535 | 97.25 MB | 31 Aug 2009 - 23:59 |
| Alexa (IA Archiver) | 3989 | 168.57 MB | 31 Aug 2009 - 23:59 |
| DoCoMo | 3761 | 17.55 MB | 31 Aug 2009 - 22:54 |
| BaiDuSpider | 2599 | 546.41 MB | 31 Aug 2009 - 22:50 |
| CFNetwork | 2226 | 86.49 MB | 31 Aug 2009 - 22:32 |
| InfoBot | 1450 | 5.79 MB | 31 Aug 2009 - 02:24 |
| psbot | 1227 | 23.89 MB | 31 Aug 2009 - 20:27 |
| BSpider | 1123 | 16.83 MB | 31 Aug 2009 - 22:08 |
| Java (Often spam bot) | 1018 | 22.06 MB | 31 Aug 2009 - 23:01 |
| Bloglines | 1017 | 60.68 MB | 31 Aug 2009 - 22:09 |
| Custo | 964 | 8.54 MB | 31 Aug 2009 - 22:59 |
| Yahoo Feed Seeker | 930 | 20.14 MB | 31 Aug 2009 - 22:14 |
| legs | 919 | 19.77 MB | 31 Aug 2009 - 23:20 |
| UniversalFeedParser | 911 | 6.73 MB | 31 Aug 2009 - 23:30 |
| larbin | 909 | 23.64 MB | 31 Aug 2009 - 14:27 |
| Unknown robot (identified by 'spider') | 872 | 18.96 MB | 31 Aug 2009 - 22:47 |
| HTTrack off-line browser | 749 | 55.47 MB | 31 Aug 2009 - 19:50 |
| Speedy Spider | 708 | 12.70 MB | 31 Aug 2009 - 23:31 |
| WordPress | 620 | 7.63 MB | 31 Aug 2009 - 23:25 |
| Unknown robot (identified by 'bot*') | 591 | 9.67 MB | 31 Aug 2009 - 23:53 |
| VSE | 510 | 7.50 MB | 29 Aug 2009 - 22:16 |
| Yahoo-MMCrawler | 458 | 16.75 MB | 31 Aug 2009 - 17:12 |
| Exabot | 336 | 2.96 MB | 31 Aug 2009 - 22:19 |
| MJ12bot | 330 | 4.13 MB | 31 Aug 2009 - 22:52 |
| echo | 319 | 4.38 MB | 21 Aug 2009 - 15:12 |
| Unknown robot (identified by '*bot') | 319 | 3.86 MB | 30 Aug 2009 - 14:55 |
| Nutch | 268 | 4.66 MB | 31 Aug 2009 - 22:25 |
| arks | 248 | 2.58 MB | 31 Aug 2009 - 21:09 |
| MSIECrawler | 229 | 1.39 MB | 31 Aug 2009 - 22:28 |
| OutfoxBot/YodaoBot | 226 | 2.59 MB | 31 Aug 2009 - 20:14 |
| Powermarks | 207 | 2.77 MB | 31 Aug 2009 - 19:26 |
| NewsGator Online | 203 | 1.69 MB | 31 Aug 2009 - 22:26 |
| WallPaper (alias crawlpaper) | 201 | 2.42 MB | 31 Aug 2009 - 00:34 |
| Python-urllib | 184 | 7.50 MB | 31 Aug 2009 - 19:14 |
| Turn It In | 155 | 11.60 MB | 09 Aug 2009 - 16:05 |
| Ocelli | 147 | 2.74 MB | 31 Aug 2009 - 02:36 |
| Grub.org | 133 | 631.29 KB | 31 Aug 2009 - 22:22 |
| yacy | 127 | 1.89 MB | 31 Aug 2009 - 12:09 |
| StackRambler | 113 | 1.49 MB | 30 Aug 2009 - 22:05 |
| Internet Shinchakubin | 108 | 3.93 MB | 31 Aug 2009 - 05:50 |
| The web archive (IA Archiver) | 83 | 77.53 KB | 31 Aug 2009 - 22:45 |
| Web Core / Roots | 82 | 274.98 KB | 29 Aug 2009 - 22:31 |
| Boris | 81 | 892.67 KB | 29 Aug 2009 - 20:19 |
| MagpieRSS | 79 | 1.24 MB | 31 Aug 2009 - 22:14 |
| ZhuaXia | 58 | 560.26 KB | 31 Aug 2009 - 23:45 |
| Jakarta commons-httpclient | 53 | 2.09 MB | 31 Aug 2009 - 04:34 |
| Sunrise | 46 | 483.87 KB | 29 Aug 2009 - 13:05 |
| Misterbot | 45 | 462.64 KB | 30 Aug 2009 - 15:45 |
| Fish search | 42 | 1.29 MB | 27 Aug 2009 - 08:37 |
| GigaBot | 36 | 432.18 KB | 30 Aug 2009 - 06:47 |
| Digger | 34 | 534.40 KB | 22 Aug 2009 - 05:49 |
| WWWC Ver 0.2.5 | 34 | 19.32 KB | 31 Aug 2009 - 14:26 |
| Holmes | 33 | 51.98 KB | 31 Aug 2009 - 14:04 |
| Sogou Spider | 23 | 643.25 KB | 31 Aug 2009 - 16:29 |
| Spiderman | 19 | 482.60 KB | 28 Aug 2009 - 04:34 |
| Google AdSense | 19 | 394.51 KB | 29 Aug 2009 - 12:26 |
| Scooter | 18 | 95.99 KB | 30 Aug 2009 - 00:48 |
| WebCollage | 17 | 451.12 KB | 31 Aug 2009 - 16:41 |
| Motor | 15 | 430.51 KB | 31 Aug 2009 - 23:27 |
| W3C Link Checker | 13 | 8.32 KB | 30 Aug 2009 - 21:34 |
| QihooBot | 12 | 249.29 KB | 30 Aug 2009 - 09:01 |
| LinkChecker | 12 | 7.44 KB | 26 Aug 2009 - 03:07 |
| Gaisbot | 10 | 203.47 KB | 29 Aug 2009 - 06:37 |
| SurveyBot | 8 | 103.70 KB | 28 Aug 2009 - 22:45 |
| Combine System | 6 | 91.82 KB | 24 Aug 2009 - 06:57 |
| Emacs-w3 Search Engine | 6 | 200.20 KB | 18 Aug 2009 - 18:19 |
| lwp-trivial | 5 | 142.33 KB | 26 Aug 2009 - 16:04 |
| Susie | 4 | 58.64 KB | 30 Aug 2009 - 11:04 |
| Feedburner | 4 | 1.55 KB | 21 Aug 2009 - 23:04 |
| W3C Validator | 3 | 60.33 KB | 14 Aug 2009 - 21:43 |
| LinkScan | 3 | 76.16 KB | 26 Aug 2009 - 19:45 |
| ComputingSite Robi/1.0 | 2 | 626 Bytes | 07 Aug 2009 - 07:29 |
| NG 2.x (Exalead) | 2 | 1.87 KB | 28 Aug 2009 - 07:21 |
| Netcraft | 2 | 47.51 KB | 06 Aug 2009 - 19:31 |
| Vagabondo | 2 | 1.25 KB | 24 Aug 2009 - 19:03 |
| mnoGoSearch search engine software | 2 | 47.69 KB | 02 Aug 2009 - 22:32 |
| Snappy | 1 | 957 Bytes | 31 Aug 2009 - 00:38 |
| SeznamBot | 1 | 957 Bytes | 27 Aug 2009 - 11:59 |
| SuperBot | 1 | 28.47 KB | 25 Aug 2009 - 17:49 |