| 110 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 138935+1 | 456.71 MB | 30 Sep 2009 - 23:59 |
| MSNBot | 103144+3830 | 1.08 GB | 30 Sep 2009 - 23:59 |
| Nagios | 42911 | 488.15 MB | 30 Sep 2009 - 23:59 |
| Yandex bot | 37033 | 116.86 MB | 30 Sep 2009 - 23:59 |
| Googlebot | 31517+28 | 374.84 MB | 30 Sep 2009 - 23:59 |
| Unknown robot (identified by empty user agent string) | 19831+85 | 201.61 MB | 30 Sep 2009 - 23:52 |
| HTTrack off-line browser | 18969+3 | 436.93 MB | 30 Sep 2009 - 05:20 |
| Python-urllib | 9912 | 215.80 MB | 30 Sep 2009 - 23:00 |
| Exabot | 8303 | 16.40 MB | 30 Sep 2009 - 23:51 |
| Speedy Spider | 5927+1 | 25.96 MB | 30 Sep 2009 - 22:02 |
| Unknown robot (identified by 'robot') | 4911+23 | 51.88 MB | 30 Sep 2009 - 23:14 |
| BaiDuSpider | 3674 | 48.59 MB | 30 Sep 2009 - 23:35 |
| Unknown robot (identified by '*bot') | 3584 | 58.41 MB | 30 Sep 2009 - 22:39 |
| Java (Often spam bot) | 3155 | 40.60 MB | 30 Sep 2009 - 23:35 |
| Unknown robot (identified by 'crawl') | 2952+9 | 53.24 MB | 30 Sep 2009 - 23:27 |
| Feedfetcher-Google | 2740 | 2.18 MB | 30 Sep 2009 - 23:55 |
| Unknown robot (identified by 'spider') | 2596 | 36.49 MB | 30 Sep 2009 - 23:53 |
| Unknown robot (identified by 'bot*') | 1969+164 | 28.09 MB | 30 Sep 2009 - 23:03 |
| WordPress | 1830 | 12.57 MB | 30 Sep 2009 - 22:51 |
| Voila | 1648 | 16.78 MB | 30 Sep 2009 - 23:54 |
| DoCoMo | 1609 | 21.96 MB | 30 Sep 2009 - 18:57 |
| Heritrix | 1411 | 19.01 MB | 30 Sep 2009 - 21:21 |
| twiceler | 1030 | 16.39 MB | 20 Sep 2009 - 15:07 |
| WWWC Ver 0.2.5 | 987 | 12.70 MB | 30 Sep 2009 - 23:58 |
| Mail.ru bot | 782 | 10.71 MB | 30 Sep 2009 - 09:36 |
| SeznamBot | 694 | 9.39 MB | 30 Sep 2009 - 07:06 |
| BSpider | 587 | 3.95 MB | 30 Sep 2009 - 18:47 |
| MJ12bot | 495 | 6.64 MB | 29 Sep 2009 - 20:52 |
| Ask | 481 | 14.87 MB | 30 Sep 2009 - 20:24 |
| Alexa (IA Archiver) | 452 | 3.19 MB | 30 Sep 2009 - 04:45 |
| Yahoo Feed Seeker | 376+50 | 9.30 MB | 30 Sep 2009 - 23:18 |
| Nutch | 379 | 5.09 MB | 30 Sep 2009 - 20:34 |
| Jakarta commons-httpclient | 371 | 5.37 MB | 30 Sep 2009 - 14:06 |
| Turn It In | 296 | 1.63 MB | 22 Sep 2009 - 09:55 |
| Powermarks | 285 | 1.72 MB | 30 Sep 2009 - 17:59 |
| Sogou Spider | 250 | 14.98 MB | 30 Sep 2009 - 23:58 |
| OutfoxBot/YodaoBot | 238 | 2.79 MB | 30 Sep 2009 - 21:42 |
| Voyager | 220 | 3.36 MB | 30 Sep 2009 - 22:39 |
| legs | 204 | 2.45 MB | 30 Sep 2009 - 15:10 |
| Custo | 133+58 | 2.06 MB | 30 Sep 2009 - 20:31 |
| larbin | 173 | 2.84 MB | 28 Sep 2009 - 11:08 |
| CFNetwork | 164 | 3.10 MB | 30 Sep 2009 - 15:53 |
| Fish search | 135 | 1.84 MB | 30 Sep 2009 - 19:43 |
| yacy | 105 | 1.25 MB | 30 Sep 2009 - 19:06 |
| W3C Validator | 75 | 1.30 MB | 30 Sep 2009 - 11:54 |
| Unknown robot (identified by hit on 'robots.txt') | 0+75 | 3.47 KB | 30 Sep 2009 - 15:56 |
| StackRambler | 64 | 1004.11 KB | 25 Sep 2009 - 02:00 |
| lwp-trivial | 64 | 885.50 KB | 30 Sep 2009 - 03:02 |
| ABCdatos BotLink | 60 | 1.35 MB | 30 Sep 2009 - 02:13 |
| Y!J Yahoo Japan | 38+19 | 501.42 KB | 26 Sep 2009 - 10:32 |
| LinkChecker | 51 | 255.84 KB | 29 Sep 2009 - 10:00 |
| Vagabondo | 50 | 812.30 KB | 30 Sep 2009 - 04:21 |
| Feedburner | 43 | 0 | 29 Sep 2009 - 13:57 |
| W3C Link Checker | 40 | 0 | 27 Sep 2009 - 11:07 |
| psbot | 39 | 699.25 KB | 22 Sep 2009 - 09:39 |
| VSE | 38 | 510.92 KB | 29 Sep 2009 - 21:14 |
| MSIECrawler | 33 | 398.38 KB | 27 Sep 2009 - 19:30 |
| WebWatch | 32 | 374.11 KB | 30 Sep 2009 - 21:49 |
| Grub.org | 26 | 299.62 KB | 30 Sep 2009 - 20:45 |
| arks | 26 | 12.82 KB | 29 Sep 2009 - 18:47 |
| Netcraft | 24 | 19.51 KB | 27 Sep 2009 - 21:51 |
| SuperBot | 20 | 233.54 KB | 30 Sep 2009 - 03:30 |
| UniversalFeedParser | 20 | 202.17 KB | 30 Sep 2009 - 10:01 |
| Holmes | 17 | 225.41 KB | 25 Sep 2009 - 05:00 |
| BBot | 16 | 172.73 KB | 29 Sep 2009 - 22:50 |
| NG 1.x (Exalead) | 16 | 170.16 KB | 29 Sep 2009 - 01:02 |
| Patric | 15 | 73.12 KB | 27 Sep 2009 - 15:54 |
| QihooBot | 15 | 216.23 KB | 30 Sep 2009 - 13:03 |
| archive.org bot | 15 | 942.12 KB | 26 Sep 2009 - 23:39 |
| NewsGator Online | 14 | 840 Bytes | 29 Sep 2009 - 00:13 |
| Boris | 12 | 167.43 KB | 30 Sep 2009 - 20:12 |
| NG 2.x (Exalead) | 11 | 150.71 KB | 28 Sep 2009 - 18:10 |
| GigaBot | 9 | 106.02 KB | 26 Sep 2009 - 01:41 |
| Checkbot | 9 | 0 | 27 Sep 2009 - 21:18 |
| HTMLParser | 9 | 109.08 KB | 30 Sep 2009 - 17:10 |
| Internet Shinchakubin | 8 | 104.74 KB | 24 Sep 2009 - 02:23 |
| ichiro | 8 | 1.21 MB | 30 Sep 2009 - 19:00 |
| NetSprint | 8 | 116.98 KB | 26 Sep 2009 - 02:45 |
| Google AdSense | 8 | 114.42 KB | 28 Sep 2009 - 17:33 |
| LinkScan | 8 | 53.80 KB | 27 Sep 2009 - 15:51 |
| SurveyBot | 3+3 | 34.45 KB | 26 Sep 2009 - 15:24 |
| Spiderman | 6 | 71.93 KB | 10 Sep 2009 - 22:49 |
| Susie | 5 | 69.36 KB | 30 Sep 2009 - 04:41 |
| FavOrg | 4 | 47.31 KB | 22 Sep 2009 - 10:29 |
| Web Core / Roots | 4 | 27.27 KB | 26 Sep 2009 - 05:26 |
| YahooSeeker Yahoo! Blog crawler | 4 | 50.76 KB | 24 Sep 2009 - 16:02 |
| Digger | 3 | 32.20 KB | 23 Sep 2009 - 04:19 |
| SBIder | 3 | 35.59 KB | 15 Sep 2009 - 14:19 |
| Emacs-w3 Search Engine | 3 | 39.64 KB | 17 Sep 2009 - 00:35 |
| Cursor | 2 | 24.55 KB | 22 Sep 2009 - 11:58 |
| Findlinks | 0+2 | 96 Bytes | 19 Sep 2009 - 08:43 |
| PhpDig | 2 | 11.86 KB | 15 Sep 2009 - 06:29 |
| Combine System | 2 | 19.51 KB | 06 Sep 2009 - 11:26 |
| TITAN | 2 | 23.72 KB | 10 Sep 2009 - 10:11 |
| Walhello appie | 2 | 23.72 KB | 11 Sep 2009 - 20:33 |
| MojeekBot | 2 | 158.49 KB | 28 Sep 2009 - 04:00 |
| Ocelli | 2 | 22.94 KB | 30 Sep 2009 - 12:58 |
| Misterbot | 1 | 12.86 KB | 08 Sep 2009 - 20:41 |
| MagpieRSS | 1 | 14.21 KB | 16 Sep 2009 - 15:32 |
| lwp-request | 1 | 12.69 KB | 21 Sep 2009 - 17:29 |
| The World Wide Web Worm | 1 | 11.57 KB | 07 Sep 2009 - 00:30 |
| The web archive (IA Archiver) | 0+1 | 48 Bytes | 25 Sep 2009 - 09:24 |
| Bloglines | 1 | 14.85 KB | 07 Sep 2009 - 13:45 |
| WallPaper (alias crawlpaper) | 1 | 14.62 KB | 06 Sep 2009 - 18:39 |
| Sunrise | 1 | 13.15 KB | 17 Sep 2009 - 02:01 |
| mnoGoSearch search engine software | 1 | 13.19 KB | 28 Sep 2009 - 22:57 |
| Bookmark-Manager | 1 | 0 | 16 Sep 2009 - 09:17 |
| Yahoo-MMCrawler | 1 | 5.47 KB | 01 Sep 2009 - 23:07 |
| MSRBOT | 1 | 9.75 KB | 04 Sep 2009 - 16:57 |
| Perman surfer | 1 | 12.69 KB | 27 Sep 2009 - 03:49 |