| 111 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 133211+2295 | 1.67 GB | 30 Nov 2009 - 23:59 |
| Yahoo Slurp | 90381 | 442.39 MB | 30 Nov 2009 - 23:59 |
| Nagios | 43170 | 439.47 MB | 30 Nov 2009 - 23:59 |
| Googlebot | 31767+11 | 430.16 MB | 30 Nov 2009 - 23:58 |
| Yandex bot | 28428 | 123.98 MB | 30 Nov 2009 - 23:59 |
| Unknown robot (identified by empty user agent string) | 25899+35 | 257.77 MB | 30 Nov 2009 - 23:57 |
| HTTrack off-line browser | 14187+1 | 311.39 MB | 30 Nov 2009 - 20:39 |
| Exabot | 8254 | 60.00 MB | 30 Nov 2009 - 22:55 |
| Mail.ru bot | 7844 | 16.03 MB | 28 Nov 2009 - 09:37 |
| BaiDuSpider | 6257+2 | 84.20 MB | 30 Nov 2009 - 23:54 |
| Unknown robot (identified by 'robot') | 5708+42 | 92.47 MB | 30 Nov 2009 - 23:37 |
| Speedy Spider | 5321 | 34.28 MB | 30 Nov 2009 - 07:37 |
| Unknown robot (identified by 'crawl') | 4821+85 | 79.46 MB | 30 Nov 2009 - 19:40 |
| Unknown robot (identified by '*bot') | 3570 | 56.35 MB | 27 Nov 2009 - 20:01 |
| twiceler | 3360+1 | 25.71 MB | 30 Nov 2009 - 23:41 |
| Feedfetcher-Google | 2871 | 3.34 MB | 30 Nov 2009 - 23:53 |
| Unknown robot (identified by 'spider') | 2635 | 36.92 MB | 30 Nov 2009 - 23:46 |
| WordPress | 2629 | 14.84 MB | 30 Nov 2009 - 23:56 |
| Unknown robot (identified by 'bot*') | 2397+184 | 33.28 MB | 30 Nov 2009 - 21:30 |
| Java (Often spam bot) | 2319 | 29.22 MB | 30 Nov 2009 - 22:46 |
| Steeler | 2002 | 47.89 MB | 30 Nov 2009 - 23:56 |
| Voila | 1574 | 16.59 MB | 30 Nov 2009 - 23:34 |
| DoCoMo | 1520 | 20.96 MB | 30 Nov 2009 - 22:41 |
| ichiro | 1298 | 29.59 MB | 04 Nov 2009 - 10:43 |
| WWWC Ver 0.2.5 | 1018 | 12.67 MB | 30 Nov 2009 - 23:55 |
| Python-urllib | 995 | 13.06 MB | 30 Nov 2009 - 23:00 |
| Heritrix | 624 | 10.31 MB | 29 Nov 2009 - 22:03 |
| SeznamBot | 604+1 | 7.96 MB | 29 Nov 2009 - 21:53 |
| MJ12bot | 522 | 7.32 MB | 30 Nov 2009 - 12:44 |
| Yahoo Feed Seeker | 437+54 | 9.65 MB | 30 Nov 2009 - 23:30 |
| Ask | 489+1 | 9.86 MB | 30 Nov 2009 - 23:33 |
| legs | 420 | 4.98 MB | 30 Nov 2009 - 23:27 |
| Turn It In | 292 | 1.45 MB | 26 Nov 2009 - 07:52 |
| yacy | 251 | 3.33 MB | 30 Nov 2009 - 23:14 |
| Nutch | 246+1 | 3.47 MB | 30 Nov 2009 - 15:32 |
| OutfoxBot/YodaoBot | 244 | 2.56 MB | 30 Nov 2009 - 23:54 |
| CFNetwork | 200 | 3.40 MB | 30 Nov 2009 - 16:42 |
| Feedburner | 199 | 0 | 30 Nov 2009 - 23:26 |
| Custo | 132+66 | 1.67 MB | 30 Nov 2009 - 18:53 |
| BSpider | 196 | 2.22 MB | 30 Nov 2009 - 23:22 |
| Sogou Spider | 195 | 17.75 MB | 30 Nov 2009 - 21:52 |
| Powermarks | 191 | 1.10 MB | 30 Nov 2009 - 23:15 |
| Jakarta commons-httpclient | 154 | 1.77 MB | 30 Nov 2009 - 18:52 |
| Fish search | 138 | 1.60 MB | 28 Nov 2009 - 11:40 |
| VSE | 109 | 1.41 MB | 30 Nov 2009 - 18:04 |
| Alexa (IA Archiver) | 107 | 2.03 MB | 30 Nov 2009 - 06:12 |
| Tarantula | 107 | 1.36 MB | 30 Nov 2009 - 15:00 |
| larbin | 94 | 1.23 MB | 30 Nov 2009 - 21:40 |
| Unknown robot (identified by hit on 'robots.txt') | 0+74 | 3.47 KB | 30 Nov 2009 - 22:11 |
| StackRambler | 66 | 1006.15 KB | 17 Nov 2009 - 02:35 |
| ABCdatos BotLink | 60 | 1.36 MB | 30 Nov 2009 - 03:37 |
| lwp-trivial | 57 | 787.25 KB | 30 Nov 2009 - 04:01 |
| W3C Validator | 55 | 952.38 KB | 30 Nov 2009 - 20:05 |
| MSIECrawler | 55 | 1.08 MB | 30 Nov 2009 - 04:46 |
| NG 1.x (Exalead) | 44 | 425.54 KB | 29 Nov 2009 - 18:04 |
| W3C Link Checker | 39 | 0 | 30 Nov 2009 - 16:09 |
| LinkChecker | 37 | 187.59 KB | 30 Nov 2009 - 02:36 |
| Y!J Yahoo Japan | 32 | 422.65 KB | 30 Nov 2009 - 01:13 |
| arks | 31 | 20.09 KB | 30 Nov 2009 - 13:09 |
| Patric | 29 | 147.12 KB | 27 Nov 2009 - 09:28 |
| Sunrise | 29 | 238.37 KB | 25 Nov 2009 - 14:14 |
| T-H-U-N-D-E-R-S-T-O-N-E | 28 | 410.91 KB | 30 Nov 2009 - 10:05 |
| Webdup | 26 | 316.58 KB | 05 Nov 2009 - 00:03 |
| Grub.org | 24 | 302.70 KB | 20 Nov 2009 - 02:40 |
| Google AdSense | 23 | 304.18 KB | 30 Nov 2009 - 15:41 |
| Voyager | 23 | 336.10 KB | 25 Nov 2009 - 22:56 |
| WebWatch | 22 | 221.00 KB | 24 Nov 2009 - 18:40 |
| QihooBot | 21 | 307.74 KB | 29 Nov 2009 - 16:48 |
| Holmes | 17 | 227.02 KB | 30 Nov 2009 - 22:43 |
| Muncher | 17 | 331.36 KB | 25 Nov 2009 - 15:49 |
| ASpider (Associative Spider) | 16 | 174.06 KB | 30 Nov 2009 - 16:17 |
| Web Core / Roots | 16 | 161.70 KB | 26 Nov 2009 - 09:07 |
| Netcraft | 16 | 20.09 KB | 30 Nov 2009 - 22:42 |
| NewsGator Online | 14 | 480 Bytes | 29 Nov 2009 - 15:41 |
| TITAN | 14 | 185.42 KB | 27 Nov 2009 - 08:59 |
| LinkScan | 13 | 100.82 KB | 29 Nov 2009 - 16:51 |
| Checkbot | 11 | 0 | 30 Nov 2009 - 01:42 |
| FavOrg | 10 | 117.72 KB | 23 Nov 2009 - 17:49 |
| MagpieRSS | 10 | 163.99 KB | 28 Nov 2009 - 22:50 |
| BBot | 10 | 118.03 KB | 26 Nov 2009 - 10:51 |
| UniversalFeedParser | 9 | 203.69 KB | 25 Nov 2009 - 09:35 |
| Susie | 8 | 96.30 KB | 26 Nov 2009 - 21:41 |
| GigaBot | 8 | 80.38 KB | 21 Nov 2009 - 21:49 |
| archive.org bot | 7 | 74.08 KB | 27 Nov 2009 - 21:07 |
| SurveyBot | 3+3 | 32.16 KB | 26 Nov 2009 - 02:57 |
| Findlinks | 3+2 | 35.19 KB | 25 Nov 2009 - 21:57 |
| psbot | 4 | 49.38 KB | 25 Nov 2009 - 12:24 |
| BlogPulse ISSpider intelliseek.com | 4 | 65.43 KB | 23 Nov 2009 - 07:00 |
| SuperBot | 3 | 30.14 KB | 05 Nov 2009 - 08:32 |
| WebCollage | 3 | 592.41 KB | 24 Nov 2009 - 07:14 |
| Internet Shinchakubin | 3 | 56.10 KB | 10 Nov 2009 - 21:00 |
| UbiCrawler | 2 | 20.09 KB | 06 Nov 2009 - 11:08 |
| Cursor | 2 | 476.60 KB | 10 Nov 2009 - 02:47 |
| InfoBot | 2 | 20.09 KB | 19 Nov 2009 - 14:28 |
| Spiderman | 2 | 26.62 KB | 30 Nov 2009 - 16:29 |
| PhpDig | 2 | 10.05 KB | 15 Nov 2009 - 07:22 |
| WallPaper (alias crawlpaper) | 2 | 20.09 KB | 03 Nov 2009 - 22:01 |
| YahooSeeker Yahoo! Blog crawler | 2 | 20.09 KB | 19 Nov 2009 - 13:22 |
| Boris | 2 | 24.97 KB | 12 Nov 2009 - 11:52 |
| HTMLParser | 2 | 20.09 KB | 10 Nov 2009 - 12:17 |
| Emacs-w3 Search Engine | 2 | 33.06 KB | 25 Nov 2009 - 16:42 |
| Yahoo-MMCrawler | 2 | 875.66 KB | 28 Nov 2009 - 02:50 |
| Perman surfer | 2 | 20.09 KB | 08 Nov 2009 - 00:11 |
| Megite | 1 | 13.90 KB | 25 Nov 2009 - 11:16 |
| ConveraCrawler | 1 | 10.05 KB | 13 Nov 2009 - 12:05 |
| The web archive (IA Archiver) | 0+1 | 48 Bytes | 24 Nov 2009 - 10:43 |
| FeedValidator | 1 | 14.80 KB | 26 Nov 2009 - 16:03 |
| mnoGoSearch search engine software | 1 | 10.05 KB | 12 Nov 2009 - 14:34 |
| Bookmark-Manager | 1 | 0 | 08 Nov 2009 - 16:50 |
| FeedCrawl by feed@aobo.com | 1 | 10.05 KB | 22 Nov 2009 - 01:36 |
| lmspider | 1 | 10.05 KB | 20 Nov 2009 - 06:12 |