| 36 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 9951 | 2.67 GB | 31 Dec 2009 - 23:56 |
| Yahoo Slurp | 5477 | 7.12 GB | 31 Dec 2009 - 23:59 |
| Python-urllib | 4700 | 58.74 MB | 31 Dec 2009 - 21:08 |
| Googlebot | 1124 | 1.35 GB | 31 Dec 2009 - 21:56 |
| Unknown robot (identified by 'crawl') | 270 | 674.43 MB | 31 Dec 2009 - 17:13 |
| BaiDuSpider | 231 | 5.49 MB | 31 Dec 2009 - 17:32 |
| Unknown robot (identified by 'bot*') | 223 | 559.03 KB | 29 Dec 2009 - 21:08 |
| Yandex bot | 211 | 967.23 KB | 31 Dec 2009 - 23:59 |
| Exabot | 164 | 401.32 MB | 31 Dec 2009 - 14:28 |
| Unknown robot (identified by empty user agent string) | 143 | 41.04 MB | 31 Dec 2009 - 09:19 |
| BSpider | 108 | 177.87 KB | 31 Dec 2009 - 22:49 |
| Java (Often spam bot) | 83 | 161.47 MB | 21 Dec 2009 - 10:20 |
| twiceler | 81 | 402.73 KB | 25 Dec 2009 - 02:03 |
| DoCoMo | 77 | 289.37 KB | 21 Dec 2009 - 19:53 |
| Heritrix | 63 | 88.10 MB | 29 Dec 2009 - 10:07 |
| WordPress | 47 | 79.33 KB | 29 Dec 2009 - 02:03 |
| Nutch | 44 | 51.52 MB | 20 Dec 2009 - 16:04 |
| Speedy Spider | 39 | 141.17 KB | 31 Dec 2009 - 17:41 |
| Unknown robot (identified by 'spider') | 32 | 38.40 MB | 31 Dec 2009 - 18:47 |
| larbin | 25 | 29.82 MB | 31 Dec 2009 - 14:41 |
| Unknown robot (identified by 'robot') | 24 | 1.83 MB | 31 Dec 2009 - 23:55 |
| StackRambler | 18 | 83.58 KB | 31 Dec 2009 - 11:23 |
| legs | 17 | 661.06 KB | 29 Dec 2009 - 07:46 |
| yacy | 15 | 62.57 KB | 31 Dec 2009 - 02:23 |
| Alexa (IA Archiver) | 11 | 109.31 KB | 31 Dec 2009 - 15:29 |
| Voila | 10 | 16.19 KB | 29 Dec 2009 - 16:03 |
| MSNBot-media | 9 | 35.44 MB | 31 Dec 2009 - 12:38 |
| Ask | 8 | 39.81 KB | 22 Dec 2009 - 02:08 |
| NG 1.x (Exalead) | 4 | 166.91 KB | 13 Dec 2009 - 21:59 |
| CFNetwork | 2 | 3.50 MB | 20 Dec 2009 - 18:10 |
| MJ12bot | 2 | 8.19 KB | 21 Dec 2009 - 14:06 |
| WebCollage | 1 | 88.14 KB | 28 Dec 2009 - 19:47 |
| Emacs-w3 Search Engine | 1 | 35.84 KB | 07 Dec 2009 - 02:31 |
| Fish search | 1 | 3.83 KB | 09 Dec 2009 - 10:55 |
| MSIECrawler | 1 | 1.62 KB | 28 Dec 2009 - 20:55 |
| Netcraft | 1 | 1.62 KB | 11 Dec 2009 - 19:14 |