| 55 different robots | Hits | Bandwidth | Last visit |
|---|
| CFNetwork | 23681 | 369.91 GB | 30 Nov 2009 - 23:59 |
| Yahoo Slurp | 19631 | 90.17 GB | 30 Nov 2009 - 23:56 |
| MSNBot | 4780 | 5.48 GB | 30 Nov 2009 - 23:57 |
| Googlebot | 4392 | 8.57 GB | 30 Nov 2009 - 23:40 |
| Unknown robot (identified by 'crawl') | 2371 | 4.22 GB | 30 Nov 2009 - 22:56 |
| twiceler | 1303 | 14.12 GB | 30 Nov 2009 - 23:58 |
| Unknown robot (identified by empty user agent string) | 1044 | 23.16 GB | 30 Nov 2009 - 22:10 |
| Exabot | 803 | 1.03 GB | 30 Nov 2009 - 23:55 |
| Yandex bot | 781 | 4.97 GB | 30 Nov 2009 - 19:01 |
| VSE | 578 | 14.76 GB | 30 Nov 2009 - 23:24 |
| Unknown robot (identified by 'robot') | 437 | 48.13 MB | 30 Nov 2009 - 21:18 |
| Feedfetcher-Google | 330 | 4.74 GB | 30 Nov 2009 - 18:33 |
| BaiDuSpider | 218 | 3.85 GB | 30 Nov 2009 - 18:43 |
| Python-urllib | 181 | 4.11 GB | 29 Nov 2009 - 13:41 |
| WordPress | 142 | 441.42 MB | 29 Nov 2009 - 14:36 |
| Web Core / Roots | 100 | 214.87 MB | 29 Nov 2009 - 08:13 |
| Unknown robot (identified by 'bot*') | 91 | 71.28 MB | 30 Nov 2009 - 06:23 |
| ABCdatos BotLink | 90 | 1.56 GB | 30 Nov 2009 - 04:01 |
| legs | 88 | 578.54 MB | 29 Nov 2009 - 15:22 |
| WWWC Ver 0.2.5 | 86 | 0 | 30 Nov 2009 - 06:30 |
| Custo | 64 | 1.58 GB | 30 Nov 2009 - 17:43 |
| Java (Often spam bot) | 64 | 894.72 MB | 30 Nov 2009 - 09:10 |
| Google AdSense | 61 | 1.27 GB | 29 Nov 2009 - 04:27 |
| larbin | 51 | 272.99 MB | 25 Nov 2009 - 03:54 |
| Jakarta commons-httpclient | 43 | 1.02 GB | 26 Nov 2009 - 11:02 |
| Nutch | 38 | 288.65 MB | 21 Nov 2009 - 20:41 |
| Voila | 36 | 124.24 MB | 30 Nov 2009 - 05:37 |
| MJ12bot | 30 | 576.09 MB | 30 Nov 2009 - 12:27 |
| BSpider | 24 | 445.14 MB | 30 Nov 2009 - 23:19 |
| Speedy Spider | 22 | 89.21 KB | 24 Nov 2009 - 04:11 |
| DoCoMo | 21 | 45.94 MB | 24 Nov 2009 - 02:31 |
| Ask | 17 | 27.64 MB | 21 Nov 2009 - 18:34 |
| Unknown robot (identified by 'spider') | 15 | 78.36 MB | 28 Nov 2009 - 00:49 |
| yacy | 14 | 27.51 MB | 29 Nov 2009 - 00:05 |
| Alexa (IA Archiver) | 10 | 59.64 KB | 28 Nov 2009 - 23:40 |
| Heritrix | 6 | 86.88 MB | 15 Nov 2009 - 18:28 |
| WallPaper (alias crawlpaper) | 5 | 137.16 MB | 28 Nov 2009 - 18:38 |
| Cursor | 5 | 137.16 MB | 23 Nov 2009 - 19:54 |
| Sogou Spider | 5 | 43.46 MB | 22 Nov 2009 - 11:32 |
| Grub.org | 4 | 13.31 KB | 14 Nov 2009 - 22:40 |
| SeznamBot | 3 | 72.12 MB | 05 Nov 2009 - 02:12 |
| arks | 3 | 82.29 MB | 21 Nov 2009 - 20:21 |
| Steeler | 2 | 26.21 KB | 24 Nov 2009 - 00:38 |
| Motor | 2 | 18.57 MB | 02 Nov 2009 - 17:49 |
| HTTrack off-line browser | 2 | 54.86 MB | 07 Nov 2009 - 18:57 |
| Feedburner | 2 | 0 | 09 Nov 2009 - 09:10 |
| BBot | 2 | 54.86 MB | 06 Nov 2009 - 00:27 |
| Muncher | 1 | 27.43 MB | 13 Nov 2009 - 03:34 |
| NG 1.x (Exalead) | 1 | 27.43 MB | 29 Nov 2009 - 04:04 |
| Sunrise | 1 | 16.00 MB | 01 Nov 2009 - 22:02 |
| gammaSpider, FocusedCrawler | 1 | 27.43 MB | 16 Nov 2009 - 15:56 |
| Turn It In | 1 | 2.96 KB | 30 Nov 2009 - 16:30 |
| Shoutcast Directory Service | 1 | 27.43 MB | 03 Nov 2009 - 23:41 |
| lwp-trivial | 1 | 27.43 MB | 19 Nov 2009 - 00:20 |
| QihooBot | 1 | 6.65 KB | 27 Nov 2009 - 04:20 |