30 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 11412 | 24.66 MB | 30 Sep 2009 - 23:55 |
MSNBot | 9095 | 48.50 MB | 30 Sep 2009 - 23:46 |
Googlebot | 3877 | 9.21 MB | 30 Sep 2009 - 20:21 |
Heritrix | 201 | 1.79 MB | 03 Sep 2009 - 12:00 |
Unknown robot (identified by 'crawl') | 177 | 403.77 KB | 30 Sep 2009 - 22:50 |
BaiDuSpider | 160 | 4.56 MB | 30 Sep 2009 - 17:12 |
MJ12bot | 131 | 428.57 KB | 24 Sep 2009 - 05:38 |
twiceler | 106 | 231.48 KB | 18 Sep 2009 - 19:53 |
Ask | 104 | 338.43 KB | 30 Sep 2009 - 08:18 |
Mail.ru bot | 101 | 564.24 KB | 28 Sep 2009 - 00:01 |
Alexa (IA Archiver) | 35 | 404.07 KB | 29 Sep 2009 - 06:05 |
GigaBot | 31 | 503.45 KB | 30 Sep 2009 - 13:30 |
Java (Often spam bot) | 29 | 510.23 KB | 17 Sep 2009 - 05:29 |
MSIECrawler | 27 | 418.40 KB | 14 Sep 2009 - 21:14 |
Unknown robot (identified by 'robot') | 25 | 393.91 KB | 23 Sep 2009 - 23:12 |
Yandex bot | 25 | 239.36 KB | 29 Sep 2009 - 12:55 |
Powermarks | 22 | 259.38 KB | 27 Sep 2009 - 02:56 |
Unknown robot (identified by empty user agent string) | 20 | 261.61 KB | 29 Sep 2009 - 11:15 |
Unknown robot (identified by 'bot*') | 20 | 48.45 KB | 29 Sep 2009 - 10:28 |
Voila | 20 | 76.10 KB | 30 Sep 2009 - 15:29 |
Unknown robot (identified by 'spider') | 18 | 70.12 KB | 25 Sep 2009 - 20:36 |
Speedy Spider | 18 | 61.62 KB | 29 Sep 2009 - 15:59 |
Google AdSense | 17 | 88.67 KB | 30 Sep 2009 - 06:30 |
Exabot | 8 | 31.16 KB | 28 Sep 2009 - 19:17 |
legs | 6 | 20.21 KB | 30 Sep 2009 - 09:18 |
Nutch | 6 | 23.42 KB | 27 Sep 2009 - 23:24 |
larbin | 4 | 182.82 KB | 06 Sep 2009 - 07:27 |
CFNetwork | 3 | 11.69 KB | 20 Sep 2009 - 09:41 |
Python-urllib | 2 | 39.16 KB | 03 Sep 2009 - 13:14 |
Netcraft | 1 | 45.71 KB | 07 Sep 2009 - 17:39 |