44 different robots | Hits | Bandwidth | Last visit |
Feedfetcher-Google | 863 | 206.97 MB | 31 Dec 2011 - 22:56 |
Unknown robot (identified by empty user agent string) | 589 | 99.83 MB | 31 Dec 2011 - 23:47 |
CFNetwork | 549 | 92.01 MB | 31 Dec 2011 - 23:38 |
MSNBot | 446 | 105.37 MB | 31 Dec 2011 - 19:13 |
NG 1.x (Exalead) | 337 | 79.69 MB | 31 Dec 2011 - 17:39 |
MagpieRSS | 206 | 48.79 MB | 31 Dec 2011 - 23:47 |
Googlebot | 125 | 19.61 MB | 31 Dec 2011 - 22:49 |
yacy | 116 | 18.84 MB | 30 Dec 2011 - 22:25 |
Unknown robot (identified by 'bot*') | 100 | 16.50 MB | 31 Dec 2011 - 19:44 |
BaiDuSpider | 79 | 12.72 MB | 31 Dec 2011 - 03:06 |
MJ12bot | 79 | 11.00 MB | 31 Dec 2011 - 22:25 |
Python-urllib | 67 | 15.86 MB | 31 Dec 2011 - 06:54 |
Unknown robot (identified by 'robot') | 60 | 8.27 MB | 31 Dec 2011 - 14:09 |
Speedy Spider | 41 | 6.63 MB | 29 Dec 2011 - 19:57 |
OutfoxBot/YodaoBot | 40 | 6.65 MB | 28 Dec 2011 - 03:21 |
Yandex bot | 40 | 5.26 MB | 31 Dec 2011 - 10:53 |
Nutch | 30 | 6.28 MB | 31 Dec 2011 - 16:54 |
Java (Often spam bot) | 29 | 3.74 MB | 30 Dec 2011 - 17:44 |
Yahoo Slurp | 28 | 4.64 MB | 26 Dec 2011 - 14:29 |
WordPress | 23 | 5.47 MB | 31 Dec 2011 - 06:18 |
Unknown robot (identified by '*bot') | 21 | 2.36 MB | 29 Dec 2011 - 15:05 |
LiveJournal.com | 20 | 4.71 MB | 31 Dec 2011 - 06:40 |
Unknown robot (identified by 'spider') | 19 | 3.19 MB | 31 Dec 2011 - 03:14 |
NewsGator Online | 12 | 2.83 MB | 31 Dec 2011 - 11:10 |
Findlinks | 10 | 1.68 MB | 29 Dec 2011 - 16:25 |
Sogou Spider | 10 | 1.66 MB | 28 Dec 2011 - 09:42 |
MSNBot-media | 9 | 1.51 MB | 28 Dec 2011 - 15:39 |
Unknown robot (identified by 'crawl') | 8 | 1.34 MB | 30 Dec 2011 - 12:04 |
Mail.ru bot | 7 | 1.19 MB | 15 Dec 2011 - 08:03 |
Exabot | 6 | 691.14 KB | 28 Dec 2011 - 11:52 |
InfoSeek Robot 1.0 | 6 | 1.01 MB | 02 Dec 2011 - 13:27 |
SeznamBot | 5 | 858.82 KB | 29 Dec 2011 - 06:05 |
GigaBot | 5 | 850.94 KB | 28 Dec 2011 - 09:32 |
Custo | 4 | 687.23 KB | 19 Dec 2011 - 11:02 |
Powermarks | 2 | 338.82 KB | 31 Dec 2011 - 17:24 |
HTTrack off-line browser | 2 | 347.01 KB | 15 Dec 2011 - 19:34 |
Harvest | 2 | 349.05 KB | 09 Dec 2011 - 14:59 |
HTMLParser | 1 | 173.09 KB | 15 Dec 2011 - 07:58 |
Combine System | 1 | 171.30 KB | 05 Dec 2011 - 06:27 |
Alexa (IA Archiver) | 1 | 167.63 KB | 22 Dec 2011 - 19:18 |
Y!J Yahoo Japan | 1 | 176.57 KB | 08 Dec 2011 - 11:44 |
archive.org bot | 1 | 167.63 KB | 22 Dec 2011 - 19:36 |
larbin | 1 | 172.15 KB | 02 Dec 2011 - 01:59 |
Netcraft | 1 | 166.93 KB | 30 Dec 2011 - 01:59 |