63 different robots | Hits | Bandwidth | Last visit |
BaiDuSpider | 28294+242 | 952.37 MB | 30 Apr 2012 - 19:10 |
Unknown robot (identified by 'bot*') | 39498+1369 | 2.55 GB | 30 Apr 2012 - 19:09 |
MJ12bot | 8415+3387 | 392.20 MB | 30 Apr 2012 - 19:08 |
Unknown robot (identified by 'crawl') | 1251+697 | 67.05 MB | 30 Apr 2012 - 19:07 |
BSpider | 2147 | 64.76 MB | 30 Apr 2012 - 19:06 |
Sogou Spider | 7270+1 | 341.80 MB | 30 Apr 2012 - 19:03 |
Yandex bot | 12809+48 | 649.65 MB | 30 Apr 2012 - 19:01 |
MSNBot-media | 1445+554 | 59.31 MB | 30 Apr 2012 - 19:00 |
Unknown robot (identified by empty user agent string) | 10293+24 | 318.11 MB | 30 Apr 2012 - 18:55 |
Unknown robot (identified by hit on 'robots.txt') | 0+611 | 177.21 KB | 30 Apr 2012 - 18:52 |
WordPress | 249 | 7.74 MB | 30 Apr 2012 - 18:48 |
Unknown robot (identified by '*bot') | 7514+699 | 335.34 MB | 30 Apr 2012 - 18:42 |
MSNBot | 70044+142 | 4.19 GB | 30 Apr 2012 - 18:39 |
Unknown robot (identified by 'robot') | 1618+178 | 73.54 MB | 30 Apr 2012 - 18:18 |
MagpieRSS | 242+67 | 10.58 MB | 30 Apr 2012 - 18:18 |
Googlebot | 5875+13 | 309.84 MB | 30 Apr 2012 - 18:05 |
CFNetwork | 941 | 44.50 MB | 30 Apr 2012 - 18:00 |
SeznamBot | 291+30 | 13.78 MB | 30 Apr 2012 - 17:44 |
Jakarta commons-httpclient | 97 | 5.52 MB | 30 Apr 2012 - 17:29 |
Java (Often spam bot) | 9269+145 | 398.35 MB | 30 Apr 2012 - 17:25 |
DoCoMo | 84+21 | 3.48 MB | 30 Apr 2012 - 14:45 |
Custo | 72 | 1.25 MB | 30 Apr 2012 - 14:15 |
Feedfetcher-Google | 56 | 1.76 MB | 30 Apr 2012 - 13:52 |
Unknown robot (identified by 'spider') | 2951+58 | 137.83 MB | 30 Apr 2012 - 11:44 |
Nutch | 89+50 | 5.15 MB | 30 Apr 2012 - 11:24 |
Findlinks | 10+9 | 498.82 KB | 30 Apr 2012 - 09:09 |
legs | 731+44 | 38.33 MB | 30 Apr 2012 - 09:00 |
InfoBot | 7 | 220.12 KB | 30 Apr 2012 - 05:31 |
Alexa (IA Archiver) | 124+89 | 6.14 MB | 30 Apr 2012 - 04:04 |
Yahoo Slurp | 143+27 | 2.20 MB | 30 Apr 2012 - 03:20 |
psbot | 7+6 | 279.60 KB | 29 Apr 2012 - 22:23 |
arks | 3 | 0 | 29 Apr 2012 - 15:02 |
W3C Validator | 248 | 8.91 MB | 29 Apr 2012 - 12:20 |
OutfoxBot/YodaoBot | 134+7 | 3.91 MB | 29 Apr 2012 - 11:09 |
LinkChecker | 0+10 | 2.90 KB | 29 Apr 2012 - 05:06 |
Mail.ru bot | 297+8 | 12.68 MB | 28 Apr 2012 - 20:33 |
Powermarks | 60 | 1.78 MB | 28 Apr 2012 - 15:50 |
SurveyBot | 9+3 | 279.28 KB | 28 Apr 2012 - 13:44 |
LinkScan | 72 | 2.28 MB | 28 Apr 2012 - 07:09 |
Speedy Spider | 79+78 | 4.50 MB | 27 Apr 2012 - 08:20 |
Harvest | 239 | 20.70 MB | 26 Apr 2012 - 20:07 |
Python-urllib | 53+7 | 36.01 MB | 26 Apr 2012 - 14:13 |
HTTrack off-line browser | 50+1 | 2.11 MB | 26 Apr 2012 - 09:35 |
Exabot | 17+32 | 1.01 MB | 26 Apr 2012 - 07:02 |
Motor | 67 | 1.24 MB | 25 Apr 2012 - 08:18 |
W3C Link Checker | 14+15 | 4.35 KB | 25 Apr 2012 - 04:41 |
larbin | 82+9 | 2.27 MB | 24 Apr 2012 - 12:44 |
VORTEX | 23 | 789.86 KB | 24 Apr 2012 - 03:10 |
GigaBot | 34 | 2.09 MB | 24 Apr 2012 - 01:47 |
Phantom | 45 | 850.04 KB | 23 Apr 2012 - 19:54 |
archive.org bot | 19+5 | 709.72 KB | 23 Apr 2012 - 17:58 |
WebCollage | 2 | 73.53 KB | 21 Apr 2012 - 20:55 |
NG 1.x (Exalead) | 3 | 121.39 KB | 21 Apr 2012 - 06:33 |
Voila | 0+1 | 297 Bytes | 20 Apr 2012 - 20:00 |
ichiro | 91+12 | 4.07 MB | 20 Apr 2012 - 00:48 |
VSE | 6+1 | 246.65 KB | 17 Apr 2012 - 09:49 |
Web Core / Roots | 1 | 61.81 KB | 12 Apr 2012 - 04:41 |
HTMLParser | 2 | 3.32 MB | 12 Apr 2012 - 02:51 |
WallPaper (alias crawlpaper) | 1 | 9.42 KB | 10 Apr 2012 - 00:00 |
Heritrix | 3+2 | 47.71 KB | 06 Apr 2012 - 14:44 |
InfoSeek Robot 1.0 | 6 | 379.59 KB | 05 Apr 2012 - 09:17 |
Netcraft | 3 | 92.39 KB | 02 Apr 2012 - 17:25 |
MSIECrawler | 1 | 44.11 KB | 01 Apr 2012 - 17:32 |