67 different robots | Hits | Bandwidth | Last visit |
Googlebot | 104388+103 | 4.87 GB | 30 Sep 2012 - 23:59 |
Unknown robot (identified by 'bot*') | 313740+770 | 19.05 GB | 30 Sep 2012 - 23:59 |
BaiDuSpider | 16967+312 | 446.76 MB | 30 Sep 2012 - 23:58 |
Yandex bot | 24861+71 | 1.06 GB | 30 Sep 2012 - 23:57 |
Unknown robot (identified by '*bot') | 13928+842 | 565.51 MB | 30 Sep 2012 - 23:57 |
Unknown robot (identified by empty user agent string) | 4947+104 | 182.86 MB | 30 Sep 2012 - 23:54 |
WebFilter | 4708 | 217.88 MB | 30 Sep 2012 - 23:52 |
CFNetwork | 2116 | 78.82 MB | 30 Sep 2012 - 23:46 |
MSNBot-media | 4380+2568 | 100.73 MB | 30 Sep 2012 - 23:44 |
MJ12bot | 8577+1531 | 409.06 MB | 30 Sep 2012 - 23:42 |
Jakarta commons-httpclient | 267 | 15.02 MB | 30 Sep 2012 - 23:37 |
Java (Often spam bot) | 4957+84 | 117.07 MB | 30 Sep 2012 - 23:36 |
Unknown robot (identified by 'robot') | 13337+606 | 896.26 MB | 30 Sep 2012 - 22:58 |
BSpider | 1170 | 41.49 MB | 30 Sep 2012 - 22:45 |
MagpieRSS | 60854+41 | 2.81 GB | 30 Sep 2012 - 22:41 |
MSNBot | 10596+43 | 472.12 MB | 30 Sep 2012 - 22:25 |
OutfoxBot/YodaoBot | 131 | 3.97 MB | 30 Sep 2012 - 21:49 |
Custo | 147 | 3.39 MB | 30 Sep 2012 - 21:47 |
Yahoo Slurp | 1232+57 | 23.68 MB | 30 Sep 2012 - 21:19 |
Unknown robot (identified by 'spider') | 2470+41 | 102.78 MB | 30 Sep 2012 - 21:09 |
Motor | 383 | 9.94 MB | 30 Sep 2012 - 20:24 |
Unknown robot (identified by 'crawl') | 745+82 | 31.59 MB | 30 Sep 2012 - 19:53 |
Unknown robot (identified by hit on 'robots.txt') | 0+491 | 142.41 KB | 30 Sep 2012 - 19:30 |
DoCoMo | 139+30 | 8.67 MB | 30 Sep 2012 - 19:20 |
yacy | 1+1 | 31.42 KB | 30 Sep 2012 - 17:19 |
SurveyBot | 9+3 | 280.61 KB | 30 Sep 2012 - 17:14 |
Sogou Spider | 1339+1 | 61.39 MB | 30 Sep 2012 - 17:05 |
Exabot | 61+32 | 2.53 MB | 30 Sep 2012 - 16:05 |
Python-urllib | 445+3 | 20.11 MB | 30 Sep 2012 - 15:32 |
Nutch | 91+36 | 4.11 MB | 30 Sep 2012 - 15:18 |
W3C Validator | 2160 | 87.03 MB | 30 Sep 2012 - 08:34 |
Findlinks | 1+5 | 32.58 KB | 30 Sep 2012 - 06:12 |
Alexa (IA Archiver) | 238+107 | 11.72 MB | 30 Sep 2012 - 05:45 |
LinkChecker | 0+17 | 4.93 KB | 30 Sep 2012 - 05:26 |
SeznamBot | 792+24 | 41.11 MB | 30 Sep 2012 - 04:49 |
Phantom | 308 | 4.98 MB | 30 Sep 2012 - 00:55 |
WebCollage | 2 | 50.12 KB | 29 Sep 2012 - 21:21 |
Powermarks | 10 | 303.91 KB | 29 Sep 2012 - 18:44 |
Mail.ru bot | 83+9 | 7.61 MB | 29 Sep 2012 - 12:23 |
lmspider | 1+1 | 43.61 KB | 29 Sep 2012 - 07:23 |
psbot | 24+18 | 659.33 KB | 29 Sep 2012 - 06:19 |
StackRambler | 2 | 94.98 KB | 28 Sep 2012 - 10:35 |
Feedfetcher-Google | 51 | 1.28 MB | 28 Sep 2012 - 01:28 |
WordPress | 243 | 10.89 MB | 27 Sep 2012 - 08:36 |
LinkScan | 10 | 341.58 KB | 26 Sep 2012 - 20:53 |
VSE | 23+2 | 365.19 KB | 24 Sep 2012 - 18:34 |
WallPaper (alias crawlpaper) | 8 | 174.68 KB | 24 Sep 2012 - 07:09 |
SuperBot | 19 | 99.91 KB | 22 Sep 2012 - 16:37 |
larbin | 29+6 | 946.01 KB | 21 Sep 2012 - 14:18 |
Vagabondo | 1 | 46.63 KB | 20 Sep 2012 - 20:39 |
bender focused_crawler | 0+5 | 1.45 KB | 20 Sep 2012 - 18:48 |
archive.org bot | 26+7 | 2.17 MB | 20 Sep 2012 - 03:05 |
arks | 1 | 0 | 19 Sep 2012 - 02:41 |
Fish search | 2 | 19.89 KB | 18 Sep 2012 - 16:34 |
BecomeBot | 1 | 40.92 KB | 18 Sep 2012 - 07:21 |
ichiro | 4529+6 | 200.73 MB | 18 Sep 2012 - 02:43 |
Harvest | 251+2 | 28.83 MB | 15 Sep 2012 - 05:40 |
Web Core / Roots | 26 | 438.57 KB | 14 Sep 2012 - 21:34 |
VORTEX | 45 | 741.18 KB | 14 Sep 2012 - 06:39 |
BBot | 6 | 317.67 KB | 14 Sep 2012 - 01:40 |
HTTrack off-line browser | 2 | 44.58 KB | 11 Sep 2012 - 21:49 |
Y!J Yahoo Japan | 3 | 0 | 11 Sep 2012 - 08:31 |
MSIECrawler | 1 | 62.32 KB | 10 Sep 2012 - 14:10 |
Netcraft | 4 | 94.40 KB | 09 Sep 2012 - 04:06 |
Netluchs | 1+1 | 30.72 KB | 05 Sep 2012 - 04:07 |
legs | 65+12 | 4.21 MB | 04 Sep 2012 - 08:59 |
HTMLParser | 8 | 463.01 KB | 02 Sep 2012 - 07:54 |