99 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by empty user agent string) | 1671661 | 1460.16 GB | 30 Apr 2011 - 23:59 |
Googlebot | 535553 | 8.67 GB | 30 Apr 2011 - 23:59 |
Yahoo Slurp | 219642 | 11.95 GB | 30 Apr 2011 - 23:59 |
Yandex bot | 143587 | 2.19 GB | 30 Apr 2011 - 23:59 |
Unknown robot (identified by 'bot*') | 126398 | 6.61 GB | 30 Apr 2011 - 23:59 |
MSNBot | 56498 | 580.31 MB | 30 Apr 2011 - 23:59 |
Nagios | 41308 | 888.57 MB | 30 Apr 2011 - 23:59 |
Unknown robot (identified by 'robot') | 40731 | 1.85 GB | 30 Apr 2011 - 23:57 |
Feedfetcher-Google | 26571 | 119.53 MB | 30 Apr 2011 - 23:58 |
NG 1.x (Exalead) | 22382 | 209.58 MB | 30 Apr 2011 - 23:57 |
Speedy Spider | 14761 | 105.63 MB | 30 Apr 2011 - 23:56 |
HTTrack off-line browser | 14652 | 1.41 GB | 30 Apr 2011 - 06:51 |
VSE | 14098 | 224.75 MB | 30 Apr 2011 - 22:41 |
Steeler | 9409 | 227.32 MB | 30 Apr 2011 - 23:59 |
BaiDuSpider | 8414 | 697.97 MB | 30 Apr 2011 - 23:57 |
Sogou Spider | 7687 | 30.02 MB | 30 Apr 2011 - 23:59 |
Alexa (IA Archiver) | 6646 | 399.84 MB | 30 Apr 2011 - 23:54 |
MJ12bot | 6507 | 46.42 MB | 30 Apr 2011 - 23:26 |
UniversalFeedParser | 5167 | 24.52 MB | 30 Apr 2011 - 23:50 |
CFNetwork | 4646 | 940.28 MB | 30 Apr 2011 - 23:57 |
Unknown robot (identified by 'spider') | 4360 | 76.88 MB | 30 Apr 2011 - 23:22 |
ichiro | 3719 | 104.88 MB | 29 Apr 2011 - 11:59 |
Custo | 3410 | 163.41 MB | 30 Apr 2011 - 02:52 |
BSpider | 2922 | 89.59 MB | 30 Apr 2011 - 23:52 |
Unknown robot (identified by '*bot') | 2849 | 99.43 MB | 28 Apr 2011 - 22:42 |
Voila | 2820 | 20.71 MB | 30 Apr 2011 - 23:46 |
Unknown robot (identified by 'crawl') | 2704 | 29.25 MB | 30 Apr 2011 - 22:01 |
Motor | 2054 | 8.36 MB | 29 Apr 2011 - 20:05 |
Mail.ru bot | 2020 | 511.72 MB | 29 Apr 2011 - 12:27 |
Exabot | 1602 | 8.28 MB | 30 Apr 2011 - 23:26 |
Web Core / Roots | 1540 | 115.45 MB | 30 Apr 2011 - 21:00 |
Python-urllib | 1501 | 95.74 MB | 30 Apr 2011 - 23:00 |
Ask | 1297 | 211.83 MB | 30 Apr 2011 - 07:35 |
Java (Often spam bot) | 1124 | 16.50 MB | 30 Apr 2011 - 23:37 |
WordPress | 1084 | 53.61 MB | 30 Apr 2011 - 23:44 |
MagpieRSS | 994 | 6.29 MB | 30 Apr 2011 - 23:06 |
Nutch | 909 | 39.96 MB | 30 Apr 2011 - 23:35 |
StackRambler | 840 | 4.81 MB | 30 Apr 2011 - 10:07 |
Y!J Yahoo Japan | 499 | 8.20 MB | 30 Apr 2011 - 19:33 |
Jakarta commons-httpclient | 483 | 5.88 MB | 30 Apr 2011 - 05:51 |
Boris | 483 | 18.38 MB | 29 Apr 2011 - 18:16 |
larbin | 441 | 9.47 MB | 30 Apr 2011 - 01:54 |
SeznamBot | 397 | 67.29 MB | 30 Apr 2011 - 12:46 |
MSNBot-media | 357 | 1.67 MB | 30 Apr 2011 - 23:41 |
Vagabondo | 347 | 10.29 MB | 27 Apr 2011 - 12:49 |
Yahoo Feed Seeker | 334 | 2.82 MB | 30 Apr 2011 - 23:38 |
yacy | 330 | 1.73 MB | 29 Apr 2011 - 16:10 |
legs | 325 | 2.78 MB | 26 Apr 2011 - 12:52 |
FeedValidator | 319 | 1.75 MB | 30 Apr 2011 - 13:46 |
Fish search | 292 | 8.09 MB | 30 Apr 2011 - 10:55 |
WallPaper (alias crawlpaper) | 264 | 1.74 MB | 30 Apr 2011 - 21:03 |
W3C Validator | 255 | 1.38 MB | 30 Apr 2011 - 13:46 |
NewsGator Online | 241 | 961.41 KB | 30 Apr 2011 - 23:36 |
MSIECrawler | 218 | 1.50 MB | 29 Apr 2011 - 06:39 |
Muncher | 189 | 1.29 MB | 18 Apr 2011 - 01:27 |
Google AdSense | 174 | 161.55 MB | 30 Apr 2011 - 21:32 |
The web archive (IA Archiver) | 161 | 249.79 KB | 30 Apr 2011 - 17:49 |
OutfoxBot/YodaoBot | 149 | 674.56 KB | 30 Apr 2011 - 23:14 |
WWWC Ver 0.2.5 | 141 | 5.90 MB | 30 Apr 2011 - 21:56 |
DoCoMo | 130 | 2.36 MB | 30 Apr 2011 - 06:22 |
LinkChecker | 111 | 970.99 KB | 28 Apr 2011 - 20:41 |
SuperBot | 105 | 3.61 MB | 22 Apr 2011 - 01:16 |
Internet Shinchakubin | 91 | 343.17 KB | 18 Apr 2011 - 15:48 |
Powermarks | 87 | 2.62 MB | 30 Apr 2011 - 20:12 |
arks | 74 | 284.99 KB | 30 Apr 2011 - 17:59 |
VORTEX | 50 | 199.01 KB | 30 Apr 2011 - 18:27 |
Scooter | 49 | 697.48 KB | 20 Apr 2011 - 08:05 |
GigaBot | 39 | 571.42 KB | 29 Apr 2011 - 20:26 |
Findlinks | 37 | 562.40 KB | 29 Apr 2011 - 20:57 |
HTMLParser | 35 | 590.30 KB | 26 Apr 2011 - 12:49 |
Holmes | 33 | 134.58 KB | 30 Apr 2011 - 17:08 |
Turn It In | 26 | 121.94 KB | 26 Apr 2011 - 16:45 |
Feedburner | 24 | 1.06 MB | 22 Apr 2011 - 22:12 |
YahooSeeker Yahoo! Blog crawler | 23 | 35.64 KB | 29 Apr 2011 - 10:59 |
Miva | 23 | 170.89 KB | 11 Apr 2011 - 22:41 |
archive.org bot | 19 | 354.47 KB | 30 Apr 2011 - 22:15 |
Heritrix | 13 | 154.44 KB | 26 Apr 2011 - 23:31 |
Grub.org | 12 | 193.01 KB | 20 Apr 2011 - 06:09 |
FavOrg | 11 | 346.92 KB | 27 Apr 2011 - 23:44 |
Emacs-w3 Search Engine | 11 | 65.84 KB | 21 Apr 2011 - 12:46 |
WebCollage | 10 | 87.87 KB | 18 Apr 2011 - 01:19 |
bender focused_crawler | 9 | 13.98 KB | 29 Apr 2011 - 19:18 |
Susie | 9 | 265.12 KB | 30 Apr 2011 - 13:18 |
Voyager | 8 | 398.76 KB | 12 Apr 2011 - 09:05 |
psbot | 6 | 13.81 KB | 24 Apr 2011 - 02:13 |
TailRank | 5 | 294.44 KB | 24 Apr 2011 - 02:39 |
Combine System | 5 | 17.88 KB | 27 Apr 2011 - 04:48 |
NetSprint | 4 | 11.16 KB | 18 Apr 2011 - 14:48 |
W3C Link Checker | 4 | 1006.46 KB | 27 Apr 2011 - 23:06 |
EasyDL | 3 | 68.57 KB | 30 Apr 2011 - 22:49 |
QihooBot | 2 | 43.11 KB | 10 Apr 2011 - 15:04 |
Netcraft | 2 | 25.80 KB | 28 Apr 2011 - 21:37 |
Atomz.com Search Robot | 2 | 3.11 KB | 20 Apr 2011 - 09:42 |
NutchCVS | 2 | 6.40 KB | 04 Apr 2011 - 20:53 |
Digger | 1 | 25.40 KB | 16 Apr 2011 - 23:47 |
Cuasarbot | 1 | 25.41 KB | 08 Apr 2011 - 19:52 |
Cursor | 1 | 15.35 KB | 29 Apr 2011 - 19:29 |
JoBo Java Web Robot | 1 | 0 | 09 Apr 2011 - 06:30 |
ping.blo.gs | 1 | 7.31 KB | 05 Apr 2011 - 01:10 |