103 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by empty user agent string) | 2183044 | 1891.11 GB | 31 Dec 2010 - 23:59 |
Googlebot | 684281 | 16.68 GB | 31 Dec 2010 - 23:59 |
Yahoo Slurp | 277214 | 16.93 GB | 31 Dec 2010 - 23:59 |
Yandex bot | 196261 | 1.83 GB | 31 Dec 2010 - 23:59 |
Unknown robot (identified by 'bot*') | 183513 | 7.35 GB | 31 Dec 2010 - 23:59 |
MSNBot | 142673 | 1.01 GB | 31 Dec 2010 - 23:59 |
Nagios | 88654 | 1.84 GB | 31 Dec 2010 - 23:59 |
Unknown robot (identified by 'robot') | 50810 | 1.53 GB | 31 Dec 2010 - 23:44 |
Feedfetcher-Google | 33081 | 132.48 MB | 31 Dec 2010 - 23:59 |
BaiDuSpider | 27730 | 3.72 GB | 31 Dec 2010 - 23:58 |
NG 1.x (Exalead) | 25658 | 238.88 MB | 31 Dec 2010 - 23:45 |
Unknown robot (identified by 'crawl') | 19478 | 212.02 MB | 31 Dec 2010 - 23:49 |
VSE | 13660 | 378.68 MB | 31 Dec 2010 - 22:06 |
Speedy Spider | 10917 | 57.20 MB | 31 Dec 2010 - 23:54 |
CFNetwork | 10216 | 1.80 GB | 31 Dec 2010 - 23:51 |
Alexa (IA Archiver) | 8953 | 675.02 MB | 31 Dec 2010 - 23:57 |
Nutch | 7291 | 401.81 MB | 31 Dec 2010 - 18:15 |
Custo | 6193 | 108.78 MB | 31 Dec 2010 - 23:12 |
UniversalFeedParser | 6129 | 41.20 MB | 31 Dec 2010 - 23:54 |
Voila | 4571 | 54.53 MB | 31 Dec 2010 - 23:50 |
MJ12bot | 4081 | 117.90 MB | 31 Dec 2010 - 17:13 |
DoCoMo | 3765 | 115.70 MB | 31 Dec 2010 - 23:18 |
BSpider | 3623 | 39.59 MB | 31 Dec 2010 - 23:59 |
Unknown robot (identified by 'spider') | 3232 | 92.50 MB | 31 Dec 2010 - 18:25 |
Python-urllib | 2754 | 139.28 MB | 31 Dec 2010 - 23:30 |
Exabot | 2621 | 35.32 MB | 31 Dec 2010 - 11:28 |
Ask | 2509 | 16.52 MB | 30 Dec 2010 - 20:34 |
HTTrack off-line browser | 2417 | 12.64 MB | 29 Dec 2010 - 20:34 |
ichiro | 2355 | 68.10 MB | 31 Dec 2010 - 12:52 |
Motor | 2272 | 9.86 MB | 31 Dec 2010 - 18:35 |
NewsGator Online | 2088 | 20.83 MB | 31 Dec 2010 - 23:53 |
Web Core / Roots | 1637 | 52.84 MB | 31 Dec 2010 - 14:43 |
Java (Often spam bot) | 1475 | 58.70 MB | 31 Dec 2010 - 13:01 |
MagpieRSS | 1470 | 12.13 MB | 31 Dec 2010 - 23:58 |
WordPress | 1457 | 43.81 MB | 31 Dec 2010 - 21:24 |
StackRambler | 1421 | 10.83 MB | 31 Dec 2010 - 19:24 |
FeedValidator | 902 | 7.91 MB | 27 Dec 2010 - 11:51 |
MSNBot-media | 841 | 4.78 MB | 31 Dec 2010 - 22:15 |
Bloglines | 780 | 5.61 MB | 17 Dec 2010 - 20:57 |
NutchCVS | 718 | 76.15 MB | 04 Dec 2010 - 07:48 |
yacy | 644 | 3.46 MB | 31 Dec 2010 - 16:12 |
Yahoo Feed Seeker | 622 | 6.20 MB | 31 Dec 2010 - 23:12 |
Mail.ru bot | 617 | 50.23 MB | 29 Dec 2010 - 18:58 |
W3C Validator | 615 | 5.24 MB | 30 Dec 2010 - 22:03 |
Y!J Yahoo Japan | 571 | 3.59 MB | 31 Dec 2010 - 15:44 |
Cursor | 510 | 3.66 MB | 30 Dec 2010 - 11:20 |
Fish search | 499 | 14.28 MB | 31 Dec 2010 - 14:46 |
Jakarta commons-httpclient | 490 | 6.76 MB | 31 Dec 2010 - 16:39 |
Voyager | 435 | 7.69 MB | 31 Dec 2010 - 23:46 |
The web archive (IA Archiver) | 384 | 4.89 MB | 31 Dec 2010 - 20:19 |
Sogou Spider | 362 | 2.07 MB | 31 Dec 2010 - 22:48 |
Heritrix | 330 | 3.13 MB | 29 Dec 2010 - 07:34 |
Vagabondo | 284 | 5.48 MB | 31 Dec 2010 - 13:23 |
SeznamBot | 245 | 64.71 MB | 31 Dec 2010 - 14:01 |
Muncher | 224 | 1.17 MB | 31 Dec 2010 - 18:15 |
legs | 216 | 1.58 MB | 31 Dec 2010 - 18:57 |
GigaBot | 187 | 7.55 MB | 31 Dec 2010 - 19:13 |
WWWC Ver 0.2.5 | 183 | 5.05 MB | 31 Dec 2010 - 12:18 |
larbin | 182 | 5.22 MB | 29 Dec 2010 - 10:44 |
Powermarks | 146 | 3.94 MB | 31 Dec 2010 - 20:29 |
Sunrise | 143 | 442.58 KB | 19 Dec 2010 - 19:23 |
MSIECrawler | 139 | 2.05 MB | 31 Dec 2010 - 20:26 |
TITAN | 132 | 317.77 KB | 06 Dec 2010 - 04:02 |
WallPaper (alias crawlpaper) | 113 | 663.82 KB | 28 Dec 2010 - 01:01 |
LinkChecker | 99 | 947.22 KB | 29 Dec 2010 - 03:32 |
Google AdSense | 61 | 124.71 MB | 31 Dec 2010 - 17:44 |
Unknown robot (identified by '*bot') | 49 | 690.73 KB | 30 Dec 2010 - 22:32 |
Argus | 40 | 236.10 KB | 15 Dec 2010 - 07:38 |
Wild Ferret Web Hopper #1, #2, #3 | 37 | 80.39 KB | 30 Dec 2010 - 12:47 |
Ingrid | 36 | 380.45 KB | 22 Dec 2010 - 21:29 |
The Jubii Indexing Robot | 34 | 240.09 KB | 31 Dec 2010 - 16:27 |
Holmes | 31 | 170.06 KB | 31 Dec 2010 - 00:49 |
YahooSeeker Yahoo! Blog crawler | 30 | 46.61 KB | 31 Dec 2010 - 10:14 |
psbot | 26 | 207.30 KB | 31 Dec 2010 - 09:26 |
Pioneer | 23 | 162.87 KB | 02 Dec 2010 - 18:12 |
VORTEX | 23 | 159.96 KB | 27 Dec 2010 - 06:06 |
NetSprint | 19 | 51.27 KB | 28 Dec 2010 - 19:49 |
Netcraft | 18 | 293.73 KB | 30 Dec 2010 - 23:20 |
arks | 16 | 108.58 MB | 29 Dec 2010 - 04:47 |
Findlinks | 14 | 366.01 KB | 31 Dec 2010 - 16:09 |
SuperBot | 12 | 467.67 KB | 26 Dec 2010 - 12:54 |
Feedburner | 12 | 315.94 KB | 31 Dec 2010 - 12:02 |
Monster | 6 | 115.33 KB | 06 Dec 2010 - 10:50 |
Digger | 5 | 108.07 KB | 09 Dec 2010 - 14:39 |
Atomz.com Search Robot | 5 | 7.77 KB | 29 Dec 2010 - 10:19 |
OutfoxBot/YodaoBot | 4 | 38.06 KB | 10 Dec 2010 - 03:00 |
Susie | 4 | 164.76 KB | 25 Dec 2010 - 23:43 |
QihooBot | 4 | 44.44 KB | 13 Dec 2010 - 05:05 |
ASpider (Associative Spider) | 3 | 47.08 KB | 24 Dec 2010 - 11:30 |
Combine System | 3 | 35.55 KB | 16 Dec 2010 - 05:34 |
lwp-trivial | 3 | 100.22 KB | 26 Dec 2010 - 18:02 |
UdmSearch | 2 | 19.08 KB | 23 Dec 2010 - 03:48 |
WebCollage | 2 | 14.45 KB | 31 Dec 2010 - 17:08 |
Webdup | 2 | 2.44 KB | 23 Dec 2010 - 05:24 |
Fluid Dynamics Search Engine robot | 2 | 18.76 KB | 27 Dec 2010 - 02:20 |
LinkScan | 2 | 45.70 KB | 12 Dec 2010 - 16:13 |
JBot Java Web Robot | 1 | 1.22 KB | 22 Dec 2010 - 14:26 |
FavOrg | 1 | 26.31 KB | 04 Dec 2010 - 17:54 |
Harvest | 1 | 73.77 KB | 06 Dec 2010 - 08:08 |
EasyDL | 1 | 291.55 KB | 31 Dec 2010 - 16:05 |
HTMLParser | 1 | 4.99 KB | 08 Dec 2010 - 11:24 |
Emacs-w3 Search Engine | 1 | 12.72 KB | 12 Dec 2010 - 16:55 |
Unknown robot (identified by hit on 'robots.txt') | 0+1 | 1.55 KB | 16 Dec 2010 - 03:50 |