81 different robots | Hits | Bandwidth | Last visit |
Googlebot | 588431 | 9.88 GB | 31 Jul 2011 - 00:01 |
Yahoo Slurp | 159309 | 8.96 GB | 31 Jul 2011 - 00:02 |
Unknown robot (identified by empty user agent string) | 143491 | 44.43 GB | 31 Jul 2011 - 00:02 |
Yandex bot | 104065 | 696.38 MB | 31 Jul 2011 - 00:04 |
Unknown robot (identified by 'bot*') | 81482 | 6.41 GB | 30 Jul 2011 - 23:56 |
HTTrack off-line browser | 28921 | 1.35 GB | 23 Jul 2011 - 19:15 |
Nagios | 23801 | 539.11 MB | 30 Jul 2011 - 23:57 |
Feedfetcher-Google | 18582 | 98.07 MB | 30 Jul 2011 - 23:53 |
BaiDuSpider | 17579 | 1.19 GB | 30 Jul 2011 - 23:51 |
Unknown robot (identified by 'robot') | 16570 | 606.81 MB | 31 Jul 2011 - 00:02 |
MSNBot | 14954 | 119.00 MB | 31 Jul 2011 - 00:03 |
Sogou Spider | 10492 | 38.31 MB | 30 Jul 2011 - 17:23 |
NG 1.x (Exalead) | 7992 | 243.56 MB | 31 Jul 2011 - 00:01 |
Speedy Spider | 6783 | 34.97 MB | 30 Jul 2011 - 23:10 |
MJ12bot | 6139 | 78.58 MB | 30 Jul 2011 - 23:21 |
Unknown robot (identified by '*bot') | 5128 | 67.59 MB | 31 Jul 2011 - 00:03 |
VSE | 5113 | 55.64 MB | 28 Jul 2011 - 16:32 |
Alexa (IA Archiver) | 4295 | 199.89 MB | 30 Jul 2011 - 22:07 |
UniversalFeedParser | 2728 | 10.21 MB | 30 Jul 2011 - 23:50 |
BSpider | 2179 | 99.34 MB | 30 Jul 2011 - 23:47 |
Voila | 2077 | 77.89 MB | 30 Jul 2011 - 22:39 |
CFNetwork | 2067 | 677.45 MB | 30 Jul 2011 - 23:40 |
Custo | 1831 | 614.90 MB | 28 Jul 2011 - 04:39 |
Unknown robot (identified by 'crawl') | 1748 | 10.61 MB | 30 Jul 2011 - 22:16 |
DoCoMo | 1695 | 68.10 MB | 30 Jul 2011 - 21:40 |
psbot | 1478 | 6.82 MB | 30 Jul 2011 - 20:58 |
Unknown robot (identified by 'spider') | 1270 | 12.85 MB | 30 Jul 2011 - 23:24 |
Exabot | 1093 | 9.92 MB | 30 Jul 2011 - 23:27 |
Java (Often spam bot) | 743 | 12.82 MB | 30 Jul 2011 - 23:33 |
Motor | 646 | 18.87 MB | 29 Jul 2011 - 01:46 |
Ask | 629 | 4.88 MB | 28 Jul 2011 - 02:58 |
Python-urllib | 615 | 61.34 MB | 30 Jul 2011 - 23:00 |
MagpieRSS | 577 | 2.84 MB | 31 Jul 2011 - 00:02 |
Nutch | 573 | 32.85 MB | 30 Jul 2011 - 23:56 |
WordPress | 502 | 18.20 MB | 30 Jul 2011 - 23:13 |
Web Core / Roots | 429 | 10.89 MB | 30 Jul 2011 - 19:50 |
legs | 314 | 2.54 MB | 30 Jul 2011 - 21:51 |
yacy | 241 | 1.12 MB | 27 Jul 2011 - 15:51 |
Y!J Yahoo Japan | 233 | 4.92 MB | 30 Jul 2011 - 22:02 |
Yahoo Feed Seeker | 232 | 2.30 MB | 21 Jul 2011 - 07:07 |
Vagabondo | 169 | 4.25 MB | 27 Jul 2011 - 01:41 |
Jakarta commons-httpclient | 156 | 1.99 MB | 29 Jul 2011 - 02:31 |
archive.org bot | 147 | 3.18 MB | 28 Jul 2011 - 19:39 |
Heritrix | 125 | 834.55 KB | 29 Jul 2011 - 00:50 |
LinkChecker | 118 | 700.65 KB | 28 Jul 2011 - 02:08 |
Google AdSense | 117 | 169.18 MB | 28 Jul 2011 - 20:57 |
MSNBot-media | 116 | 457.35 KB | 29 Jul 2011 - 00:16 |
OutfoxBot/YodaoBot | 108 | 501.62 KB | 30 Jul 2011 - 22:51 |
SeznamBot | 102 | 674.31 KB | 28 Jul 2011 - 13:38 |
larbin | 95 | 2.14 MB | 25 Jul 2011 - 11:40 |
WWWC Ver 0.2.5 | 85 | 3.63 MB | 30 Jul 2011 - 21:54 |
W3C Validator | 83 | 486.73 KB | 28 Jul 2011 - 02:10 |
Fish search | 68 | 1.93 MB | 28 Jul 2011 - 12:24 |
Cursor | 65 | 402.39 KB | 01 Jul 2011 - 07:43 |
NewsGator Online | 58 | 244.01 KB | 28 Jul 2011 - 06:28 |
ichiro | 54 | 1.97 MB | 28 Jul 2011 - 04:43 |
WallPaper (alias crawlpaper) | 54 | 244.22 KB | 23 Jul 2011 - 05:48 |
Powermarks | 46 | 1.34 MB | 30 Jul 2011 - 22:33 |
MSIECrawler | 44 | 85.84 KB | 30 Jul 2011 - 19:23 |
Internet Shinchakubin | 34 | 1.78 MB | 02 Jul 2011 - 22:39 |
GigaBot | 33 | 2.35 MB | 28 Jul 2011 - 14:25 |
VORTEX | 24 | 175.74 KB | 17 Jul 2011 - 23:19 |
FeedValidator | 22 | 101.32 KB | 24 Jul 2011 - 14:48 |
Findlinks | 19 | 239.03 KB | 25 Jul 2011 - 23:22 |
Harvest | 18 | 197.00 KB | 27 Jul 2011 - 01:00 |
NetSprint | 14 | 33.72 KB | 28 Jul 2011 - 05:24 |
Holmes | 13 | 106.38 KB | 30 Jul 2011 - 18:32 |
Netcraft | 12 | 263.43 KB | 29 Jul 2011 - 01:11 |
arks | 10 | 69.85 KB | 30 Jul 2011 - 16:37 |
bender focused_crawler | 8 | 14.26 KB | 30 Jul 2011 - 18:43 |
QihooBot | 6 | 40.68 KB | 28 Jul 2011 - 18:50 |
FavOrg | 3 | 75.76 KB | 25 Jul 2011 - 01:09 |
Feedburner | 3 | 77.54 KB | 22 Jul 2011 - 16:26 |
W3C Link Checker | 3 | 6.38 KB | 26 Jul 2011 - 14:00 |
Voyager | 3 | 168.28 KB | 26 Jul 2011 - 12:52 |
The web archive (IA Archiver) | 1 | 1.55 KB | 05 Jul 2011 - 21:28 |
Atomz.com Search Robot | 1 | 1.55 KB | 12 Jul 2011 - 07:10 |
Sunrise | 1 | 15.95 KB | 25 Jul 2011 - 10:47 |
marvin/infoseek | 1 | 1.22 KB | 13 Jul 2011 - 07:58 |
LinkScan | 1 | 41.03 KB | 14 Jul 2011 - 23:01 |
Perman surfer | 0+1 | 1.55 KB | 24 Jul 2011 - 02:35 |