96 different robots | Hits | Bandwidth | Last visit |
Yahoo Slurp | 138837 | 385.33 MB | 31 Aug 2009 - 23:59 |
MSNBot | 72440+2373 | 614.01 MB | 31 Aug 2009 - 23:59 |
Nagios | 43678 | 434.18 MB | 31 Aug 2009 - 23:59 |
Googlebot | 28358+35 | 311.19 MB | 31 Aug 2009 - 23:59 |
Unknown robot (identified by 'robot') | 22686+22 | 106.76 MB | 31 Aug 2009 - 23:58 |
Yandex bot | 20153 | 92.85 MB | 31 Aug 2009 - 23:57 |
HTTrack off-line browser | 10249 | 210.46 MB | 31 Aug 2009 - 21:58 |
Unknown robot (identified by 'crawl') | 5324+6 | 116.10 MB | 31 Aug 2009 - 23:40 |
Unknown robot (identified by empty user agent string) | 4922+23 | 48.43 MB | 31 Aug 2009 - 23:59 |
Exabot | 3985 | 7.98 MB | 31 Aug 2009 - 23:57 |
Heritrix | 3349 | 51.07 MB | 31 Aug 2009 - 18:24 |
Unknown robot (identified by 'spider') | 3237+1 | 46.40 MB | 31 Aug 2009 - 23:47 |
Speedy Spider | 3047 | 19.71 MB | 31 Aug 2009 - 23:56 |
Unknown robot (identified by '*bot') | 2989+2 | 32.15 MB | 30 Aug 2009 - 05:15 |
\wbot[\/\-] | 2795+41 | 38.58 MB | 21 Aug 2009 - 17:02 |
BaiDuSpider | 2511 | 32.57 MB | 31 Aug 2009 - 23:31 |
BSpider | 1757 | 9.30 MB | 31 Aug 2009 - 23:59 |
Mail.ru bot | 1552 | 10.76 MB | 31 Aug 2009 - 23:22 |
twiceler | 1443 | 10.88 MB | 31 Aug 2009 - 23:56 |
Voila | 1350 | 13.43 MB | 31 Aug 2009 - 23:47 |
WWWC Ver 0.2.5 | 1082 | 13.34 MB | 31 Aug 2009 - 23:45 |
Feedfetcher-Google | 995 | 1.66 MB | 31 Aug 2009 - 23:31 |
Python-urllib | 900 | 9.20 MB | 31 Aug 2009 - 23:00 |
Java (Often spam bot) | 611 | 7.22 MB | 31 Aug 2009 - 22:16 |
Unknown robot (identified by 'bot*') | 508+50 | 6.48 MB | 31 Aug 2009 - 23:23 |
SeznamBot | 515 | 5.74 MB | 31 Aug 2009 - 22:01 |
WordPress | 461 | 3.05 MB | 31 Aug 2009 - 22:08 |
Ask | 435 | 11.55 MB | 31 Aug 2009 - 23:03 |
Alexa (IA Archiver) | 359 | 6.86 MB | 31 Aug 2009 - 20:54 |
Yahoo Feed Seeker | 296+41 | 7.50 MB | 31 Aug 2009 - 23:26 |
Voyager | 322 | 3.22 MB | 19 Aug 2009 - 19:43 |
legs | 302 | 3.58 MB | 31 Aug 2009 - 22:10 |
Unknown robot (identified by hit on 'robots.txt') | 0+247 | 11.34 KB | 31 Aug 2009 - 11:58 |
arks | 225 | 1.28 MB | 31 Aug 2009 - 23:57 |
DoCoMo | 214+2 | 2.44 MB | 31 Aug 2009 - 13:57 |
Yahoo-MMCrawler | 146 | 10.96 MB | 31 Aug 2009 - 19:52 |
Turn It In | 144 | 852.41 KB | 08 Aug 2009 - 10:56 |
larbin | 135 | 1.65 MB | 31 Aug 2009 - 13:45 |
Nutch | 107 | 2.13 MB | 31 Aug 2009 - 22:16 |
Powermarks | 83 | 516.15 KB | 31 Aug 2009 - 19:37 |
psbot | 77 | 622.72 KB | 31 Aug 2009 - 02:09 |
echo | 73 | 846.61 KB | 21 Aug 2009 - 02:01 |
StackRambler | 69 | 994.81 KB | 30 Aug 2009 - 14:15 |
OutfoxBot/YodaoBot | 67 | 743.98 KB | 31 Aug 2009 - 20:15 |
ABCdatos BotLink | 66 | 1.49 MB | 31 Aug 2009 - 02:11 |
Fish search | 60 | 1.11 MB | 31 Aug 2009 - 14:06 |
Custo | 39+20 | 578.18 KB | 31 Aug 2009 - 21:26 |
MJ12bot | 56 | 573.84 KB | 31 Aug 2009 - 16:38 |
Grub.org | 50 | 463.36 KB | 31 Aug 2009 - 18:34 |
yacy | 48 | 553.12 KB | 31 Aug 2009 - 23:46 |
LinkChecker | 47 | 234.38 KB | 30 Aug 2009 - 10:01 |
Sogou Spider | 41 | 2.19 MB | 31 Aug 2009 - 17:43 |
W3C Validator | 39 | 825.31 KB | 31 Aug 2009 - 06:22 |
CFNetwork | 38 | 589.53 KB | 31 Aug 2009 - 19:49 |
Jakarta commons-httpclient | 32 | 267.06 KB | 31 Aug 2009 - 05:43 |
WebWatch | 29 | 295.21 KB | 31 Aug 2009 - 17:25 |
MSIECrawler | 26 | 547.51 KB | 30 Aug 2009 - 18:46 |
NewsGator Online | 23 | 1.17 KB | 29 Aug 2009 - 05:34 |
SuperBot | 22 | 263.94 KB | 25 Aug 2009 - 17:50 |
lwp-trivial | 20 | 263.43 KB | 31 Aug 2009 - 10:20 |
Patric | 18 | 87.74 KB | 30 Aug 2009 - 20:30 |
Holmes | 18 | 226.28 KB | 26 Aug 2009 - 17:21 |
VSE | 18 | 210.49 KB | 31 Aug 2009 - 10:14 |
BBot | 17 | 369.42 KB | 22 Aug 2009 - 01:54 |
Feedburner | 15 | 0 | 28 Aug 2009 - 01:14 |
Netcraft | 14 | 19.84 KB | 27 Aug 2009 - 21:50 |
LinkScan | 14 | 109.08 KB | 30 Aug 2009 - 15:51 |
Checkbot | 11 | 0 | 30 Aug 2009 - 21:13 |
Google AdSense | 10 | 147.25 KB | 28 Aug 2009 - 09:31 |
MojeekBot | 10 | 110.64 KB | 29 Aug 2009 - 19:10 |
SurveyBot | 4+4 | 40.85 KB | 27 Aug 2009 - 19:19 |
Spiderman | 8 | 115.07 KB | 31 Aug 2009 - 02:02 |
GigaBot | 8 | 81.33 KB | 30 Aug 2009 - 12:48 |
W3C Link Checker | 8 | 0 | 31 Aug 2009 - 08:48 |
ComputingSite Robi/1.0 | 6 | 71.80 KB | 22 Aug 2009 - 09:54 |
Sunrise | 4 | 48.09 KB | 29 Aug 2009 - 13:10 |
NetSprint | 4 | 58.49 KB | 30 Aug 2009 - 08:26 |
QihooBot | 3 | 31.39 KB | 30 Aug 2009 - 18:45 |
WallPaper (alias crawlpaper) | 3 | 35.12 KB | 25 Aug 2009 - 00:21 |
Y!J Yahoo Japan | 3 | 43.87 KB | 30 Aug 2009 - 10:59 |
Susie | 2 | 21.14 KB | 31 Aug 2009 - 13:16 |
Web Core / Roots | 2 | 19.84 KB | 04 Aug 2009 - 11:59 |
Motor | 2 | 20.49 KB | 29 Aug 2009 - 06:29 |
JoBo Java Web Robot | 2 | 22.01 KB | 07 Aug 2009 - 16:57 |
FastCrawler | 2 | 36.61 KB | 16 Aug 2009 - 16:55 |
PhpDig | 2 | 10.25 KB | 15 Aug 2009 - 06:20 |
UniversalFeedParser | 2 | 0 | 27 Aug 2009 - 08:30 |
TITAN | 2 | 20.49 KB | 10 Aug 2009 - 14:52 |
mnoGoSearch search engine software | 2 | 20.17 KB | 30 Aug 2009 - 10:56 |
Perman surfer | 2 | 20.49 KB | 23 Aug 2009 - 02:59 |
SpiderBot | 1 | 9.92 KB | 04 Aug 2009 - 17:09 |
Internet Shinchakubin | 1 | 10.25 KB | 24 Aug 2009 - 18:47 |
Pioneer | 1 | 13.55 KB | 19 Aug 2009 - 03:49 |
eventax | 1 | 10.25 KB | 31 Aug 2009 - 02:07 |
Combine System | 1 | 10.25 KB | 10 Aug 2009 - 18:57 |
Ocelli | 1 | 10.25 KB | 21 Aug 2009 - 19:27 |