100 different robots | Hits | Bandwidth | Last visit |
Nutch | 1315+5 | 16.03 MB | 30 Apr 2013 - 23:59 |
Googlebot | 76729+16 | 1.63 GB | 30 Apr 2013 - 23:59 |
legs | 603 | 7.88 MB | 30 Apr 2013 - 23:59 |
Unknown robot (identified by 'bot*') | 73394+1000 | 1.19 GB | 30 Apr 2013 - 23:59 |
BaiDuSpider | 8807 | 195.59 MB | 30 Apr 2013 - 23:59 |
Java (Often spam bot) | 8772 | 109.31 MB | 30 Apr 2013 - 23:59 |
Nagios | 14339 | 162.91 MB | 30 Apr 2013 - 23:58 |
Yandex bot | 274871+2 | 5.63 GB | 30 Apr 2013 - 23:58 |
Unknown robot (identified by empty user agent string) | 7041+3 | 113.98 MB | 30 Apr 2013 - 23:57 |
Feedfetcher-Google | 6492 | 106.72 MB | 30 Apr 2013 - 23:55 |
CFNetwork | 2719 | 39.45 MB | 30 Apr 2013 - 23:52 |
Motor | 189 | 3.89 MB | 30 Apr 2013 - 23:51 |
MJ12bot | 3574+3 | 53.19 MB | 30 Apr 2013 - 23:50 |
Voila | 87 | 1.47 MB | 30 Apr 2013 - 23:50 |
Feedburner | 785 | 13.72 MB | 30 Apr 2013 - 23:47 |
WebFilter | 2445 | 29.16 MB | 30 Apr 2013 - 23:46 |
MSNBot-media | 3282+25 | 52.48 MB | 30 Apr 2013 - 23:45 |
Unknown robot (identified by 'spider') | 13521+19 | 207.86 MB | 30 Apr 2013 - 23:44 |
Unknown robot (identified by 'robot') | 8621+17 | 143.06 MB | 30 Apr 2013 - 23:44 |
Yahoo Slurp | 1494+2 | 21.43 MB | 30 Apr 2013 - 23:39 |
Unknown robot (identified by '*bot') | 742917+1 | 8.44 GB | 30 Apr 2013 - 23:33 |
WWWC Ver 0.2.5 | 534 | 5.38 MB | 30 Apr 2013 - 23:04 |
MagpieRSS | 665 | 9.81 MB | 30 Apr 2013 - 22:59 |
NG 1.x (Exalead) | 1664 | 35.42 MB | 30 Apr 2013 - 22:56 |
BSpider | 619 | 12.14 MB | 30 Apr 2013 - 22:47 |
Unknown robot (identified by 'crawl') | 5776+148 | 92.39 MB | 30 Apr 2013 - 22:44 |
Powermarks | 143 | 1.66 MB | 30 Apr 2013 - 22:43 |
Sogou Spider | 603 | 12.07 MB | 30 Apr 2013 - 22:30 |
MSNBot | 2844+1 | 45.64 MB | 30 Apr 2013 - 22:12 |
WordPress | 1527 | 22.97 MB | 30 Apr 2013 - 21:59 |
Jakarta commons-httpclient | 445 | 5.16 MB | 30 Apr 2013 - 21:11 |
Python-urllib | 22964 | 467.37 MB | 30 Apr 2013 - 21:04 |
UniversalFeedParser | 195 | 4.01 MB | 30 Apr 2013 - 20:51 |
Mail.ru bot | 4830 | 42.84 MB | 30 Apr 2013 - 20:28 |
Exabot | 538 | 8.26 MB | 30 Apr 2013 - 19:36 |
VORTEX | 2 | 25.37 KB | 30 Apr 2013 - 17:59 |
Phantom | 53 | 1.15 MB | 30 Apr 2013 - 17:14 |
Web Core / Roots | 81 | 1.19 MB | 30 Apr 2013 - 15:43 |
W3C Validator | 198 | 2.89 MB | 30 Apr 2013 - 14:28 |
Sven | 1 | 12.14 KB | 30 Apr 2013 - 14:13 |
Unknown robot (identified by hit on 'robots.txt') | 0+95 | 4.45 KB | 30 Apr 2013 - 13:18 |
HTTrack off-line browser | 43375 | 903.64 MB | 30 Apr 2013 - 12:52 |
yacy | 80+1 | 1.19 MB | 30 Apr 2013 - 11:56 |
LinkScan | 38 | 461.27 KB | 30 Apr 2013 - 09:24 |
SurveyBot | 3 | 34.76 KB | 30 Apr 2013 - 09:07 |
archive.org bot | 1502 | 21.29 MB | 30 Apr 2013 - 08:43 |
DoCoMo | 581 | 10.49 MB | 30 Apr 2013 - 08:39 |
Alexa (IA Archiver) | 86 | 1.20 MB | 30 Apr 2013 - 08:12 |
Y!J Yahoo Japan | 72+21 | 1.13 MB | 30 Apr 2013 - 07:39 |
NG 2.x (Exalead) | 70 | 1.32 MB | 30 Apr 2013 - 07:07 |
SuperBot | 2 | 27.98 KB | 30 Apr 2013 - 04:33 |
Heritrix | 54 | 619.96 KB | 30 Apr 2013 - 02:26 |
ABCdatos BotLink | 60 | 1.36 MB | 30 Apr 2013 - 01:59 |
Google AdSense | 39 | 584.02 KB | 29 Apr 2013 - 22:25 |
Vagabondo | 7 | 115.44 KB | 29 Apr 2013 - 22:16 |
LinkChecker | 78 | 932.04 KB | 29 Apr 2013 - 15:44 |
StackRambler | 70 | 1.00 MB | 29 Apr 2013 - 12:54 |
Muncher | 2 | 23.94 KB | 29 Apr 2013 - 12:11 |
SeznamBot | 1719 | 32.58 MB | 29 Apr 2013 - 10:04 |
VSE | 31 | 476.90 KB | 29 Apr 2013 - 06:22 |
ichiro | 2626 | 60.12 MB | 29 Apr 2013 - 05:35 |
LiveJournal.com | 23 | 484.42 KB | 29 Apr 2013 - 05:03 |
W3C Link Checker | 26 | 308.10 KB | 28 Apr 2013 - 01:05 |
lwp-trivial | 7 | 83.63 KB | 27 Apr 2013 - 20:38 |
Custo | 9 | 114.32 KB | 27 Apr 2013 - 16:34 |
MSIECrawler | 6 | 69.49 KB | 27 Apr 2013 - 12:10 |
YahooSeeker-Testing | 3 | 35.75 KB | 26 Apr 2013 - 19:08 |
Checkbot | 3 | 35.72 KB | 26 Apr 2013 - 07:24 |
Findlinks | 8+1 | 108.79 KB | 25 Apr 2013 - 21:42 |
Aport | 5 | 69.00 KB | 25 Apr 2013 - 21:35 |
Emacs-w3 Search Engine | 2 | 28.76 KB | 25 Apr 2013 - 07:35 |
Fish search | 4 | 47.88 KB | 25 Apr 2013 - 03:55 |
Monster | 4 | 50.32 KB | 24 Apr 2013 - 23:08 |
LinkBot | 4 | 46.57 KB | 24 Apr 2013 - 14:56 |
JBot Java Web Robot | 3 | 35.41 KB | 24 Apr 2013 - 01:34 |
larbin | 197 | 3.33 MB | 23 Apr 2013 - 19:10 |
Ask | 21 | 208.23 KB | 23 Apr 2013 - 06:14 |
NewsGator Online | 6 | 126.37 KB | 22 Apr 2013 - 19:49 |
Dumbot | 2 | 22.96 KB | 22 Apr 2013 - 14:08 |
Raven Search | 11 | 168.79 KB | 22 Apr 2013 - 07:20 |
FeedValidator | 8 | 108.57 KB | 20 Apr 2013 - 19:09 |
MojeekBot | 1 | 13.25 KB | 19 Apr 2013 - 00:58 |
ArchitextSpider | 1 | 11.80 KB | 18 Apr 2013 - 18:24 |
OutfoxBot/YodaoBot | 36 | 413.91 KB | 18 Apr 2013 - 02:37 |
Voyager | 43 | 518.81 KB | 16 Apr 2013 - 18:36 |
the World Wide Web Wanderer | 54 | 774.13 KB | 16 Apr 2013 - 02:07 |
HamBot | 35+3 | 460.34 KB | 15 Apr 2013 - 04:03 |
Kevin | 3 | 197.38 KB | 14 Apr 2013 - 10:02 |
Boris | 4 | 48.22 KB | 13 Apr 2013 - 19:54 |
Combine System | 3 | 48.94 KB | 13 Apr 2013 - 13:12 |
Bookmark-Manager | 1 | 11.80 KB | 12 Apr 2013 - 19:23 |
lwp-request | 1 | 11.80 KB | 12 Apr 2013 - 13:15 |
Girafabot | 2 | 21.80 KB | 12 Apr 2013 - 08:47 |
Sunrise | 2 | 24.79 KB | 12 Apr 2013 - 08:47 |
FavOrg | 1 | 11.80 KB | 12 Apr 2013 - 08:14 |
Netcraft | 5 | 48.84 KB | 10 Apr 2013 - 15:25 |
ComputingSite Robi/1.0 | 2 | 22.31 KB | 05 Apr 2013 - 03:24 |
TITAN | 2 | 23.25 KB | 04 Apr 2013 - 23:38 |
TestBot | 2 | 27.28 KB | 02 Apr 2013 - 23:23 |
ExactSeek Crawler | 1 | 11.16 KB | 02 Apr 2013 - 20:20 |