Objective. This study introduces the rubrics of Native Hawaiian values developed to measure youth knowledge and understanding of indigenous values along with 8 other tools to evaluate Hui Mālama o ke Kai (HMK), a culturally relevant, positive youth development, after-school program in a Native Hawaiian community. Findings from our efforts to validate the rubrics tool, as an evaluation measure, using triangulation are presented. Methods. Evaluation tools were modified through community input and measured youth risk and protective factors, including knowledge and practice of Hawaiian values. Validity and reliability of the tools were tested by analyzing internal consistency, intraclass correlations, and triangulating data sources. Results. Corroboration of results from the different data sources indicated convergent validity of measures to evaluate youth understanding and practice of Hawaiian values. Conclusions. This community-focused approach to evaluation demonstrates how multiple evaluation instruments may reliably evaluate a program.
Hawaii State Department of Health. Hawaii State Department of Business, Economic Development, and Tourism, The State of Hawaii Data Book, A Statistical Abstract. Honolulu: Hawaii Health Surveillance Program; 2005.
3.
MacDonaldJM. The effect of ethnicity on juvenile court decision making in Hawaii. Youth Soc. 2003;35:243-263.
4.
PearsonRS. The 2003 Hawaii Student Alcohol, Tobacco, and Other Drug Use Study (1987-2003). Honolulu: Hawaii Department of Health; 2003.
5.
KeanyM. Grading the public schools: The 2010 grades. Honolulu Mag. 2010; 44(11):38-50.
AkeoNPBunyanESBurgessKN. Hui Malama o ke Kai: mobilizing to prevent youth violence and substance use with passion, common goals, and culture. Am J Prev Med. 2008;34(3 suppl):S67-S71.
8.
DemaioA. Local wisdom and health promotion: barrier or catalyst?Asia Pac J Public Health. 2011;23:127-132.
9.
StradaMJDonohueB. Substance use in ethnic minority youth. J Ethn Subst Abuse. 2006;5:67-89.
10.
JohnstonLDO’MalleyPMBachmanJGSchulenbergJE. Monitoring the Future: National Survey Results on Drug Use, 1975-2004. Rockville, MD: National Institute on Drug Abuse; 2005.
11.
FinauS. Communicating health risks in the Pacific: scientific construct and cultural reality. Asia Pac J Public Health. 2000;12:90-97.
12.
DurlakJAWeissbergRP. The Impact of After-School Programs That Promote Personal and Social Skills. Chicago, IL: Collaborative for Academic, Social, and Emotional Learning; 2007.
13.
MetzRAGoldsmithJArbretonAJA. Putting It All Together: Guiding Principles for Quality After School Programs Serving Preteens. New York, NY: Public/Private Ventures; 2008.
14.
LarsonR. Positive youth development, willful adolescents, and mentoring. J Community Psychol. 2006;34:677-689.
15.
HishinumaEChangJSyA. Hui Malama o ke Kai: a positive prevention-based youth development program based on Native Hawaiian values and activities. J Community Psychol. 2009;37:987-1007.
16.
FlayBRGraumlichSSegawaEBurnsJLHollidayMY; Aban Aya Investigators. Effects of 2 prevention programs on high-risk behaviors among African American youth. Arch Pediatr Adolesc Med. 2004;158:377-384.
17.
CarltonBSGoebertDAMiyamotoRH. Resilience, family adversity, and well-being among Hawaiian and non-Hawaiian adolescents. Int J Soc Psychiatry. 2006;52:291-308.
18.
KleinJDSabaratnamPAuerbachMM. Development and factor structure of a brief instrument to assess the impact of community programs on positive youth development: The Rochester Evaluation of Asset Development for Youth (READY) Tool. J Adolesc Health. 2006;39:252-260.
19.
GlaserRRHornMLVArthurMWHawkinsJDCatalanoRF. Measurement properties of the communities that care youth survey across demographic groups. J Quant Criminol. 2005;21:73-102.
20.
RezentesWC. Na Mea Hawai’i: a Hawaiian acculturation scale. Psychol Rep. 1993;73:383-393.
21.
IsraelBA. Commentary: model of community health governance: applicability to community-based participatory research partnerships. J Urban Health. 2003;80:50-53.
22.
TervalonMMurray-GarciaJ. Cultural humility versus cultural competence: a critical distinction in defining physician training outcomes in multicultural education. J Health Care Poor Underserved. 1998;9:117-125.
23.
MinklerMWallersteinN. Introduction to community based participatory research. In: MinklerMWallersteinN eds. Community Based Participatory Research for Health. San Francisco, CA: Jossey-Bass; 2003.
24.
Centers for Disease Control and Prevention (CDC). Framework for program evaluation in public health. MMWR Morb Mortal Wkly Rep. 48;1999:1-40.
25.
ChatterjiM. Evidence on “What works”: an argument for Extended-Term Mixed Methods (ETMM) evaluation designs. Educ Researcher. 2004;33(9):3-13.
26.
CreswellJW. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches: Thousand Oaks, CA: Sage; 2009.
