Community Prevention Coalition Context and Capacity Assessment

Abstract

Effective planning for community health partnerships requires understanding how initial readiness—that is, contextual factors and capacity—influences implementation of activities and programs. This study compares the context and capacity of drug and violence prevention coalitions in Mexico to those in the United States. Measures of coalition context include community problems, community leadership style, and sense of community. Measures of coalition capacity include the existence of collaborative partnerships and coalition champions. The assessment was completed by 195 members of 9 coalitions in Mexico and 139 members of 7 coalitions in the United States. Psychometric analyses indicate the measures have moderate to strong internal consistency, along with good convergent and discriminant validity in both settings. Results indicate that members of Mexican coalitions perceive substantially more serious community problems, especially with respect to education, law enforcement, and access to alcohol and drugs. Compared to respondents in the United States, Mexican respondents perceive sense of community to be weaker and that prevention efforts are not as valued by the population where the coalitions are located. The Mexican coalitions appear to be operating in a substantially more challenging environment for the prevention of violence and substance use. Their ability to manage these challenges will likely play a large role in determining whether they are successful in their prevention efforts. The context and capacity assessment is a valuable tool that coalitions can use in order to identify and address initial barriers to success.

Keywords

capacity coalitions community context measurement development partnerships

Multiple community partnership models for health promotion have been shown to influence health outcomes (Butterfoss, 2007; Hawkins et al., 2012; Spoth et al., 2013). However, implementation of such models must be sensitive to context to succeed (Chang et al., 2013; El Arifeen et al., 2013). More specifically, contextual factors and initial coalition capacity can have a powerful influence on coalition ability to support the implementation of prevention programs and policies (L. D. Brown, Feinberg, & Greenberg, 2010; L. D. Brown, Feinberg, Shapiro, & Greenberg, 2015). Yet we know relatively little about how community and coalition characteristics vary across contexts and thus how partnerships may need to adapt their approach to be successful (Chang et al., 2013).

This study seeks to enhance understanding of the role of community context and initial coalition capacity in shaping coalition success through two primary aims: (1) to describe the psychometric properties of an assessment of coalition context and capacity administered in both English and Spanish and (2) to use this assessment instrument to examine how the context and initial capacity of prevention coalitions in Mexico compare to those in the United States. The measures provide the infrastructure necessary for future research examining how context and capacity influence the course of implementation and the attainment of health outcomes. Context and capacity assessments can inform adaptations to the implementation process that respond to environmental demands. Furthermore, identifying international context and capacity differences is an important first step in understanding how coalition models developed in the United States need to be adapted to be successful in Mexico.

Theoretical Model of Coalition Functioning

Figure 1 outlines the theoretical model of coalition functioning guiding this study, which has emerged from and in turn guided several previous studies (e.g., L. D. Brown, Feinberg, & Greenberg, 2012; L. D. Brown, Redelfs, Taylor, & Messer, 2015; Feinberg, Greenberg, & Osgood, 2004; Greenberg, Feinberg, Gomez, & Osgood, 2005). In the model, coalition capacities are one facet of coalition functioning, which affect health outcomes through their influence on coalition ability to implement programs and policies (L. D. Brown et al., 2010; Spoth, Guyll, Lillehoj, Redmond, & Greenberg, 2007). Community contextual factors are a separate component of the model hypothesized to influence all components of the causal chain from coalition functioning to health outcomes (Butterfoss & Kegler, 2009). This study focuses on specific coalition capacities and community contextual factors, as described further in the following sections.

Figure 1.

Theoretical model of coalition functioning.

Community Context

Within a socioecological framework (Bronfenbrenner & Morris, 1997), community contextual factors may hinder or support a coalition successfully achieving change and can thus be conceptualized as part of community readiness for a coalition approach to prevention (Burgess, McDonald, & Roberts, 1955; Carmack, 1965; Chilenski, Greenberg, & Feinberg, 2007; Foster-Fishman, Salem, Allen, & Fahrbach, 1999; Plested, Edwards, & Jumper-Thurman, 2006). Community readiness has been shown to relate to early coalition functioning (Greenberg, Feinberg, Meyer-Chilenski, Spoth, & Redmond, 2007) and to other important community demographics such as poverty and population density (Chilenski et al., 2007). The current study examines four constructs that fit within the community readiness framework: perceived community problems, participatory leadership, sense of community, and support of prevention (Chilenski et al., 2007; Edwards, Jumper-Thurman, Plested, Oetting, & Swanson, 2000). All characteristics are expected to influence a community coalition’s functioning and ability to achieve outcomes.

Community Problems

The community problems of interest are risk factors for youth substance use, such as poverty, lack of supervised activities for youth, and easy access to drugs (Feinberg, Ridenour, & Greenberg, 2007; Hawkins, Van Horn, & Arthur, 2004). Assessing the severity of these problems is important because they are potential points of intervention, which can be prioritized by the coalition and modified through collective action (Feinberg, 2012). As contextual factors, community problems such as poverty can also influence the implementation process and may be relevant even when the problems are not directly targeted by the coalition (L. D. Brown et al., 2010).

Participatory Leadership

A participatory leadership style is one where community leaders take into consideration the views of others when making decisions, and work to build consensus among involved parties (Magzan, 2011; Van Wart, 2013). If this type of leadership style is common within a community, coalition members are more likely to be comfortable employing such an approach in their own coalition. The ability to effectively employ a participatory leadership style contributes to community readiness by facilitating shared decision making, minimizing intergroup conflict, and strengthening coalition functioning (Chilenski et al., 2007; Greenberg et al., 2007; Lehman, Greener, & Simpson, 2002; Nelson, Raskind-Hood, Galvin, Essien, & Levine, 1999).

Sense of Community

A sense of community involves emotional attachment to the place and the people, the feeling that community members matter to each other, and that the community can meet the members’ needs (McMillan & Chavis, 1986). This construct influences community readiness through its impact on coalition functioning and its sustainability (Chilenski et al., 2007; Feinberg, Chilenski, Greenberg, Spoth, & Redmond, 2007; Greenberg et al., 2007; Perkins et al., 2011). Communities with a strong sense of community may be easier to engage in coalition efforts because residents believe their needs can be met through the coalition’s efforts (Armenakis, Harris, & Mossholder, 1993; Lehman et al., 2002).

Community Support for Prevention

Another aspect of community readiness is the recognition by community members that adolescent substance use is a problem in their community (Beebe, Harrison, Sharma, & Hedger, 2001; Edwards et al., 2000; Plested, Smitham, Jumper-Thurman, Oetting, & Edwards, 1999). Positive attitudes regarding prevention predict enhanced adoption and implementation of prevention programs (Aarons & Palinkas, 2007; Feinberg, Chilenski, et al., 2007; Hagedorn & Heideman, 2010; Spoth, Clair, Greenberg, Redmond, & Shin, 2007; Spoth, Guyll, Redmond, Greenberg, & Feinberg, 2011).

Coalition Capacity

Figure 1 displays several coalition capacities that have been theoretically and empirically connected with coalitions reaching their proximal and distal goals (E. C. Brown et al., 2014; Spoth, Guyll, et al., 2007; Welsh et al., 2015). In our framework, coalition capacities are defined as knowledge, resources, skills, and influence that coalition members bring to the coalition through their participation (Raine et al., 2014; Shapiro, Oesterle, & Hawkins, 2015). Collaborative relationships and community champions are two coalition capacities of interest in this study because of the role they play in enhancing coalition influence on key segments of the community, encouraging cooperation and support (Nowell, 2009; Zakocs, Tiwari, Vehige, & Dejong, 2008).

Collaborative Relationships

A history and positive experience with collaboration will likely support success, as multisector collaboration supporting a comprehensive health promotion approach can be challenging (L. D. Brown et al., 2013; Hausman, Becker, & Brawer, 2005). Research suggests collaboration capacity can enhance coalition functioning, promote systems change, and lead to improvements in youth outcomes (L. D. Brown et al., 2015; Feinberg, Chilenski, et al., 2007; Nowell, 2009).

Community Champions

A community champion is someone influential, vocal, and effective in promoting support for coalition goals in one or more community sectors, such as local government and schools (Zakocs et al., 2008). Influential champions can work within a network or organizational bureaucracy to provide coalitions with visibility and aid in the commitment of resources (Steckler & Goodman, 1989). Champions can also help the coalition frame the issue in ways that will resonate with key stakeholders, thereby enhancing readiness to adopt targeted programs (Cookston, Sandler, Braver, & Genalo, 2007).

Community Coalitions in the United States and Mexico

The U.S. and Mexican coalitions in this study focused on the prevention of youth substance use and violence. Both were multisector partnerships, engaging parents, teachers, youth, schools, media, law enforcement, faith community, health providers, social service agencies, and government agencies. Coalition coordinators helped organize day-to-day operations, typically as part-time paid staff. Substantial training and technical assistance were available in both countries, helping support the use of best practices and troubleshooting implementation challenges. A key difference was that the U.S. coalitions followed the Communities That Care (CTC) system whereas coalitions in Mexico followed the Strategic Prevention Framework (SPF; Hawkins, Catalano, & Arthur, 2002; Orwin, Edwards, Buchanan, Flewelling, & Landy, 2012).

Both CTC and SPF use epidemiological data to identify prevention priorities. However, CTC employs a specific survey to assess risk and protective factors for problem behaviors, whereas the SPF is less proscriptive in its approach to community assessment (Hawkins et al., 2004). The CTC system is again more proscriptive in selecting strategies to address priorities, emphasizing the use of evidence-based programs that meet rigorous inclusion criteria (e.g., programs listed at http://www.blueprintsprograms.com/). The Mexican coalitions received training from Community Anti-Drug Coalitions of America emphasizing the use of environmental change strategies, for which the evidence base is more difficult to establish (Pettibone, Friend, Nargiso, & Florin, 2013).

The U.S. coalitions were located throughout the state of Pennsylvania and funded by the Pennsylvania Commission for Crime and Delinquency. The Mexican coalitions emerged through a partnership between Programa Compañeros Asociación Civil and the Alliance of Border Collaboratives, with financial support from the U.S. Department of Anti-Narcotic Affairs at the U.S. Embassy in Mexico. The partnership—now called the Red de Coaliciones Comunitarias (Network of Community Coalitions)—started nine coalitions in four border municipalities: Ciudad Juárez (population 1,506,908), Nogales (population 220,292), Agua Prieta (population 79,138), and Tijuana (population 1,300,983). Ciudad Juarez and Tijuana are larger urban areas, whereas Nogales and Agua Prieta are smaller towns. Each of the Mexican coalitions focused on one specific neighborhood within these cities, with target population size ranging from 3,295 to 220,000 residents. The U.S. coalitions focused on school districts or counties, targeting rural and suburban areas, along with small and large towns. The population size of the areas where U.S. coalitions operated ranged from 4,199 to 438,965 people.

Research Aims

The goals of the current study are twofold. First, we examine the psychometric properties of measures for the previously described coalition context and capacity constructs in English and Spanish. These measures can be helpful in future research aimed at understanding how coalition context and capacity may influence coalition implementation of programs and policies, along with changes in community-level health outcomes. The second goal of the study is to compare the context and capacity of U.S. and Mexico coalitions to see if there are systematic differences across settings. We do not hypothesize specific differences between the United States and Mexico, but the identification of systematic differences can help inform how coalition approaches to health promotion may need to be different in the United States as compared to Mexico. We accomplish these goals by analyzing coalition context and capacity survey data collected from the previously described coalitions in Mexico and the United States.

Method

Procedure

The coalition context and capacity assessment was originally developed in English, drawing from several existing measures (Arthur, Hawkins, Catalano, & Olson, 1998; Bumbarger, Kelsey, Mastrofski, & Witmer, 2010; Chilenski et al., 2007; Feinberg, Chilenski, et al., 2007; Feinberg et al., 2004; Greenberg et al., 2007; Substance Abuse and Mental Health Services Administation, 2009) The survey was translated in Spanish, using back-translation to identify discrepancies followed by discussion to reach consensus on the most appropriate translation (Cantor et al., 2005). Study instruments and data are available from the first author.

In both the United States and Mexico, the coalition context and capacity assessment was administered soon after coalitions received funding. In the United States, the assessment was administered as a Web-based survey. Coalition leaders provided researchers with the e-mail addresses of coalition members, who were then invited to participate in the survey. Of the 313 individuals invited to complete the survey, there were 139 respondents across the 7 community coalitions, for a response rate of 44%. In Mexico, the survey was administered via paper and pencil at the initial coalition training. Everyone who attended the meeting completed the survey, for a response rate of 100%. However, membership lists for the Mexican coalitions were not developed until after the initial training, thus making the response rates across countries difficult to compare. In Mexico, there were 221 respondents from 9 community coalitions in Juarez, Nogales, and Tijuana. Among the completed surveys in the United States and Mexico, the percentage of missing data across items ranged from 3% to 21%.

Coalition and Participant Characteristics

Table 1 provides coalition and respondent characteristics from Mexico and the United States. Mexican coalition members were significantly younger, with less formal education, and were more likely to be male. Furthermore, Mexican respondents had less experience in prevention and were less likely to have prior coalition involvement. With regard to occupational sector representation, the Mexican coalitions had more participants from the business and concerned citizen categories, whereas the U.S. coalitions had more human services representation. The Mexican coalitions operated with substantially less grant funding and tended to be in areas with higher population density.

Table 1.

Characteristics of Respondents and Coalitions From Mexico and the United States.

Characteristic	Mexico, %	United States, %
Gender
Female	54	67
Male	46	33
Age in years	40	49
Years in prevention	7	13
Prior coalition involvement
Yes	17	39
No	83	61
Educational attainment
Elementary school	10	0
Middle school	27	0
High school or GED	18	9
Associates or trade school	12	3
Bachelors degree	27	42
Masters degree	4	36
MD, JD, PhD, or other terminal degree	1	9
Community sector representation
Business	17	5
Education	12	16
Local government	12	9
Health services	9	7
Human services	22	43
Judicial system	2	6
Law enforcement	3	5
Faith community	6	4
Concerned citizen	19	5
Amount of primary funding award, $	5,000	40,000
Population density (persons per km²)	578	98

Measures

Table 2 presents psychometric properties of the measures examined in this study, including the number of items, intraclass correlation coefficient (respondents are nested within coalitions), mean, standard deviation, Cronbach’s alpha value, and intermeasure correlations separately for the United States and Mexico. Following is an example item from each scale along with a description of the response options.

Table 2.

Psychometric Properties of the Coalition Context and Capacity Scales.

Scale name	No. of items	ICC	Mexico M (SD)	U.S. M (SD)	Mexico α	U.S.α	1	2	3	4	5	6
1. Community Problems	17	.22	5.77 (0.83)	5.09 (0.76)	.88	.90	—	.06	−.03	.02	.02	.18
2. Participatory Leadership	4	.04	4.77 (1.39)	5.09 (1.25)	.87	.92	−.06	—	.22	.48	.02	.24
3. Sense of Community	4	.12	4.08 (1.23)	4.70 (0.91)	.72	.68	−.39	.22	—	.36	.12	.29
4. Community Support for Prevention	3	.12	3.09 (0.95)	3.69 (0.83)	.45	.52	−.004	.52	.21	—	.12	.30
5. Collaborative Relationships	13	.13	1.00 (0.87)	0.69 (0.61)	.96	.92	.001	.16	.01	−.07	—	.24
6. Community Champions	15	.15	3.79 (1.49)	4.52 (1.20)	.95	.90	−.05	.34	.27	.39	.12	—

Note. ICC = intraclass correlation coefficient. Correlations above the diagonal are for Mexico and below the diagonal for the United States. Correlations in boldface are statistically significant (p < .05).

Community Problems

Example: “For each one, indicate how serious of a problem you feel it is in your area . . . Poverty.” Response options ranged from not at all serious (1) to very serious (7; adapted from Arthur et al., 1998).

Participatory Leadership

Example: “Community leaders are . . . . Able to represent all sectors of the community, including disadvantaged groups.” Response options ranged from strongly disagree (1) to strongly agree (7; adapted from Feinberg et al., 2004).

Sense of Community

Example: “Most people in your area feel a strong tie to the community.” Response options ranged from strongly disagree (1) to strong agree (7; adapted from Chilenski et al., 2007).

Community Support for Prevention

Example: “Does the community overall recognize that there is a substance abuse problem that needs to be addressed?” Response options varied across items but ranged from The community is in denial (1) to The community is extremely aware of substance use problems (4), for the example item (adapted from Feinberg et al., 2004).

Collaborative Relationships

Example: “In what manner does your coalition collaborate with each of the following organizations . . . Primary and secondary schools?” Response options included the following: cosponsor of events or activities, share funding or in-kind resources, exchange information, no collaboration, and does not exist in our community (adapted from Chilenski, Ang, Greenberg, Feinberg, & Spoth, 2014). Scores for each item ranged from 0 to 3, computed as a sum, with each of the first three response options counted as 1 point if marked.

Community Champions

Example: “Is there an enthusiastic champion for substance abuse prevention—someone who is influential and effective in promoting substance abuse prevention in their own organization and in the community—in the . . . Local government?” Response options ranged from no champion (1) to a very effective champion (7; adapted from Bumbarger et al., 2010).

Plan of Analysis

We used Mplus Version 7.2 to conduct a confirmatory factor analysis (CFA) of our context and capacity measurement model. For the regression analyses predicting each coalition context and capacity measure at the individual level, we used SAS Version 9.3. Proc Mixed estimated multilevel regression models that accounted for the nesting of survey respondents within coalitions. To account for missing data, we used multiple imputation, generating 10 imputed data sets (Sinharay, Stern, & Russell, 2001). All measures of coalition context and capacity were standardized prior to analysis to ease interpretation (M = 0, SD = 1). Coalition nationality was the focal predictor, with gender, age, educational attainment, years working in prevention, previous coalition involvement, and population density entered as covariates. We conducted follow-up analyses on meaningful scale subcomponents if coalition nationality was a significant predictor of the overall scale at p < .05. Only Community Problems, Collaborative Relationships, and Community Champions contained meaningful subcomponents.

Results

Table 2 reports the psychometric properties of the coalition context and capacity scales. Cronbach’s alpha values generally range from .68 to .96. However, Community Support for Prevention had substantially lower alpha values, at .45 for Mexico and .52 for the United States. Alphas for each construct were similar in the United States and Mexico. Correlations between the measures of coalition context and capacity are generally similar in the Mexican and U.S. samples, with one exception. The correlation between Community Problems and Community Champions is positive in Mexico (r = .18, p < .05) and negative in the United States (r = −.05, n.s.).

Figure 2 presents the standardized parameter estimates and fit indices for the CFA of the context and capacity measurement model. The initial CFA had χ² of 3463.65 (degrees of freedom [df] = 1469, p < .05), a comparative fit index of .80, and a root mean square error of approximation of .06. Several item residual variances were significantly correlated within three factors: Community Problems, Community Champions, and Collaborative Relationships. Freely estimating the residual variances within these constructs that had a magnitude greater than r = .19 improved model fit substantially. The revised CFA had χ² of 2453.37 (df = 1437, p < .05), a comparative fit index of .90, and a root mean square error of approximation of .04. Standardized factor loading magnitudes varied across constructs. For Community Champions, Collaborative Relationships, Participatory Leadership, and Sense of Community, factor loadings ranged from .59 to .85. Community Problems factor loadings ranged from .31 to .78, and Community Support for Prevention factor loadings ranged from .22 to .72.

Figure 2.

Confirmatory factor analysis of coalition context and capacity scales.

Table 3 presents findings from the regression models predicting coalition context and capacity. Coalition nationality was a significant predictor of Community Problems, Sense of Community, and Community Support for Prevention. Specifically, Mexican coalition nationality predicted a 1.00 standard deviation unit increase in Community Problems. Mexican coalitions were .54 standard deviation units lower on sense of community. With regard to Community Support for Prevention, Mexican coalitions were .57 standard deviation units lower. The covariates of gender, age, educational attainment, years working in prevention, and previous coalition involvement were generally not significant predictors of coalition context and capacity. The only exception was for gender; being female predicted a .31 standard deviation increase in Community Problems.

Table 3.

Results From Multilevel Regression Models Predicting Measures of Coalition Context and Capacity (n = 360).

	Community Problems		Participatory Leadership		Sense of Community		Community Support for Prevention		Collaborative Relationships		Community Champions
Covariate	B	SE	B	SE	B	SE	B	SE	B	SE	B	SE
Mexican coalition (vs. U.S.)^b	1.00	.19	−.04	.19	−.54	.21	−.57	.18	.25	.22	−.24	.22
Female (vs. male)^a	.31	.10	.14	.11	−.03	.11	.11	.11	−.20	.11	.04	.11
Age^a	.001	.01	.001	.01	.01	.01	−.002	.01	−.003	.01	−.01	.01
Educational attainment^a	.02	.04	.04	.04	−.06	.04	−.02	.04	.01	.04	.02	.04
Years in prevention^a	.01	.01	−.002	.01	.002	.01	−.003	.01	.01	.01	.01	.01
Prior coalition involvement (vs. none)^a	.19	.13	.12	.15	.05	.14	.21	.14	.03	.13	.28	.14
Population density^b	.02	.08	−.07	.08	−.03	.09	−.06	.08	.18	.09	−.09	.09

Note. Each column is a separate regression model. Estimates in boldface are statistically significant, p < .05; dependent variables are standardized.

Level 1 predictor. ^bLevel 2 predictor.

Coalition nationality predicted significant differences in one scale containing meaningful subcomponents—Community Problems. Figure 3 presents follow-up regression analyses using the same set of covariates to predict the specific issues measured by each item in the Community Problems scale. The magnitude of the estimate for the coalition nationality covariate ranged from −0.07 for mental illness to 1.28 for lack of enforcement for laws. The regression estimates presented are Cohen’s d effect sizes, where ±0.8 is considered a “large” effect, ±0.5 is a “medium” effect, and ±0.25 is a “small” effect (Cohen, 1988). The perceived severity of problems with youth violence, lack of enforcement for laws, lack of trust in law enforcement, school quality, easy access to illegal drugs, and crime were all predicted to be more than 0.8 standard deviation units higher among respondents from Mexican coalitions.

Figure 3.

Standardized effect of Mexican coalition status on Community Problems.

Discussion

This study makes a unique contribution to the literature by providing data on the psychometric properties of coalition context and capacity measures in both Spanish and English. The psychometric properties of the scales appear to be strong. The internal consistency of each scale is similar across United States and Mexican coalitions, supporting the validity of comparisons between countries. Scales measuring community problems, participatory leadership, collaborative relationships, and community champions all had strong internal consistency (α = .87-.96). Sense of community had moderate internal consistency (α = .68-.72). CFA fit indices suggest that community problems, collaborative relationships, and community champions are not unidimensional constructs, however, as several residual variances within these constructs had to be estimated freely to produce good fit for the overall measurement model. Each item represents a different problem or sector of the community, and thus it is not surprising some items within a construct are more correlated than others.

The only scale with poor internal consistency and low factor loadings in the CFA was community support for prevention (α = .45-.52), which may be improved with additional items. Community support for prevention may also be additive in nature, with each item measuring unique issues that together yield important information. If the low alpha values indicated the measure was not valid, the large correlations observed with participatory leadership would be unlikely (r = .52 in the United States and r = .48 in Mexico). Thus, we believe the scale is valid and useful as constructed, although future research with additional items may further improve the scale.

In general, correlations between scales were modest but in the expected direction, suggesting scales measure unique factors and possess construct validity. Specifically, community champions, community support for prevention, sense of community, and participatory leadership were positively correlated with one another among both U.S. and Mexican coalitions. Each of these coalition strengths may help support the others (Stone & Hughes, 2002). For example, community champions’ efforts may increase community support for prevention, which in turn may cultivate additional community champions (Dariotis, Bumbarger, Duncan, & Greenberg, 2008).

Collaborative relationships and community problems were generally not significantly correlated with other constructs. It may be that they influence coalition functioning largely independently of other aspects of context and capacity. However, community problems were negatively related to sense of community among U.S. coalitions. Low sense of community may exacerbate other problems in the community and vice versa (Chung & Lim, 2014). In Mexican coalitions, community problems were positively associated with the presence of community champions for prevention, which may help coalitions address problems in their community (Zakocs et al., 2008).

This study is the first to our knowledge to measure coalition context and capacity in Mexico and the first comparison across international settings. Coalition context in Mexico is substantially different from that of the United States. Results of this study show that coalition members in Mexico perceive more severe community problems, especially a lack of enforcement for established laws, high rates of youth violence, and a lack of trust toward the police and government. Although familiarity with these border cities may make the findings obvious, it is interesting to note that problems such as poverty, which are also higher in these Mexican communities than in the United States, are not perceived as significantly more severe by coalition members. If Mexican coalitions want to address problems with a lack of effective and trustworthy law enforcement, the strategies used will need to be vastly different from those taken by drug prevention coalitions in the United States, which often focus on implementing school- and community-based programs (Hawkins et al., 2002; Spoth et al., 2013).

The Mexican coalitions also face lower levels of support for community prevention activities and fewer community champions, making it challenging to build the momentum necessary to take action (Aoun, Shahid, Le, & Packer, 2013; Holmila, Mustonen, Osterberg, & Raitasalo, 2009). Furthermore, the Mexican coalition members perceive lower levels of sense of community, which may make the establishment of trusting community relations particularly challenging but nevertheless essential. The ability of the Mexican coalitions to manage these challenges will likely play a large role in determining whether they are successful in their substance use prevention efforts. Mexican coalitions may need to focus additional energy on building community support for their implementation efforts to be successful.

Strengths, Limitations, and Future Research

A key strength of this study is its examination of coalition context and capacity in substantially different international settings using the same measures. One challenge in interpreting the results is that the geographic scope of the U.S. sites included counties and school districts, whereas the Mexican sites were always neighborhoods, typically in more urban areas. It is difficult to know how these differences affected results, although the nationality effects are not due to population density, which was included as a covariate in analyses. An important limitation of the study is that the data are cross-sectional, limiting our ability to establish the validity of the scales in predicting outcomes such as the implementation of prevention programs and policies. One limitation of the measures is that they rely on coalition member perceptions of community context and capacity. Observational ratings or survey sampling of community members outside the coalition may provide a more accurate approach to examining community context. The measures presented here regarding community context are not intended to replace epidemiological assessments of community risk and protective factors (e.g., Feinberg, Ridenour, et al., 2007).

Implications for Theory and Practice

The assessment tools presented here can help inform future coalition action aimed at strengthening coalition capacity and shaping community context to be more supportive of prevention. Future research should identify best practices that coalitions can use to build capacity and address prioritized contextual challenges. This assessment is a first step in clarifying the context and capacity constructs that influence the achievement of coalition goals. With additional understanding of these important challenges, coalitions will be better able to identify and address weaknesses, thereby enhancing long-term goal achievement.

Footnotes

Acknowledgements

We are grateful for the cooperation of the many coalition members in Mexico and the United States.

Authors’ Note

Findings and recommendations herein are not official statements of the U.S. Embassy, Pennsylvania Commission for Crime and Delinquency, or National Cancer Institute.

Declaration of Conflicting Interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Louis D. Brown, Rebeca Ramos, and Nora Gallegos were supported by a grant from the U.S. Embassy in Mexico. Sarah Meyer Chilinski and Mark E. Feinberg were supported by the Pennsylvania Commission for Crime and Delinquency. Louis D. Brown was additionally supported in part by the National Cancer Institute through a Community Networks Program Center grant U54 CA153505.

References

Aarons

G. A.

Palinkas

L. A.

(2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 411-419. doi:10.1007/s10488-007-0121-3

Aoun

S. M.

Shahid

Packer

T. L.

(2013). The role and influence of “champions” in a community-based lifestyle risk modification programme. Journal of Health Psychology, 18, 528-541. doi:10.1177/1359105312449194

Armenakis

A. A.

Harris

S. G.

Mossholder

K. W.

(1993). Creating readiness for organizational-change. Human Relations, 46, 681-703.

Arthur

M. W.

Hawkins

D. J.

Catalano

R. F.

Olson

J. J.

(1998). Diffusion project: Fall 1998 community key informant interview. Seattle: University of Washington, Social Development Research Group.

Beebe

T. J. J.

Harrison

P. A.

Sharma

Hedger

(2001). The community readiness survey: Development and initial validation. Evaluation Review, 25, 55-71.

Bronfenbrenner

Morris

P. A.

(1997). The ecology of developmental processes. In Damon

(Ed.), Handbood of child psychology (5th ed., pp. 993-1028). New York, NY: Wiley.

Brown

E. C.

Hawkins

J. D.

Rhew

Shapiro

Abbott

Oesterle

. . . Catalano

(2014). Prevention system mediation of Communities That Care effects on youth outcomes. Prevention Science, 15, 623-632. doi:10.1007/s11121-013-0413-7

Brown

L. D.

Alter

T. R.

Brown

L. G.

Corbin

M. A.

Flaherty-Craig

McPhail

L. G.

. . . Weaver

M. E.

(2013). Rural Embedded Assistants for Community Health (REACH) Network: First-person accounts in a community-university partnership. American Journal of Community Psychology, 51, 206-216. doi:10.1007/s10464-012-9515-9

Brown

L. D.

Feinberg

M. E.

Greenberg

M. T.

(2010). Determinants of community coalition ability to support evidence-based programs. Prevention Science, 11, 287-297. doi:10.1007/s11121-010-0173-6

10.

Brown

L. D.

Feinberg

M. E.

Greenberg

M. T.

(2012). Measuring coalition functioning: Refining constructs through factor analysis. Health Education & Behavior, 39, 486-497. doi:10.1177/1090198111419655

11.

Brown

L. D.

Feinberg

M. E.

Shapiro

V. B.

Greenberg

M. T.

(2015). Reciprocal relations between coalition characteristics and the provision of implementation support. Prevention Science, 16, 101-109. doi:10.1007/s11121-013-0447-x

12.

Brown

L. D.

Redelfs

A. H.

Taylor

T. J.

Messer

R. L.

(2015). Comparing the functioning of youth and adult partnerships for health promotion. American Journal of Community Psychology. Advance online publication. doi: 10.1007/s10464-015-9730-2

13.

Bumbarger

B. K.

Kelsey

Mastrofski

Witmer

(2010). Weed and Seed Web survey 2010 statewide report. EPISCenter: University Park, PA.

14.

Burgess

C. B.

McDonald

Roberts

M. B.

(1955). More effective mental health by activation of community potentials. Journal of Psychiatric Social Work, 24, 250-255.

15.

Butterfoss

F. D.

(2007). Coalitions and partnerships in community health. San Francisco, CA: Jossey-Bass.

16.

Butterfoss

F. D.

Kegler

M. C.

(2009). The community coalition action theory. In DiClemente

R. J.

Crosby

R. A.

Kegler

M. C.

(Eds.), Emerging theories in health promotion practice and research (2nd ed., pp. 237-276). San Francisco, CA: Jossey-Bass.

17.

Cantor

S. B.

Byrd

T. L.

Groff

J. Y.

Reyes

Tortolero-Luna

Mullen

P. D.

(2005). The language translation process in survey research: A cost analysis. Hispanic Journal of Behavioral Sciences, 27, 364-370. doi:10.1177/0739986305277940

18.

Carmack

W. R.

(1965). Communication and community readiness for social change. American Journal of Orthopsychiatry, 35, 538-543. doi:10.1111/j.1939-0025.1965.tb00415.x

19.

Chang

Salvatore

A. L.

Lee

P. T.

Liu

S. S.

Tom

A. T.

Morales

. . . Minkler

(2013). Adapting to context in community-based participatory research: “Participatory starting points” in a Chinese immigrant worker community. American Journal of Community Psychology, 51, 480-491.

20.

Chilenski

S. M.

Ang

P. M.

Greenberg

M. T.

Feinberg

M. E.

Spoth

(2014). The impact of a prevention delivery system on perceived social capital: The PROSPER project. Prevention Science, 15, 125-137.

21.

Chilenski

S. M.

Greenberg

M. T.

Feinberg

M. E.

(2007). Community readiness as a multidimensional construct. Journal of Community Psychology, 35, 347-368.

22.

Chung

G. H.

Lim

J. Y.

(2014). Understanding sense of neighbourhood community in Korean adolescents: Its relation to adolescent well-being and the role of parents. International Journal of Adolescence and Youth, 19, 350-365.

23.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

24.

Cookston

J. T.

Sandler

I. N.

Braver

S. L.

Genalo

M. T.

(2007). Predicting readiness to adopt evidence-based programs for divorcing families: Champions, attitudes, and access to funding. American Journal of Orthopsychiatry, 77, 573-581. doi:10.1037/0002-9432.77.4.573

25.

Dariotis

J. K.

Bumbarger

B. K.

Duncan

L. G.

Greenberg

M. T.

(2008). How do implementation efforts relate to program adherence? Examining the role of organizational, implementer, and program factors. Journal of Community Psychology, 36, 744-760.

26.

Edwards

R. W.

Jumper-Thurman

Plested

B. A.

Oetting

E. R.

Swanson

(2000). Community readiness: Research to practice. Journal of Community Psychology, 28, 291-307.

27.

El Arifeen

Christou

Reichenbach

Osman

F. A.

Azad

Islam

K. S.

. . . Peters

D. H

. (2013). Community-based approaches and partnerships: Innovations in health-service delivery in Bangladesh. The Lancet, 382, 2012-2026.

28.

Feinberg

M. E.

(2012). Community epidemiology of risk and adolescent substance use: Practical questions for enhancing prevention. American Journal of Public Health, 102, 457-468. doi:10.2105/ajph.2011.300496

29.

Feinberg

M. E.

Chilenski

S. M.

Greenberg

M. T.

Spoth

Redmond

(2007). Community and team member factors that influence the operations phase of local prevention teams: The PROSPER project. Prevention Science, 8, 214-226. doi:10.1007/s11121-007-0069-2

30.

Feinberg

M. E.

Greenberg

M. T.

Osgood

D. W.

(2004). Readiness, functioning, and perceived effectiveness of community prevention coalitions: A study of Communities That Care. American Journal of Community Psychology, 33, 163-176.

31.

Feinberg

M. E.

Ridenour

T. A.

Greenberg

M. T.

(2007). Aggregated indices of risk and protective factors in the Communities That Care survey. Journal of Adolescent Health, 40, 506-513.

32.

Foster-Fishman

P. G.

Salem

D. A.

Allen

N. E.

Fahrbach

(1999). Ecological factors impacting provider attitudes towards human service delivery reform. American Journal of Community Psychology, 27, 785-816.

33.

Greenberg

M. T.

Feinberg

M. E.

Gomez

Osgood

D. W.

(2005). Testing a community prevention focused model of coalition functioning and sustainability: A comprehensive study of communities that care in Pennsylvania. In Stockwell

Gruenewald

Toumbourou

J. W.

Loxley

(Eds.), Preventing harmful substance use: The evidence base for policy and practice (pp. 129-142). London, England: Wiley.

34.

Greenberg

M. T.

Feinberg

M. E.

Meyer-Chilenski

Spoth

Redmond

(2007). Community and team member factors that influence the early phase functioning of community prevention teams: The PROSPER project. Journal of Primary Prevention, 28, 485-504. doi:10.1007/s10935-007-0116-6

35.

Hagedorn

H. J.

Heideman

P. W.

(2010). The relationship between baseline Organizational Readiness to Change Assessment subscale scores and implementation of hepatitis prevention services in substance use disorders treatment clinics: A case study. Implementation Science, 5. doi:10.1186/1748-5908-5-46

36.

Hausman

A. J.

Becker

Brawer

(2005). Identifying value indicators and social capital in community health partnerships. Journal of Community Psychology, 33, 691-703. doi:10.1002/jcop.20078

37.

Hawkins

J. D.

Catalano

R. F.

Arthur

M. W.

(2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951-976.

38.

Hawkins

J. D.

Oesterle

Brown

E. C.

Monahan

K. C.

Abbott

R. D.

Arthur

M. W.

Catalano

R. F.

(2012). Sustained decreases in risk exposure and youth problem behaviors after installation of the Communities That Care prevention system in a randomized trial. Archives of Pediatrics & Adolescent Medicine, 166, 141-148. doi:10.1001/archpediatrics.2011.183

39.

Hawkins

J. D.

Van Horn

M. L.

Arthur

M. W.

(2004). Community variation in risk and protective factors and substance use outcomes. Prevention Science, 5, 213-220. doi:10.1023/b:prev.0000045355.53137.45

40.

Holmila

Mustonen

Osterberg

Raitasalo

(2009). Public opinion and community-based prevention of alcohol-related harms. Addiction Research & Theory, 17, 360-371. doi:10.1080/16066350902770425

41.

Lehman

W. E. K.

Greener

J. M.

Simpson

D. D.

(2002). Assessing organizational readiness for change. Journal of Substance Abuse Treatment, 22, 197-209. doi:https://dx-doi-org.web.bisu.edu.cn/10.1016/S0740-5472(02)00233-7

42.

Magzan

(2011). The art of participatory leadership: A tool for social and organizational development and change. Journal of Engineering Management and Competitiveness, 1, 21-26.

43.

McMillan

D. W.

Chavis

D. M.

(1986). Sense of community: A definition and theory. Journal of Community Psychology, 14(1), 6-23.

44.

Nelson

J. C.

Raskind-Hood

Galvin

V. G.

Essien

J. D. K.

Levine

L. M.

(1999). Positioning for partnerships: Assessing public health agency readiness. American Journal of Preventive Medicine, 16, 103-117.

45.

Nowell

(2009). Profiling capacity for coordination and systems change: The relative contribution of stakeholder relationships in interorganizational collaboratives. American Journal of Community Psychology, 44, 196-212. doi:10.1007/s10464-009-9276-2

46.

Orwin

R. G.

Edwards

J. M.

Buchanan

R. M.

Flewelling

R. L.

Landy

A. L.

(2012). Data-driven decision making in the prevention of substance-related harm: Results from the Strategic Prevention Framework State Incentive Grant Program. Contemporary Drug Problems, 39, 73-106.

47.

Perkins

D. F.

Feinberg

M. E.

Greenberg

M. T.

Johnson

L. E.

Chilenski

S. M.

Mincemoyer

C. C.

Spoth

R. L.

(2011). Team factors that predict to sustainability indicators for community-based prevention teams. Evaluation and Program Planning, 34, 283-291. doi:10.1016/j.evalprogplan.2010.10.003

48.

Pettibone

K. G.

Friend

K. B.

Nargiso

J. E.

Florin

(2013). Evaluating environmental change strategies: Challenges and solutions. American Journal of Community Psychology, 51, 217-221. doi:10.1007/s10464-012-9556-0

49.

Plested

B. A.

Edwards

R. W.

Jumper-Thurman

(2006). Community readiness: A handbook for successful change. Fort Collins: Tri-Ethnic Center for Prevention Research Sage Hall, Colorado State University.

50.

Plested

B. A.

Smitham

D. M.

Jumper-Thurman

Oetting

E. R.

Edwards

R. W.

(1999). Readiness for drug use prevention in rural minority communities. Substance Use & Misuse, 34, 521-544.

51.

Raine

K. D.

Sosa Hernandez

Nykiforuk

C. I. J.

Reed

Montemurro

Lytvyak

MacLellan-Wright

M.-F.

(2014). Measuring the progress of capacity building in the Alberta Policy Coalition for Cancer Prevention. Health Promotion Practice, 15, 496-505. doi:10.1177/1524839913511627

52.

Shapiro

V. B.

Oesterle

Hawkins

J. D.

(2015). Relating coalition capacity to the adoption of science-based prevention in communities: Evidence from a randomized trial of Communities That Care. American Journal of Community Psychology, 55(1-2), 1-12. doi:10.1007/s10464-014-9684-9

53.

Sinharay

Stern

H. S.

Russell

(2001). The use of multiple imputation for the analysis of missing data. Psychological Methods, 6, 317-329.

54.

Spoth

Clair

Greenberg

Redmond

Shin

(2007). Toward dissemination of evidence-based family interventions: Maintenance of community-based partnership recruitment results and associated factors. Journal of Family Psychology, 21, 137-146. doi:10.1037/0893-3200.21.2.137

55.

Spoth

Guyll

Lillehoj

C. J.

Redmond

Greenberg

M. T.

(2007). Prosper study of evidence-based intervention implementation quality by community-university partnerships. Journal of Community Psychology, 35, 981-999.

56.

Spoth

Guyll

Redmond

Greenberg

M. T.

Feinberg

M. E.

(2011). Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: The PROSPER study. American Journal of Community Psychology, 48, 412-425. doi:10.1007/s10464-011-9430-5

57.

Spoth

Redmond

Shin

Greenberg

Feinberg

Schainker

(2013). Longitudinal effects of universal PROSPER community–university partnership delivery system effects on substance misuse through 6 1/2 years past baseline from a cluster randomized controlled intervention trial. Preventive Medicine, 56, 190-196.

58.

Steckler

Goodman

R. M.

(1989). How to institutionalize health promotion programs. American Journal of Health Promotion, 3, 34-43. doi:10.4278/0890-1171-3.4.34

59.

Stone

Hughes

(2002). Understanding community strengths. Family Matters, 61, 62-67. Retrieved from https://aifs.gov.au/publications/family-matters/issue-61/understanding-community-strengths

60.

Substance Abuse and Mental Health Services Administation. (2009). Strategic prevention framework State Incentive Grant (SPF SIG): Cohort III/IV cross-site evaluation Community Level Instrument (CLI). Rockville, MD: Substance Abuse and Mental Health Services Administration.

61.

Van Wart

. (2013). Lessons from leadership theory and the contemporary challenges of leaders. Public Administration Review, 73, 553-565. doi:10.1111/puar.12069

62.

Welsh

Johnson

L. E.

Chilenski

S. M.

Perkins

D. F.

Greenberg

M. T.

Feinberg

M. E.

Spoth

R. L.

(2015). Pathways to sustainability: 8-year outcomes from the PROSPER project. Manuscript submitted for publication.

63.

Zakocs

R. C.

Tiwari

Vehige

Dejong

(2008). Roles of organizers and champions in building campus-community prevention partnerships. Journal of American College Health, 57, 233-239.