Abstract
Purpose
The purpose is to describe how local quantitative and qualitative data were used to assess the progress of the Supplemental Nutrition Assistance Program Education (SNAP-Ed) interventions in Los Angeles County, California.
Approach
Data from the California Health Interview Survey informed the geographical concentration of program resources during the planning phase. At the end of the program, semi-structured interviews with stakeholders were conducted to assess factors that facilitated SNAP-Ed implementation.
Setting
Los Angeles County, California.
Participants
Twenty-four project coordinators were interviewed.
Intervention
From 2016 to 2020, 24 organizations across Los Angeles County delivered nutrition education, reaching an estimated 2 million people. Two-hundred policy, systems, and environmental change interventions reached an estimated 1.2 million people.
Method
Semi-structured interview data were analyzed using a form of both inductive and deductive content analysis. A codebook was developed based on themes identified in these interviews. Each interview was coded by 2 team members; discrepancies (if they arose) were resolved by a 5-member group.
Results
Two facilitators—support for capacity building from a local health department and presence of community partnerships—were identified as critical factors that contributed to the success of SNAP-Ed implementation.
Conclusion
A local health department can increase SNAP-Ed intervention reach and uptake by assisting funded partners with further capacity building, helping them to develop feasible work plans, foster evaluation skills, and engage in sustainability planning.
Keywords
Purpose
The obesity epidemic and the increase in chronic disease prevalence across the United States (US) have disproportionately impacted low-income communities and communities of color, 1 contributing to poor health outcomes and a rise in expenses for safety net programs such as Medicaid and the Supplemental Nutrition Assistance Program (SNAP). 2 The educational arm of the latter entity—SNAP Education (SNAP-Ed)—is an evidence-based nutrition education program that helps SNAP eligible households eat better and take better advantage of available food resources and opportunities for physical activity. The program accomplishes this by delivering nutrition education, promoting physical activity, and implementing complementary policy, systems, and environmental change interventions (PSEs) in the community. The PSEs often take the form of food and built environment modifications or policy changes. In prior studies, SNAP-Ed has been linked to improved dietary outcomes.3,4
From 2016 to 2020, the Los Angeles County Department of Public Health (DPH) implemented its version of the local SNAP-Ed program using several evidence-based, community-oriented interventions; they targeted obesity risk factors including unhealthy eating and physical inactivity. Twenty-four funded partner organizations (hereafter ‘partners’) were selected through a competitive contract solicitation process and asked to deliver nutrition education, support coalition building, and implement PSEs. These partners were given flexibility to select a range of PSEs from a menu of strategies provided by DPH. The menu offered such evidence-based or informed interventions as the smarter lunchroom movement and community edible gardens.
The present program assessment describes the planning and implementation processes employed during the prior SNAP-Ed funding cycle in Los Angeles County (LAC), 2016–2020. The assessment sought to explain the program structure established in LAC and illustrate how local population health data were used to inform the geographical concentration of program resources. Results from 24 qualitative interviews with funded partners were used to document lessons learned from implementing SNAP-Ed in LAC. These results also offered insights into ways in which LAC’s effort could be improved to better address obesity, nutrition, and overall health among the underserved in this county.
Approach
Throughout 2016–2020, SNAP-Ed in LAC utilized data from the California Health Interview Survey (CHIS) to inform the geographical concentration of program resources during the initial and subsequent planning phases of the program. At the end of the 3-year project, the program commissioned a series of semi-structured interviews with funded partners’ (their project coordinators) to assess factors that facilitated the successful implementation of the program locally.
Setting
There are approximately 10 million residents in LAC. During the time of the 2016–2020 program, an estimated 3.5 million of LAC residents qualified for the SNAP-Ed program with household incomes at or below 185% of the Federal Poverty Level (FPL).
Participants
Twenty-four project coordinators were interviewed by DPH’s program assessment team. These coordinators of funded partners represented nonprofit organizations (n = 17), healthcare systems (n = 3), academic institutions (n = 2), a faith-based organization (n = 1), and a school district (n = 1). All interviewees were familiar with the day-to-day SNAP-Ed operation of their organization. All had prior experience working with populations that are food insecure, had >5 years of experience in community outreach, and were part of prior SNAP-Ed programming.
Methods
Department of public health staff utilized health behavior prevalence estimates from CHIS 2013–2015—a random-digit dial telephone survey in California 5 —to guide LAC-specific SNAP-Ed priorities. These data were used to inform the selection of the 24 funded partners and to identify where to concentrate SNAP-Ed resources. For example, analyses using CHIS data 5 allowed DPH to locate and target adults with household incomes ≤185% of the Federal Poverty Level (SNAP-Ed eligibility criterion) by geography (e.g., by Service Planning Area [SPA]). Once identified, resources were strategically allocated to these areas with the highest need and greatest number of SNAP-Ed eligible households. Throughout 2016–2020, funded partners reported on their ongoing work in these areas, documenting the following in a federal reporting system: estimates of population reach; direct project activities (e.g., nutrition education), indirect project activities (e.g., distribution of educational materials), information about PSE interventions, and any progress made by the community partnerships.
At the end of the program cycle in 2020, 24 semi-structured, in-depth interviews were completed with funded partners to document lessons learned during the 3-year project. All project coordinators of the 24 funded partners (interviewees) were asked to participate; they gave verbal consent prior to enrollment in the program assessment. An interview guide was developed to elicit the interviewees’ reflections about their project, for example, experiences with coalition building, lessons learned about barriers and facilitators, and others. It also had a protocol (series of question probes) to solicit recommendations about ways in which SNAP-Ed implementation could be improved (see Supplementary File 1). All 24 interviews were conducted and recorded by one of the program assessment team members and transcribed verbatim by 4 others. Each of the interviews were conducted by an experienced interviewer.
After completing the interviews, all transcripts were uploaded to Dedoose (a qualitative data software) to facilitate qualitative content management and analysis. A codebook was then developed based on pre-identified domains of the interview guide and on the themes identified in the data collected. 6 A hierarchical organizational strategy was employed to organize the content, for example, subthemes were captured to reflect coherent variations of a given, larger theme. Each transcript was coded by 2 team members to ensure acceptable reliability. Discrepancies in coding (if any) were resolved via consensus by a 5-member group. For example, in a sample of 3 interviews, the initial reliability was calculated as .69, but after reconciliation with the group (which included further testing in 2 additional interviews), the reliability score was rescored to .80. Coders worked simultaneously on the Dedoose platform, building coding hierarchies, communicating about the coding process, and contributing to coding definitions. A framework analysis (i.e., themes were indexed in an Excel spreadsheet by interviewee role for review), combining with deductive and inductive techniques, 7 was conducted to identify and better understand the various themes and subthemes identified in the interview data. This pragmatic combination of post-positivist and interpretivist approaches was used because each of these approaches addresses different aspects of our research questions that neither approaches addresses alone: organizational experiences with the SNAP-Ed grant and how experiences may vary by interviewee role. 8 The coders were trained in qualitative methods in the context of health services research, and had prior exposure to interview data on food insecurity. Therefore, the analytic process may have occasionally drawn on assumptions and expectations associated with prior work. Other metrics such as percent saturation were not included in the process, because we had fixed pool of interviewees and saturation metrics could not have been leveraged to increase recruitment or data collection. All program assessment materials were reviewed and approved by the DPH Institutional Review Board.
Intervention
In California, the California Department of Social Services administers the SNAP-Ed program, with 4 State Implementing Agencies tasked with implementing the program on the ground. Of the 4, the California Department of Public Health (CDPH) is the State Implementing Agency that coordinates with local health departments (LHDs) to scale SNAP-Ed interventions. At the local level, LHDs serve as the local lead agency (LLA) and SNAP-Ed resources (including direct funding) are further allocated to key partners to assist with program implementation. As a LLA, DPH developed a request for proposals 9 in 2016 to solicit and select 24 partners for this purpose.
California Health Interview Survey, Supplemental Nutrition Assistance Program Education Eligible Participants, Los Angeles County, 2013–2015.
Abbreviations: BMI, body mass index; CHIS, California Health Interview Survey; FPL, federal poverty level; LAC, Los Angeles County; SE, standard error; SNAP, Supplemental Nutrition Assistance Program (also known as CalFresh in California); SNAP-Ed, Supplemental Nutrition Assistance Program Education (also known as CalFresh Healthy Living Program in California); SPA, Service Planning Area.
Note: Means are weighted using CHIS sampling weights. Standard errors in parentheses. SNAP-Ed eligibility is defined as those households with incomes at or below 185% of the FPL.
Intervention Selection
For the LAC SNAP-Ed program, funded partners were tasked with carrying out 3 required implementation actions: (1) nutrition education and physical activity promotion, (2) coalition and partnership building, and (3) scale and spread of complementary PSEs. Recognizing that these partner organizations knew their target populations very well, DPH gave them tremendous latitude and flexibility when it came to prioritizing and selecting the best interventions that work for their communities. The partners also were given access to 5 DPH analysts who provided technical support and assistance to help them comply with CDPH expectations and state-contractual requirements.
Results
Most funded partners were able to freely choose their target populations (e.g., youth or adults) and select the curricula from a state-approved list for the nutrition education component of the SNAP-Ed program. Over the 3-year project, these partners delivered nearly 20,000 nutrition education and community classes, reaching an estimated 2 million people (data from the federal reporting system). All partners were asked to convene community coalitions to facilitate discussions about implementation issues (e.g., outreach, troubleshoot transportation barriers, education methods). For PSEs, there was a broad range of interventions selected by the partners. Figure 1 shows the most frequently selected PSEs along with the delivery sites. Overall, >200 PSEs were implemented to varying degrees over the 3-year timeframe, reaching approximately 1.2 million people. Most common policy, systems, and environmental change interventions (PSEs) and number of sites implementing them in Los Angeles county.
Salient Quotes for Themes Emerging From Interviews With Supplemental Nutrition Assistance Program Education Funded Partners, Los Angeles County, California.
Another key facilitator identified by interviewees during the interviews was the value of having robust community partnerships (Table 2). Stipulated by DPH, the establishment and use of community partnerships (coalition building) turned out to be both uniformly accepted and pragmatically beneficial for troubleshooting implementation challenges, especially for PSEs. The partnerships facilitated sharing of data, networking, and learning of key lessons that became a staple part of the problem-solving process for partners, especially when it came to logistical issues. The partnerships led to the establishment of several infrastructures that were larger than originally imagined. As an example, many partners wanted to deliver free fruits and vegetables to participants of their nutrition education classes but were not able to do so due to the cost and lack of infrastructure to transport produce. Through these community partnerships, strategies were devised to overcome the challenge, that is, several organizations stepped up to provide transport for the delivery of free produce to target class sites while others offered large-scale storage for the produce.
Discussion
During 2016–2020, DPH and its 24 funded partners were successful in delivering SNAP-Ed nutrition education and implementing PSEs in LAC, reaching millions of county households. Although previous research has documented the promise of multi-level public health programming for addressing conditions like obesity 10 and hunger, only a few have described the nuances of planning and implementing such a large-scale safety net program as SNAP-Ed. Results from the present program assessment sought to do just this, revealing 2 key lessons that were learned during the 3-year project which helped to scale and spread SNAP-Ed strategies to better reach populations disproportionately impacted by chronic disease. First, local health departments can plan and prioritize for centralized capacity building support for partner organizations to learn and develop skills and best practices in the field. Second, local health departments can facilitate community partnerships to increase communication, collaboration, and to troubleshoot implementation challenges, especially for PSEs.
In California, the SNAP-Ed LHD model has provided numerous opportunities for LLAs to tailor their planning and program delivery to fit the needs of the underserved populations they serve. 11 Among the benefits of the CDPH’s flexibility is the ability of LHDs to subcontract out SNAP-Ed interventions, choosing only high need cities within a supervisorial district or funding projects through a superintendent of schools. In LAC, use of local data helped prioritize the jurisdiction’s intervention selection and development, and concentrated resources in geographical areas (i.e., certain SPAs) where they were needed most.
Department of public health’s decision to partner with organizations that had on-the-ground experience resulted in a unique set of assets and learning opportunities that facilitated further capacity building and advancement of SNAP-Ed PSEs.12,13 DPH’s decision to rely strictly on population-level health data to prioritize resource allocation, however, did not fare as well. Too much emphasis on SPA geographies, in some instances, created artificial boundaries and other inflexible, structural/system barriers that slowed services delivery and PSE implementation. Although reliance on data is often seen as the first step to traditional program planning 14 and is usually well-intended, approaches grounded or driven primarily by data frequently miss the nuances of implementation and of how complex community contexts and capacity can be when it comes to implementation of a combination of individual and community-level interventions.
In LAC, community partnerships were generally perceived as very useful vehicles for partners to network, share resources, and receive logistical support. However, despite these advantages,15,16 there is growing research that suggest partnerships, particularly for implementing PSEs, can become particularly time- and labor-intensive. 13
Limitations
The results of the program assessment should be interpreted carefully and used with several limitations in mind. The qualitative data, for instance, may not be generalizable to other jurisdictions or communities. While other LHDs across California have similarly subcontracted SNAP-Ed services or resources out to partners, their circumstances, and the counties they serve may not be comparable to DPH’s. LAC’s geography is enormous and is substantially more diverse than 42 other states in the United States, suggesting that lessons learned in LAC may not be translatable elsewhere.
Conclusion
Planning and implementing a large government program such as SNAP-Ed at the local level requires strategic balance between meeting community-driven needs and adhering to federal and state requirements for the program. In LAC, implementing SNAP-Ed was a challenge because of the county’s sheer size, that is, SNAP-Ed eligible people likely exceeded 3.5 million during 2016–2020. Unfortunately, this number will likely continue to grow, especially as the economic toll from the coronavirus disease 2019 pandemic becomes more apparent in the upcoming years. Nonetheless, LAC will be more prepared for this increase in food insecure households, as lessons learned from 2016 to 2020 point to ways in which implementation challenges can be mitigated effectively. That is, a cohesive network of local partners has been established and can work to create opportunities for further capacity building and for fostering relationships between different sectors to solve issues that are mutually inclusive. Similarly, LHDs are well-positioned to leverage other large obesity and diet-related chronic disease prevention programs to complement the efforts of local SNAP-Ed interventions, further creating and strengthening systems of institutions and agencies that can collectively advance system-level determinants of health at a faster pace, with the goal of achieving health equity for the underserved in LAC and across the United States. The present program assessment showed that capacity building support from a local health department and the use of community partnerships to problem-solve implementation challenges can be useful approaches to scaling SNAP-Ed nutrition education and policy, systems, and environmental change interventions locally. A local health department can increase SNAP-Ed intervention reach and uptake by assisting funded partners with further capacity building, helping them to develop feasible work plans, foster evaluation skills, and engage in sustainability planning.So What?
What does this article add?
What are the implications for health promotion practice?
Supplemental Material
sj-pdf-1-ahp-10.1177_08901171211069128 – Supplemental Material for Use of Population Health Data and Qualitative Analysis to Guide Local Planning and Implementation of Supplemental Nutrition Assistance Program Education
Supplemental Material, sj-pdf-1-ahp-10.1177_08901171211069128 for Use of Population Health Data and Qualitative Analysis to Guide Local Planning and Implementation of Supplemental Nutrition Assistance Program Education by Julia I. Caldwell, Alina Palimaru, Deborah Cohen, Daniel Rizik-Baer, Dipa Shah-Patel and Tony Kuo in American Journal of Health Promotion
Footnotes
Author’s Note
This article describes the process of planning and implementation of SNAP-Ed at the local level in Los Angeles County from 2016 to 2020. SNAP-Ed includes nutrition education, physical activity promotion, and complementary policy, systems, and environmental change interventions (PSEs). Findings from 24 semi-structured interviews with project coordinators indicate that capacity building facilitated by the county health department and community partnerships were important in successfully implementing SNAP-Ed. Findings have practical implications for local-level entities to initiate and scale large obesity and other chronic disease prevention programs.
Author’s Contributions
All authors contributed to the conceptualization, data interpretation, and manuscript preparation. All authors have approved the final version for publication. Interpretation of the data are those of the authors and do not necessarily represent the views of the Los Angeles County Department of Public Health or any other organization mentioned in the text.
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project was supported in part by a contract from the California Department of Public Health to the Los Angeles County Department of Public Health (#16-10148) for work related to the United States Department of Agriculture’s Supplemental Nutrition Assistance Program Education.
Ethical Approval
This project received IRB approval from the Los Angeles County Department of Public Health Institutional Review Board (2014-09-535) prior to field implementation.
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
