Abstract
Abstract
Background:
The School Nutrition Advances Kids project tested the effectiveness of school-initiated and state-recommended school nutrition practice and policy changes on student dietary intake in low-income middle schools.
Methods:
Schools recruited by an application for grant funding were randomly assigned to (1) complete an assessment of nutrition education, policies, and environments using the Healthy School Action Tools (HSAT) and implement an action plan, (2) complete the HSAT, implement an action plan, and convene a student nutrition action team, (3) complete the HSAT and implement an action plan and a Michigan State Board of Education nutrition policy in their cafeteria à la carte, or (4) a control group. All intervention schools were provided with funding and assistance to make self-selected nutrition practice, policy, or education changes. Block Youth Food Frequency Questionnaires were completed by 1176 seventh-grade students from 55 schools at baseline and during eighth-grade follow-up. Nutrient density and food group changes for the intervention groups were compared to the control group, controlling for baseline dietary intake values, gender, race/ethnicity, school kitchen type, urbanization, and percent of students eligible for free or reduced-price meals. Analyses were conducted by randomization and based on changes the schools self-selected.
Results:
Improvements in students' nutrient density and food group intake were found when schools implemented at least three new nutrition practice changes and established at least three new nutrition policies. Students in schools that introduced mostly healthful foods in competitive venues at lunch demonstrated the most dietary improvements.
Conclusions:
New USDA nutrition standards for à la carte and vending will likely increase the healthfulness of middle school children's diets.
Introduction
Foods offered at school can play a major role in the overall quality of children's diets. 1 Passage of the Healthy, Hunger-Free Kids Act of 2010 and the new USDA Nutrition Standards in the National School Lunch and Breakfast Program highlight a national commitment to enhance the nutritional quality of foods available to children in schools, including competitive foods outside of federal school meals programs, such as those available in vending machines and à la carte.2,3 Recent national estimates suggest that virtually all high school students and 71–81% of middle school students have access to competitive foods of some kind during the school day, which nearly always have included unhealthy options.4–6 This will soon change because of the 2013 USDA interim final rule, Nutrition Standards for All Foods Sold in School as Required by the Healthy, Hunger-Free Kids Act of 2010, which was designed to improve the healthfulness of competitive foods in most school venues. 7
Many states and schools did not wait for federal regulations, but established their own competitive foods policies. In 2003, the Michigan State Board of Education (MSBE) adopted a nutrition policy recommending that schools offer and promote healthy foods and beverages in all competitive venues. That policy was superseded in 2010 by more comprehensive Michigan standards. 8 Such state policies have resulted in reductions in junk food available in schools and have been associated with healthier student dietary intake.9–11 Using data from the most recent School Health Policies and Practices Study conducted in 2006, researchers found that elementary and middle schools in states with firm policies to prohibit junk foods had less junk food than schools that were not under such policies. 12 Taber and colleagues found that high school students in California with standards for competitive foods reported consuming less fat, sugar, and total calories at school than students in states with no competitive standards. 11
Other school nutrition practices and policies also shape the nutrition environment and hence what children consume.1,13 These include practices such as marketing healthful foods in the cafeteria, hosting health fairs, and classroom nutrition education as well as policies such as eliminating the use of foods as rewards. These types of practices and policies are not mandated under the Healthy, Hunger-Free Kids Act and are up to individual schools to adopt and implement on their own. Since 2004, hundreds of Michigan schools have utilized the online Healthy School Action Tools (HSAT) 14 to assess their current policies and practices and create healthier school action plans. Many Michigan schools have also received small grant funding from various state organizations to implement their action plans.
Few controlled studies have evaluated the effects of implementing competitive foods policies and other school nutrition practices and policy changes on children's total diets. The School Nutrition Advances Kids (SNAK) project evaluated the effectiveness of various nutrition interventions, based on the HSAT, on low-income middle school children's nutrient density and healthy food group intake.
Methods
The SNAK project was a 2-year study conducted in low-income middle schools in Michigan from 2007 to 2010. Design elements included both a modified experimental intervention and a natural experiment, whereby schools were encouraged to make self-selected nutrition policy and practice changes and followed over time. Schools were recruited through an application for small grant funding with award values ranging from $2,000 to $4,600. Eligibility criteria included having 50% or more of students eligible for free or reduced-price meals and having seventh and eighth grades within the same building (for follow-up purposes). Recruitment methods included direct mailings, e-mails, and phone calls to eligible schools, as well as a posting on the Michigan Team Nutrition website. All study procedures and instruments were approved by the Michigan State University (MSU) Institutional Review Board. Collaborators included MSU Departments of Food Science and Human Nutrition and Epidemiology and Biostatistics, Michigan Department of Community Health, Michigan Department of Education (MDE), MSU Extension, Grand Rapids Public Schools, several partner agencies of the Michigan Action for Healthy Kids Coalition, and the University of Colorado Rocky Mountain Prevention Research Center.
The design involved two overlapping cohorts with schools recruited in 2007 and 2008 and follow-up assessments measured the next school year. Seventy-five schools were randomized into the four intervention groups. The 10 schools that did not initiate the project (usually because of misunderstanding the project scope or a change in personnel) were similar to schools that did in terms of percent of students eligible for free and reduced-price lunch (both 68%) and size [average enrollment was 370 students (standard deviation [SD], 130) vs. 490 students (SD, 211) for those who initiated the study]. The first cohort included 32 schools in 30 school districts participating from October 2007 to June 2009, and the second cohort included 33 schools in 20 districts participating from September 2008 to June 2010. Of the 65 schools that participated, 55 had both pre- and postintervention diet assessment measures from food frequency questionnaires (FFQs).
There were four study groups, including the control group (see Table 1). On their application, schools selected which of the study groups to which they were willing to be assigned. Fifty-six percent of schools selected all groups, 27% selected at least two groups, and 17% selected only one group. Schools that met the eligibility criteria and selected more than one group were randomized within the nutritional intervention groups they had selected, as well as within strata of school size and district. School size was stratified by schools with more than 200 seventh graders versus all others as well as school district by the largest two Michigan school districts versus all others. We randomized within these strata of schools to ensure balance. Schools that selected only one study group were assigned that group.
Summary of Interventions in the SNAK Project
Schools with pre- and post-FFQ data.
HSAT facilitator, substitute teacher pay to enable classroom teachers to participate in HSAT meeting, and funding for school nutrition education and/or marketing nutritious choices in cafeteria.
CSHT, Coordinated School Health Team; HSAT, Healthy School Action Tools; MSBE, Michigan State Board of Education; SNAK, School Nutrition Advances Kids.
Description of the Interventions
The HSAT, an online assessment and action planning process similar in content to the CDC's School Health Index, was a key component of all of the interventions. 15 With the HSAT intervention, Coordinated School Health Teams (CSHT)—with representatives from various sectors of the school, including administration, faculty, food service, healthcare, and students—completed a number of questions about their school regarding nutrition education, practices, and policies, were given ideas for improvement, and developed an action plan based on the assessment and their own priorities. The four intervention groups included the following:
1. Control Group schools participated only in data collection during the study period and were offered the HSAT intervention after the last data collection point.
2. HSAT Only intervention schools were asked to convene a CSHT. A trained facilitator met with the CSHTs one time to complete the HSAT nutrition module, and schools received $1000 funding to implement nutrition education or marketing aspects of their action plan.
3. Student SNAK Team intervention schools built upon the HSAT Only intervention by additionally providing a facilitator to work with a seventh-grade student team to assess school nutrition environments and policies, participate in the HSAT with the CSHT, and also provide $400 for the students to implement the nutrition education/marketing aspect of their own student action plan. A standardized curriculum was developed for the facilitator/student meetings, and each student team met with the facilitator three times. This intervention was intended as a pilot and had a reduced sample size (n=5 schools).
4. MSBE Nutrition Policy intervention schools, also built upon the HSAT Only intervention; in addition to developing their own action plan with funding for nutrition education/marketing, schools were asked to implement the 2003 MSBE Healthy Food and Beverage Policy 16 in their cafeteria à la carte lines during the study's second year and were provided with $1500 to compensate for any losses to their food service revenue. The SNAK research partner team reviewed current recommendations from the Institute of Medicine, 17 the Alliance for a Healthier Generation, 18 and the Michigan Action for Healthy Kids 19 and created nutrient and food standards for each food group. These standards were virtually identical to the new proposed standards issued by USDA, with sugars being limited to less than 35% of calories; differences include SNAK requirement for greater than 1 g of fiber for grain products, rather than that they be primarily whole grain, and less than 230 mg of sodium, rather than 200 mg. 20 Guidance documents and assistance were provided to the schools' food service professionals. Schools were asked to implement their plans before the second-year fall data collection.
Student-Level Dietary Intake
Active parental consent and student assent were obtained for participating students. The Block Kids FFQ 2004 (ages 8–17 years) was administered to assess usual student dietary intake.21,22 Online surveys were originally attempted, but discontinued because of lack of computer access and low participation by students. Students in cohort 1 completed the baseline survey between November 2007 and March 2008 (either online or paper) and the follow-up survey (paper only) October–December 2008. Cohort 2 students completed baseline surveys between November 2008 and February 2009 (paper only) and the follow-up survey between October 2009 and January 2010 (paper only). Students who returned consent, assent, and surveys received small prizes and were entered into a raffle for prizes, such as a bicycle.
Of 8626 seventh-grade students eligible for the study, 1777 responded with a completed consent form, assent form, and baseline surveys. Among those, 1274 completed follow-up surveys during eighth grade. Compared with schools with higher response rates (>= 40%), schools with lower response rates had larger student enrollments [average 531 students (SD, 212) vs. average 331 (SD, 108)], but a similar percentage of children eligible for free or reduced-price school lunch (71 vs. 70%). Surveys were removed from analysis if they had incomplete or “playful” patterns (i.e., always responded “every day”) upon visual inspection (baseline, n=14; follow-up, n=19), physiologically implausible values for energy intake (<500 or >5000 kcal/day; baseline, n=120; follow-up, n=69), or missing ethnicity data (n=17). Schools with fewer than five completed surveys were removed from analyses to conduct the hierarchical modeling (eight schools; baseline, n=28 students; follow-up, n=10 students). Two schools closed during the project and were not included in the final analysis. The 10 schools not included in the analysis (eight with too few completed surveys and two that closed) were similar to the remaining schools in terms of enrollment [average enrollment 420 students (SD, 189) vs. 490 (SD, 211)] and percent of children eligible for free and reduced-price school lunch [average percent eligible was 80% (SD, 13) vs. 68% (SD, 15)]. The final sample used to analyze student dietary intake consisted of 55 schools with 1176 students with both baseline and follow-up surveys.
Data on the gender and race/ethnicity of all children in each of the schools in the final sample were obtained from MDE 23 and compared to the SNAK sample using a test for proportion and chi-square goodness of fit. The SNAK sample had more females (58.7 vs. 49.3%; p<0.05) and fewer white children (48.3 vs. 55.2%; p<0.05) than the school data. However, students' race/ethnicity was identified by parents or school personnel in the MDE data, but self-identified in the SNAK data. There were differences in reporting categories between the MDE data (parents selected among African American, White, Hispanic, Asian, Native American, Native Hawaiian, and multiracial) and those available to students in the FFQ survey (students selected among African American, White, Hispanic/Latino, Asian, American Indian/Alaskan native, and other).
School-Level Measures
School characteristics
The percent of students eligible for free or reduced-price school meals at each school was obtained through the MDE. School setting (urban, rural, or suburban) was determined using 2000 US Census data. Type of food service program was determined through interactions with each school. A variable was created distinguishing kitchen types: traditional (a full-service or satellite kitchen in the district with food prepared on site); satellite kitchen district (large district with a central kitchen with limited preparation done on site); vendor operated (a vendor brings in prepared foods to the school); operations run by a local food service management company; smaller districts with heat-and-serve kitchens (without full cooking capacity); or a large district with a heat-and-serve operation.
Cafeteria à la carte and vending offerings
Standardized data collection forms were created, requesting information over a 5-day period on school breakfast and lunch, student-accessible vending machines, and à la carte foods at baseline and follow-up. Food service directors or other food service personnel were asked to complete these forms during the fall and spring of each study year. School food service programs received $325 for each round of data forms returned. All data were entered into Access databases for processing. Response rates ranged from 82 to 98% for each of the four data collection periods.
À la carte and vending
Schools were categorized at baseline and at follow-up as selling à la carte or vending during lunch if any additional foods or beverages were sold in the cafeteria, not including milk. Data collected for à la carte included items offered, visible nutrition information, amount in package/item, cost to school per item, selling price, meal time offered, and vendor code. Data collected on each vending machine available to students during meal times included location, hours turned on, number of slots, items available, size of package/item, selling price, and vendor code.
To verify whether schools had implemented the MSBE policy, analysis was conducted of the schools' à la carte line before the intervention and at follow-up. Some schools had vending machines on in the cafeteria during lunch, and thus changes made to vending machines available to students during lunch in the cafeteria (but not outside the cafeteria or during other times) were also included in the analysis. À la carte and vending items were categorized according to whether they met criteria for “healthy” as outlined by the MSBE policy. Percentage of healthy à la carte and vending items at each data collection period were calculated. Foods were considered to meet the MSBE policy if their nutrient profiles fell within 10% of the SNAK nutrient criteria provided to schools (e.g., SNAK guidance suggested less than 200 calories; we allowed up to 220). Entrée items that could be sold as part of a reimbursable school meal were not included. Schools were considered to have implemented the MSBE policy if 50% of the foods they served in vending or à la carte met the criteria or there was a substantial increase in the percentage of healthy foods offered. The verification process revealed that schools made a range of changes to their à la carte and vending during the intervention period (see Table 2).
Completion of Intervention Components by Study Group
Number of school-initiated nutrition practice changes made during the study period reported by the school administrator or food service professional, of 15 possible changes (see Table 3).
Number of school-initiated nutrition policies adopted during the study period reported by the school administrator or food service professional, of six possible polices (see Table 3).
HSAT, Healthy School Action Tools; MSBE, Michigan State Board of Education; SNAK, School Nutrition Advances Kids.
Nutrition practice and policy changes
The Middle-School School Environment and Policy Survey (SEPS) for administrators/principals and food service directors/kitchen managers was used to assess building-level nutrition education, practices, and policies at baseline and follow-up. This instrument was adapted from an Elementary-School SEPS developed for use in Colorado elementary schools 24 and was reviewed by several school food service and administration representatives to establish face and content validity. A $25 gift card was provided for each completed survey. Response rates ranged from 86 to 94%.
The follow-up SEPS ended with an item asking respondents to report on whether improvements had been made in 15 nutrition practices or whether they had adopted any of six nutrition policies since the beginning of the study (see Table 3). A new practice or policy was considered to have been adopted if either the administrator or the food service professional reported it. Two scale scores were created: the new nutrition practices (0–14; Cronbach's alpha=0.74) and new policies (0–6; Cronbach's alpha=0.76). Schools were then categorized by the number of new practices changes: 0–2, 3–6, or 7–14 changes; and the number of new policies adopted: 0, 1–2, and 3–6 (see Table 2).
Nutrition Practices and Policies
Statistical Analyses
To assess intervention effects on student dietary intake, nutrient and food-level intake assessed by the FFQ at follow-up were modeled as outcomes using baseline dietary intake as a control. For all models, hierarchical linear (SAS PROC MIXED; SAS Institute Inc., Cary, NC) and logistic (SAS PROC GLIMMIX; SAS Institute) regression analyses with the random intercept specified was used, taking into account variation within and between schools, following the protocol outlined by Singer.25,26 In all analyses, a p value<0.05 was considered statistically significant.
All nutrient and food-level FFQ outcomes were energy adjusted by dividing by total calories. Because most student nutrient and food intake variables were not normally distributed, all outcomes were log-transformed, except for percent calories from fat, saturated fat, sodium, intake of orange and leafy vegetables, and percent calories from sugar-sweetened beverages. Categorical outcomes were defined for two variables with extreme skewing: intake of orange and green leafy vegetables/1000 kcals was categorized into 0, >0–<5, 5–<25, and >=25 g, and percent calories from sugar-sweetened beverages were categorized into cut points: 0, >0–<5, 5–<10, 10–< 15, and 15–71.9%.
Analyses were conducted to determine the effect of study group assignment on dietary outcomes (experimental design) and also based on actual changes made to nutrition practice and policies: (1) changes made to the à la carte line and/or vending offerings to students during lunch; (2) school changes in nutrition practices excluding à la carte and vending; and (3) school changes in nutrition policies. Because the school nutrition interventions could affect all students in a school, this article reports analyses of all students combined, rather than specific subgroups. Analyses were adjusted for baseline dietary intake values (student-level variable), school setting (school-level variable), school kitchen type (school-level variable), percent of students eligible for free or reduced-price school meals (school-level variable), gender (student-level variable), and student-selected race/ethnicity (student-level variable). The interaction of student gender and race/ethnicity were found to be associated with multiple outcomes, and this interaction was also included in the models. Models were assessed controlling for school breakfast and lunch nutrients (e.g., analysis of changes in dietary intake of vitamin C controlled for changes in breakfast and lunch vitamin C from baseline to follow-up), but school meal changes were not statistically significant and they were left out of the models.
To interpret regression coefficients, the following calculations were made. For log-transformed outcomes, the exponents of the coefficients were calculated to determine the percentage additional change for the treatment group, compared to the control group (controlling for the baseline dietary intake value and other control variables). For the two categorical outcomes, exponents of the coefficients were calculated to determine the odds of being in the higher category for the treatment group, compared to the control group (controlling for the baseline dietary intake value and other control variables). For variables that were not log-transformed, coefficients are interpreted as the additional change in value for the treatment group, compared to the control group (controlling for the baseline dietary value and other control variables).
Results
Characteristics of schools and students included in the study and student dietary intake at baseline are shown in Tables 4 and 5. There were no significant differences among intervention groups with regard to school characteristics at baseline. The mean percentage of students eligible for free/reduced-price meals for schools in the SNAK project was 68% (range, 50–98%), which was similar to all Michigan low-income middle schools in 2007 (72%; n=514). There were some significant differences at baseline with regard to student dietary intake and all subsequent analyses adjusted for baseline dietary values.
Baseline School and Student Characteristics
HSAT, Healthy School Action Tools; MSBE, Michigan State Board of Education; SD, standard deviation.
Baseline Student Dietary Intake
Significantly different from the control group within the same gender after controlling for race/ethnicity, urbanization, kitchen type, and percent of children eligible for free/reduced-price meals.
HSAT, Healthy School Action Tools; MSBE, Michigan State Board of Education; SD, standard deviation.
Nutrient and food group changes (adjusted for total caloric intake) between baseline and follow-up for the three intervention groups were compared to the control group (experimental design; Table 6). When compared to the control group, students in the HSAT Only group significantly increased their fiber intake by 5.2%, fruit by 17.3%, and fruit plus juice by 13.8%; students in the Student SNAK Team group decreased their intake of vitamin C by 11.8% and increased their added sugars by 14.6%; and students in the MSBE Nutrition Policy group decreased their cholesterol intake by 6.7%, increased their fiber by 4.9%, and increased their fruit by 18.3%. When the Student SNAK Team and MSBE Nutrition Policy intervention groups were compared to the HSAT Only group, students in the Student SNAK Team also decreased their vitamin C intake (by 17.7%) and increased their intake of added sugars (by 21.8%; data not shown). Changes in student intake between baseline and follow-up were not significantly different between the MSBE Nutrition Policy group and the HSAT Only group (data not shown).
Results of Hierarchical Multivariate Regression Models to Examine Student Nutrient and Food Group Intake Changes Comparing Intervention Conditions Versus Control Group
All analyses controlled for baseline value, interaction of race*gender, kitchen type, urbanization, and percent of children eligible for free/reduced-price meals. FFQ outcome % calories from sugar-sweetened beverages did not converge.
y=(1 – exp(Coeff)) and is interpreted as percentage change for the treatment group, compared to the control group (n=17), controlling for the baseline value.
Coefficient=additional change for the treatment group, compared to the control group, controlling for the baseline value in milligrams.
y=exp(Coeff) and is interpreted as the odds of being in the higher category for the treatment group, compared to the control group, controlling for the baseline value. Categories include: 0, >0–<5, 5–<25, and >=25 g.
FFQ, Food Frequency Questionnaire; HSAT, Healthy School Action Tools; MSBE, Michigan State Board of Education; SNAK, School Nutrition Advances Kids; Coef, coefficient; CI, confidence interval; OR, odds ratio.
Changes to Lunch-Time à la Carte and Vending
Students in schools that started a healthy lunch-time à la carte or vending program increased their fiber by 12.6%, calcium by 7.9%, vitamin A by 15.4%, vitamin C by 18.4%, fruit by 26.7%, total vegetables by 14.5%, and whole grains by 30.5% and increased the odds of being in the next-higher category of orange and green leafy vegetables by 2.2 (see Table 7). There were no dietary improvements detected for the group that implemented the MSBE policy.
Results from the Natural Experiment—Cafeteria à la Carte/Vending Changes: Student Nutrient and Food Group Intake Changes Comparing Five Groups to the Group That Made No à la Carte/Vending Changes (n=994 Students)
All analyses controlled for baseline value, interaction of race/ethnicity*gender, kitchen type, urbanization, and percent of children eligible for free/reduced-price meals.
y=(1 – exp(Coeff)) and is interpreted as percentage change for the treatment group, compared to schools that did not change ALC/vending (n=21), controlling for the baseline value.
Coefficient=additional change for the treatment group, compared to the control group, controlling for the baseline value in milligrams.
y=exp(Coeff) and is interpreted as the odds of being in the higher category for the treatment group, compared to schools that did not change ALC/vending, controlling for the baseline value. Categories include: 0, >0–<5, 5–<25, and >=25 g.
y=exp(Coeff) and is interpreted as the odds of being in the higher category for the treatment group, compared to schools that did not change ALC/vending, controlling for the baseline value. Categories include: 0, >0–<5, 5–<10, 10–<15, and 15–71.9%.
FFQ, Food Frequency Questionnaire; ALC, à la carte; vend, vending; MSBE, Michigan State Board of Education; est CI, estimated confidence interval; OR, odds ratio.
Nutrition Practice and Policy Changes
As compared to schools that made 0–2 nutrition practice changes, students in schools that made 3–6 practice changes significantly increased their intake of fiber by 10.5% and fruit by 30.1%; students in schools that made 7–14 practice changes significantly increased their intake of fiber by 6.3% and fruit by 24.4% (p=0.10; data not shown). As compared to schools that made no nutrition policy changes, students in schools that made 1–2 policy changes significantly decreased their intake of whole grains by 12.0%, whereas students in schools that made 3–6 policy changes significantly increased their fruit intake by 24.3% (data not shown).
Discussion
In our study, improvements in student dietary intake were noted in the schools that started new vending or à la carte programs with almost entirely or entirely healthy choices, such as salads, fruits, and whole grain snacks. Other studies have shown that implementation of school interventions or state-wide policies that call for an increase in healthy food options, without a corresponding elimination of unhealthy options, show weak results on student intake.27–31 For example, one intervention eliminating certain snack foods from school snack bars, but not vending, showed a decrease in chip consumption from the snack bar, but the number of vending machines doubled during the intervention period, and consumption of snack chips and candy from vending, as well as ice cream sales, increased. 27 In contrast, implementation of new policies in Texas and California that called for the elimination of “unhealthy” items showed some positive effects on student dietary intake.22,27,32,33
Our findings raise some cautions regarding a popular belief that students have better diets when no competitive foods are available. The presence of competitive foods at lunch is associated with a decrease in students' consumption of the Federal School Meals Program lunch, fruits, vegetables, and key nutrients, such as calcium and vitamin A, and an increase in consumption of sugar-sweetened beverages and low-nutrient-dense snacks.1,34,35 However, these studies were conducted in the milieu that has existed up to this point, in which competitive foods consisted primarily of low-nutrient, energy-dense foods or beverages. 36 Few studies have examined the effect on student dietary intake when competitive foods offered are entirely or almost entirely healthy and offer students healthy options above and beyond the school meal programs.
Some observers question the value of improving the nutritional quality of competitive foods in schools, assuming that students who are denied popular snack foods in school venues will simply get them at home or buy them elsewhere. Our findings suggest otherwise. Unlike most studies of school nutrition environmental and policy changes, we measured students' total diets—not just foods eaten or purchased at schools—and showed dietary improvements with school-level changes.1,32,37–39
We also found support for the importance of tackling issues beyond competitive foods. Students in schools that made improvements in nutrition practices, including nutrition education, and policies in general, improved intake of key nutrients and food groups more than students in schools that had made few policy and practice improvements. Students in schools that only made 1–2 policy changes, however, showed a decrease in whole grain intake; this could point to a need to make more significant modifications than 1–2 policy changes. When we tested practices and policies individually, we did not find any one that stood out (data not shown); rather, we observed a threshold effect whereby making changes to at least three practices and adopting at least three policies improved students' diets. This is consistent with the conclusions of reviews of school-based interventions—that multi-component interventions have the greatest likelihood of improving student behaviors and body weight.40,41 The SNAK intervention schools were provided with funding for nutrition education improvements and/or marketing healthful foods in their cafeterias, and the majority of the SNAK intervention schools made 2–5 nutrition education or marketing-related changes (data not shown), which could have contributed to the interventions' successes. 42
In our study, results for the schools randomized to convene a student SNAK team on student dietary intake did not show improvements in diet and instead showed a decrease in vitamin C intake and increase in sugar intake. Process evaluation and exit interviews with the schools revealed that whereas some of the schools randomized to this group had some qualitative successes (e.g., the student SNAK team in one school convinced the school board to switch their food service vendor to a company more committed to serving healthy foods), they were not a homogenous group and each made quite disparate changes within their schools. Our sample size for the Student SNAK Team group (n=4 schools and n=94 students) was very limited for this intervention. The CDC has advised that student involvement is critical to the success of a nutrition policy, and students who become involved in school-based promotions have reported more healthful eating behaviors than less-involved students.13,29,43 Other interventions have successfully involved student leadership in enacting school improvements. The TEENS study team, for example, found that having students taste low-fat items being considered for introduction into the food environment was critical for their acceptance. 29 The TACOS study worked with student teams to conduct nutrition promotions in a randomized study of 20 secondary schools; more promotions were associated with a higher percentage of lower-fat snack sales. 31
There are many challenges when undertaking school-based nutrition interventions, and this study has several limitations. To maximize intervention implementation, the randomization process we used took into account the preferences of the schools. For example, schools that stated that they did not want to create a student SNAK team were excluded from the randomization to that group. Even so, we found that some schools did not complete the interventions as designed. When this occurred, reasons included competing priorities, low motivation, and/or inadequate guidance.
Likewise, we found it impossible to keep schools in the control group from making nutrition improvements. We believe that it would have been unethical to actively discourage schools from making improvements that they believed would improve kids' health. Many control schools were disappointed that they were not randomized into the intervention, actively told us so throughout the project, and went ahead and made nutrition-related changes. Three control schools even completed the HSAT during the intervention. Thus, our ability to detect effects when analyzing the data by the experimental design was greatly hindered. The planned natural experiment yielded fruitful results; however, our findings likely only apply to schools that are motivated to make nutrition policy and practice changes. Other school studies have discussed challenges with randomized designs and poor implementation.29–31,44
An additional limitation was the low response rates for the student surveys, primarily the result of the difficulty in receiving signed consent forms from parents. Compared to schools with higher response rates, schools with lower response rates had similar student family income levels, as measured by percent of students eligible for free and reduced-price lunch, but larger student enrollment. Results are therefore best generalized to smaller schools. Our response rate of 72% for student completion of follow-up surveys compares well with nationally representative surveys, such as the YRBSS. 45 Our response rate for completion of school-based food offerings was high (82–98%). Because we wanted to involve school professionals as active participants, we trained and paid food service professionals to fill out standardized forms for data collection. Receiving complete data about school food service operations, foods and beverages offered, and school lunch recipes from busy food service professionals proved challenging. However, during our exit interviews, we learned that many food service professionals implemented improvements based on what they learned through participation in the study.
Conclusion
In summary, findings from the SNAK project demonstrate that implementation of school-initiated nutrition practices and policies resulted in improvements in student dietary intake. If implemented strictly, the new USDA standards for school competitive foods options will likely increase the nutrient density of middle school children's diets and increase intake of fruits, vegetables, and whole grains.
Footnotes
Acknowledgments
The SNAK project was funded by the Robert Wood Johnson Foundation's Healthy Eating Research Program, the Michigan Department of Community Health, and the USDA Supplemental Nutrition Assistance Program–Nutrition Education, supported by the Michigan Department of Human Services under contract numbers ADMIN-07-99010, ADMIN-08-99010, and ADMIN 09-99010. The authors are grateful to the students and staff of the schools that participated in the SNAK project. In addition, the authors thank: Richard Miles; Deb Bailey; Deanne Kelleher; Paul McConaughy; Ann Guyer; Paul Baumgartner; Donna Hensey; Larry Merx; Dru Szczerba; Elaine Belansky; and Julie Marshall. The authors also acknowledge Julie Orth, Hali Sobzcek, Tiffany Chritz, Elizabeth Weber, Caitlin Fischer, Ellen Mang, and Allison Krusky for data-processing support, as well as Karen Petersmarck and Caroline Crawford for assistance with manuscript preparation.
Author Disclosure Statement
No competing financial interests exist.
