Abstract
Abstract
Background:
The Texas Childhood Obesity Research Demonstration project, a multicenter, multisystem approach to childhood overweight and obesity (OW/OB), included training and materials to support primary care clinics (PCCs) in addressing child OW/OB in the office. This study evaluated the impact over 24 months of brief training and practice-based support on primary care providers' (PCPs) perceived self-efficacy and practice behaviors.
Methods:
The PCPs at five Houston and seven Austin PCCs completed questionnaires at baseline (2012, n = 36), 12 months (2013, n = 30), and 24 months (2014, n = 34) follow-up. Mixed-effects linear regression models were used to compare changes in self-efficacy (15 items, responses 1–4: not at all confident to very confident) and practice behaviors (30 items, responses 0–4: never to always) in obesity-related screening and counseling, and to assess association between prior training and these outcomes.
Results:
Self-efficacy items for identification of (2.9 [0.1] vs. 3.3 [0.1]) and counseling about (2.8 [0.1] vs. 3.4 [0.1]) OW/OB-related parenting practices, and setting behavioral goals (2.9 [0.2] vs. 3.3 [0.2]) improved significantly (p < 0.05) between baseline and 24-month follow-up. Self-efficacy items with “confident” mean baseline scores that further improved included determining child OW/OB (3.6 [0.1] vs. 3.9 [0.1]) and interpreting BMI (3.6 [0.1] vs. 3.9 [0.1]). At all measurements, PCPs reported frequently addressing medical problems and lifestyle behaviors. Use of patient-centered counseling techniques, which was low at baseline, increased significantly, including asking permission before discussing lifestyle (1.5 [0.3] vs. 2.4 [0.3]). Prior training was associated with improved self-efficacy.
Conclusions:
The improvement in PCPs' self-efficacy and patient-centered counseling to address childhood OW/OB supports implementation of brief training and practice support in clinics that serve Medicaid-eligible children.
Background
Primary care pediatric providers confront the epidemic in childhood obesity daily. Over 18% of children aged 2–19 years have a BMI ≥95th percentile, and some practices serve populations with obesity prevalence >20%. 1 Pediatricians have reported low self-efficacy in addressing childhood obesity.2,3 In particular, providers perceive low confidence in counseling skills needed to address childhood obesity. Training has led to self-efficacy improvement,4,5 but evaluation of training impact has been minimal and short term. Studies have also examined reported practice behavior. 6 However, such studies have focused on counseling topics (e.g., fruit and vegetable consumption or screen time) rather than the counseling techniques used by providers. In addition, little attention has been paid to the recommended follow-up steps after a visit, such as return visit or referral to a dietitian.
The Texas Childhood Obesity Research Demonstration (TX CORD) project evaluated a multisystem approach to childhood obesity prevention and intervention for children aged 2–12 years, which included training and support for primary care providers (PCPs) and practices. The multiyear project provided an opportunity to assess provider self-efficacy in obesity-related counseling techniques and reported practice behavior over several years.
The aim of this study was to evaluate the change in provider-reported self-efficacy and practice behaviors from baseline to 24 months during the TX CORD intervention to improve child overweight/obesity (OW/OB) care in primary care practices. In addition, the study examined the relationship of past training in nutrition, physical activity, or obesity care with these changes.
Methods
Study Settings, Design, and Sample
The TX CORD project, an integrated, systems-oriented approach to primary and secondary childhood obesity prevention, was implemented in low-income catchment areas in Houston and Austin, Texas, between 2012 and 2014, and included implementation programs in different sectors: healthcare, elementary school, early childhood education, and community centers. The primary and secondary prevention components of the TX CORD study are further described elsewhere.7,8
The healthcare intervention took place in 12 primary care clinics (PCCs), whose patients were predominantly Hispanic (60%) and non-Hispanic Black (20%), on Medicaid or CHIP (72%), with rates of OW/OB comparable with national prevalence. 9 The five Houston PCCs were part of a large pediatric association and shared one electronic health record (EHR). The seven Austin PCCs were federally qualified health clinics or other safety-net clinics, comprising three different organizations, each with its own EHR. All but one Austin site served both adult and pediatric patients.
This study utilized a serial cross-sectional study design. PCP participation was voluntary, and no PCP refused. All PCPs received the clinic staff survey at baseline, at time of training (2012, n = 36); ∼1 year later, during active recruitment for the secondary prevention (interim, 2013, n = 30); and ∼2 years later, ∼9 months after secondary prevention enrollment was complete (follow-up, 2014, n = 34). PCPs received the interim and follow-up questionnaires to complete at their convenience. Study staff collected completed questionnaires.
PCC Intervention
The TX CORD PCC primary prevention strategies were aimed at improving recognition of patients 2–12 years of age with BMI ≥85th percentile (indicating OW/OB) and providing support for evaluation, prevention, and intervention of obesity within the constraints of Medicaid benefits. Resources included a set of office materials, Next Steps, which uses wall posters, flip charts with simple graphics, and a home activity book to guide providers and parents in healthy lifestyle counseling at individualized pace. 10 Offices also had information about community resources, such as farmers markets and recreational centers. In addition, the EHR used by Houston offices launched an alert when a patient 2–12 years of age had an elevated BMI, and offered a set of obesity-related diagnoses, laboratory orders, and referrals designed to streamline evaluation of children with OW/OB.
As part of the TX CORD project, a secondary prevention study compared an intensive community-based weight-management intervention, at nearby Young Men's Christian Associations (YMCAs), with PCC-based weight management. Enrollment in the secondary prevention was limited to patients from the 12 TX CORD PCCs who were referred and agreed to be randomized.7,8
At the start of the study, the PCPs received a 2-hour training on use of Next Steps material and EHR changes (if applicable), with a brief introduction to motivational interviewing, a technique providers can use to help patients and families identify their motivation for behavior change and which has shown to be useful in childhood obesity interventions. 11 PCPs received training in person, by webinar, or through a recording of a webinar depending on their preference. Research staff also made brief, informal visits to each office every 2–3 months during the first year and every 4 months in the second year, to restock Next Steps material as needed, encourage ongoing referral to the secondary prevention trial, and answer questions.
Study Measures
PCP characteristics
Information gathered from the PCPs included professional degree (MD/DO/NP/PA), gender, age, racial/ethnic background, years of experience in the current position and in the medical field, and prior training in clinical nutrition, physical activity education, and the management of children with OW/OB. In 2014, PCPs also reported whether they had received training in the TX CORD study at baseline.
Self-efficacy of the providers
Fifteen questions asked PCPs to rate their confidence in treating children with OW/OB. Items included calculating and interpreting BMI, and identifying and counseling about eating behaviors, physical activity, screen time, and sleep. Additional items focused on parenting practices, behavior goals, and motivational interviewing. Responses were recorded on a four-point Likert scale (1–4): not at all confident, not confident, confident, and very confident. A validated instrument assessed pediatricians' confidence in obesity prevention and treatment counseling. With the author's permission, we added topics (e.g., sleep, screen time) using the same construction: assessing confidence in identifying a behavior, then in counseling about the behavior. 5
Practice behaviors of the providers
The survey obtained PCPs' self-report of their routine evaluation when they addressed OW/OB. The items included discussion of BMI percentile; evaluation of obesity-related medical conditions; addressing nutrition, physical activity, and screen time; and use of community resources. In addition, PCPs reported use of patient-centered counseling techniques, including asking about family priorities and assessing readiness to change. The 17 items had responses on a five-point Likert scale (0–4) ranging from never to always. Another 13 items asked PCPs about frequency of referral and return-visit scheduling after such visits. Response options for these items were recorded on a five-point Likert scale (0–4): less than 10%, 10%–25%, 25%–50%, 50%–75%, and 75%–100%. The questions and responses were adapted from the Maine Youth Overweight Collaborative study. 12
The Institutional Review Boards of the University of Texas Health Sciences Center at Houston (UTHealth) Committee for Protection of Human Subjects, Baylor College of Medicine, and Seton Healthcare Family approved all procedures and protocols for this study (HSC-SPH-11-0513).
Statistical Analysis
For provider characteristics, we reported descriptive statistics as frequencies with proportions and conducted Fisher's exact chi-square tests to compare the characteristics across the years. For the self-efficacy and practice behavior individual items, we reported means with standard deviations.
Mean scales (ranges from 1 to 4) were created for the self-efficacy items: one assessing confidence in identification of obesity-related behaviors (five items), one assessing confidence in counseling about these behaviors (five items), and a third scale that included these 10 items plus 5 other self-efficacy questions (e.g., obesity recognition, setting behavior goals). Two mean scales (ranges from 0 to 4) were created for the practice behavior items: one assessing the frequency of evaluation of medical problems and lifestyle during visits addressing OW/OB (17 items), and the other assessing frequency of planned follow-up after visits addressing OW/OB (13 items).
Mixed-effects linear regression models with a random intercept term for PCC were conducted to examine whether the estimated marginal mean scores of the self-efficacy and practice behavior items and of the scales changed across the 3 years. Bonferroni corrections were made during each test to account for multiple comparisons. All data analyses were conducted using STATA software version 14.0 (College Station, TX).
Results
PCP Characteristics
At baseline, each practice had two to six providers (mean 4.0). The number of patients aged 2–12 years at each practice ranged from 225 to 6625 (mean 2230). Table 1 presents the description of the PCPs across the years. Turnover among the providers across the years is estimated at 25% based on the percentage of responders at the last survey reporting that they had been in the same position for >2 years. (To protect privacy, individual responders were not tracked.) Most providers were females, were physicians, and had at least 6 years of experience working in the medical field. About half of the PCPs reported >10 hours of training in clinical nutrition, and one-third reported >10 hours of training in treating children with overweight or obesity.
Sociodemographic Characteristics of Primary Care Providers by Year, 2012–2014
Differences across measurement times were not significant (p ≥ 0.05). Missing data for all variables of interest were <10%, thus, not reported in the table.
—, not applicable; CORD, Childhood Obesity Research Demonstration.
Self-Efficacy Change across the Years
Table 2 presents the estimated marginal mean scores of the self-efficacy items and scales over three measurement times. The means of 9 of the 15 items were >3 (“confident”). Scores of five items changed significantly (p < 0.05) from 2012 (baseline) to 2014 (follow-up): self-efficacy for diagnosing OW/OB (3.6 [0.1] vs. 3.9 [0.1]); interpreting BMI (3.6 [0.1] vs. 3.9 [0.1]); identifying (2.9 [0.1] vs. 3.3 [0.1]) and counseling (2.8 [0.1] vs. 3.4 [0.1]) about OW/OB-related parenting practices; and setting behavioral goals (2.9 [0.2] vs. 3.3 [0.2]). The marginal mean scores of the self-efficacy counseling scale and combined scale also increased significantly between 2012 and 2014 (3.1 [0.1] vs. 3.4 [0.1], p < 0.05 for counseling scale; 3.2 [0.1] vs. 3.5 [0.1], p < 0.05 for combined scale). The identification scale did not change, nor were there significant differences between 2013 (interim) and 2014 (follow-up) in scores of any of the self-efficacy items and scales.
Self-Efficacy Items and Scales by Year, 2012–2014
Estimated marginal means from the mixed-effects linear regression models with Bonferroni correction. Shared superscripts indicate significant difference (p < 0.05) between measures.
For 2013 versus 2012.
For 2014 versus 2012.
For 2014 versus 2013.
SE, standard error.
Practice Behavior Change across the Years
Marginal means of the practice behavior items and scales across the 3 years were also examined (Table 3). Likert responses ranged from 0 to 4: never, rarely, once in a while, sometimes, and always. PCPs reported high rates of routine evaluation of obesity-related medical problems and addressing lifestyle at baseline, with no significant increase at interim. Use of patient-centered counseling techniques was low at baseline and increased at interim, including asking permission before discussing lifestyle (1.5 [0.3] vs. 2.4 [0.3], p < 0.05), asking which lifestyle issues are important (2.0 [0.2] vs. 2.6 [0.2], p < 0.05), and assessing patient/family confidence (2.4 [0.2] vs. 3.0 [0.2], p < 0.05). There was a significant increase in practice behavior scale measuring PCPs' routine treatment of OW/OB among all patients between baseline and interim (3.2 [0.1] vs. 3.5 [0.1], p < 0.05).
Evaluation and Counseling Practice Behavior Items and Scales by Year 2012–2014
Estimated marginal means with standard errors for the individual from the mixed-effects linear regression models with Bonferroni correction. Shared superscripts indicate significant difference (p < 0.05) between measures.
For 2013 versus 2012.
For 2014 versus 2012.
For 2014 versus 2013.
—, model did not converge.
Between 2013 and 2014, none of the mean scores of the practice behavior items and scales changed. As shown in Table 4, planned follow-up did not change; the estimated marginal mean scores of the practice behavior items and scales measuring PCPs' schedule and referral frequency for OW/OB patients with/without comorbidity did not differ significantly across the intervention.
Planned Follow-Up Practice Behavior Items and Scales by Year 2012–2014
Estimated marginal means with standard errors for the individual from the mixed-effects linear regression models with Bonferroni correction. Shared superscripts indicate significant difference (p < 0.05) between measures.
For 2013 versus 2012.
For 2014 versus 2012.
For 2014 versus 2013.
Training
Table 5 displays the association between the reported prior training and the scales of self-efficacy and practice behavior. Training in physical activity education was associated with significantly higher scores at interim and follow-up for self-efficacy identification scale (2013: β = 0.5 [0.2], p < 0.05; 2014: β = 0.5 [0.2], p < 0.01) and counseling scale (2013: β = 0.5 [0.2], p < 0.01; 2014: β = 0.6 [0.2], p < 0.05). Training in child OW/OB was also associated with higher scores at the two follow-ups for self-efficacy identification scale (2013: β = 0.5 [0.2], p < 0.01; 2014: β = 0.5 [0.2], p < 0.01) and counseling scale (2013: β = 0.5 [0.2], p < 0.01; 2014: β = 0.4 [0.2], p < 0.05).
Associations between Trainings in Nutrition/Physical Activity/Child Overweight and Obesity and Self-Efficacy and Practice Behavior Scales, 2012–2014
Beta-coefficients with standard errors from the mixed-effects linear regression models. Significant beta-coefficients in bold.
ns = p value ≥0.05.
ns, not significant.
Prior training had little association with practice behavior scales: clinical nutrition training correlated with higher evaluation and counseling practice behavior scale at baseline only (β = 0.3 [0.1], p < 0.05), and training in child OW/OB was negatively associated with after-visit plan in 2014 only (β = −0.7 [0.3], p < 0.05).
Discussion
During a multisystem intervention in childhood obesity, medical providers in 12 primary care offices improved self-efficacy and practice behavior at 12 and 24 months compared with baseline measures. Specific areas of improved self-efficacy included counseling about sleep and use of behavior change strategies. Areas of evaluation and counseling practice behaviors that improved were patient-centered counseling approaches, which had low frequencies at baseline. Discussion of BMI, evaluation of medical conditions, and addressing lifestyle (all evaluation and counseling behaviors reported to be frequent at baseline) did not change significantly, nor did planned follow-up practice behaviors.
Prior training in physical activity education and child OW/OB education was associated with higher scores in both self-efficacy identification scale (confidence in identifying lifestyle factors associated with OW/OB) and self-efficacy counseling scale (confidence in counseling about lifestyle factors associated with OW/OB).
At baseline in this study, the providers reported high self-efficacy for the established foci of obesity management, including BMI assessment, eating behaviors, physical activity, and screen time. However, self-efficacy for addressing sleep behaviors, a behavior more recently recognized as associated with obesity, 13 as well as for parenting, goal setting, and use of motivational interviewing, were lower at baseline.
Previous studies have shown that confidence of pediatric providers has been higher for identifying OW/OB and managing medical comorbidities than for counseling skills used in addressing obesity.2,3,14,15 The baseline ratings among the TX CORD providers were very similar to ratings of community providers in Perrin's study for the parallel questions of identification of and counseling about eating behaviors and physical activity behaviors. 5 Other studies have also found that providers rated confidence in assessment strategies for OW/OB higher than confidence in counseling and interventions.6,16,17
The improvement in self-efficacy scores at 12 and 24 months, after correcting for multiple comparisons, is notable; the overall counseling score rose over the 2 years in contrast to the identification score, suggesting that the TX CORD training and intervention were especially beneficial for provider counseling for OW/OB. Other studies have demonstrated an effect of brief training on self-efficacy, but the longest time to reassessment was 6 months. In a study in a single practice (seven providers), 3 hours of training was associated with improved confidence at 6 months in assessment of readiness to change. 4 Another study with 2 hours of training, including the “5 A” provider steps to counsel patients (ask, advise, assess, assist, and arrange), reported improvement in self-efficacy immediately after training. 6 One-hour training in addressing obesity and motivational interviewing led to significant improvement in confidence at 4 months. 5
Our study demonstrated maintenance of higher self-efficacy scores between 12 and 24 months for most counseling topics. This suggests that the TX CORD clinic intervention process, which included training, office-based tools, and informal support from team, led to sustained impact on self-efficacy, with changes most notable in counseling areas (parenting, goal setting, and the five-item counseling scale).
In parallel with improved self-efficacy in counseling areas related to child OW/OB, reported frequency of patient-centered counseling practice behaviors rose between baseline and 12 months, and had no significant decrement between 12 and 24 months. The reported frequency at baseline for these counseling strategies was lower (means <3, which denoted “sometimes”) than the reported frequency of more conventional obesity care, which includes medical assessment and nutritional education, for example. The increase in reported frequency of patient-centered counseling practice behavior suggests that these techniques were unfamiliar at the start of the study but were adopted after training and support and were sustained. In contrast, the intervention had no effect on planned follow-up (return visit, referral to a dietitian, or referral to structured weight-management program), despite attention in the training to when and how to make referrals.
Several recent studies show high reported frequency of assessment of behaviors that are conventionally associated with obesity, both through provider report6,18 and through chart audit. 19 Counseling about sleep, more recently recognized as associated with obesity risk, was reported in one other study, from 2016, with results similar to this study's baseline results. 19 Use of counseling methods, including patient-centered focus, is not always assessed, 19 or assessment has been narrow. One study assessed documentation of patient wellness goals at single time point, 18 and another audited charts of children with high BMI for documentation of motivational interviewing, which increased after training from 0% to 35%. 20
Our study suggests that relatively brief training of providers from multiple offices improves reported use of patient-centered counseling. The increased use of motivational interviewing despite no self-efficacy improvement may result from the brevity of the training; providers may have used the technique without feeling fully confident in their skill level.
The lack of significant decreases in scores between interim (2013) and follow-up (2014) suggests that providers maintained the changes in self-efficacy and behaviors, despite less contact and check-ins by study staff. We speculate that improvement continued in the last year because providers found these tools useful and relevant, and these techniques were consistent with secular changes in the focus on childhood obesity, but confirmation would require a larger sample size, a controlled condition, or more focused qualitative work with the providers.
The lack of increase in use of follow-up appointments and referrals was disappointing because the TX CORD intervention highlighted available programs, the training included recommendations for follow-up after primary care evaluation, and the practices had materials to guide the referral process. Responders indicated that lack of reimbursement under Texas Medicaid for obesity was not a common reason. Although not assessed, the lack of availability of dietitians and long wait times for tertiary obesity program may have contributed to the low referrals. One study, carried out in a single practice, successfully increased return visits when EHR modifications were created to support standard obesity care practices, including follow-up visits. 20
Prior training (defined as ≥10 hours) in child overweight and obesity and in physical activity education were positively associated with both self-efficacy identification and counseling scales although training in nutrition was not. This association suggests that brief training may have more effect when prior training has occurred; however, prior training may instead be a marker for interest and motivation. Further study with larger samples and detailed information about prior training are needed.
In contrast, training was not positively associated with reported practices (either evaluation and counseling or after-visit plan) with the exception of a baseline association between clinical nutrition training and evaluation and management scale. Further study should explore whether lack of after-visit planning reflects provider attitudes or external barriers.
Other research in this area is limited. Prior training was often not assessed, or was assessed but not examined for association with attitudes.2,6 One study found an association between obesity training and higher self-efficacy and reported behaviors, but because the study was cross-sectional, it did not examine whether prior training enhanced effect of current training. 17 One study compared live and web-based training on knowledge and skills, assessed through simulation, among nursing students, and found no moderator effect of prior training immediately after training and 1 month later. However, only 15% of participants reported experience with prior weight-related training. 21
Strengths of this study include the 12- and 24-month evaluation after the training, longer than other reports, and the setting in busy, nonacademic pediatric practices. The clustering analysis and correction for multiple testing increase the statistical reliability of the findings. Limitations include the self-report of practice behavior, the small sample size, no tracking of individual providers over the intervention, and lack of a control group.
In conclusion, this study demonstrates that brief training and materials for childhood obesity care in primary care settings can result in improvement in PCP self-efficacy for behavior change skills and in reported practice behaviors, and these improvements are sustained for over a year. Prior training was associated with positive effects, suggesting that repeated, brief trainings of PCPs are beneficial for improving self-efficacy of provider OW/OB screening and counseling. Future studies should use a more rigorous, prospective design to document the impact of provider training and intervention on practice behavior, on family behavior, and ultimately on child weight. Other areas of investigation could include the association of provider interest in training with change in self-efficacy and practice behavior and also exploration of different behaviorally oriented approaches to the training.
Footnotes
Acknowledgments
This research was supported by cooperative agreement U18DP003377 from the CDC. The content is solely the responsibility of the authors and does not necessarily represent the official views of the CDC. Additional support was provided by the Michael and Susan Dell Foundation through the Michael & Susan Dell Center for Healthy Living. This work is a publication of the USDA (USDA/ARS) Children's Nutrition Research Center, Department of Pediatrics, Baylor College of Medicine, Houston, Texas, and had been funded, in part, with federal funds from the USDA/ARS under Cooperative Agreement No. 58-6250-0-008. The contents of this publication do not necessarily reflect the views or policies of the USDA, nor does mention of trade names, commercial products, or organizations imply endorsement from the US government. The authors thank Allison Marshall MSSW, MPH and Natalie Neumann for their assistance.
Author Disclosure Statement
No competing financial interests exist.
