Abstract
Purpose
The purpose is to compare the predictive utility of alternate measures of diet and physical activity for overweight and obesity among low-income minority women.
Design
Cross-sectional analysis of baseline data from a cohort study.
Setting
Three public housing developments in South Los Angeles.
Subjects: Adult women (N = 425).
Measures
Primary outcome—weight status (normal BMI, overweight, or obese). Primary predictors— diet: 24-hour dietary recalls (Healthy Eating Index), dietary screener (intake of specific food groups), and single-item survey question (diet quality); physical activity: accelerometry (minutes/day of moderate-to-vigorous activity), short recall questionnaire (minutes/week of moderate and vigorous activity), and single-item questions (days per week did exercise; self-assessment of overall activity level).
Analysis
Multinomial logistic regression models, controlling for socio-demographic covariates. Models are built up starting with least resource-intensive measures of diet and physical activity (single items) and sequentially adding more resource-intensive measures. Model performance is assessed via information-based model selection indices.
Results
Adjusted relative risk for obesity for single-item measures ranged from .61 to .64 for diet (P < .01) and from .80 to .81 for physical activity (P <.05). The added value of resource-intensive measures was negligible for physical activity and at best small for diet.
Conclusion
Single-item questions for diet and physical activity can provide valuable information about risk for overweight and obesity in low-income minority women when more resource-intensive assessments are infeasible.
Keywords
Introduction
Overweight and obesity are a major public health concern and place a disproportionate and growing burden on low-income and Hispanic and non-Hispanic Black women.1,2 Addressing these disparities requires developing a better understanding of diet and activity behaviors and their association with overweight and obesity in low-income, minority populations.
Conceptually, there are several aspects of diet and activity that may be of interest such as total energy intake, diet-quality, -variety, or -patterns, total energy expenditure, time spent doing vigorous and moderate activity, or fitness for physical activity. A wide range of assessments have been used in population studies to measure these aspects of diet and physical activity.3,4 These assessments are primarily based on self-reports and range from single-item measures, to short and long recalls over a pre-specified period, to detailed diaries and logs of diet and activity. A central question is which conventional measures of diet and physical activity are most informative, more specifically, most predictive of overweight or obesity, in at-risk populations.
The validity of these alternate assessments has been studied extensively.4,5 The emerging consensus is that there is no single best measure that optimizes both validity and cost or feasibility in population-based studies, nor is universally applicable in different contexts (e.g., across regions within states or across countries) or across populations (age, race/ethnicity, income, literacy, etc.). Experts have suggested administering multiple measures in a study to maximize the strengths of each measure when the budget allows.6,7 However, there are two key gaps in the literature that we seek to address in the present study. First, the bulk of the validation literature is conducted in Caucasian samples, 5 so more evidence is needed in minority populations, which bear the larger burden of overweight and obesity. Second, the diet and physical activity validation literatures have been largely siloed, despite both contributing to overweight and obesity. Although there is not yet a consensus causal model of how physical activity interacts with food intake to influence body composition status, both are critical components of the overall energy expenditure 8 and the joint improvement on both aspects was shown to induce larger long-term weight loss than focusing on one aspect alone. 9 Our study intends to build upon the limited literature10-13 by systematically examining the predictive utility of diet and physical activity measures for body composition simultaneously.
In this paper, we compare the performance of alternate measures of diet and physical activity for predicting overweight and obesity in a sample of low-income minority women. Our goal is to assess whether measures based on approaches that are more time and resources-intensive (i.e., dietary recalls and accelerometry) add value over easy-to-administer single-item measures in terms of their predictive utility for overweight and obesity.
Methods
Study Design and Sample
Our data come from the Watts Neighborhood Health Study, an ongoing longitudinal cohort study of low-income urban public housing residents located in South Los Angeles. Briefly, the study is designed to examine the impact of a community redevelopment on residents’ obesity and related behaviors. The study recruited adult residents from three public housing developments in the Watts neighborhood over a 2-year period (2018–2019). A total of 868 adults were recruited and two waves of baseline data were collected during this period, prior to the beginning of the redevelopment. Adults who were recruited in year 1 were invited to participate in both rounds of baseline data collection (N = 494), whereas those recruited in year 2 only participated in one round. Over the two waves of baseline data collection, we administered a few different diet and physical activity assessments allowing us to study how they correlated with each other and compare their performance in terms of how well they predicted objectively measured overweight and obesity status in this high-risk population.
This study uses data on adult women who participated in both waves 1 and 2 (n = 425). There were 45 men who participated in both waves, but were excluded from the analyses due to small sample size. The higher participation of women is not unusual and is in line with the demographic composition of public housing developments; about 56% of housing units at the three study sites are female-headed with children. 14
In both waves, respondents participated in a Computer-Assisted Personal Interview (CAPI) and body composition measurements by trained study staff.
Measures
Body Mass Index, Overweight, and Obesity
Trained study staff measured participant’s height and weight using a standardized protocol. Height was measured using a stadiometer (Charder HM200P Portstad Portable Stadiometer, Charder), rounded to the nearest .1 cm. Weight was measured using a Tanita UM-081 digital scale, recorded to the nearest .1 kg. Prior to each wave of data collection, accuracy of each scale was assessed by study staff using a standardized 5lb weight. All participant measurements were taken at least twice, and a third measurement was taken if the two measurements differed by a pre-determined amount (>0.5 cm for height and >0.2 kg for weight). The average of the two closest measurements was used as the final measure. BMI was computed as the ratio of the measured weight [kg] to height [m]-squared. We constructed indicators of normal weight, overweight, and obese, where normal weight is defined as BMI <25, overweight is defined as BMI between 25 and <30, and obesity is defined as BMI at 30 or higher.
Diet and Physical Activity
We first administered the assessments that are considered to have higher validity—24-hour dietary recalls for diet, and accelerometry for physical activity. However, these assessments presented several challenges in this population, including logistics, compliance, mistrust, and respondent burden. Therefore, shorter and easier assessments were added thereafter, creating the opportunity to compare the predictive utility of the different measures in this population, with respect to the outcomes of interest— overweight and obesity. These measures are described in detail below.
Three different dietary assessments were administered at baseline, including 24-hour dietary recalls, a brief dietary screener, and a single-item question for self-reported overall diet quality.
Dietary Recalls: Two interviewer-assisted 24-hour dietary recalls were conducted using National Cancer NCI’s ASA24® 24-hour recall tool. 15 The tool guides respondents through multiple steps of recalls including meal-based list, gap review, detailed pass, forgotten foods, and a final review. It also asks respondents if the recall captures usual intake, more-than-usual intake, or less-than-usual intake. We used data from the ASA24® to create the Healthy Eating Index (HEI), 16 a measure (0–100) of diet quality to assess how well food intake aligns with key recommendations of the Dietary guidelines for Americans. We also computed average cups of fruit and vegetables per day, average ounces of whole grains per day, and average cups of dairy per day from the food recall data for sensitivity analyses.
Dietary Screener: Adult participants completed the National Cancer Institute’s (NCI’s) Dietary Screener Questionnaire (DSQ) to assess consumption frequency of key food groups. 17 Respondents were asked how often each item was consumed in the past 30 days (never, 1 time, 2–3 times, 1 time per week, 2 times per week, 3–4 times per week, 5–6 times per week, 1 time per day, and 2 or more times per day). Using the data from the DSQ, we constructed measures of predicted cups of vegetables including legumes but excluding french fries per day, predicted ounces of whole grains per day, predicted cups of dairy per day following data processing and scoring procedures developed for the National Health and Nutrition Examination Survey. 18 In separate analyses not shown here, we also included predicted teaspoons per day of added sugars from sugar-sweetened drinks but it was excluded from the present analyses as higher reported sugar intake was associated with lower relative risk of overweight and obesity, suggesting either underreporting of or reduced intake of sugar-sweetened drinks among those who have higher body fat composition.
Single-item Diet Quality Question: Participants were also asked a single-item validated19,20 self-reported measure of overall diet quality: “In general, how healthy is your diet? Would you say it is… Excellent (5), Very good (4), Good (3), Fair (2), Poor (1).”19,20
Assessment of physical activity (PA) included accelerometer-assessed moderate-to-vigorous physical activity (MVPA), a short recall of leisure time physical activity, and two single-items for self-reported overall physical activity.
Accelerometer-Assessed Physical Activity: Participants were also asked to wear an Actigraph, Inc. wGT3X-BT accelerometer on their waist for 7 days to collect continuous physical activity data. Moderate-to-vigorous physical activity (MVPA) was defined as at least 2020 counts per minute, consistent with other studies. 21 Total minutes of MVPA during each valid day was computed. 21 We calculated the average minutes per day of MVPA for up to 7 valid days of accelerometer data among participants with at least 2 days of valid data.22-24
Short Recall of Leisure Time Physical Activity: Adults reported days per week and minutes per day of moderate and vigorous activity outside of work for the past week, similar to the National Health and Nutrition Examination Survey.25,26 Specifically, adults were asked, “During the last week, on how many days did you do vigorous physical activities for 10 minutes or more at a time, like circuit weight training, sports (basketball, soccer, baseball), Zumba, heavy housework, running, when you were NOT at work?” If participants did vigorous activity on one or more days, they were then asked, “How much time did you usually spend on 1 of those days doing vigorous physical activities when you were not at work?” Similar questions were asked for moderate physical activity, such as carrying light loads, bicycling, gardening, putting groceries away, skateboarding, moderate housework, or fast walking. Vigorous and moderate physical activity measures were each capped at 2940 min per week to avoid distortion of the results due to implausibly large values. Adults also reported time spent watching TV and playing video games. We constructed a measure of total weekly time spent on these sedentary activities, capped at 3360 minutes per week. Time spent on these three types of activities were used as separate predictors in the analysis, allowing a more nuanced model specification.
Single-Item Physical Activity Questions: We developed two single-item questions about physical activity to address two concerns with the other self-reported measure. First, given that the moderate and vigorous activity self reports had to be capped for some respondents, it suggested that the distinction between moderate and vigorous physical activity was not consistently clear to respondents despite providing visual examples and textual explanations of each type. And second, the sample varied considerably in terms of age, disability/health status, and education levels, so a question that was simple to interpret for respondents of varying backgrounds was needed. The first question was a global measure of physical activity level that asked adults to rate their level of daily physical activity on a scale of 1 to 10 (On a scale of 1 to 10, where 1 means you spend most of your day sitting or lying down and 10 means you spend most of your day moving around on your feet, how physically active are you? 1 means spend most of day sitting or lying down; 10 means spend most of day moving around on feet). The second question asked on how many days they were physically active for at least 20 minutes at a stretch during the past week. 27
Covariates
Adults reported the following covariates: age (18–34, 35–54, and 55 or older), ethnicity (Hispanic and non-Hispanic), education level (less than high school, high school graduate, more than high school, and some college/technical school or higher), household income ($9,999 or less, $10,000–$19,999, and $20,000 or more), coupled (married or living as married), and working on a paid or unpaid basis.
Analysis
The analyses were restricted to adult women who completed both waves of the surveys (N = 425), excluding 24 cases with missing variables other than the accelerometer data. For a total of 76 cases that were missing accelerometer data, we imputed their MVPA minutes per day using regression-based multiple imputation with other PA variables as well as dietary and demographic variables, and averaged across the 20 imputed sessions. 28 We examined the summary statistics describing the variable distributions, including correlation among dietary and PA measures with Pearson and Spearman’s rank correlations.
The primary analyses rely on the multinomial logistic regression predicting the probability of being in one of three BMI categories (normal weight, overweight, and obese) using the dietary or PA measures. For each domain (i.e., diet and PA), we ordered the measures by the easiness and cost-efficiency to administer the assessment. For diet, the order was single item, then dietary screener (DSQ), and lastly 24-hour dietary recall (ASA24®). For PA measures, the order was single items, short recall of leisure time physical activity, and accelerometer-assessed MVPA. The model was built up by adding one type of measure at a time.
Selection of the most parsimonious model, or essentially, the most predictive and efficient sets of variables, was determined by several criteria that strive to balance the statistical significance, interpretability and practical value. We considered a costlier assessment to have added value if (a) the derived measures significantly predicted overweight and/or obesity status with clinically meaningful effect size, (b) the model-data fit was significantly poorer when the derived measures were omitted based on the likelihood ratio test, in consideration of other information-based model selection indices such as Akaike’s information criterion (AIC) and Bayesian information criterion (BIC), 29 or (c) inclusion of such derived measures meaningfully increased the overall predictive power of the model according to McFadden’s R2, a popular pseudo-R2 statistic. 30 Such a measure selection process was performed on dietary and PA measures separately, and the final selected measures were used jointly in the same model to predict the likelihood of normal weight, overweight, or obese status.
Statistical sensitivity analyses were also conducted to investigate the robustness of the findings. Specifically, we replicated the above analyses restricting to the subsample that had complete accelerometer data, as a check for the robustness due to multiple imputation. In addition, we performed the model building using (a) alternative ASA24®-derived measures (average cups of fruit and vegetables per day, average ounces of whole grains per day, and average cups of dairy per day, adding quadratic term of HEI), (b) the sample with 2 completed ASA24® recalls, or the sample with only recalls that represent usual intake, and (c) the sample with at least 4 days of valid accelerometer data (to increase reliability. 31 Furthermore, as an alternative to using the predictors as continuous variables, we also conducted the analyses after categorizing the variables, with thresholds recommended in the literature or, if not available, by splitting the variable at the observed median. Finally, we replicated the measure selection process when severe obesity, with BMI≥40, was considered as an additional outcome category, separated from non-severe obesity (i.e., 40>BMI≥30).
Analyses were performed using Stata, version 16. All models adjusted for age, race/ethnicity, education, household income, married or living as married, and working status.
Results
Sample Descriptive Statistics (N = 425).
DSQ: Dietary Screener Questionnaire.
ASA24®: Automated Self-Administered 24-hour Dietary Assessment Tool.
Correlation of Dietary and Physical Activity Measures (Lower Triangle: Person’s Correlation; Upper Triangle: Spearman’s Correlation).
DSQ: Dietary Screener Questionnaire; ASA24®: Automated Self-Administered 24-hour Dietary Assessment Tool; MVPA: moderate-to-vigorous physical activity.
Adjusted Relative Risk of Dietary Measures Predicting Obesity Groups.
* P < .05, ** P < .01, *** P < .001.
DSQ: Dietary Screener Questionnaire; ASA24®: Automated Self-Administered 24-hour Dietary Assessment Tool.
Model 1 includes single-item diet quality; Model 2 adds dietary screener variables; Model 3 adds Health Eating Index from the ASA24® dietary recall.
All models include age, ethnicity, education level, household income, coupled, and working on paid or unpaid basis.
Models were then assessed and compared by whether the additional predictors improved the model-data fit or enhanced the explanatory power of the outcome variability. The likelihood ratio test suggests that adding DSQ variables beyond the single-item overall rating of dietary quality (Model 2 vs 1) did not significantly improve the model-data fit (χ26 = 9.98, P > .05), and the information criterion, AIC and BIC, also increased, implying that the little gain in model-data fit did not sufficiently compensate for the increase in model complexity, favoring the simpler model with overall dietary quality only. However, the pseudo R2 increased from .076 to .089 after including the DSQ variables, suggesting that the DSQ variables helped to explain more variability in obesity status. When assessing the added value of ASA24® HEI (Model 3 vs 2), both the likelihood ratio test (χ22 = 6.41, P < .05) and AIC (decreased from 735.9 to 733.5) favored inclusion of HEI, but the BIC increased (from 849.4 to 855.1). The pseudo R2 also increased with HEI. Although the model comparisons suggest that the addition of the ASA24® HEI resulted in marginal improvement in model-data fit, the coefficient estimate on the ASA24® HEI was counter-intuitive, with higher index of diet quality associated with higher risk of overweight and obesity. Therefore, Model 2 was favored, which included the single item for self-reported overall diet quality and measures derived from the DSQ.
Adjusted Relative Risk of Physical Activity Measures Predicting Obesity Groups.
* P < .05, ** P < .01, *** P < .001.
MVPA: moderate-to-vigorous physical activity.
Model 1 includes single-item physical activity items; Model 2 adds short recall of leisure time physical activity items; Model 3 adds accelerometer-assessed physical activity.
All models include age, ethnicity, education level, household income, coupled, and working on paid or unpaid basis.
Adjusted relative risk of selected diet and physical activity measures predicting obesity groups.
* P < .05, ** P < .01, *** P < .001.
DSQ: Dietary Screener Questionnaire.
Model includes age, ethnicity, education level, household income, coupled, and working on paid or unpaid basis.
Sensitivity Analyses
The main results presented above were robust across several sensitivity analyses. Analyses restricting to the subsample of participants with only recalls representing usual intake (Supplementary Appendix Table 1) and only participants with two ASA24® recalls yielded similar results. In addition, analyses restricting the subsample to participants with at least 4 days of valid accelerometer MVPA data (Supplementary Appendix Table 2), restricting to participants with observed accelerometer MVPA, and alternative configurations for diet and PA variables data yielded similar estimates. Models predicting a 4-category body composition status, with severe obesity (n = 75) as a separate category (Appendix Tables 3 and 4), yielded similar findings.
Discussion
This study compared the predictive utility of alternate measures of diet and PA with respect to overweight and obesity among low-income minority women. The easiest to collect were single-item questions included in surveys, followed by brief dietary screeners and physical activity questions, also fielded in surveys. These measures have often been found to have lower validity.4,5 In contrast, the most resource-intensive (for researchers) and burdensome (for participants) assessments were the 24-hour dietary recalls and accelerometry (over a 7-day period), which have been found to have higher validity.4,5
Our results indicate that single-item measures of diet and PA can be very informative about the risk for overweight and obesity in this population. The added value of more resource-intensive measures based on 24-hour dietary recalls and accelerometry was negligible for PA and at best small for diet.
The predictive utility of self-reported single-item measures of diet quality and physical activity has been demonstrated in prior studies. Loftfield et al. assessed a single-item measure of diet quality, similar to that used in the present study, in a large community sample of adults in New York City and found it to be highly predictive of blood pressure and BMI. 19 A single-item measure of physical activity, the Saltin-Grimby Physical Activity Level Scale, has been assessed in several studies conducted in European samples.32-34 This measure asks respondents to self-rate their level of leisure time physical activity and has been shown to be predictive of cardiovascular risk factors, including BMI. Our contribution is to assess how well short, simple, and easy-to-administer measures predict obesity among low-income minority women. Moreover, we simultaneously assess the predictive utility of diet and PA, in contrast to prior work that either examines diet or PA.
There are several possible reasons that might explain the relatively higher utility of single-item measures of diet and PA relative to the more intensive measures in our study. First, dietary recalls and accelerometry assess short-term diet and PA compared to short questionnaires or single-item questions that can capture long-term or “usual” diet and may, therefore, correlate better with obesity. For example, the substantial day-to-day variation inherent in 24-hour dietary recalls generates within-person random error that leads to attenuation in the diet-disease relationship. 35 Therefore, it is recommended that multiple recalls, often more than two non-consecutive recalls, are needed to minimize measurement error. However, because the respondents felt most challenged by the lengthy time to complete and the requirement of multiple recalls, our study was only able to administer at most 2 recalls and only a portion of respondents completed both. Second, our sample consists entirely of women, and women have been shown to be more likely than men to misreport energy intake when using multiple pass recalls, as in the ASA-24. 5 Furthermore, misreporting is also higher among overweight and obese individuals, 5 which is another potential factor given the high rates of both in our sample. Comparison of our findings to a NHANES-based analysis for low-income adult women also shows that our sample reported lower overall calorie intake than NHANES (an average of 1543 total calories/day in our sample compared to about 1700 total calories/day in NHANES), which may suggest under-reporting in our ASA-24 recalls. Third, the high participant burden from dietary recalls and accelerometry can induce reactivity, especially when these assessments are announced in advance, as was the case in our study. Respondents may try to reduce the burden by “simplifying the reporting process (e.g., consuming single foods rather than combination foods) or to comply with socially desirable norms (i.e., to appear to have a healthy diet by reporting intake as per recommended in dietary guidelines)”. 5 Finally, much of the validation work for 24-hour dietary recalls and accelerometry-based PA measures is based on Caucasian samples, with limited evidence in low-income, minority women.
Our study has some limitations. First, the analysis was based on cross-sectional data, in which PA and diet measures were administered in the same wave as the outcome BMI measures. As a result, there is the possibility of reverse causation, where obesity status influenced the self-reported healthiness of diet and level of physical activity. As we collect more waves of data on this cohort, we will be able to prospectively examine the predictive utility of our baseline diet and PA measures on overweight. Second, our sample comprises of adult women in 3 public housing developments in Los Angeles, which may limit its generalizability. However, our sample characteristics were comparable to those of public housing residents in LA County (77.4% Hispanic, 19.34% African American or Black; 49% 18–40 years old, 33% 41–60 years old, 19% 61 years old or older; average household income $23,063). 14 Moreover, the high rates of overweight and obesity in our sample are comparable to those found in other studies of public housing sites36-38 and make this a particularly important group to study. Third, while BMI is a useful measure for public health surveillance purposes and is cost-effective for studies with large and/or geographically dispersed samples, it is an imperfect measure of adiposity. 39 Four, although our study robustly found that single-item measures have good predictive utility, these measures were developed for our study specifically and their psychometric properties need to be tested. Since multi-item instruments usually have better psychometric properties, a deeper understanding of why multi-item instruments did not perform better than single-item questions in this case is needed, for example, to what extent it is attributable to education attainment, and in particular, respondents’ numeracy or social desirability. Last, we considered physical activity and dietary measures as linear predictors of body composition in our analysis, explaining only a small proportion of BMI variance. Although not unique to our study, 40 this suggests that model misspecification may be a potential concern. Expansion of theoretical models to describe more accurately the ways in which dietary choices and physical activity measures are associated with body composition is critical for future work.
In conclusion, single-item questions that assess diet quality and physical activity level can provide valuable information about risk for overweight and obesity in low-income minority women when more resource-intensive assessments are infeasible.
• What is already known on this topic? There are no single best measures of diet or physical activity that optimize both validity and cost or feasibility in population-based studies, or universally applicable in different contexts or across populations. • What does this article add? An assessment of whether diet and physical activity measures based on approaches that are more time and resources-intensive (i.e., dietary recalls and accelerometry) add value over easy-to-administer single-item measures in terms of their predictive utility for overweight and obesity in low-income minority women. • What are the implications for health promotion practice or research? Single-item questions for diet and physical activity can provide valuable information about risk for overweight and obesity in low-income minority women when more resource-intensive assessments are infeasible.So What?
Supplemental Material
sj-pdf-1-ahp-10.1177_08901171211069992 – Supplemental Material for Predictive Utility of Alternate Measures of Physical Activity and Diet for Overweight and Obesity in Low-Income Minority Women
Supplemental Material, sj-pdf-1-ahp-10.1177_08901171211069992 for Predictive Utility of Alternate Measures of Physical Activity and Diet for Overweight and Obesity in Low-Income Minority Women by Ying Liu, Victoria Shier, Sara King and Ashlesha Datar in American Journal of Health Promotion
Footnotes
Acknowledgments
This research was supported by grants from the National Cancer Institute (R01CA228058) and the Eunice Kennedy Shriver National Center for Child Health and Human Development (R01HD096293). All opinions are those of the authors and not of the funding agency. We acknowledge the generous support of the Housing Authority of the City of Los Angeles (HACLA) for conducting this study. The authors thank the Community Coaches and residents at the study sites for their participation and support for this study.
Author Contributions
Ying Liu contributed to the concept of the work, analysis of data, interpretation of data, drafting the article, and article revisions. Victoria Shier contributed to the concept of the work, interpretation of data, drafting the article, and article revisions. Sara Ellen King contributed to cleaning the data, interpretation of data, and drafting the article. Ashlesha Datar contributed to the concept of the work, analysis of data, interpretation of data, drafting the article, and article revisions.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National Cancer Institute and Eunice Kennedy Shriver National Institute of Child Health and Human Development.
Ethical approval
The study was approved by the University of Southern California’s Institutional Review Board (UP-17-00842).
Supplemental Material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
