Abstract
Purpose:
Adolescent and young adult (AYA)-aged central nervous system (CNS) tumor survivors are an understudied population that is at risk of developing adverse health outcomes, such as obesity. Long-term follow-up guidelines recommend monitoring those at risk of obesity, thus motivating the need for an eating behavior questionnaire. An abbreviated online version of the Three-Factor Eating Questionnaire (TFEQ-R18v2) has been developed, but its applicability to this population is not yet known. This study investigated the instrument's factor structure and reliability in this population.
Methods:
AYA-aged CNS tumor survivors (n = 114) aged 15–39 years completed the TFEQ-R18V2 questionnaire online. Confirmatory factor analysis was used to examine the fit of the three-factor structure (uncontrollable eating, cognitive restraint, and emotional eating [EE]) and reliability (internal consistency of the TFEQ-R18v2). Associations between the three factors and body mass index (BMI) were assessed by linear regression.
Results:
The theorized three-factor structure was supported in our population (RMSEA = 0.056 and CFI = 0.98) and demonstrated good reliability (α of 0.81–0.93). EE (β = 0.07, 95% CI 0.02–0.13) was positively associated with BMI, whereas the other two subscale scores were not.
Conclusion:
The TFEQ-R18v2 instrument holds promise for research and clinical use among AYA-aged CNS tumor survivors. The instrument may be a useful tool for researchers to develop tailored weight management strategies. It also may be a valuable tool for clinicians to monitor survivors who are at risk of obesity and to facilitate referral. Our results also suggest that EE in this population should be further investigated as a potential target for intervention.
Introduction
C
Being overweight/obese is a major concern among childhood and AYA CNS tumor survivors even years after diagnosis,9,12,13 because it may increase survivors' risk for developing obesity-related diseases such as metabolic syndrome 7 and dyslipidemia. 14 Unhealthy eating patterns are a risk factor for the development of obesity. 15 Studies have found that survivors consume a high-fat diet and fail to meet national dietary guidelines.15–17 Given the unhealthy eating behaviors among survivors and the potential risk for being overweight/obese, the Children's Oncology Group recommends monitoring and counseling for childhood and AYA cancer survivors during long-term follow-up. 12
In addition to the assessment of eating patterns, evaluation of eating behavior patterns has been used to understand the mechanisms contributing to obesity 18 and has also been used to develop targeted weight management interventions among cancer-free populations.19–21 Therefore, an established self-reported eating behavior measure, such as the Three-Factor Eating Questionnaire (TFEQ), can be a useful tool for monitoring childhood and AYA CNS tumor survivors who are at risk for obesity.
The TFEQ measures uncontrollable eating (UE), cognitive restraint (CR), and emotional eating (EE) dimensions. 22 TFEQ is considered a robust measure, because the three-factor structure of TFEQ (i.e., TFEQ-R18, 23 TFEQ-R21, 24 and TFEQ-R18v2 22 ) has been replicated and validated across various cancer-free populations22, 23, 25,26 and across different delivery mechanisms such as paper versus online versions. 22 To our knowledge, there are no published studies that have evaluated the factor structure of the TFEQ in this high-risk population even though it has been used by two other studies among childhood and AYA CNS tumor survivors.27,28
Aside from the need to evaluate the psychometric properties of TFEQ when applied to a new population,29,30 a recent study indicated greater risk for severe long-term neurocognitive impairment for CNS tumor survivors who received craniospinal irradiation compared with those who did not. 31 Such findings further motivated the need to evaluate whether survivors can understand the questions posed and complete the instrument to provide valid information. Thus, our primary aim was to examine the factor structure and reliability of TFEQ-R18v2 among childhood and AYA CNS tumor survivors. Second, we aimed at examining the relationship between TFEQ-R18v2 factors and self-reported body mass index (BMI). This was to determine whether or not latent factors were associated with BMI in this population as theorized.
Subjects and Methods
Study design and participants
We conducted a cross-sectional study by using web-based questionnaires. Childhood and AYA CNS tumor survivors were recruited in person and via mail or phone at two children's cancer centers in Texas. We also recruited them through flyers or online postings at other children's cancer hospitals, community organizations, and social media sources such as Facebook, Twitter, and Google+. Henceforth, we will refer to our study sample as AYA-aged CNS tumor survivors. Final eligibility was determined via phone screening. Inclusion criteria included: (1) AYA-aged CNS tumor survivors aged 15–39 at enrollment and diagnosed at age <39 years (following the National Cancer Institute's definition of AYA as aged 15–39 years 32 ), (2) off therapy without relapse for at least 6 months, and (3) internet and phone access. Exclusion criteria included: (1) without legal guardians and (2) having significant cognitive and communication impairments (e.g., cannot provide their age). Participants provided consent (for those ≥18 years of age) or assent for those aged 15–17. Parental consent was also obtained for the minors. The institutional review board at UT MD Anderson Cancer Center and at Baylor College of Medicine approved this study. A total of 189 web-based questionnaire links were sent to those who consented, and 114 (60%) completed the web-based questionnaire. A total of five reminders per participant were made via phone calls, emails, and text messages in an attempt to increase participation rate.
TFEQ-R18v2
We provided each consented participant with the Assessment Center™ (www.assessmentcenter.net/) link via email. Each participant completed approximately 60 web-based questions. These 60 questions included demographic variables (Table 1 and the original TFEQ-R18v2. 22 The details of TFEQ-R18v2 have been published elsewhere. 22 Briefly, the UE subscale measures loss of control over eating (nine items). The CR subscale assesses consciously choosing to restrict food intake (three items). Lastly, the EE subscale measures responding to negative emotions by eating (six items). 22 The TFEQ-R18v2 items have four-point response scales ranging from definitely true (score = 4) to definitely false (score = 1). Raw scores are commonly converted into scaled scores of 0–100. 33 Higher scaled scores for each subscale suggest greater UE, CR, or EE characteristics. 33 TFEQ-R18v2 showed evidence of factorial validity in a previous study of who participated in the 2006 National Health and Wellness Survey. The comparative fit index (CFI) was 0.96. The internal consistency showed an α of 0.89 for UE, 0.78 for CR, and 0.94 for EE factors. 22
For those <18 years of age, BMI categories were determined by CDC BMI-for-age growth charts; for those ≥18 years of age, BMI categories were determined by CDC classifications.
BMI = weight (kg)/[height (m)]2.
The equation used to convert the raw scores into a scale score of 0–100 was: [(Raw sum score of each factor-Lowest possible raw score)/(Raw score range)]*100. 33
BMI, body mass index; CDC, Centers for Disease Control and Prevention.
Analyses
Demographic characteristics were summarized by descriptive statistics. For those <18 years of age, the BMI interpretation depends on sex and age; thus, the BMI categories were determined by Centers for Disease Control and Prevention (CDC) BMI-for-age growth charts. 34 As for those ≥18 years of age, BMI categories were determined by CDC classifications. 34 Correlation analyses were performed to identify co-linearity between all variables of interest.
Factor structure and reliability of TFEQ-R18v2
We used confirmatory factor analysis (CFA) for our primary aim of examining the factor structure and reliability of TFEQ-R18v2 among AYA-aged CNS tumor survivors. Specifically, Mplus (version 7) 35 was used to determine whether or not the items comprising each factor—UE, CR, and EE from the TFEQ-R18v2—loaded on those factors without any modifications. Furthermore, we also computed standardized loadings for each parameter to compare our sample estimates with the published estimates (Table 3). 22 We treated the scores as ordinal variables. A robust mean and a variance-adjusted, weighted least-squares estimator were used to address the lack of normality for each item having a range from one to four. We standardized the latent factors by setting factor variance to one and freely estimated all items to factor coefficients for all CFA models.
The fit indices and cut-off values recommended by Suhr 36 and Brown 37 were used to evaluate model fit (Table 2). These included: chi-square (χ2) goodness-of-fit, CFI, Tucker–Lewis index (TLI), root mean square error of approximation (RMSEA), and weighted root mean square residual (WRMR). For goodness-of-fit evaluation using the chi-square test, a p value ≥0.05 for the chi-squares indicates that there are no significant differences between the observed and expected variance–covariance matrix. CFI takes sample size into consideration, whereas TLI considers model complexity. The CFI/TLI cut-off criterion for an acceptable model fit is ≥0.90. 36 RMSEA evaluates the residual variance in the model. It is recommended that RMSEA values be <0.06. 37 If RMSEA is ≥0.06 but ≤0.08, it is considered a mediocre fit. 37 For the WRMR, a value of <0.90 indicates a good model fit. 38 If the fit was considered acceptable, we then examined the parameter estimates and evaluated the standardized loadings of each item to the factors. We used the 0.40 cut-off value 39 and a p value ≤0.05 to determine whether the items have low loadings to the factors.
For goodness-of-fit evaluation using chi-square test, a p value great than 0.05 for the chi-squares indicates that there are no significant differences between the observed and expected variance–covariance matrix.
CFI takes into consideration the sample size, whereas TLI considers the model complexity. The CFI/TLI cut-off criterion for an acceptable model fit is ≥0.90. 36
RMSEA evaluates the residual variance in the model. It was recommended that RMSEA values be <0.06. 37 If RMSEA is >0.60 but <0.08, it is considered a mediocre fit. 37
For the WRMR, a value of <1.0 indicates a good model fit. 38
CFA, confirmatory factor analysis; CFI, comparative fit index; RMSEA, root mean square error of approximation; TFEQ, three factor eating questionnaires; TLI, Tucker–Lewis index; WRMR, weighted root mean square residual.
In addition to scale scores, factor scores were calculated for each of the three factors by using multivariate regression methods based on the best CFA solution's factor loadings and factor correlation. 40 This method provides a more accurate estimate, because it takes into consideration the correlation between factors as well as the correlation between observed variables. 40 Scale reliability, also known as the internal consistency of the instrument, was assessed by using composite (scale) reliability. The composite reliability is a CFA-based method that is used to evaluate subscales' internal consistency. 37 The composite reliability was derived based on the scores of the items within each factor.
Relationship between TFEQ-R18v2 factors and BMI
For the secondary aim of evaluating the association between eating behaviors and BMI among AYA-aged CNS tumor survivors, we constructed a multivariable linear regression model combining all latent factors—UE, CR, and EE—as predictors and BMI as the outcome. Significance was set at p < 0.05. Covariates of interest were gender, race, and age. However, those covariates with a p ≥ 0.05 were removed manually one at a time by evaluating the changes in the Akaike's information criterion (AIC) and Bayesian information criterion (BIC) values. Due to the non-normal distribution for BMI, we computed nonparametric 95% confidence intervals (CI) for regression estimates by using bootstrap resampling with 10,000 samples. The distributions of scaled scores and factor scores of UE, CR, and EE were evaluated for floor and ceiling effects. Censored regressions were also conducted to account for floor or ceiling effects.
Finally, since AYA-aged CNS tumors are rare cancers, we also conducted a power and sample size analysis and found that a sample size of 110 would provide 80% power to show a difference between a good fit (RMSEA 0.05) and a poor fit (RMSEA >0.08) for the proposed CFA model. 41
Results
Slightly more than half of the participants were women; the majority was non-Hispanic White. The mean age was approximately 27 years, with the majority being ≥18 years of age. Approximately 41% of participants were classified as overweight/obese. The EE mean scaled score was significantly higher among women than men, t(101) = −3.57, p < 0.001 (Table 1).
Evaluation of TFEQ-R18v2 factor structure
Table 2 provides a summary of the fit statistics from the CFA models that we had constructed to address the primary aim. The initial three factors CFA for the original TFEQ-R18v2 (model 1) showed a “mediocre” 37 fit (RMSEA >0.06 but <0.08). An examination of residuals and modification indices indicated that an observed correlation between items 12 (“When I smell a sizzling steak or see a juicy piece of meat, I find it very difficult to keep from eating—even if I've just finished a meal.”) and 15 (“When I see something that looks very delicious, I often get so hungry that I have to eat right away.”) of the TFEQ-R18v2 was not entirely explained by the underlying latent factor. Since these two items assessed similar concepts of a participant's desire to eat when they observed desired food and there were only two such items, we proceeded to correlate these error terms. 37 By correlating the error terms of these items under the UE factor, the resulting model (model 2) indicated a significantly better fit [χ2(1) = 11.9, p = 0.0006]. Although the significant χ2 result for model 2 suggested some lack of fit, it may not have been substantial since other fit indices showed a reasonable fit (CFI/TLI >0.90; RMSEA <0.06; and WRMR <1.0). 37 The composite reliability for UE, CR, and EE based on model 2 results was above the recommended minimum reliability of 0.70. 42 The composite reliability was 0.86 (95% CI: 0.81, 0.90) for the UE factor, 0.81 (95% CI: 0.75, 0.87) for the CR factor, and 0.93 (95% CI: 0.90, 0.96) for the EE factor.
Table 3 summarizes the standardized regression coefficient results from model 2 compared with published 22 results. In our sample, UE was significantly correlated with EE. Since the statistical significance level of the factor correlations in the previous study were not reported, we assumed similar findings based on the reported factor correlation estimates. 22 Z tests (with Bonferroni correction) showed that the majority of the standardized regression coefficients were similar to published results, 22 except item 10 (“When I feel lonely, I console myself by eating.”; p < 0.003) of the EE factor. In our sample, the factor loading for item 10 was significantly higher than the published estimate (Table 3).
Z-score = (standardized estimate from our sample–published standardized estimate/estimated SE from our sample).
A p < 0.003 was considered significantly different. We used the Bonferroni correction (0.05/18) to reduce chance findings with multiple comparisons.
p < 0.0001.
AYA, adolescent and young adult; CNS, central nervous system; CR, cognitive restraint; EE, emotional eating; N/A, not applicable; SE, standardized estimate; UE, uncontrollable eating.
Relationship between TFEQ-R18v2 factors and BMI
We conducted simple correlations between the scaled scores and the factor scores to confirm the use of the scaled scores. The correlation results indicated a strong correlation between the scaled scores and the factor scores (Table 4). Thus, the scaled scores were used to interpret the regression results. Both gender (p = 0.91) and age (p = 0.79) were dropped from the model because of a lack of significant association with BMI; the AIC/BIC also decreased after the removal of these covariates. The censored model did not indicate differences in estimates after accounting for floor effects of the CR and EE factors, so we report the results of only the uncensored analyses. The results indicated a significant positive association between EE and BMI based on both the scaled score and factor score models (Table 5). In addition, race/ethnicity also indicated a significant positive association with a BMI over and above the TFEQ factors. Using the scaled score results, we found that while holding UE, CR, and race/ethnicity constant, a 10-point higher score of EE was associated with a 0.7 kg/m2 increase in BMI.
p < 0.05
With BMI as the outcome, we controlled for race/ethnicity; the best model was selected based on AIC/BIC results.
We performed bootstrap sampling with 10,000 samples by using the 2.5 percentile and 97.5 percentile to construct the 95% confidence interval (CI) for BMI regression estimates.
The equation used to convert the raw scores into a scaled factor score of 0–100 was: [(Raw sum score of each factor-Lowest possible raw score)/(Raw score range)]*100. 33
Factor scores were calculated for each factor by using the multivariate methods based on the best CFA solution's factor loadings and factor correlation.
AIC, Akaike's information criterion; BIC, Bayesian information criterion.
Discussion
Overall, this examination of the factor structure and reliability of TFEQ-R18v2 among a sample of AYA-aged CNS tumor survivors indicated a reasonably similar factor structure to that published by Cappelleri et al. using the data obtained from U.S. adults without a history of CNS tumors. 22 The fit indicators (CFI/TLI, RMSEA, and WRMR) showed a reasonable fit, and the composite reliability estimates were acceptable. Our CFI results from models one (CFI: 0.98) and two (CFI: 0.98) were also comparable to the results obtained by Cappelleri et al. from their clinical sample (CFI: 0.91) and web-based survey (CFI: 0.96). 22 Composite reliability findings for UE (0.86), CR (0.81), and EE (0.93) were similar to published results (UE was 0.89, CR was 0.78, and EE was 0.94). 22 Additionally, all of the factor loadings for each item were significantly associated with each of the purported latent factors.
Higher CR was not significantly associated with higher BMI in our sample, in contrast to findings from Hansen et al. 27 Hansen et al. found that CR was positively associated with BMI among acute lymphoblastic leukemia and brain tumor survivors aged 12–17 years old. 27 We may have different results, because our sample included a higher proportion of normal versus obese participants. Previous research indicated that the association between restrained eating behavior and BMI depends on the distribution of obese versus normal weight in the study samples.22,43 Similar to Angle et al., 25 who found that EE was positively associated with BMI among women aged 17–20 years old without history of cancer, 25 we also found a positive relationship between EE and BMI in our population. Overall, EE may be an important target for intervention based on the significant relationship with BMI. However, we cannot determine the directional relationship between BMI and these eating behavior latent factors in a cross-sectional study. According to previous research, EE and UE are associated with higher BMI among women. 44 Nevertheless, longitudinal studies found that BMI may also influence a person's eating behaviors.26,45 Similar to Hansen et al., 27 a significant association between race and BMI was found. Future studies are needed to explore variables that may moderate the relationship between TFEQ factors and BMI.
Based on our results, TFEQ-R18v2 may be a useful tool for researchers to use as a way to characterize eating behaviors22,23,25 and develop tailored weight management strategies for AYA-aged CNS tumor survivors.19,46 It is a promising tool for clinicians or oncologists to use to monitor AYA-aged CNS tumor survivors who are at risk of obesity and to facilitate early referral to behavioral services or dietary counseling.12,47 With the advancement of electronic medical records and the increasing use of electronic communication formats, delivering the TFEQ-R18v2 via the web would allow patients the opportunity to complete the questionnaire before clinic visits.
Our study must be considered in the light of certain limitations. For instance, we were limited in our ability to review medical records to obtain height, weight, diagnosis, and treatment information. Although self-reported anthropometric information is weaker than objective measurement, it has been used to facilitate the reach of populations across large areas, 48 such as in this case to reach AYA-aged CNS tumor survivors throughout the United States. In addition, we were only able to determine the association between eating behavior latent factors and BMI with cross-sectional data, but we were not able to determine the causal relations between BMI and the eating behavior latent factors. These cross-sectional data also cannot address potential difficulties with long-term recall. Future studies are needed to evaluate the temporal relationship between the latent factors and BMI and to evaluate latent factors that are associated with 24-hr recalls among AYA-aged CNS tumor survivors. Lastly, the sample size was smaller than that typically found in psychometric studies, though we found that we had 82% power to detect poor or good fit of our CFA model by using RMSEA. 41 Moreover, other studies have also indicated that a sample of 100 is adequate when there are five or fewer latent constructs and each construct has at least three items.49,50
Our evaluation of the factor structure and reliability of TFEQ-R18v2 among AYA-aged CNS tumor survivors is only the first step in evaluating the generalizability of the TFEQ-R18v2. Given the similarity between findings with our clinic-based population and findings in Cappelleri et al. 22 with a nonclinic-based population, future research should explore measurement invariance between nonclinic-based AYA adults and AYA-aged CNS tumor survivors by simultaneously administering this measure to samples from both populations. A formal evaluation of measurement invariance will lend additional evidence to the generalizability of the TFEQ-R18v2.
In summary, our findings supported the three-factor structure of TFEQ-R18v2 among AYA-aged CNS tumor survivors. The TFEQ-R18v2 also indicated good reliability within this population. Results also suggested the generalizability of the TFEQ-R18v2 factor structure among AYA-aged CNS tumor survivors. TFEQ-R18v2 may be a useful tool to help improve the quality of cancer survivorship care by monitoring the eating behavior patterns of AYA-aged CNS tumor survivors who are at risk of obesity for targeted intervention. Given that an increasing number of survivors are transitioning their medical care from the oncology setting to the general care setting, our findings may have important clinical implications for the effective treatment of a highly vulnerable, understudied population.
Footnotes
Acknowledgments
This research was supported in part by a cancer prevention fellowship for Maria Swartz that was supported by the National Cancer Institute grant R25T (CA057730), Shine Chang, Ph.D., Principal Investigator; the National Institutes of Health for Maria Swartz through the University of Texas MD Anderson's Cancer Center Support Grant (CA 016672); the Patient-Reported Outcomes, Survey, and Population Research (PROSPR) Shared Resources, NCI funded (CA 16772) to MD Anderson Cancer Center; MD Anderson Children's Cancer Hospital ON to Life Program; Texas Children's Cancer Center; Cook Children's Hematology and Oncology Center; and the Center for Energy Balance in Cancer Prevention and Survivorship, Duncan Family Institute. Currently, Maria Swartz is being supported by the Comparative Effectiveness Research on Cancer in Texas grant (RP140020), funded by the Cancer Prevention and Research Institute of Texas and the National Institute on Disability, Independent Living and Rehabilitation Research, Department of Education (90AR5009). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Cancer Institute or the National Institutes of Health.
The authors would like to thank their participants and the following individuals, clinics, and organizations for assisting them in their recruitment effort: Ignacia N. Ramirez, Adolescent and Young Adult Cancer Support, American Brain Tumor Association, American Cancer Society, American Childhood Cancer Organization inland Northwest, Alex's Lemonade Stand Foundation, Badger Childhood Cancer network, Brain and Spine Center at the UT MD Anderson Cancer Center, Brain Tumor Alliance, Candlelighters Childhood Cancer Foundation of Southern Arizona, Casey's Fund for Big Sky Kids Cancer Camp, Childhood Cancer Survivors Clinic at the UT MD Anderson Cancer Center, CURE Childhood Cancer Association, Childhood Cancer/Astrocytoma Awareness, Healthy Lives After Cancer: Young Adult Survivorship Program, Hope for Young Adults with Cancer, Jessica June Children's Cancer Foundation, Livestrong, MACC Fund-Midwest Athletes Against Childhood Cancer, Inc., Meghan's Miracle-One Million Voices for Childhood Cancer, Richi Childhood Cancer Foundation, Roswell Park's Adolescent and Young Adult Program, National Brain Tumor Society, Young Adult Cancer Survivors, Young Survival Coalition, and Ulman Cancer Fund.
Author Disclosure Statement
The authors declare that no competing financial interests exist.
