Abstract
Self-reported changes in physical and mental health by members are an important dimension by which the quality of a Medicare Advantage (MA) plan is rated by the Centers for Medicare & Medicaid Services. To better target their interventions, MA plans need a better understanding of what observed characteristics—including clinical health conditions—predict self-reported changes in physical and mental health. This study explored how one MA plan's survey of participants' responses regarding changes in physical and mental health is associated with a set of chronic conditions as well as sociodemographic characteristics. Multinomial logistic regressions were used to examine the influence of 9 chronic conditions and age, sex, race, education, dual eligibility status (Medicare/Medicaid eligible), marital and living status, and assistance with survey completion on changes in patient-reported physical and mental health. Six conditions—dementia (P < 0.001), diabetes (P = 0.003), congestive heart failure (P = 0.002), cerebrovascular disease (P = 0.001), coronary artery disease (CAD) (P < 0.001), and rheumatoid arthritis (P < 0.001)—were associated with self-reported worsening of overall physical health. Four conditions—dementia (P < 0.002), diabetes (P = 0.047), CAD (P = 0.001), and decubitus ulcers (P = 0.033)—were associated with self-reported worsening of overall mental health. Females, married respondents, and those needing assistance with survey completion were more likely to report worsening of their mental health. Enrollees older than age 65 actually were less likely to report worsening of overall mental health. Findings provide insight into which members may be more susceptible to reporting that their physical or mental health is worsening.
Introduction
I
The ability to predict which members are most susceptible to feeling that their physical and mental health is worsening over time is useful to MA plans in their effort to design interventions efficiently to manage these members' chronic conditions. Thus, it may be hypothesized that chronic health conditions, defined as “those conditions that last a year or more and require ongoing medical attention and/or limit activities of daily living,” 2 may play a notable role in member perceptions of their own physical and mental health. This is an especially relevant area of research because the prevalence of chronic conditions is projected to increase over the next decades. 3 It has been estimated that people in the United States who report 1 chronic medical condition will increase from 133 million in 2005 to 164 million in 2020, with 81 million reporting 2 or more conditions. 3,4 Among the elderly, hypertension, heart disease, diabetes (DM), arthritis, chronic pulmonary disease, osteoporosis, and cancer are the most common chronic conditions. 3,5
This study used data collected by a large MA plan from an in-house survey that closely mirrors the HOS and CAHPS survey, combined with patient claims data, and analyzed how the following chronic conditions—DM, decubitus ulcers, congestive heart failure (CHF), coronary artery disease (CAD), chronic kidney disease (CKD), cerebrovascular disease (CVD), chronic obstructive pulmonary disease (COPD), arthritis, and dementia—and sociodemographic characteristics (ie, age, sex, race/ethnicity, education level, dual status, living and marital situation, needing assistance with survey completion) predict whether a respondent will report declines, improvements, or no change in his or her overall physical health and mental health.
Methods
Data used in this study were in-house observational data that were originally collected by an MA health plan in southeast Louisiana as part of the organization's annual patient satisfaction survey process. The survey was administered by a third-party vendor. The survey instrument comprised 52 items that were adapted from the CAHPS survery and HOS. As is required for MA plans, the organization's survey tool was submitted to CMS for approval before use.
This study was reviewed and approved as non–human subject-research by the University of Alabama at Birmingham Institutional Review Board.
Population and sample
The process of survey administration by the third-party vendor was as follows: A prenotification letter was mailed to randomly selected respondents 1 week before mailing the surveys. The survey instrument was mailed with a cover letter explaining the purpose and significance of the survey. A return business reply envelope addressed to an external third party was included with each questionnaire. Neither the organization nor the third-party vendor performed any follow-up calls and each randomly selected respondent received only 1 survey. Data were collected at 3 points in time: September 2011, October 2011, and January 2012. A 99% confidence level was used to determine the sample size at ±5% accuracy. Fifteen thousand surveys were mailed to members in 3 separate 5000-survey increments. A total of 4752 surveys were returned representing a 32% response rate. There were no duplicate responses in the data sample. Data from these 3 satisfaction surveys were combined into 1 data set by a third party.
The satisfaction survey was administered randomly to individual members who were in the MA plan's network of primary care practices. The survey targeted currently enrolled members who were aged 18 years and older at the time of the sample draw and had been continuously enrolled in the health plan for at least 6 months. Member characteristics (age, sex, race, educational level, marital status, length of time enrolled in the health plan, assistance with completing the survey, living situation, total number of chronic conditions, and total number of prescription medications) from the organization's claims and enrollment database were linked to the survey data. This allowed the unique opportunity to study the association between objective data on clinical health status obtained from claims data and self-reported physical and mental health using a survey instrument similar to HOS and CAHPS.
The chronic hierarchical condition categories (HCCs) as defined by CMS were calculated using a 3-year look-back period in the organization's administrative claims database. Two questions asked the respondents to rate their overall physical health and overall mental health.
(1) Compared to 1 year ago, how would you rate your physical health, in general, now?
(2) Compared to 1 year ago, how would you rate your emotional problems (such as feeling anxious, depressed, or irritable), in general, now?
Respondents rate their answers to these questions on a 5-point Likert scale: much worse, slightly worse, about the same, slightly better, and much better.
Data management
Data management and analysis were performed using SPSS statistical software version 21 (IBM Corp., Armonk, NY). 6 Before analysis of the data, each survey question was evaluated for out-of-range values and eligibility criteria. This resulted in 51 cases that did not meet eligibility criteria and 82 out-of-range responses. The ineligible cases and individual out-of-range responses were eliminated from the analysis. In addition, 4 survey questions (ie, self-reported number of chronic conditions, self-reported number of prescription medications, self-rating of physical health, self-rating of mental health) were evaluated for missing responses; 375 cases with missing responses to these questions were excluded from the data set. Responders were compared to nonresponders to assess response bias.
Empirical approach
Respondents' characteristics and distribution of chronic conditions were summarized using descriptive statistics and are shown in Tables 1 and 2.
SD, standard deviation.
CAD, coronary artery disease; CHF, congestive heart failure; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; CVD, cerebrovascular disease; DM, diabetes mellitus; HCC, hierarchical condition category; RA, rheumatoid arthritis.
The main outcomes of interest were respondent-reported changes in their physical health and mental health over the past year. For each, the dependent variable was recoded into 3 categories: worse, which included slightly worse and much worse; better, which included slightly better and much better; and about the same, which was selected as the reference category. Multinomial logistic regressions were used to analyze the relationship of each of the 2 dependent variables and the chronic conditions, with controls for age, race, sex, educational level, marital and living status, needing assistance with survey completion, and dual eligibility status. The chronic conditions of interest were treated as independent variables in the logistic regression model and were coded as a 1 or 0 with a value of 1 when the condition was present and a value of 0 otherwise. All comorbidities were considered simultaneously in the logistic regression model. The predictors X1–X14 are DM, CHF, CVD, COPD, CKD, CAD, rheumatoid arthritis (RA), decubitus ulcers, dementia, sex, age, race, education, and dual status. All inferential statistical analyses used a level of α = 0.05 as a determinant of statistical significance.
Results
The final sample consisted of 4325 responses. Females represented more than half of the total responses (Table 1). The majority of respondents were white with a mean age of 76.3 years. The mean length of time respondents were enrolled with the health plan was 9.2 years. In all, 41% of respondents reported completing a high school education and 12.3% of respondents reporting completing less than an eighth grade education. In addition, reported statistics for nonresponders revealed that 55.9% were female, 62% were white, with a mean age of 77 years, and the mean number of years with the plan of just over 10 years. Descriptive characteristics are summarized in Table 1. The frequency of the chronic conditions was derived from administrative claims data and is presented in Table 2.
Multinomial logistic regression analysis
This exploratory analysis evaluated the likelihood of an association between the specific chronic conditions as defined by the organization's claims data using HCCs and the self-reported responses to respondents' perception of changes in their physical and mental health compared to 1 year ago.
The results of the multinomial logistic regression analysis (Table 3) revealed that the following chronic conditions were significantly associated with higher odds of respondents reporting a worsening of their physical health compared to remaining about the same: dementia (P < 0.001), DM (P = 0.003), CHF (P = 0.002), CVD (P = 0.001), CAD (P < 0.001), and RA (P < 0.001). Respondents reporting needing assistance with survey completion were more likely to report their physical health as worsening (P < 0.001). Respondents older than age 65 were less likely to report a worsening of their physical health (P = 0.001). Results also revealed that the following chronic conditions were significantly associated with higher odds of respondents reporting improvement in physical health compared to about the same: DM (P = 0.006) and CHF (P = 0.001). With respect to the other sociodemographic predictors, being older than age 65 (P = 0.046) and dual eligibility (Medicare/Medicaid) status (P = 0.030) were associated with higher odds of reporting a better rating of physical health compared to about the same. Nonminority status (P < 0.001), an education level of high school and above (P = 0.001), being female (P = 0.029), and needing assistance with survey completion (P < 0.001) were significantly associated with lower odds of reporting a better rating of physical health compared to about the same. P values, odds ratios (OR), and 95% confidence intervals are presented in Table 3.
Reference category is about the same.
CAD, coronary artery disease; CHF, congestive heart failure; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; CVD, cerebrovascular disease; DM, diabetes mellitus; HCC, hierarchical condition category; OR, odds ratio; RA, rheumatoid arthritis.
The following chronic conditions were significantly associated with higher odds of respondents reporting a worsening of their mental health compared to about the same: dementia (P = 0.002), DM (P = 0.047), CAD (P = 0.001), and decubitus ulcers (P = 0.033) (Table 4). Being female (P = 0.002), married (P = 0.017), and needing assistance with survey completion (P < 0.001) also were associated with higher odds of reporting their mental health as worsening. Being older than age 65 (P < 0.001) was associated with lower odds of categorizing one's mental health as worse versus about the same compared to the reference group. One chronic condition was significantly associated with higher odds of respondents reporting their mental health as better: CVD (OR 1.219, P = 0.013). Being older than age 65 (P < 0.039) and nonminority race (P < 0.001) were associated with higher odds of reporting better mental health, while assistance with survey completion (P < 0.001) and an education level of high school and above (P < 0.001) were associated with lower odds of reporting better mental health. Detailed results are presented in Table 4.
CAD, coronary artery disease; CHF, congestive heart failure; CKD, chronic kidney disease; COPD, chronic obstructive pulmonary disease; CVD, cerebrovascular disease; DM, diabetes mellitus; HCC, hierarchical condition category; RA, rheumatoid arthritis.
Discussion
This study used in-house survey data similar to those collected in HOS and CAHPS surveys by CMS. The survey is then linked to in-house claims data so as to better understand what factors predicted enrollees' reporting changes in their physical and mental health status. The health burden of chronic conditions and self-perceptions about one's own physical health and mental health have been described as having “multidimensional and reciprocal relationships,” 7 especially among older adults. 8 –10 In this study, 6 chronic conditions were associated with higher odds of reporting one's physical health as worsening: dementia, DM, CHF, CVD, CAD, and RA. Respondents reporting needing assistance with survey completion were associated with higher odds of reporting their physical health as worsening. Four chronic conditions were associated with higher odds of reporting one's mental health as worsening: DM, CAD, dementia and decubitus ulcers. Respondents who were female, married, or reported needing assistance with survey completion also were more likely to report their mental health as worsening.
Some of the findings appear counterintuitive; for example, results demonstrated that DM and CHF were significantly associated with rating one's physical health as better and worse versus about the same. Furthermore, being older than age 65 was associated with lower odds of reporting worse mental and physical health, whereas higher levels of education were associated with lower odds of reporting better physical and mental health. However, extant studies indicate that there are a number of factors that relate to one's self-perception of health and functional status, including expectations as well as optimism and acceptance. Individuals with chronic conditions can have a long period of time to develop a conceptual belief about their conditions through their own experiences as well as the experiences of others with similar conditions. Idler et al researched the chronic illness models that have implications for self-rated health. 11 These include the disease “identity, timeline, causes, consequences, and controllability”—all of which contribute to one's concept of well-being. In the 2009 research article, Self-Comparisons Affect Responses to Health-Related Quality of Life Questionnaires, Robertson concluded 2 key points: (1) some chronic conditions that have symptoms that are “expected” may be perceived to be more manageable and therefore may change the parameters for how an individual responds to questions related to physical health and (2) optimism may be a key factor in evaluating one's health more positively as the elderly accept the limitations resulting from increasing age and chronic conditions. 12 Another potential factor is the unpredictability of symptoms patients can experience with some chronic conditions. A downward progression of physical symptoms that is slower than what the patient expected may be perceived as better physical health, only to be followed by an acute medical crisis, which is reported as a worsening condition. These findings demonstrate the challenges of determining the underlying constructs respondents use when self-reporting on health-related surveys. 13
With respect to one's overall rating of mental health, it has been estimated that 15% of Americans older than age 65 suffer from significant depressive symptoms. 14 Harman reports that several studies have shown that when depression “co-occurs” with chronic conditions such as DM and CAD, the resulting implications are poorer rates of treatment adherence and poorer health outcomes. 14 Dementia, frequently a long-term chronic condition, may prevent an individual from participating in everyday activities that help maintain cognitive functioning, which also may be a contributing factor in self-reported worsening of mental health.
Findings from this study may have strategic implications for MA plans as they continue to design care coordination models to improve members' quality of life and reduce health care expenditures. Organizations need to understand the factors that influence members' perceptions of their physical and mental health to improve outcomes and remain competitive. As organizations move to a population health focus, the ability to stratify the enrolled population not just by predicted expense but also by social determinants of health and the ability to perform activities of daily living (ADLs)—which in this study were captured by the proxy variable of “requiring assistance to complete daily tasks”—becomes imperative in allocating limited resources to improve outcomes. Annual evaluation of an enrollee's health status utilizing an instrument such as a health risk assessment tool can provide valuable information on ADLs and instrumental ADLs. 15 At the same time, this study's results suggest that, when it comes to self-reported health, some of the observable indicators of social determinants of health (eg, education, marital status, age) may not influence self-perceptions of physical and mental health in the anticipated direction. The adoption of predictive modeling tools can assist an organization to identify those enrollees in low-, moderate-, and high-risk categories of reporting worsening health based on sociodemographic characteristics, chronic conditions, and other observable factors—and allow targeted care coordination interventions to improve or, at a minimum, maintain enrollees' health status.
In addition to stratifying the population, assessing and understanding enrollees' level of engagement in their health care is an important factor in improving outcomes. Utilization of the Patient Activation Measure (PAM-13) tool can give providers and care coordinators insight on how to more effectively enhance an individual's level of self-activation and engagement in the care process. Respondents' self-reported assessment of their health includes self-knowledge, knowledge of conditions, and the interaction between chronic conditions. Greater patient-level self-activation—defined as “understanding one's own role in the care process and having the knowledge, skills, and confidence to take on that role” 16 —may give patients a better sense of control, realistic expectations, and a more positive outlook regarding their own health.
Another factor that may moderate the relationship between multiple chronic conditions and self-perceptions of health may be better care coordination among various providers because patients with multiple chronic conditions often experience suboptimal health care. 17 This requires a shift from a patient receiving care for a specific chronic condition from a specialist in isolation to coordination between complex treatment regimens. 18
Limitations
The study was limited to survey respondents who were enrolled in an MA plan in southeastern Louisiana; therefore, generalizability beyond the specific geographic region should be considered carefully. The survey used self-reported assessments of respondents' overall physical health and overall mental health but lacked data on the social support systems of respondents and the quality of their interactions with health care providers. The possibility of response bias may serve as a limitation to the accuracy of self-reports. Using claims data presents a limitation in that the data are only as complete as the health care providers' accuracy of submitted claims to the health plan, and there is potential for underreporting. In addition, this study lacked information about the severity of chronic conditions as well as the length of time since initial diagnosis, which also may be important factors in self-perceptions of health.
Conclusion
The significant growth of the aging population will require the health care industry and the organizations that care for the elderly to further their understanding of the physical and psychological ways in which people adapt to aging, to changes in their sociodemographic situation, and to chronic conditions. MA plans should more broadly consider collecting survey data from members using survey instruments similar to what is used by CMS, and linking it to claims data and clinical history to receive insights into what factors are linked to members being more susceptible to perceptions of worsening physical or mental health. This helps MA plans to develop targeted interventions that have the potential advantage of improving members' quality of life, which in turn can help lead to improvements of the MA plans' Star Ratings.
Areas for future research include developing a more complete understanding of what range of factors contribute other attributes respondents consider when reporting their health status and determining if those considerations change over time and with age. With an aging population who are living longer with more chronic conditions, developing a more comprehensive understanding of the physical and emotional impacts of chronic conditions occurring over time will be important considerations for MA plans as they make strategic business decisions related to the components of their delivery models. In addition, one policy suggestion is for CMS to consider developing a risk adjustment model that examines the potential effects of severity of illness for survey respondents, as the burden of chronic conditions continues to increase in the population.
Footnotes
Author Disclosure Statement
Drs. Guerard, Omachonu, Hernandez, and Sen declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Dr. Guerard is employed at Peoples Health; Drs. Omachonu and Sen are independent contractors for Peoples Health. Dr. Hernandez declared no conflicts of interest. The authors received the following financial support: This study was partially supported by Peoples Health, a Medicare Advantage plan in southeast Louisiana. The data used in this work are the property of the Peoples Health organization. The organization had no role in the design or conduct of the study or approval of the article. The content is solely the responsibility of the authors and does not represent the official views of the organization.
