Objective: Compare missing data and reliability of health care evaluations between African Americans and Whites in Medicare managed care health plans. Method: Consumer Assessment of Healthcare Providers and Systems (CAHPS) 3.0 health plan survey data collected from 109,980 Medicare managed care enrollees (101,189 Whites, 8,791 African Americans) in 321 plans. Participants self-administered the survey and four single-item global ratings of care. Results: Missing data rates were significantly higher for African Americans than Whites on all CAHPS items (p < .0001). Internal consistency reliability estimates for the CAHPS scales did not differ significantly between African Americans and Whites, but plan-level reliability estimates for the scales and global rating items were significantly lower for African Americans than Whites. Discussion: Higher missing data rates and lower plan-level reliability estimates for African American Medicare managed care enrollees suggest caution in making race/ethnicity comparisons. Future efforts are needed to enhance the quality of data collected from older African Americans.
Barents Group of KPMG Consulting, Inc., & Westat (2002). Implementation of Medicare Managed Care CAHPS: Strategies for reducing barriers to access and increasing use of services by vulnerable Medicare populations and enrolled in health plans. (500-95-0057). McLean, VA: Author.
2.
Bost, J. E. (2001). Managed care organizations publicly reporting three years of HEDIS measures. Managed Care Interface, 14(9), 50-54.
3.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
4.
Cunningham, W. E., Hays, R. D., Burton, T. M., & Kington, R. S. (2000). Health status measurement performance and health status differences by age, ethnicity, and gender: Assessment in the Medical Outcomes Study. Journal of Health Care for the Poor and Underserved, 11(1), 58-76.
5.
Ettl, M. K, Hays, R. D., Cunningham, W. E., Shapiro, M. F., & Beck, C. K. (1996). Assessing health-related quality of life in disadvantages and very ill populations. In B. Spilker (Ed.), Quality of life and pharmacoeconomics in clinical trials (pp. 595-604). Philadelphia: Lippincott-Raven.
6.
Gandek, B., Sinclair, S. J., Kosinski, M., & Ware, J. E., Jr. (2004). Psychometric evaluation of the SF-36 health survey in Medicare managed care. Health Care Financial Review,25(4), 5-25.
7.
Goldstein, E., Cleary, P. D., Langwell, K. M., Zaslavsky, A. M., & Heller, A. (2001). Medicare CAHPS:A tool for performance improvement. Health Care Financing Review, 22(3), 101-107.
8.
Hargraves, J. L., Hays, R. D., & Cleary, P. D. (2003). Psychometric properties of the Consumer Assessment of Health Plans Study (CAHPS) 2.0 adult core survey. Health Services Research, 38, 1509-1527.
9.
Haviland, M. G., Morales, L. S., Reise, S. P., & Hays, R. D. (2003). Do health care ratings differ by race and or ethnicity?Joint Commission Journal on Quality and Safety, 29(3), 134-145.
10.
Hays, R. D. D., Shaul, J. A., Williams, V. S. L., Lubalin, J. S., Harris-Kojetin, L. D., Sweeny, S. F., et al. (1999). Psychometric properties of the CAHPS 1.0 survey measures. Medical Care, 37(3), MS22-MS31.
11.
Landon, B. E., Zaslavsky, A. M., Bernard, S. L., Cioffi, M. J., & Cleary, P. D. (2004). Comparison of performance of traditional Medicare vs Medicare managed care. Journal of the American Medical Association, 291, 1744-1752.
12.
Langwell, K. M., & Moser, J. M. (2002). Strategies for Medicare health plans serving racial and ethnic minorities. Health Care Financing Review, 23(4), 131-147.
13.
McHorney, C. A., Ware, J. E., Jr., Lu, J. F., & Sherbourne, C. D. (1994). The MOS 36-item short form health survey (SF-36): III. Test of data quality, scaling assumptions, and reliability across diverse patient groups. Medial Care, 32, 40-66.
14.
Morales, L. S., Elliott, M. N., Weech-Maldonado, R., Spritzer, K., & Hays, R. D. (2001). Differences in CAHPS adult survey reports and ratings by race and ethnicity: An analysis of the National CAHPS Benchmarking data 1.0. HSR: Health Service Research, 36, 595-617.
15.
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
16.
Schnaier, J. A., Sweeny, S. F., Williams, V. S. L., Kosiak, B., Lubalin, J. S., Hays, R. D., et al. (1999). Special issues addressed in CAHPS survey of Medicare managed care beneficiaries. Medical Care, 3(3), MS69-MS78.
17.
Shih, S. C., Bost, H. E., & Pawlson, G. (2003). Standardized health plan reportings in four areas of preventive health care. American Journal of Preventive Medicine, 24, 293-300.
18.
Stewart, A. L., & Nápoles-Springer, A. M. (2003). Advancing health disparities research: Can we afford to ignore measurement issues?Medical Care, 4, 1207-1220.
19.
Weech-Maldonado, R., Elliott, M. N., Morales, L. S., Spritzer, K., Marshall, G. N., & Hays, R. D. (2004). Health plan effects on patient assessments of Medicaid managed care among racial/ ethnic minorities. Journal of General Internal Medicine, 19, 136-145.
20.
Weech-Maldonado, R., Morales, L. S., Elliott, M., Spritzer, K., Marshall, G., & Hays, R. D. (2003). Race/ethnicity, language, and patients assessments of care in Medicaid managed care. HSR: Health Service research, 38, 789-808.
21.
Zaslavsky, A. M., Zaborski, L. B., & Cleary, P. D. (2002). Factors affecting response rates to the consumer assessment of Health Plans Study Survey. Medical Care, 40, 485-499.
