Are Claims Data Accurate Enough to Identify Patients for Performance Measures or Quality Improvement? The Case of Diabetes,Heart Disease,and Depression

Abstract

The objective of this study was to demonstrate a method to accurately identify patients with specific conditions from claims data for care improvement or performance measurement. In an iterative process of trial case definitions followed by review of repeated random samples of 10 to 20 cases for diabetes, heart disease, or newly treated depression, a final identification algorithm was created from claims files of health plan members. A final sample was used to calculate the positive predictive value (PPV). Each condition had unacceptably low PPVs (0.20, 0.60, and 0.65) when cases were identified on the basis of only 1 International Classification of Diseases, ninth revision, code per year. Requiring 2 outpatient codes or 1 inpatient code within 12 months (plus consideration of medication data for diabetes and extra criteria for depression) resulted in PPVs of 0.97, 0.95, and 0.95. This approach is feasible and necessary for those wanting to use administrative data for case identification for performance measurement or quality improvement.

Keywords

diabetes mellitus depression efficiency organizational heart diseases quality indicators health care health care quality

Get full access to this article

View all access options for this article.

References

Corrigan JM , Nielsen DM . Toward the development of uniform reporting standards for managed care organizations: the Health Plan Employer Data and Information Set (version 2.0). Jt Comm J Qual Improv. 1993;19:566-575.

National Committee for Quality Assurance . HEDIS 3.0. Washington, DC: National Committee for Quality Assurance; 1998.

Kerr EA , McGlynn EA , Van Vorst KA , Wickstrom SL . Measuring antidepressant prescribing practice in a health care system using administrative data: implications for quality measurement and improvement. Jt Comm J Qual Improv. 2000;26:203-216.

Valenstein M , Ritsema T , Green L , et al. Targeting quality improvement activities for depression: implications of using administrative data. J Fam Pract. 2000;49:721-728.

Pronk NP , O'Connor P , Isham G , Hawkins C . Building a patient registry for implementation of health promotion initiatives: targeting high-risk individuals. HMO Pract.1997;11:43-46.

Deyo RA , Cherkin DC , Ciol MA . Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45:613-619.

Charlson ME , Pompei P , Ales KL , MacKenzie CR . A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis.1987;40:373-383.

Melfi CA , Croghan TW . Use of claims data for research on treatment and outcomes of depression care. Med Care.1999;37:AS77-AS80.

Huston P , Naylor CD . Health services research: reporting on studies using secondary data sources. Can Med Assoc J.1996;155:1697-1709.

10.

Eisenberg JM . Health services research in a market-oriented health care system. Health Aff (Millwood). 1998; 17:98-108.

11.

Hofer TP , Hayward RA , Greenfield S , Wagner EH , Kaplan SH , Manning WG . The unreliability of individual physician “report cards” for assessing the costs and quality of care of a chronic disease. JAMA. 1999;281:2098-2105.

12.

Eddy DM . Performance measurement: problems and solutions. Health Aff (Millwood). 1998;17:7-25.

13.

Mainous AG III , Talbert J . Assessing quality of care via HEDIS 3.Is there a better way? Arch Fam Med. 1998; 7:410-413.

14.

Fowles JB , Fowler EJ , Craft C . Validation of claims diagnoses and self-reported conditions compared with medical records for selected chronic diseases. J Ambul Care Manage.1998;21:24-34.

15.

Kashner TM . Agreement between administrative files and written medical records: a case of the Department of Veterans Affairs. Med Care. 1998;36:1324-1336.

16.

Malenka DJ , McLerran D , Roos N , Fisher ES , Wennberg JE . Using administrative data to describe casemix: a comparison with the medical record. J Clin Epidemiol. 1994;47: 1027-1032.

17.

O'Connor PJ , Rush WA , Pronk NP , Cherney LM . Identifying diabetes mellitus or heart disease among health maintenance organization members: sensitivity, specificity, predictive value, and cost of survey and database methods. Am J Manag Care. 1998;4:335-342.

18.

Rost K , Smith R , Matthews DB , Guise B . The deliberate misdiagnosis of major depression in primary care. Arch Fam Med. 1994;3:333-337.

19.

Spettell CM , Wall TC , Allison J , et al. Identifying physician-recognized depression from administrative data: consequences for quality measurement. Health Serv Res.2003;38:1081-1102.

20.

Kramer TL , Owen RR , Cannon D , et al. How well do automated performance measures assess guideline implementation for new-onset depression in the Veterans Health Administration? Jt Comm J Qual Saf. 2003;29: 479-489.

21.

Solberg LI . Prevention in managed care. In: Kongstvedt PR , Plocher DW , eds. Best practices in medical management. 2nd ed. Gaithersburg, Md: Aspen; 1998:37-43.

22.

National Committee for Quality Assurance . The State of Health Care Quality 2003: Industry Trends and Analysis. Washington, DC: National Committee for Quality Assurance; 2003.