The authors estimated the validity of algorithms for identification of mental health conditions (MHCs) in administrative data for the 133 068 diabetic patients who used Veterans Health Administration (VHA) nationally in 1998 and responded to the 1999 Large Health Survey of Veteran Enrollees. They compared various algorithms for identification of MHCs from International Classification of Diseases, 9th Revision (ICD-9) codes with self-reported depression, posttraumatic stress disorder, or schizophrenia from the survey. Positive predictive value (PPV) and negative predictive value (NPV) for identification of MHC varied by algorithm (0.65-0.86, 0.68-0.77, respectively). PPV was optimized by requiring ≥2 instances of MHC ICD-9 codes or by only accepting codes from mental health visits. NPV was optimized by supplementing VHA data with Medicare data. Findings inform efforts to identify MHC in quality improvement programs that assess health care disparities. When using administrative data in mental health studies, researchers should consider the nature of their research question in choosing algorithms for MHC identification.
Druss BG, Bradford DW, Rosenheck RA, Radford MJ, Krumholz HMMental disorders and use of cardiovascular procedures after myocardial infarction . JAMA. 2000;283: 506-511.
2.
Hermann RC, Ettner SL, Dorwart RAThe influence of psychiatric disorders on patients’ ratings of satisfaction with health care. Med Care. 1998;36:720-727.
3.
Hoff RA, Rosenheck RA, Meterko M., Wilson NJMental illness as a predictor of satisfaction with inpatient care at Veterans Affairs hospitals. Psychiatr Serv. 1999;50: 680-685.
4.
Druss BG, Rosenheck RAUse of medical services by veterans with mental disorders. Psychosomatics. 1997;38: 451-458.
5.
Ashton CM, Petersen NJ, Souchek J., et al. Geographic variations in utilization rates in Veterans Affairs hospitals and clinics. N Engl J Med. 1999;340:32-39.
6.
Hoge CW, Lesikar SE, Guevara R., et al. Mental disorders among U.S. military personnel in the1990s: association with high levels of health care utilization and early military attrition. Am J Psychiatry. 2002 ;159: 1576-1583.
7.
Seng JS, Clark MK, McCarthy AM, Ronis DLPTSD and physical comorbidity among women receiving Medicaid: results from service-use data. J Trauma Stress. 2006;19:45-56.
8.
Smith BM, Weaver FM, Ullrich PMPrevalence of depression diagnoses and use of antidepressant medications by veterans with spinal cord injury. Am J Phys Med Rehabil. 2007;86:662-671.
9.
Committee on Quality Health Care in America, Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press; 2001.
10.
American Psychiatric Association. Diagnostic and Statistical Manualof Mental Disorders. 4th ed. Washington, DC: American Psychiatric Press; 1994.
11.
Spettell CM , Wall TC, Allison J., et al. Identifying physician-recognized depression from administrative data: consequences for quality measurement. Health Serv Res. 2003;38:1081-1102.
12.
Juster IA, Stensland M., Brauer L., Thuras P.Use of administrative data to identify health plan members with unrecognized bipolar disorder: a retrospective cohort study. Am J Manag Care. 2005;11:578-584.
13.
Desai MM, Rosenheck RA, Craig TJCase-finding for depression among medical outpatients in the Veterans Health Administration. Med Care. 2006;44:175-181.
14.
Frayne SM, Halanych JH, Miller DR, et al. Disparities in diabetes care: impact of mental illness. Arch Intern Med. 2005;165:2631-2638.
15.
Miller DR, Safford MM, Pogach LMWho has diabetes? Best estimates of diabetes prevalence in the Department of Veterans Affairs based on computerized patient data. Diabetes Care. 2004;27(suppl 2):B10-B21.
16.
Perlin J., Kazis L., Skinner K., et al. Health Status and Outcomes of Veterans: Physical and Mental Component Summary Scores, Veterans SF361999 Large Health Survey of Veteran Enrollees Executive Report. Washington, DC: Department of Veterans Affairs; 2000.
17.
Fleming C., Fisher ES, Chang CH, Bubolz TA, Malenka DJStudying outcomes and hospital utilization in the elderly: The advantages of a merged data base for Medicare and Veterans Affairs hospitals. Med Care. 1992;30:377-391.
18.
Dillman D. Mail and Telephone Surveys: The Total Design Method . New York, NY: John Wiley; 1978.
19.
American Psychiatric Association. Diagnostic and Statistical Manualof Mental Disorders, 4th Edition: Primary Care Version (DSM-IV-PC). Washington, DC: American Psychiatric Association; 1995.
20.
Pingitore D., Sansone RAUsing DSM-IV primary care version: a guide to psychiatric diagnosis in primary care. Am Fam Physician. 1998;58:1347-1352.
21.
Peyrot M., Rubin RRPersistence of depressive symptoms in diabetic adults. Diabetes Care. 1999;22:448-452.
22.
Klinkman MS, Schwenk TL, Coyne JCDepression in primary care-more like asthma than appendicitis: the Michigan depression project. Can J Psychiatry. 1997 ;42:966-973.
23.
Bremner JD, Southwick SM, Darnell A., Charney DSChronic PTSD in Vietnam combat veterans: course of illness and substance abuse . Am J Psychiatry. 1996;153:369-375.
24.
Daradkeh TKStability of psychiatric diagnoses in clinical practice. Int J Soc Psychiatry. 1996;42:207-212.
25.
Desai MM, Rosenheck RA, Druss BG, Perlin JBMental disorders and quality of diabetes care in the Veterans Health Administration . Am J Psychiatry. 2002;159:1584-1590.
26.
Charbonneau A., Rosen AK, Ash AS, et al. Measuring the quality of depression care in a large integrated health system. Med Care. 2003;41:669-680.
27.
Moos RH, Mertens JRPatterns of diagnoses, comorbidities, and treatment in late-middle-aged and older affective disorder patients: comparison of mental health and medical sectors. J Am Geriatr Soc. 1996;44:682-688.
28.
Tisnado DM, Adams JL, Liu H., et al. What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Med Care . 2006;44: 132-140.
29.
Simpson CF, Boyd CM, Carlson MC, Griswold ME, Guralnik JM, Fried LPAgreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement. J Am Geriatr Soc. 2004;52: 123-127.
30.
Skinner KM, Miller DR, Lincoln E., Lee A., Kazis LEConcordance between respondent self-reports and medical records for chronic conditions: experience from the Veterans Health Study. J Ambul Care Manage. 2005;28:102-110.
31.
Haapanen N. , Miilunpalo S., Pasanen M., Oja P., Vuori I.Agreement between questionnaire data and medical records of chronic diseases in middle-aged and elderly Finnish men and women . Am J Epidemiol. 1997;145:762-769.
32.
Midthjell K. , Holmen J., Bjorndal A., Lund-Larsen G.Is questionnaire information valid in the study of a chronic disease such as diabetes? The Nord-Trondelag diabetes study . J Epidemiol Community Health. 1992;46:537-542.
33.
Katz JN, Chang LC, Sangha O., Fossel AH, Bates DWCan comorbidity be measured by questionnaire rather than medical record review ? Med Care. 1996;34:73-84.
34.
Hebert PL, Geiss LS, Tierney EF, Engelgau MM, Yawn BP, McBean AMIdentifying persons with diabetes using Medicare claims data. Am J Med Qual. 1999;14:270-277.
35.
Borzecki AM , Wong AT, Hickey EC, Ash AS, Berlowitz DRIdentifying hypertension-related comorbidities from administrative data: what’s the optimal approach? Am J Med Qual. 2004;19:201-206.
36.
Lurie N., Popkin M., Dysken M., Moscovice I., Finch M.Accuracy of diagnoses of schizophrenia in Medicaid claims. Hosp Community Psychiatry. 1992;43:69-71.
37.
Walkup JT, Boyer CA, Kellermann SLReliability of Medicaid claims files for use in psychiatric diagnoses and service delivery. Adm Policy Ment Health. 2000;27: 129-139.
38.
Rawson NS, Malcolm E., D’Arcy C.Reliability of the recording of schizophrenia and depressive disorder in the Saskatchewan health care datafiles. Soc Psychiatry Psychiatr Epidemiol. 1997;32:191-199.
39.
Kashner TMAgreement between administrative files and written medical records: a case of the Department of Veterans Affairs. Med Care. 1998;36:1324-1336.
40.
Hankin CS, Spiro A III, Miller DR, Kazis L. Mental disorders and mental health treatment among U.S. Department of Veterans Affairs outpatients: the Veterans Health Study. Am J Psychiatry. 1999;156:1924-1930.
41.
Rosenheck R., Greenberg G.Department of Veterans Affairs National Mental Health Program Performance Monitoring System: Fiscal Year2001 Report. West Haven, CT: North-east Program Evaluation Center , VA Connecticut Healthcare System; 2002.
42.
Friedman MJ , Schnurr PP, McDonagh-Coyle A.Posttraumatic stress disorder in the military veteran. Psychiatr Clin North Am . 1994;17:265-277.
43.
Perez-Stable EJ, Miranda J., Munoz RF, Ying YWDepression in medical outpatients: underrecognition and misdiagnosis. Arch Intern Med. 1990;150:1083-1088.
44.
Unutzer J., Schoenbaum M., Druss BG, Katon WJTransforming mental health care at the interface with general medicine: report for the presidents commission. Psychiatr Serv. 2006; 57:37-47.
45.
Jencks SFRecognition of mental distress and diagnosis of mental disorder in primary care. JAMA. 1985;253:1903-1907.
46.
Rost K., Smith R., Matthews DB, Guise B.The deliberate misdiagnosis of major depression in primary care. Arch Fam Med. 1994;3:333-337.
47.
Walkup JT, Yanos PTPsychological research with administrative data sets: an underutilized strategy for mental health services research. Prof Psychol Res Pr. 2005;36:551-557.
