Development and validation of lupus nephritis case definitions using United States veterans affairs electronic health records

Abstract

Objective

International Classification of Diseases (ICD) codes are commonly used to identify patients with rare diseases in electronic health records (EHRs). However, misclassification is common, impacting the validity of study results. In this study, we compared the accuracies of several ICD-based case definitions of lupus nephritis (LN) in identifying United States veterans with LN.

Methods

Using the Department of Veterans Affairs (VA) EHR, we identified all veterans with ≥1 ICD-9 or 10 diagnostic codes for systemic lupus erythematosus (SLE) between October 1, 1999 and September 30, 2017. A cohort was randomly selected for diagnostic validation and 9 ICD-based LN case definitions were applied to this cohort. The diagnostic accuracy of each definition was assessed against gold standard criterion of biopsy-proven LN.

Results

18,420 veterans had ≥1 ICD-9 or 10 diagnostic codes for SLE; 981 were randomly selected for diagnostic validation. 95 veterans (9.7%) had biopsy-proven LN. The case definitions had high specificity and NPV but variable sensitivity and PPV. The definition containing ≥2 ICD -9 codes for SLE and ≥2 nephritis indicators had the highest combination of sensitivity and specificity (87.4% and 94.6% respectively). ICD-10 code for LN had high specificity (99.8%) and PPV (93.9%).

Conclusion

ICD-based case definitions of LN in the VA population have high specificity and NPV but variable sensitivity and PPV. Our results may help guide the design of future LN studies in VA cohorts. The choice of specific case definitions depends on the relative importance of different accuracy measures to individual studies.

Keywords

Lupus nephritis International Classification of Diseases case definition validation Veterans Affairs electronic health records

Get full access to this article

View all access options for this article.

References

Schwartzman-Morris

Putterman

Gender differences in the pathogenesis and outcome of lupus and of lupus nephritis. Clin Dev Immunol 2012; 2012: 604892.

Feldman

Costenbader

KH.

Editorial: a stalemate in lupus-related end-stage renal disease: can we do better?

Arthritis Rheumatol (Hoboken, NJ) 2016; 68: 1323–1326.

Hoover

Costenbader

KH.

Insights into the epidemiology and management of lupus nephritis from the US rheumatologist's perspective. Kidney Int 2016; 90: 487–492.

Hanly

O’Keeffe

, et al. The frequency and outcome of lupus nephritis: results from an international inception cohort study. Rheumatology (Oxford, England) 2016; 55: 252–262.

Bernatsky

Boivin

Joseph

, et al. Mortality in systemic lupus erythematosus. Arthritis Rheum 2006; 54: 2550–2557.

Nossent

Cikes

Kiss

, et al. Current causes of death in systemic lupus erythematosus in Europe, 2000–2004: relation to disease activity and damage accrual. Lupus 2007; 16: 309–317.

Wallace

Podell

Weiner

Klinenberg

Forouzesh

Dubois

EL.

Systemic lupus erythematosus–survival patterns. Experience with 609 patients. JAMA 1981; 245: 934–938.

Almaani

Meara

Rovin

BH.

Update on lupus nephritis. Clin J Am Soc Nephrol 2017; 12: 825–835.

Costenbader

Desai

Alarcón

, et al. Trends in the incidence, demographics and outcomes of end-stage renal disease due to lupus nephritis in the U.S., 1995–2006. Arthritis Rheum 2011; 63: 1681–1688.

10.

Parikh

Rovin

BH.

Current and emerging therapies for lupus nephritis. J Am Soc Nephrol 2016; 27: 2929–2939.

11.

Rijnink

Teng

YKO

Wilhelmus

, et al. Clinical and histopathologic characteristics associated with renal outcomes in lupus nephritis. Clin J Am Soc Nephrol 2017; 12: 734–743.

12.

Mok

Kwok

Yip

PS.

Effect of renal disease on the standardized mortality ratio and life expectancy of patients with systemic lupus erythematosus. Arthritis Rheum 2013; 65: 2154–2160.

13.

Bright

Avorn

Everitt

DE.

Medicaid data as a resource for epidemiologic studies: strengths and limitations. J Clin Epidemiol 1989; 42: 937–945.

14.

Widdifield

Labrecque

Lix

, et al. Systematic review and critical appraisal of validation studies to identify rheumatic diseases in health administrative databases. Arthritis Care Res (Hoboken) 2013; 65: 1490–1503.

15.

Moores

Sathe

NA.

A systematic review of validated methods for identifying systemic lupus erythematosus (SLE) using administrative or claims data. Vaccine 2013; 31 Suppl 10: K62–73.

16.

Arkema

Jönsen

Rönnblom

Svenungsson

Sjöwall

Simard

JF.

Case definitions in Swedish register data to identify systemic lupus erythematosus. BMJ Open 2016; 6: e007769.

17.

Chibnik

Massarotti

Costenbader

KH.

Identification and validation of lupus nephritis cases using administrative data. Lupus 2010; 19: 741–743.

18.

Singh

Holmgren

Noorbaloochi

Accuracy of veterans administration databases for a diagnosis of rheumatoid arthritis. Arthritis Rheum 2004; 51: 952–957.

19.

Singh

Holmgren

Krug

Noorbaloochi

Accuracy of the diagnoses of spondylarthritides in veterans affairs medical center databases. Arthritis Rheum 2007; 57: 648–655.

20.

Zgibor

Orchard

Saul

, et al. Developing and validating a diabetes database in a large health system. Diabetes Res Clin Pract 2007; 75: 313–319.

21.

Churg

Bernstein

Glassock

RJ.

Renal disease: classification and atlas of glomerular diseases. 2nd ed. New York: Igaku-Shoin, 1995.

22.

Weening

D’Agati

Schwartz

, et al. The classification of glomerulonephritis in systemic lupus erythematosus revisited. J Am Soc Nephrol 2004; 15: 241–250.

23.

Ernesto

Amaral

MSP

Mendelsohn

Cefalu

Current and future demographics of the veteran population, 2014–2024. Popul Rev 2018; 57: 28–60.

24.

Hanly

Thompson

Skedgel

Identification of patients with systemic lupus erythematosus in administrative healthcare databases. Lupus 2014; 23: 1377–1382.

25.

Lim

Bayakly

Helmick

Gordon

Easley

Drenkard

The incidence and prevalence of systemic lupus erythematosus, 2002-2004: the Georgia lupus registry. Arthritis Rheumatol 2014; 66: 357–368.

26.

Katz

Barrett

Liang

, et al. Sensitivity and positive predictive value of Medicare part B physician claims for rheumatologic diagnoses and procedures. Arthritis Rheum 1997; 40: 1594–1600.

27.

Bernatsky

Joseph

Pineau

Tamblyn

Feldman

Clarke

AE.

A population-based assessment of systemic lupus erythematosus incidence and prevalence–results and implications of using administrative data for epidemiological studies. Rheumatology (Oxford) 2007; 46: 1814–1818.

28.

Benchimol

Manuel

Griffiths

Rabeneck

Guttmann

Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol 2011; 64: 821–829.

29.

Chubak

Pocobelli

Weiss

NS.

Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol 2012; 65: 343–349.e2.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.18 MB