Correcting for verification bias in studies of a diagnostic test's accuracy

Abstract

Standard methods for assessing the accuracy of diagnostic tests require determination of true disease status for each study patient. In practice, some study patients might not have verified disease status. If the decision to verify a patient is influenced by the test result, analysis using only verified cases might lead to biased results, commonly known as verification bias. This paper reviews recent developments in bias-correction methods for studies on the accuracy of diagnostic tests.

Get full access to this article

View all access options for this article.

References

Rifkin MD , Zerhouni EA , Gatsonis CA et al. Comparison of magnetic resonance imaging and ultrasonography in staging early prostate cancer . New England Journal of Medicine 1990; 323: 621-626 .

Begg CB , Greenes RA. Assessment of diagnostic tests when disease is subject to selection bias . Biometrics 1983; 39: 207-216 .

Ransohoff DF , Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests . New England Journal of Medicine 1978; 299: 926-930 .

Levine JJ , Seidman E , Walker WA. Screening tests for enteropathy in children . American Journal of Diseases of Children 1987; 141: 435-438 .

Tavel ME , Enas NH , Woods JR. Screening tests for enteropathy in children . American Journal of Cardiology 1987; 60: 1167-1169 .

Drum DE , Christacopoulos JS. Hepatic scintigraphy in clinical decision making . Journal of Nuclear Medicine 1972; 13: 908-915 .

Marshall V , Williams DC , Smith KD. Diaphanography as a means of detecting breast cancer . Radiology 1984; 150: 339-343 .

Greenes RA , Begg CB. Assessment of diagnostic technologies: methodology for unbiased estimation from samples of selective verified patients . Investigative Radiology 1985; 20: 751-756 .

Bates AS , Margolis PA , Evans AT. Verification bias in pediatric studies evaluating diagnostic tests . Journal of Pediatrics 1993; 122: 585-590 .

10.

Philbrick JT , Horwitz RI , Feinstein AR. Methodologic problems of excerise testing for coronary artery disease: groups, analysis and bias . American Journal of Cardiology 1980; 46: 807-812 .

11.

Hui SL , Zhou XH. Evaluation of diagnostic tests without gold standards . Statistical Methods in Medical Research 1998; 7: 354-370 .

12.

Feinstein AR. On the sensitivity, specificity and discrimination of diagnostic tests . Clinical Pharmacology and Therapeutics 1975; 17: 104-116 .

13.

Zhou XH. Maximum likelihood estimators of sensitivity and specificity corrected for verification bias . Communication in Statistics - Theory and Methods 1993; 22: 3177-3198 .

14.

Zhou XH. Effect of verification bias on positive and negative predictive values . Statistics in Medicine 1994; 13: 1737-1745 .

15.

Schatzkin A , Connor RJ , Taylor PR et al. Comparing new and old screening tests when a reference procedure cannot be performed on all screenees . American Journal of Epidemiology 1987; 125: 672-678 .

16.

Baker SG. Evaluating multiple diagnostic tests with partial verification . Biometrics 1995; 51: 330-337 .

17.

Zhou XH. Comparing accuracies of two screening tests in a two-phase study for dementia . Journal of Royal Statistical Society, Series C, Applied Statistics 1998; 47: 135-147 .

18.

SAS Institute Inc. SAS/STAT user's guide, Version 6. SAS Institute, Inc., Cary, NC , 1990.

19.

Zhou XH. Nonparametric ML estimate of an ROC area corrected for verification bias . Biometrics 1996; 52: 310-316 .

20.

Agresti A. Categorical data analysis. New York: John Wiley , 1990.

21.

Metz CE. ROC Methodology in radiologic imaging . Investigative Radiology 1986; 21: 720-733 .

22.

Swets JA. ROC analysis applied to the evaluation of medical imaging techniques . Investigative Radiology 1979; 14: 109-121 .

23.

Hanley JA. Receiver operating characteristic (ROC) curve methodology . Critical Reviews in Diagnostic Imaging 1989; 29: 307-335 .

24.

Gray R , Begg CB , Greenes RA. Construction of receiver operating characteristic curves when disease verification is subject to selection bias . Medical Decision Making 1984; 4: 151-164 .

25.

Hunink MGM , Richardson DK , Doubilet PM , et al. Testing for fetal pulmonary maturity: ROC analysis involving covariates, verification bias, and combination testing . Medical Decision Making 1990; 10: 201-211 .

26.

Rodenberg CA , Zhou XH. ROC curve estimation when covariates affect the verification . Biometrics 1998; in press.

27.

Rodenberg CA. Correcting for verification bias in ROC estimation with covariates. PhD thesis, Department of Statistics, Purdue University, West Layafette, Indiana, 1996.

28.

Little RJA , Rubin DB. Statistical analysis with missing data. New York: John Wiley , 1987.

29.

Lehmann EL Theory of point estimation. New York: John Wiley , 1983.

30.

Efron B , Tibshirani RJ. An introduction to the bootstrap. New York: Chapman & Hall , 1993.

31.

Dorfman DD and Alf E. Maximum liklihood estimation of parameters of signal detection theory and determination of confidence intervals: rating data . J Math Psychol 1969; 6: 487-496 .

32.

England WL. An exponential model used for optimal threshold selection on ROC curves . Medical Decision Making 1988; 8: 120-131 .

33.

Grey DR , Morgan BJT. Some aspects of ROC curve-fitting: normal and logistic models . Journal of Mathematical Psychology 1972; 9: 128-129 .

34.

Ogilvie JC , Creelman CD. Maximum-likelihood estimation of receiver operating characteristic curve parameters . Journal of Mathematical Psychology 1968; 5: 377-391 .

35.

McCullagh P. Regression models for ordinal data . Journal of Royal Statistical Society, Series B 1980; 42: 109-142 .

36.

Tosteson AAN , Begg CB. A general regression methodology for ROC curve estimation . Medical Decision Making 1985; 8: 204-215 .

37.

Toledano AY. Generalized estimating equations for repeated ordinal categorical data, with applications to diagnostic medicine. PhD thesis, Department of Biostatistics, Harvard School of Public Health, Boston, MA, 1993.

38.

Robbins JM , Rotnitzky A , Zhao LP. Estimation of regression coefficients when some regressors are not always observed . Journal of the Americian Statistical Association 1994; 89: 846-866 .

39.

Paik MC. The generalized estimating equation approach when data are not missing completely at random . Journal of the Americian Statistical Association 1997; 92: 1320-1329 .

40.

Zhou XH. Comparing the correlated areas under the ROC curves of two diagnostic tests in the presence of verification bias . Biometrics 1998; 54: 349-366 .

41.

Liang KY , Zeger SL. Longitudinal data analysis using generalized linear models . Biometrika 1988; 73: 13-22 .

42.

Toledano AY , Gatsonis CA. Ordinal regression methdology for ROC curves derived from correlated data . Statistics in Medicine 1996; 15: 1807-1826 .

43.

Zhou XH , Higgs R. COMPROC and CHECKNORM: computer programs for comparing accuracies of diagnostic tests using ROC curves in the presence of verification bias . Computer Methods and Programs in Biomedicine 1998; in press.