Bayesian hierarchical latent class models for estimating diagnostic accuracy

Abstract

The diagnostic accuracy of a test or rater has a crucial impact on clinical decision making. The assessment of diagnostic accuracy for multiple tests or raters also merits much attention. A Bayesian hierarchical conditional independence latent class model for estimating sensitivities and specificities for a large group of tests or raters is proposed, which is applicable to both with-gold-standard and without-gold-standard situations. Through the hierarchical structure, not only are the sensitivities and specificities of individual tests estimated, but also the diagnostic performance of the whole group of tests. For a small group of tests or raters, the proposed model is further extended by introducing pairwise covariances between tests to improve the fitting and to allow for more modeling flexibility. Correlation residual analysis is applied to detect any significant covariance between multiple tests. Just Another Gibbs Sampler (JAGS) implementation is efficiently adopted for both models. Three real data sets from literature are analyzed to explicitly illustrate the proposed methods.

Keywords

Binary diagnostic outcome latent class model multiple tests sensitivity specificity

Get full access to this article

View all access options for this article.

References

Hui

Walter

. Estimating the error rates of diagnostic tests. Biometrics 1980; 36: 167–171.

Joseph

Gyorkos

Coupal

. Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. Am J Epidemiol 1995; 141: 263–272.

Dendukuri

Joseph

. Bayesian approaches to modeling the conditional dependence between multiple diagnostic tests. Biometrics 2001; 57: 158–167.

Vacek

. The effect of conditional dependence on the evaluation of diagnostic tests. Biometrics 1985; 41: 959–968.

Brenner

. How independent are multiple ‘independent’ diagnostic classifications? Stat Med 1996; 15: 1377–1386.

Torrance-Rynard

Walter

. Effects of dependent errors in the assessment of diagnostic test performance. Stat Med 1997; 16: 2157–2175.

Yang

Becker

. Latent variable modeling of diagnostic accuracy. Biometrics 1997; 53: 948–958.

Jones

Johnson

Hanson

, et al. Identifiability of models for multiple diagnostic testing in the absence of a gold standard. Biometrics 2010; 66: 855–863.

Tan

Kutner

. Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics 1996; 52: 797–810.

10.

Albert

Dodd

. A cautionary note on the robustness of latent class models for estimating diagnostic error without a gold standard. Biometrics 2004; 60: 427–435.

11.

van Smeden

Naaktgeboren

Reitsma

, et al. Latent class models in diagnostic studies when there is no reference standard–a systematic review. Am J Epidemiol 2014; 179: 423–431.

12.

Collins

Albert

. Estimating diagnostic accuracy without a gold standard: A continued controversy. J Biopharmaceut Stat 2016; 26: 1078–1082.

13.

Rothenberg

. Identification in parametric models. Econometrica 1971; 39: 577–591.

14.

Dendukuri

Rahme

Belisle

, et al. Bayesian sample size determination for prevalence and diagnostic test studies in the absence of a gold standard test. Biometrics 2004; 60: 388–397.

15.

Gustafson

. On model expansion, model contraction, identifiability and prior information: two illustrative scenarios involving mismeasured variables. Stat Sci 2005; 20: 111–140.

16.

Zhang

Chen

Albert

. Estimating diagnostic accuracy of raters without a gold standard by exploiting a group of experts. Biometrics 2012; 68: 1294–1302.

17.

Lin

Chen

Edwards

, et al. Modeling rater diagnostic skills in binary classification processes. Stat Med 2018; 37: 557–571.

18.

Plummer M. Jags: A program for analysis of Bayesian graphical models using Gibbs sampling. In: Proceedings of the 3rd international workshop on distributed statistical computing, Vienna, Austria. ISSN 1609-395X, 2003.

19.

Kruschke

. Doing Bayesian data analysis: a tutorial with r, jags, and stan, Cambridge, MA: Academic Press, 2015.

20.

Robert

Soubrian

. Estimation of a mixture model through Bayesian sampling and prior feedback. Test 1993; 2: 125–146.

21.

Gelman A, Carlin JB, Stern HS, et al. Bayesian data analysis. UK: Chapman and Hall, CRC Texts in Statistical Science, 2013.

22.

Su YS and Yajima M. Using R to Run ‘JAGS’. R package version 0.5-7. 2015, https://CRAN.R-project.org/package=R2jags.

23.

Spiegelhalter

Best

Carlin

, et al. Bayesian measures of model complexity and fit (with discussion). J Royal Stat Soc, Ser B 2002; 64: 583–639.

24.

Beam

Conant

Sickles

. Association of volume-independent factors with accuracy in screening mammogram interpretation. J Natl Cancer I 2003; 4: 282–290.

25.

Alvord

Drummond

Arthur

, et al. A method for predicting individual HIV infection status in the absence of clinical information. AIDS Res Human Retrovirus 1988; 4: 295–304.

26.

Espeland

Handelman

. Using latent class models to characterize and assess relative error in discrete measurements. Biometrics 1989; 45: 587–599.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.15 MB