Parametric Three-Way Receiver Operating Characteristic Surface Analysis Using Mathematica

Abstract

Three-way receiver operating characteristic (ROC) surface analysis involves the calculation of a volume under an ROC surface (VUS), which is a measure of discriminatory accuracy of 2 diagnostic tests for 3 diseases. Nonparametric methods for calculating VUS and its standard error have been developed. The author presents the code for roc3D, a Mathematica computer program for performing parametric ROC surface analysis. roc3D calculates VUS assuming a multinormal distribution of test results in the 3 diseased populations, provides user-specified pointwise confidence limits for VUS, and displays a 3-dimensional plot of the ROC surface. Limitations of the roc3D program are discussed.

Keywords

three-way receiver operating characteristic computer programs Mathematica

Get full access to this article

View all access options for this article.

References

Green DM , Swets JA . Signal Detection Theory and Psychophysics. New York: RE Kreiger; 1974.

Lusted LB . Signal detectability and medical decision making. Science. 1971;171:1217-1219.

Centor RM . Signal detectability: the use of ROC curves and their analyses. Med Decis Making. 1991;11:102-106.

Mossman D. Three-way ROCs. Med Decis Making. 1999;19:78-89.

Dreiseitl S , Ohno-Machado L , Binder M. Comparing three-class diagnostic tests by three-way ROC analysis. Med Decis Making. 2000;20:323-331.

Wolfram S. Mathematica: A System for Doing Mathematics by Computer. 2nd ed. Reading, MA: Addison-Wesley; 1991.

Dorfman DD , Alf E JR. Maximum likelihood estimation of parameters of signal detection theory—a direct solution. Psychometrika. 1968;33:117-124.

Dorfman DD , Alf E JR. Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals—rating-method data. J Math Psychol. 1969;6:487-496.

Hanley JA , McNeil BJ . The meaning and use of the area under the receiver operating characteristic (ROC) curve. Radiology. 1982; 143:29-36.

10.

Hanley JA . The robustness of the “binormal” assumptions used in fitting ROC curves. Med Decis Making. 1988;8:197-203.

11.

Fryback DG . Bayes’ theorem and conditional nonindependence of data in medical diagnosis. Computers Biomed Res. 1978;11:423-434.

12.

Ma G , Hall WJ . Confidence bands for receiver operating characteristic curves. Med Decis Making. 1993;13:191-197.