A method is proposed for classifying diagnostic tests that have underlying binormal distri butions. The method involves using the parameters that characterize these distributions as axes of a two-dimensional graph called a separation-asymmetry (S-A) diagram. Each point on an S-A diagram corresponds to a possible diagnostic test. The diagram also has super imposed on it any of three possible families of curves of constant performance: curves of constant area under the ROC graph (iso-AUR), curves of constant overlap area (iso-OA), and curves of constant maximum information (iso-MaxInfo). Thus, the performance of any test can be determined immediately by identifying the iso-performance curve of the desired type that passes through the corresponding point of the S-A diagram. The concept of "ec centric" diagnostic tests is defined and incorporated into the S-A diagrams. The classification scheme is applied to 28 diagnostic tests. Excellent agreement is found in the ranking between the iso-OA and iso-MaxInfo measures of performance, but the iso-AUR produces markedly different results. Only three of the 28 tests were found to be eccentric. Several other inter esting patterns emerged. Key words: diagnostic tests; separation-asymmetry diagrams; test efficacy; information theory; receiver operator characteristic analysis. (Med Decis Making 1994;14:157-168)
Get full access to this article
View all access options for this article.
References
1.
Somoza E., Mossman D.Introduction to neuropsychiatric decision making: binary diagnostic testsJ Neuropsychiat Clin Neurosci.1990 ;2:297-300.
2.
Green DM, Swets JASignal detection theory and psychophysicsNew York: John Wiley and Sons, 1974 .
3.
Metz CEBasic principles of ROC analysisSemin Nucl Med. 1978;8:283-98.
4.
Swets JAMeasuring the accuracy of diagnostic systemsScience.1988;240:1285-93.
Somoza E., Mossman D.ROC curves and the binormal assumptionJ Neuropsychiat Clin Neurosci.1991;3:436-9.
7.
Swets JAForms of empirical ROCs in discrimination and diagnostic tasks: implications for theory and measurement performancePsychol Bull.1986;99:181-98.
8.
Hanley JAThe robustness of the "binormal" assumptions used in fitting ROC curvesMed Decis Making.1988;8:197-203.
9.
Green DM, Swets JASignal Detection Theory and PsychophysicsNew York : John Wiley and Sons, 1966.
10.
Hanley JA, McNeil BJThe meaning and use of the area under a receiver operating characteristic (ROC) curveRadiology.1982;143:29-36.
11.
Swets JAROC analysis applied to the evaluation of medical imaging techniquesInvest Radiol.1979;14:109-121.
12.
Borland International, 1987. 1800 Green Hills Road; P.O. Box 660001, Scotts Valley, CA 95067-0001.
13.
Shannon CE, Weaver W.The Mathematical Theory of CommunicationUrbana, IL: University of Illinois Press, 1963.
14.
Metz CE, Goodenough DJ, Rossmann K.Evaluation of receiver operating characteristic curve data in terms of information theoiy, with applications in radiographyRadiology . 1973;109:297-303.
15.
Mossman D., Somoza E.Diagnostic tests and information theoryJ Neuropsychiat Clin Neurosci.1992;4:95-8.
16.
Somoza E., Mossman D.Comparing diagnostic tests using information theory: the INFO-ROC techniqueJ Neuropsychiat Clin Neurosci.1992;4:214-9.
17.
Somoza E., Mossman D.Comparing and optimizing diagnostic tests: an information theoretical approachMed Decis Making.1992;12:179-88.
18.
Mossman D., Somoza E.Maximizing diagnosis information from the dexamethasone suppression test: an approach to criterion selection using receiver operating characteristic analysisArch Gen Psychiat.1989;45:653-60.
19.
Somoza E., Soutullo-Esperon L., Mossman D.Evaluation and optimization of diagnostic tests using receiver operating characteristic analysis and information theoryInt J Biomed Comput.1989;24:153-89.
20.
Somoza E., Mossman D.Optimizing REM latency as a diagnostic test for depression using receiver operating characteristic analysis and information theoryBiol Psychiat.1990;27:990-1006.
21.
Somoza E., Mossman D."Biological markers" and psychiatric diagnosis: risk-benefit balancing using ROC analysisBiol Psychiat. 1991;29:811-26.
22.
Weiss SH, Goedert JJ, Sarngadharan MG, Bodner AJ, Ballo RC, Blattner WAScreening test for HTLV-III (AIDS agent) antibodiesJAMA . 1985;253:221-5.
23.
Carlson JR, Bryant ML, Hinrichs SH, et al.AIDS serology testing in low- and high-risk groupsJAMA.1985;253:3405-8.
24.
Reesink HW, Huisman JG, Gonsalves M., et al.Evaluation of six enzyme immunoassays for antibody against human immunodeficiency virusLancet. 1988;ii:483-6.
25.
Lee TH, Weisberg MC, Cook EF, Daley K., Brand DA, Goldman L.Evaluation of creatine kinase and creatine kinase-MB for diagnosing myocardial infarctionArch Intern Med.1987 ;147: 115-21.
26.
Mendlewicz J., Kerhofs M., Hoffmann G., Linkowski P.Dexamethasone suppression test and REM sleep in patients with major depressive disorderBr J Psychiat.1984;145:383-8.
27.
Akiskal HS, Lemmi H., Yerevanian B., King D., Belluomini J.The utility of the REM latency test in psychiatric diagnosis: a study of 81 depressed outpatientsPsychiat Res.1982 ;7:101-10.
28.
Feinberg M. , Gillin JC, Carroll BJ, Greden JF, Zis APEEG studies of sleep in the diagnosis of depression1982;17:305-16.
29.
Rush AJ, Giles DE, Roffwarg HP, Parker CRSleep EEG and dexamethasone suppression test findings in outpatients with unipolar major depressive disordersBiol Psychiat.1982;17:327-41.
30.
Berger M., Doerr P., Lund R., Bronish T., von Zerssen D.Neuroendocrinological and neurophysiological studies in major depressive disorders: are there biological markers for the endogenous subtype?Biol Psychiat.1982;17:1217-42.
31.
Briley MS, Langer SZ, Raisman R.Tritiated imipramine binding sites are decreased in platelets of untreated depressed patientsScience.1980 ;209:303-5.
32.
Paul SM, Rehavi M., Skolnich P., Ballenger JC, Goodwin FKDepressed patients have decreased binding of tritiated imipramine to platelet serotonin "transporter."Arch Gen Psychiat.1981; 38:1315-7.
33.
Suranyi-Cadotte BE, Gauthier S., Lafaille F., et al.Platelet 3H-imipramine binding distinguishes depression from Alzheimer dementiaLife Sci.1985;37:2305-11.
34.
Nemeroff CB , Knight DL, Krishman RR, et al.Marked reduction in the number of platelet-tritiated imipramine binding sites in geriatric depressionArch Gen Psychiat.1988;45:919-23.
35.
Carroll BJ, Feinberg M., Gieden JP, et al.A specific laboratory test for the diagnosis of melancholia: standardization, validation and clinical utilityArch Gen Psychiat.1981;38:15-22.
36.
Mendlewicz J., Charles G., Francksen JMThe dexamethasone suppression test in affective disorder: relationship to clinical and genetic subgroupsBr J Psychiat.1982;141:464-70.
37.
Sarai M., Matsunaga H.Low-dose (0.5 mg) dexamethasone suppression test in depressive patientsBiol Psychiat.1986;21: 744-50.
38.
Peselow ED, Goldring N., Fieve RR, Wright R.The dexamethasone suppression test in depressed outpatients and normal control subjectsAm J Psychiat.1983;140:245-7.
39.
Coppen A., Abou-Saleh M., Milln P., Metcalfe M., Harwood J., Bailey J.Dexamethasone suppression test in depression and other psychiatric illnessesBr J Psychiat.1982;142:498-504.
40.
Bionskill MJ , Hendelman RM, Poon PY, et al.Magnetic resonance imaging, computed tomography and radio nuclide scintigraphy in detection of liver metastasesJ Can Assoc Radiol. 1988 ;39: 3-9.
41.
Gohagan JK, Spitznagel EL, McCrate MM, et al.ROC analysis of mammography and palpation for breast screeningInvest Radiol.1984;19:547-92.
42.
Kokman E., Naessens JM, Offord KPA short test of mental status: description and preliminary resultsMayo Clin Proc.1987;62: 281-8.
43.
Behrens VJ, Worner TM, Braly LF, et al.Carbohydrate-deficient transferrin, a marker for chronic alcohol consumption in different ethnic populationsAlcoholism: Clin Exp Res.1988;12: 427-32.
44.
Ghanbari HA , Barney BE, Haigler HJ, et al.Biochemical assay of Alzheimer's disease associated protein(s) in human brain tissueJAMA . 1990;263:2907-10.
