The overlap coefficient () measures the similarity between two distributions through the overlapping area of their distribution functions. Given its intuitive description and ease of visual representation by the straightforward depiction of the amount of overlap between the two corresponding histograms based on samples of measurements from each one of the two distributions, the development of accurate methods for confidence interval construction can be useful for applied researchers. The overlap coefficient has received scant attention in the literature since it lacks readily available software for its implementation, while inferential procedures that can cover the whole range of distributional scenarios for the two underlying distributions are missing. Such methods, both parametric and non-parametric are developed in this article, while R-code is provided for their implementation. Parametric approaches based on the binormal model show better performance and are appropriate for use in a wide range of distributional scenarios. Methods are assessed through a large simulation study and are illustrated using a dataset from a study on human immunodeficiency virus-related cognitive function assessment.
ClevelandWSLachenbruchPA. A measure of divergence among several populations. Commun Stat1974; 3: 201–211.
2.
MulekarMSMishraSN. Overlap coefficients of two normal densities: equal means case. J Jpn Stat Soc1994; 24: 189–180.
3.
SneathP. A method for testing the distinctness of clusters: a test of the disjunction of two clusters in euclidean space as measured by their overlap. J Int Assoc Math Geol1977; 9: 123–143.
4.
HornHS. Measuremtn of overlap in comparative ecology studies. Am Nat1966; 100: 419–424.
5.
HurlbertSH. The measurement of niche overlap and some relatives. Ecology1978; 59: 67–77.
6.
PiankaER. The structure of lizard communities. Annual Rev Ecol Syst1973; 4: 53–74.
7.
AndersonGLintonOWhangY-J. Nonparametric estimation and inference about the overlap of two distributions. J. Econometrics2012; 171: 1–23.
8.
GastwirthJL. Statistical measures of earnings differentials. Amer Statist1975; 29: 32–35.
9.
LamD. Lorenz curves, inequality, and social welfare under changing population com position. J Policy Model1988; 10: 141–162.
10.
WeitzmanML. Measures of overlap of income distributions of white and Negro families in the United States. US Bureau of the Census: Vol. 22, 1970.
11.
BayoudHA. Testing the equality of two Pareto distributions. In Proceedings of the World Congress on Engineering, II, London, UK, 2017.
12.
Al-SaidyOSamawiHMAl-SalehMF. Inference on overlap coefficients under the weibull distribution: Equal shape parameter. ESAIM Probab Stat2005; 9: 206–219.
13.
FedererWT, s, L. and PayneMG. Studies on statistical procedures applied to chemical genetic data from sugar beets. Tech. Report, number 77, Agricultural Experimentation Station. Colorado State University, 1963.
14.
MizunoSYamaguchiTFukushimaA, et al. Overlap coefficient for assessing the similarity of pharmacokinetic data between ethnically different populations. Clin Trials2005; 2: 174–181.
15.
MontoyaJAFigueroaGGonzàlez-SànchezD. Statistical inference for the weitzman overlapping coefficient in a family of distributions. Appl Math Model2019; 71: 558–568.
16.
SamawiHMRobertLV. A more efficient nonparametric test of symmetry based on overlapping coefficient. Biometrics Biostatist Int J2014; 1: 00015. MedCrave Group. doi: 10.15406/bbij.2014.01.00015.
17.
Silva-FortesCTurkmanMASousaL. Arrow plot: a new graphical tool for selecting up and down regulated genes and genes differentially expressed on sample subgroups. BMC Bioinformatics2012; 13: 147–148.
18.
AndersenJPSchneiderJWJagsiR, et al. Meta-research: Gender variations in citation distributions in medicine are very small and due to self-citation and journal prestige. Elife2019; 8: e45374.
19.
LevenduskyMSPopeJC. Red states vs. blue states: going beyond the mean. Public Opin Q2011; 75: 227–248.
20.
BradleyEL. Overlapping Coefficient. In Encyclopedia of Statistical Sciences, Volume 6. Edited by KtozS, Balakrishnan N, Read CB, Vidakovic B and Johnson NL. New York: Chapman and Hall, 546–547, 1985.
21.
InmanHFBradleyEL. The overlapping coefficient as a measure of agreement between two probability distributions and point estimation of the overlap of two normal densities. Commun Statist Theory Methods1989; 18: 3851–3872.
22.
SamawiHMYinJRochaniH, et al. Notes on the overlap measure as an alternative to the youden index: How are they related?. Stat Med2017; 36: 4230–4240.
23.
WangDTianL. Parametric methods for confidence interval estimation of overlap coefficients. Comput Stat Data Anal2017; 106: 12–26.
24.
RoystonPAltmanDG. Visualizing and assessing discrimination in the logistic regression model. Stat Med2010; 29: 2508–2520.
25.
Al-SalehMSamawiH. Inference on overlapping coefficients in two exponential populations. J Mod Stat Sci2007; 6: 503–516.
26.
ChaubeyYPSenDMishraSN. Inference on overlap for two inverse gaussian populations: equal means case. Commun Stat Theory Method2008; 37: 1880–1894.
27.
HeluASamawiH. On inference of overlapping coefficients in two lomax populations using different sampling methods. J Stat Theory Pract2011; 5: 683–696.
28.
MulekarMSMishraSN. Confidence interval estimation of overlap: equal means case. Comput Statist Data Anal2000; 34: 121–137.
29.
ReiserBFaraggiD. Confidence intervals for the overlapping coefficient: the normal equal variance case. J R Stat Soc.: Ser D (Statist.)1999; 48: 413–418.
30.
SamawiHMAl-SalehMF. Inference on overlapping coefficients in two exponential populations using ranked set sampling. Commun Stat Appl Methods2008; 15: 147–159.
31.
ClemonsTEBradleyEL. A nonparametric measure of the overlapping coefficient. Comput Statist Data Anal2000; 34: 51–61.
32.
SchmidFSchmidtA. Nonparametric estimation of the coefficient of overlapping theory and empirical application. Comput Statist Data Anal2006; 50: 1583–1596.
33.
BoxGECoxDR. An analysis of transformations. J. R. Stat. Soc. Ser. B Stat. Methodol 1964; 26: 211–252.
34.
ZouKHHallWJ. Two transformation models for estimating an ROC curve derived from continuous data. Journal of Applied Statistics2000; 27: 621–631.
35.
ChangLLeePLYiannoutsosCT, et al. A multicenter in vivo proton-MRS study of HIV-associated dementia and its relationship to age. NeuroImage2004, 23, 1336–1347.
36.
NaviaBAJordanBDPriceRW. The aids dementia complex: I. Clinical features. Ann Neurol1986; 19: 517–524.
37.
InmanH.F. Behavior and properties of the overlapping coefficient as a measure of agreement between distributions. Ph. Dissertation. University of Alabama in Birmingham, 1984.
38.
MulekarMSPereira De AndradeN. A necessary condition for computation of the overlap measure. Am J Math Manage Sci2017; 36: 112–117.
39.
BantisLENakasCTReiserB. Construction of confidence intervals for the maximum of the youden index and the corresponding cutoff point of a continuous biomarker. Biom J2019; 61: 138–156.
40.
ZhouX-HObuchowskiNAMcCliskDK. Statistical Methods in Diagnostic Medicine. John Wiley & Sons, New Jersey: Second Edition, 2011.
41.
ZouKHLiuABandosAI, et al. Statistical Evaluation of Diagnostic Performance: Topics in ROC Analysis. Boca Raton, Florida: Chapman & Hall, 2012.
42.
HanleyJA. The robustness of the “binormal” assumptions used in fitting ROC curves. Med Decis Making1988; 8: 197–203.
43.
HanleyJA. The use of the ’binormal’ model for parametric ROC analysis of quantitative diagnostic tests. Stat Med1996; 15: 1575–1585.
44.
LaskoTABhagwatJGZouKH, et al. The use of receiver operating characteristic curves in biomedical informatics. J Biomed Inform2005; 38: 404–415.
45.
FaraggiDReiserB. Estimation of the area under the ROC curve. Stat Med2002; 21: 3093–3106.
46.
FlussRFaraggiDReiserB. Estimation of the youden index and its associated cutoff point. Biom J2005; 47: 458–472.
47.
Franco-PereiraAMNakasCTPardoMC. Biomarker assessment in ROC curve analysis using the length of the curve as an index of diagnostic accuracy: the binormal model framework. AStA Adv Stat Anal2020; 104: 625–647. DOI: 10.1007/s10182-020-00371-8
48.
MolodianovitchKFaraggiDReiserB. Comparing the areas under two correlated ROC curves: parametric and non parametric approaches. Biom J2006; 48: 745–757.
49.
SchistermanEFFaraggiDReiserBHuJ. Youden index and the optimal threshold for markers with mass at zero. Stat Med2008; 27: 297–315.
50.
DoksumKAWongCW. Statistical tests based on transformed data. J Am Stat Assoc1983; 78: 411–417.
51.
BantisLENakasCTReiserB. Construction of confidence regions in the ROC space after the estimation of the optimal youden index-based cut-off point. 2014Biometrics70: 212–223.
52.
WandMPJonesMC. Kernel smoothing. London: Chapman and Hall, 1995.
53.
AbramsonIS. On bandwidth variation in kernel estimates-A square root law. Ann Stat1982; 10: 1217–1223.
54.
JonesMCMarronJSParkBU. A simple root bandwidth selector. Ann Stat1991; 19: 1919–1932.
SilvermanBW. Density Estimation for Statistics and Data Analysis. London: Chapman & Hall, 1986.
57.
Hosmer JrDWLemeshowSSturdivantRX. Applied logistic regression. Hoboken, New Jersey: John Wiley, 2013.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
