A Comparison of Logistic Regression and Mantel-Haenszel Procedures for Detecting Differential Item Functioning

Abstract

The Mantel-Haenszel (MH) procedure is sensitive to only one type of differential item functioning (DIF). It is not designed to detect DIF that has a non uniform effect across trait levels. By generalizing the model underlying the MH procedure, a more general DIF detection procedure has been developed (Swaminathan & Rogers, 1990). This study compared the performance of this procedure—the logistic regression (LR) procedure—to that of the MH procedure in the detection of uniform and non uniform DIF in a simulation study which examined the distributional properties of the LR and MH test statistics and the relative power of the two proce dures. For both the LR and MH test statistics, the expected distributions were obtained under nearly all conditions. The LR test statistic did not have the expected distribution for very difficult and highly discriminating items. The LR procedure was found to be more powerful than the MH procedure for detecting nonuniform DIF and as powerful in detecting uniform DIF.

Keywords

Index terms: differential item functioning logistic regression Mantel-Haenszel statistic nonuniform DIF uniform DIF.

Get full access to this article

View all access options for this article.

References

Hambleton, R.K. , & Swaminathan, H. (1985). Item response theory. Boston MA: Kluwer-Nijhoff.

Holland, P.W. , & Thayer, D.T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale NJ: Erlbaum.

Raju, N.S. (1988). The area between two item characteristic curves . Psychometrika, 53, 495-502.

Swaminathan, H. , & Rogers, H.J. (1990). Detecting item bias using logistic regression procedures. Journal of Educational Measurement, 27, 361-370.