Data from a 45-item vocabulary test (tryout edition) were used to assess the degree of congruence between the signed area measure, the unsigned area measure, Lord's chi-square statistic, and the Mantel-Haenszel (MH) technique in identifying items with significant differential item functioning (DIF). In both the Black-White and Female-Male comparisons, the three methods based on item response theory (IRT) identified the same items as having statistically significant DIF. There was close agreement between the MH technique and the three IRT-based procedures only in the Female-Male comparison; different items were identified as biased in the Black-White comparison.
Get full access to this article
View all access options for this article.
References
1.
Baker, F. B. , Al-Karni, A., and Al-Dosary, I. M. (1991). EQUATE: A computer program for the test characteristic curve method of IRT equating. Applied Psychological Measurement, 15, 78.
2.
Drasgow, F. and Parsons, C. K. (1983). Applications of unidimensional item response models to multidimensional data. Applied Psychological Measurement, 7, 189-199.
3.
Hambleton, R. K. and Swaminathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer Nijhoff Publishing.
4.
Holland, P. W. and Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer and H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Erlbaum.
5.
Hulin, C. L. , Drasgow, F., and Parsons, C. K. (1983). Item response theory: Applications to psychological measurement. Home- wood, IL: Dow-Jones-Irwin.
6.
Lim, R. G. and Drasgow, F. (1990). Evaluation of two methods for estimating item response theory parameters when assessing differential item functioning. Journal of Applied Psychology, 2, 164-174.
7.
Lord, F. M. (1980). Applications of item response theory to practical problems. Hillsdale, NJ: Erlbaum.
8.
McLaughlin, M. E. and Drasgow, F. (1987). Lord's chi-square test of item bias with estimated and with known person parameters. Applied Psychological Measurement, 11, 161-173.
9.
Mislevy, R. J. and Bock, R. D. (1990). BILOG: Item analysis and test scoring with binaty logistic models. Morresville, IN: Scientific Software.
10.
Raju, N. S. (1988). The area between two item characteristic curves. Psychometrika, 53, 495-502.
11.
Raju, N. S. (1990). Determining the significance of estimated signed and unsigned areas between two item response functions. Applied Psychological Measurement, 14, 197-207.
12.
Reckase, M. D. (1979). Unifactor latent trait models applied to multi-factor tests: Results and implications. Journal of Educational Statistics, 4, 207-230.
13.
The Riverside Publishing Company (1989). Gates-MacGinitie Reading Tests. Chicago: Author.
14.
Rudner, L. M. , Geston, P. P., and Knight, D. L. (1980). A Monte Carlo comparison of seven biased item detection techniques. Journal of Educational Measurement, 17, 1-10.
15.
Shepard, L. A. , Camilli, G., and Averill, M. (1981). Comparison of procedures for detecting test-item bias with both internal and external ability criteria. Journal of Educational Statistics, 6, 317-375.
16.
Stocking, M. L. and Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measure- ment, 7, 210-210.
17.
Swaminathan, H. and Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361-370.
18.
Tatsuoka, M. M. (1988). Multivariate analysis: Techniques for educational and psychological research. New York: Macmillan.
