Equating Tests Under the Graded Response Model

Abstract

The Stocking and Lord (1983) procedure for computing equating coefficients for tests having dichotomously scored items is extended to the case of graded response items. A system of equations for obtaining the equating coefficients under Samejima's (1969, 1972) graded response model is derived. These equations are used to compute equating coefficients in two related situations. Under the first, the equating coefficients are obtained by matching, on an examinee by examinee basis, the true scores on two tests. In the second case, the equating coefficients are obtained by matching the test characteristic curves (TCCS) of the two tests. Several examples of computing equating coefficients in these two situations are provided. The TCC matching ap proach was much less demanding computationally and yielded equating coefficients that differed little from those obtained through the true score distribution matching approach.

Keywords

Index terms: equating coefficients graded response model,quadratic loss function response function method,Stocking and Lord equating technique test equating,test characteristic curves.

Get full access to this article

View all access options for this article.

References

Baker, F.B. (1986). GENIRV: Computer program for generating item responses . Unpublished manuscript, University of Wisconsin-Madison .

Baker, F.B. , & Al- Karni, A. (1991). A comparison of two procedures for computing IRT equating coefficients. Journal of Educational Measurement , 28, 147-163.

Davidon, W.C. (1959). Variable metric method for minimization (Research and Development Rep. No. ANL-5990, revised edition. Argonne IL: Argonne National Laboratory, U.S. Atomic Energy Commission.

Fletcher, R. , & Powell, M.J.D. (1963). A rapidly convergent descent method for minimization. The Computer Journal, 6, 163-168.

Haebara, T. (1980). Equating logistic ability scales by a weighted least squares method. Japanese Psychological Research, 22, 144-149.

Lord, F.M. (1980). Applications of item response theory to practical testing problems. Hillsdale NJ: Erlbaum.

Loyd, B.H. , & Hoover, H.D. (1980). Vertical equating using the Rasch model. Journal of Educational Measurement, 17, 179-193.

Marco, G.L. (1977). Item characteristic curve solutions to three intractable testing problems. Journal of Educational Measurement, 14, 2, 139-160.

Press, W.H. , Flannery, B.P. , Teukolsky, S.A. , & Vetterling, W.T. (1986). Numerical Recipes. Cambridge England: Cambridge University Press.

10.

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, No. 17.

11.

Samejima, F. (1972). A general model for free-response data. Psychometrika Monograph, No. 18.

12.

Stocking, M.L. (1985). Transforming B's using a least squares technique: The TBLT system. [Computer program manual]. Unpublished manuscript, Educational Testing Service, Princeton NJ.

13.

Stocking, M.L. , & Lord, F.M. (1983). Developing a common metric in item response theory . Applied Psychological Measurement, 7, 201-210.

14.

Thissen, D. (1988). MULTILOG: Multiple, categorical item analysis and test scoring using item response theory [Computer program]. Mooresville: Scientific Software.