True Score Equating by Fixed b's Scaling: A Flexible and Stable Equating Alternative

Abstract

Six methods of equating The Test of English as a Foreign Language (TOEFL) test scores were evaluated in terms of scale stability. True score item response theory (IRT) equating based on "Fixed b's" scaling, the current TOEFL operational scaling and equating procedure, was found to produce the least discrepant results when compared to two IRT models (b parame ter estimated, a and c parameters fixed; all three pa rameters reestimated), and to three conventional equat ing methods (Tucker, Levine, and equipercentile). The results for Fixed b 's scaling were limited by an inade quately fit item; but if such items can be identified prior to calibration, or if pretested data are observed to produce reliable estimates of total group data, then true score IRT equating based on scaling by fixing the b parameters of a set of pretested items may be a very acceptable option.

Get full access to this article

View all access options for this article.

References

Angoff, W.H. Summary and derivations of equating methods used at ETS. In P. W. Holland & D. B. Rubin (Eds.), Test equating. New York : Academic Press, 1982.

Angoff, W.H. , & Dyer, H.S. The admissions testing program. In W. H. Angoff (Ed.), The College Board Admissions Program: A technical report on research and development activities relating to the Scholastic Aptitude Test and Achievement Tests. New York: College Entrance Examination Board, 1971.

Braun, H.I. , & Holland, P.W. Observed score test equating: A mathematical analysis of some ETS equating procedures. In P. W. Holland & D. B. Rubin (Eds.), Test equating. New York: Academic Press, 1982.

Levine, R.S. Equating the score scales of alternate forms administered to samples of different ability (RB-55-23). Princeton NJ: Educational Testing Service, 1955.

Lord, F.M. Applications of item response theory to practical testing problems. Hillsdale NJ: Erlbaum, 1980.

Lord, F.M. The standard error of equipercentile equating (RR-81-48). Princeton NJ: Educational Testing Service, 1981.(a)

Lord, F.M. Unbiased estimators of ability parameters, of their variance, and of their parallel forms reliability (RR-81-50). Princeton NJ: Educational Testing Service, 1981.(b)

Lord, F.M. Statistical bias in maximum likelihood estimators of item parameters (RR-82-20-0NR) . Princeton NJ: Educational Testing Service, 1982.

Marco, G.L. Item characteristic curve solutions to three intractable testing problems . Journal of Educational Measurement, 1977 , 14, 139-160.

10.

Petersen, N.S. , Marco, G.L. , & Stewart, E.E. A test of the adequacy of linear score equating methods. In P. W. Holland & D. B. Rubin (Eds.), Test equating. New York : Academic Press, 1982.

11.

Stocking, M.L. , & Lord, F.M. Developing a common metric in item response theory (RR-82-25-0NR). Princeton NJ: Educational Testing Service, 1982.

12.

Wood, R.L. , Wingersky, M.S. , & Lord, F.M. LOGIST: A computer program for estimating examinee ability and item characteristic curve parameters (RM-76-6). Princeton NJ: Educational Testing Service, 1976.