A total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima’s graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule.
Andrich, D. (1978). Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied Psychological Measurement, 2, 581-594.
2.
Baek, S. G. (1995). Computerized adaptive attitude testing using the partial credit model. Dissertation Abstracts International—A, 55(7-A), 1922. Abstract retrieved March 10, 2003, from PsychInfo database.
3.
Balasubramanian, S. K., & Kamakura, W. A. (1989). Measuring consumer attitudes toward the marketplace with tailored interviews. Journal of Marketing Research, 26, 311-326.
4.
Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179-197.
5.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
6.
Dodd, B. G., De Ayala, R. J., & Koch, W. R. (1995). Computerized adaptive testing with polytomous items. Applied Psychological Measurement, 19, 5-22.
7.
Dodd, B. G., Koch, W. R., & De Ayala, R. J. (1989). Operational characteristics of adaptive testing procedures using the graded response model. Applied Psychological Measurement, 13, 129-143.
8.
Drasgow, F., & Buchanan, J. B. (Eds.). (1999). Innovations in computerized assessment. Mahwah, NJ: Lawrence Erlbaum.
9.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
10.
Everitt, B. S. (1977). The analysis of contingency tables. New York: John Wiley.
11.
Finger, M. S., & Ones, D. S. (1999). Psychometric equivalence of the computer and booklet forms of the MMPI: A meta-analysis. Psychological Assessment, 11, 58-66.
12.
Gibbons, J. D. (1985). Nonparametric statistical inference. New York: Marcel Dekker.
13.
Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802.
14.
Hol, A. M., Vorst, H. C. M., & Mellenbergh, G. J. (2001). Toepassing van een computergestuurde adaptieve testprocedure op persoonlijkheidsdata [Application of a computerized adaptive test procedure on personality data]. Nederlands Tijdschrift Voor de Psychologie, 56, 119-133.
15.
Koch, W. R., Dodd, B. G., & Fitzpatrick, S. J. (1990). Computerized adaptive measurements of attitudes. Measurement and Evaluation in Counseling and Development, 23, 20-30.
16.
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
17.
McCoach, D. B. (2002). A validation study of the school attitude assessment survey. Measurement and Evaluation in Counseling and Development, 35, 66-77.
18.
McCoach, D. B., & Siegle, D. (2003). The School Attitude Assessment Survey-Revised: A new instrument to identify academically able students who underachieve. Educational and Psychological Measurement, 63, 414-429.
19.
Mead, A. D., & Drasgow, F. (1993). Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin, 114, 449-458.
20.
Meijer, R. R., & Nering, M. L. (1999). Computerized adaptive testing: Overview and introduction. Applied Psychological Measurement, 23, 187-194.
21.
Mellenbergh, G. J. (1995). Conceptual notes on models for discrete polytomous item responses. Applied Psychological Measurement, 19, 91-100.
22.
Reise, S. P., & Henson, J. M. (2000). Computerization and adaptive administration of the NEO PI-R. Assessment, 7, 347-364.
23.
Samejima, F. (1969). Estimation of latent trait ability using a response pattern of graded scores. Psychometrika Monograph, no. 17.
24.
Samejima, F. (1997). Graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85-100). New York: Springer-Verlag.
25.
Singh, J., Howell, R. D., & Rhoads, G. K. (1990). Adaptive designs for Likert-type data: An approach for implementing marketing research. Journal of Marketing Research, 27, 304-321.
26.
Stevens, J. (1996). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum.
27.
Thissen, D. (1991). Multilog 6.0 user’s guide. Chicago: Scientific Software.
28.
Tutz, G. (1990). Sequential item response models with an ordered response. British Journal of Mathematical and Statistical Psychology, 43, 39-55.
29.
Vorst, H. C. M. (2000). Schoolvragenlijst [School Attitude Questionnaire]. Lisse, the Netherlands: Swets & Zeitlinger.
30.
Waller, N. G. (1999). Searching for structure in the MMPI. In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement: What every psychologist and educator should know (pp. 185-217). Mahwah, NJ: Lawrence Erlbaum.
31.
Waller, N. G., & Reise, S. P. (1989). Computerized adaptive personality assessment: An illustration with the Absorption Scale. Journal of Personality and Social Psychology, 57, 1051-1058.
32.
Wicherts, J. M. (2002). Meetequivalentie tussen pen & papier en computerafname van vragenlijsten: Alexithymie, sociale wenselijkheid en angst [Measurement equivalence of paper-and-pencil and computerized administration of questionnaires: Alexithymia, social desirability, and anxiety]. Unpublished master’s thesis, University of Amsterdam.
33.
Zwick, R. (1985). Nonparametric one-way multivariate analysis of variance: A computational approach based on the Pillai-Bartlett trace. Psychological Bulletin, 97, 148-152.
