Item Homogeneity in Verbal Tests: A Rasch Analysis of Amthauer'S Verbal Tests

Abstract

The dichotomous Rasch model was applied to the verbal subtests of the Intelligence Structure Test Battery (IST) developed by Amthauer (1973). Three tests were used: (a) Word-grouping, (b)Word Analogies, and (c) Word-pairing. The first two are similar to tests which have been used by Thurstone (1938) in his search for the "Primary Mental Abilities." The tests were administered with a time-limit. Hence, not all items were completed in the time given. The Rasch model held for neither of the tests, when all items were included in the analysis. Importantly, van den Wollenberg's 02statistic was highly significant, which may indicate multidimensionality of the items. A thorough analysis based on subsets of items made quite clear that the following five factors should be taken into account to understand the poor model fit: (1) ambiguity in the formulation of the items; (2) the use of specific knowledge to solve the problems; (3) the use of distractors by which the subject may easily be tempted to resort to responses which seem to be correct, but are actually incorrect; (4) the use of specific problem solving strategies, which appear in some of the items, but not in all;(5) positional effects, in which some alternatives attract the attention more than others. The factors as such do not violate the Rasch model. The Rasch model may only be violated when such a factor plays a role in some of the items, but not in all. In order to establish item homogeneity one should take into consideration the following rule: if any factor is used to increase the difficulty of the items, then that factor should be used in all items.

Get full access to this article

View all access options for this article.

References

Amthauer, R. (1973). Intelligenz-Struktur-Test LS. T. 70. Handan-weisung fair die Durchfiihrung und Auswertung. Gottingen: Verlag fur Psychologie.

Fischer, G. H. (1974). Einfiihrung in die Theorie psychologischer Tests. Vienna: Hans Huber Verlag.

Monks, F. J. , van Boxtel, H. W. , Roelofs, J. J. W. , and Sanders, M. P. M. (1986). The identification of gifted children in secondary education and a description of their situation in Holland. In: Heller, K. A. and Feldhusen, J. F. (Eds.). Identifying and nurturing the gifted. Pp. 39-65. Toronto: Hans Huber Publishers.

Thurstone, L. L. (1938). Primary mental abilities. Chicago (Illinois): The University of Chicago Press.

van der Ven, A. H. G. S. (1992). A Rasch analysis of Amthauer's cubes test. European Joumal of Psychological Assessment. (submitted for publication).

van den Wollenberg, A. L. (1979). The Rasch model and time-limit tests (doctoral dissertation). Nijmegen (The Netherlands), The University of Nijmegen.

van den Wollenberg, A. L. (1982a). Two new test statistics for the Rasch model. Psychometrika, 47, 123-140.

van den Wollenberg, A. L. (1982b). A simple and effective method to test the dimensionality axiom of the Rasch model. Applied Psychological Measurement, 6, 83-91.

van den Wollenberg, A. L. and Raaijmakers, M. (1979). RADI: program for the dichotomous Rasch model. Nijmegen (The Netherlands), The University of Nijmegen, Internal Report 79 MA 06.