An Investigation of the Rasch Simple Logistic Model: Sample Free Item and Test Calibration1

Abstract

This research investigated the use of the Rasch simple logistic model in item and test calibration. Tests employing word, picture, symbol, and number analogies were administered to high school students, college students, civil service clerical employees, and clients of the Minnesota Division of Vocational Rehabilitation. The results indicated that Rasch item easiness ratios and z item difficulty ratios were invariant with respect to the ability of the calibrating sample when an adequate sample was employed and the test design did not incorporate biasing factors. The invariance of the Rasch item easiness ratios was shown to be related to the goodness-of-fit of the items to the Rasch model in that the deletion of items with low Rasch probabilities increased the invariance of the Rasch item easiness ratios. The estimation of the amount of ability indicated by the raw scores on a test was also shown to be invariant with respect to the ability of the calibrating sample for tests of 25 or more items, even when samples of fewer than 100 subjects were studied.

Get full access to this article

View all access options for this article.

References

Anderson, J. , Kearney, G. E. , and Everett, A. V. An evaluation of Rasch's structural model for test items. The British Journal of Mathematical and Statistical Psychology, 1968, 21, 231-238.

Barth, W. H. , Lele, K. , and Rosse, R. Item analysis by the Rasch model. Minneapolis: Department of Psychological Foundations of Education, 1970.

Birnbaum, A. Efficient design and use of tests of mental ability for various decision making problems. School of Aviation Medicine, United States Air Force, Report No. 58-16, 1957.

Birnbaum, A. Statistical theory for logistic mental test models with a prior distribution of ability. Journal of Mathematical Psychology, 1969, 6, 258-276.

Bliss, E. F. The difficulty of an item. Journal of Educational Psychology, 1929, 20, 63-66.

Brink, N. E. Overview of the Rasch model. Proceedings of the 79th Annual Convention of the American Psychological Association , 1971, 101-102.

Brooks, R. D. An empirical investigation of the Rasch ratio-scale model for item difficulty indexes. (Doctoral dissertation, University of Iowa) Ann Arbor, Michigan: University Microfilms, 1965, No. 65-434.

Guilford, J. P. Psychometric methods (2nd ed.). New York: McGraw-Hill, 1954.

Guilford, J. P. Three faces of intellect. American Psychologist, 1959, 14, 469-479.

10.

Guilford, J. P. Intelligence: 1965 model. American Psychologist, 1966, 21, 20-26.

11.

Gulliksen, H. Theory of mental tests. New York: John Wiley and Sons, 1950.

12.

Helmstadter, G. C. Principles of psychological measurement. New York: Appleton-Century-Crofts , 1964.

13.

Horst, A. P. The difficulty of a multiple choice item. Journal of Educational Psychology, 1933, 24, 229-232.

14.

Lord, F. M. and Novick, M. R. Statistical theories of mental test scores. Reading, Mass.: Addison-Wesley, 1968.

15.

Panchapakesan, N. The simple logistic model and mental measurement. Unpublished Doctoral dissertation, University of Chicago, 1969.

16.

Rasch, G. Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research, 1960.

17.

Rasch, G. On general laws and the meaning of measurement in psychology. Proceedings of the Fourth Symposium on Mathematical Statistics, 1961, 4, 321-334.

18.

Rasch, G. An item analysis which takes individual differences into account. British Journal of Mathematical and Statistical Psychology, 1966a, 19, 49-57.

19.

Rasch, G. An individualistic approach to item analysis. In P. F. Lazarsfeld and N. W. Henry (Eds.), Readings in mathematical social science. Chicago: Science Research Associates, 1966b, 89-108.

20.

Richardson, M. W. The relationship between the difficulty and the differential validity of a test. Psychometrika, 1936, 2, 33-49.

21.

Schmidt, W. H. Necessity of the model. Paper given at the 1970 American Educational Research Association Presession on Sample Free Item Analysis and Person Measurement, Minneapolis, March, 1970.

22.

Sitgreaves, R. Review of G. Rasch, Probabilistic models for some intelligence and attainment tests. Psychometrika , 1963, 28, 219-220.

23.

Thorndike, E. L. , Bergman, E. O. , Cobb, M. V. , and Woodyard, E. The measurement of intelligence . New York: Bureau of Public Teachers College, Columbia University, 1926.

24.

Thurstone, L. L. A method of scaling psychological and educational tests. Journal of Educational Psychology , 1925, 16, 433-451.

25.

Thurstone, L. L. The calibration of test items . American Psycologist, 1947, 2, 103-104.

26.

Tinsley, H. E. A. An investigation of the Rasch simple logistic model for tests of intelligence or attainment. (Doctoral dissertation, University of Minnesota), Ann Arbor, Michigan : University Microfilms, 1972 , No. 72-14, 387.

27.

Tucker, L. R. Selecting appropriate scales for tests. Proceedings of the 1952 Invitational Conference on Testing Problems. Princeton, N. J.: Educational Testing Service, 1953, 22-28.

28.

Wright, B. Sample-free test calibration and person measurement. Proceedings of the 1967 Invitational Conference on Testing Problems. Princeton, N. J.: Educational Testing Service, 1967, 85-101.

29.

Wright, B. and Panchapakesan, N. A procedure for sample-free item analysis. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1969, 29, 23-48.

30.

Wright, B. and Panchapakesan, N. Item analysis by the Rasch model, UCSL801. Chicago: University of Chicago Computation Center, Social Science Program Library, 1970.