Cloze Technique and Multiple Choice Technique: Reliability and Validity

Abstract

Two multiple choice forms of two cloze tests were developed based on the most frequent responses given to the cloze forms by college students. These forms were administered to large samples of undergraduate students and were scored and item analyzed with original keys, empirical keys, and empirical keys with option weighting. Correlations were calculated between different scales and Scholastic Aptitude Test Scales, Co-operative English Test scales and High School Deciles for the samples. These validity indices for the scales and tests were compared. The results indicated a trend for the empirical key scales to be more reliable and valid than the other scales across different forms and samples. The multiple choice forms, although ostensibly less reliable, appeared to be more valid than the cloze forms. Option weighting did not increase the validity of the scales, and as such, was considered not useful with cloze tests.

Get full access to this article

View all access options for this article.

References

Anderson, J.H. Cloze measure as indices of achievement comparison when learning from extended prose. Journal of Educational Measurements, 1974, 11, 83-92.

Bormuth, J.R. Cloze test as a measure of comprehension ability and readability. Unpublished Doctoral Dissertation, Indiana University, 1962.

Bormuth, J.R. Cloze as a measure of readability. In J. A. Figurel (Ed.), The proceedings, International Reading Association . New York: Scholastic Magazine , 1963, 131-134.

Cranney, A.G., Jr. A comparison of the free response and multiple choice cloze reading test. Unpublished Doctoral Dissertation, Minnesota University, 1968.

Davis, F.B. and Fifer, G. The effect on test reliability and validity of scoring aptitude and achievement tests with weights for every choice. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1959, 19, 159-170.

Feldt, L.S. The approximate sampling distribution of Kuder-Richardson reliability coefficient twenty. Psychometrika, 1965, 30, 357-370

Fletcher, E., Jr. A study of the relationship between ability to use context as an aid in reading and other verbal abilities. Unpublished Doctoral Dissertation, University of Washington, 1959.

Gallant, R.M.F. An investigation of the cloze tests as a measure of readability of materials for primary grades. Unpublished Doctoral Dissertation, Indiana University, 1964.

Guttman, L. An outline of the statistical theory prediction. In Paul Horst (Ed.), The prediction of personal adjustment . New York, Social Science Research Council, 1941.

10.

Nedelsky, L. Ability to avoid gross error as a measure of achievement. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1954, 14, 459-472.

11.

Olkin, I. Correlation Revisited. In Julian C. Stanley (Ed.), Improving Experimental Design and Statistical Analysis . Chicago, Rand McNally , 1967.

12.

Taylor, W.L. Cloze procedure: a new tool for measuring readability. Journalism Quarterly, 1953, 30, 415-433.

13.

Taylor, W.L. Recent developments in the use of cloze procedure. Journalism Quarterly, 1956, 33, 42-48.