Evaluation of Negation in Stems of Multiple-Choice Items

Abstract

The opinion of some test experts is that negation (e.g., not, except) should be used sparingly or avoided in the stems of multiplechoice items. In these items, examinees are required to select the one alternative that is false from among those that are true. However, negation continues to be used and frequently accounts for 15-20% of the multiple-choice items within a given medical examination. A 90-item multiple-choice examination was administered in various formats to approximately 200 nursing students in each of two consecutive academic years. The findings of the present study provide evidence that the use of negation in stems should be limited and that the single-response, negatively worded (SRNW) item should often be converted to a multiple-response, positively worded (MRPW) item. This recommendation is based on the inherent cuing (ie., eliminating some alternatives by comparative deduction) within SRNW items and on an increase in the reliability and concurrent validity of MRPW test scores.

Get full access to this article

View all access options for this article.

References

Albanese, M. A. , Kent, T. A. , & Whitney, D. R. (1977). A comparison of the difficulty, reliability and validity of complex multiple choice, multiple response, and multiple true-false items. Annual Conference of Research in Medical Education, 16, 105-110.

Albanese, M. A. , & Sabers, D. L. (1988). Multiple true-false items: A study of inter-item correlations, scoring alternatives, and reliability estimation. Journal of Educational Measurement, 25, 111-123.

Dudycha, A. L. , & Carpenter, J. B. (1973). Effects of item format on item discrimination and difficulty. Journal ofApplied Psychology, 58, 116-121.

Ferguson, G. A. (1971). Statistical analysis in psychology and education. New York: McGrawHill.

Frisbie, D. A. , & Sweeney, D. C. (1982). The relative merits of multiple true-false achievement tests. Journal of Educational Measurement, 19, 29-35.

Gronlund, N. , & Linn, J. E. (1990). Measurement and evaluation in teaching (6th ed.). New York: Macmillan.

Harasym, P. H. , Norris, D. A. , & Lorscheider, F. L. (1980). Evaluating student multiple-choice responses: Effects of coded and free formats. Evaluation & the Health Professions, 3, 63-84.

Hubbard, J. P. (1978). Measuring medical education-the tests and the experience of the National Board of Medical Examiners (2nd ed.). Philadelphia: Lea & Febiger.

Huttenlocher, J. (1962). Some effects of negative instances on the formation of simple concepts. Psychological Reports, 11, 35-42.

10.

Lord, F. M. , & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

11.

Morrison, D. F. (1967). Multivariate statistical methods. New York: McGraw-Hill.

12.

Swanson, D. B. , Case, S. M. , Kelley, P. R. , Lawley, J. L. , Nungester, R. J. , Powell, R. D. , & Volle, R. L. (1991). Phase-in of the NBME Comprehensive Part I Examination. Academic Medicine, 66, 443-444.

13.

Timm, N. H. (1975). Multivariate analysis with applications in education and psychology. Monterey, CA: Brooks/Cole.

14.

Violato, C. , & Marini, A. E. (1989). Effects of stem orientation and completeness of multiplechoice items on item difficulty and discrimination. Educational andPsychological Measurement, 49, 287-295.

15.

Wason, P. C. (1961). Response to affirmative and negative binary statements. British Journal of Psychology, 52, 133-142.

16.

Zern, D. (1967). Effects of variations in question-phrasing on true-false answers by grade-school children. Psychological Reports, 20, 527-533.