The Evaluation of a Microcomputer Scoring Program to Mark Examinee Write-in Responses

A study was undertaken to determine the feasibility of using a computer program to mark examinee write-in responses. It compared the performance of a computer against that of physician markers. A new examination designed to assess clinical decision-making was administered to eighteen residents. The write-in responses on twenty-three questions were marked both by physicians and a microcomputer. The study found the computer to be more consistent in marking, equally as cost effective, and as valid as physician markers. Since the computer provided question statistics (i.e., means, frequencies of examinees' responses) it was evaluated to be better and more helpful than physician markers by providing data useful for improving examination questions and learning experiences.