Alternative Response and Scoring Methods for Multiple-Choice Items: An Empirical Study of Probabilistic and Ordinal Response Modes

Abstract

Binary, probability, and ordinal scoring proce dures for multiple-choice items were examined. In a situation where true scores were experimentally controlled by the manipulation of partial informa tion, it was found that both the probability and or dinal scoring systems were more reliable than the binary scoring method. A second experiment using vocabulary items and standard reliability estimation procedures also showed higher reliability for the two partial information scoring methods relative to binary scoring.