A Recommended formula for scoring probabilistic multiple-choice tests

This paper addresses the issue of how best to score test responses obtained when using Probabilistically Answered Examinations (PAE). After discussing the PAE methodology, the paper identifies and explores the attributes of a simple, intuitively appealing scoring rule. The results of this analysis suggest that, in many classroom situations, this simple scoring rule produces indices of test effectiveness that are at least as good as those produced by more complicated and costly scoring rules. These tentative findings are drawn upon in support of the use of this simple scoring rule with PAE.