Statistical Inference for two Reliability Indices in Mastery Testing Based on the Beta-Binomial Model

In mastery testing the raw agreement index and the kappa index may be estimated via one test administration when the test scores follow beta-binomial distributions. This paper reports formulae, tables, and a computer program which facilitate the computation of the standard errors of the estimates. Illustrative applications are provided in the form of confidence intervals, hypothesis testing, and minimum sample sizes in reliability studies for mastery tests.