The Objective Borderline Method: a probabilistic method for standard setting |
| |
| Authors: | Boaz Shulruf Phillippa Poole Philip Jones Tim Wilkinson |
| |
| Institution: | 1. Medical Education, University of New South Wales, Sydney, Australia;2. Department of Medicine, University of Auckland, Auckland, New Zealand;3. Medical Education, University of Otago, Christchurch, New Zealand |
| |
| Abstract: | A new probability-based standard setting technique, the Objective Borderline Method (OBM), was introduced recently. This was based on a mathematical model of how test scores relate to student ability. The present study refined the model and tested it using 2500 simulated data-sets. The OBM was feasible to use. On average, the OBM performed well with specificity .88, sensitivity .51, false positive rate 3.4% and false negative rate 26%. These indices were insensitive to the borderline score range. This probability-based standard setting may be a useful addition to the range of standard setting methods available. |
| |
| Keywords: | standard setting borderline grades simulation study |
|
|
