The Issue of Range Restriction in Bookmark Standard Setting |
| |
| Authors: | Adam E Wyse |
| |
| Affiliation: | The American Registry of Radiologic Technologists |
| |
| Abstract: | This article uses data from a large‐scale assessment program to illustrate the potential issue of range restriction with the Bookmark method in the context of trying to set cut scores to closely align with a set of college and career readiness benchmarks. Analyses indicated that range restriction issues existed across different response probability (RP) values and item response theory (IRT) models if one were to apply the Bookmark procedure using intact test forms. Results also suggested that range restriction may still be present if one had access to additional data from an item bank. This demonstration critically highlights challenges that may exist in some practical applications of the Bookmark method due items not being designed to cover the full range of examinee abilities. |
| |
| Keywords: | benchmarks Bookmark method college and career readiness range restriction standard setting |
|
