Rater effects: Ego engagement in rater decision-making |
| |
| Authors: | Cynthia S Wiseman |
| |
| Institution: | 1. Department of Linguistics, University of Oregon, United States;2. English Department, Yonsei University, Republic of Korea;1. Nursing Foundation Program, University of Calgary in Qatar, Qatar;2. Macquarie University, Australia;1. Santa Clara University, Department of English, Vari Hall, Santa Clara, CA 95053, USA;2. School of Languages and Linguistics, The University of Melbourne, Babel (Building 139), VIC 3010, Australia |
| |
| Abstract: | The decision-making behaviors of 8 raters when scoring 39 persuasive and 39 narrative essays written by second language learners were examined, first using Rasch analysis and then, through think aloud protocols. Results based on Rasch analysis and think aloud protocols recorded by raters as they were scoring holistically and analytically suggested that rater background may have contributed to rater expectations that might explain individual differences in the application of the performance criteria of the rubrics when rating essays. The results further suggested that rater ego engagement with the text and/or author may have helped mitigate rater severity and that self-monitoring behaviors by raters may have had a similar mitigating effect. |
| |
| Keywords: | |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
