On rank-based effectiveness measures and optimization |
| |
| Authors: | Stephen Robertson Hugo Zaragoza |
| |
| Institution: | (1) Microsoft Research, 7 JJ Thomson Avenue, Cambridge, CB3 0FB, UK;(2) Yahoo! Research, Ocata 1, Barcelona, 08003, Spain |
| |
| Abstract: | Many current retrieval models and scoring functions contain free parameters which need to be set—ideally, optimized. The process
of optimization normally involves some training corpus of the usual document-query-relevance judgement type, and some choice
of measure that is to be optimized. The paper proposes a way to think about the process of exploring the space of parameter
values, and how moving around in this space might be expected to affect different measures. One result, concerning local optima,
is demonstrated for a range of rank-based evaluation measures.
|
| |
| Keywords: | Effectiveness metrics Ranking functions Optimization |
| 本文献已被 SpringerLink 等数据库收录！ |
|
