| 信息检索用户实验设计中时间限制和任务次序的影响研究 |
| |
| 引用本文： | 刘畅,赵瑜,杨帆.信息检索用户实验设计中时间限制和任务次序的影响研究[J].图书情报工作,2015,59(1):99-105. |
| |
| 作者姓名： | 刘畅 赵瑜 杨帆 |
| |
| 作者单位： | 北京大学信息管理系 北京 100871 |
| |
| 基金项目： | 国家自然科学基金青年项目“基于用户检索行为和搜索任务情境的个性化信息检索系统研究”(项目编号:71303015)研究成果之一 |
| |
| 摘 要： | 目的/意义] 通过分析时间限制和任务次序在用户实验设计中对被试和实验结果的影响,提出响应的优化方案。方法/过程] 使用实验法,对被试搜索时间进行严格的控制,分别验证时间限制和任务次序对被试搜索体验的影响。结果/结论] 在有时间限制的情况下,被试对于成功完成搜索任务的信心较低,且在任务结束后,对检索结果的自我认同度较低;任务次序也会影响被试的检索体验,搜索任务的次序越靠前,用户的信心和体验越易受到较为负面的影响。建议学者在采用实验法进行用户行为分析的时候,要科学全面地对搜索任务和情境变量进行轮换,如采用拉丁方的设计。同时,若非检验实验时间限制对搜索行为的影响,应尽量避免实验过程中对被试的搜索时间进行限制。
|
| 关 键 词： | 时间限制 任务次序 检索体验 实验设计 拉丁方 |
| 收稿时间： | 2014-11-17 |
Examination of the Effects of Time Constraint and Task Order in User Experiments |
| |
| Liu Chang;Zhao Yu;Yang Fan.Examination of the Effects of Time Constraint and Task Order in User Experiments[J].Library and Information Service,2015,59(1):99-105. |
| |
| Authors: | Liu Chang;Zhao Yu;Yang Fan |
| |
| Institution: | Department of Information Management, Peking University, Beijing 100871 |
| |
| Abstract: | Purpose/significance] User experiments are often conducted in order to measure user behavior, and by understanding user behavior, better system performance and better user experience can be achieved. This study examines the effects of time constraint and task order on participants in a user experiment and comes up with practices of suggestions. Method/process] A user experiment was conducted to examine the effects of time constraints and task order effects on search experience. In the experiment, participants were asked to search four tasks of two types under two different time conditions. Result/conclusion] The results demonstrated that participants had significantly lower confidence before searching and evaluated their search performance worse when there was time constraint. In addition, task order also influenced participants' search experience; i.e. they had much lower confidence in latter tasks than in previous tasks. The authors suggest that when conducting user experiments, researchers should systematically rotate the search tasks and other contextual factors examined in the experiment, e.g. Latin Square; and they should set strictly time constraint only if the time constraint effect will be examined. These findings could have practical implication for the design of user experiments in interactive information retrieval. |
| |
| Keywords: | time constraint task order search experience experimental design Latin Square |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
| 点击此处可从《图书情报工作》浏览原始摘要信息 |
| 点击此处可从《图书情报工作》下载免费的PDF全文 |
|
