The usefulness of multimedia surrogates for making relevance judgments about digital video objects |
| |
| Institution: | 1. University of North Carolina at Chapel Hill, United States;2. Data Science, Facebook 1 Hacker Way Menlo Park, CA 94025, United States;3. User Experience and Customer Insights, NetBrain 15 Network Drive Burlington, MA, 01803, United States;1. University of Glasgow, United Kingdom;2. National Institute of Standards and Technology, United Kingdom;1. School of Data and Computer Science, Sun Yat-sen University, China;2. School of Computing Science, University of Glasgow, Glasgow, UK;3. School of Computer Science, The University of Adelaide, Adelaide, Australia;1. The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 Japan;2. RIKEN, Japan;1. Dept. of Computer Science, Jerusalem College of Technology, 21 Havaad Haleumi St., P.O.B. 16031, 9116001 Jerusalem, Israel;2. Dept. of Hebrew and Semitic Languages, Bar-Ilan University, 5290002 Ramat-Gan, Israel |
| |
| Abstract: | Large collections of digital video are increasingly accessible. The large volume and range of available video demands search tools that allow people to browse and query easily and to quickly make sense of the videos behind the result sets. This study focused on the usefulness of several multimedia surrogates, in terms of effectiveness, efficiency, and user satisfaction. Three surrogates were evaluated and compared: a storyboard, a 7-second segment, and a fast forward. Thirty-six experienced users of digital video conducted searches on each of four systems: three incorporated one of the surrogates each, and the fourth made all three surrogates available. Participants judged the relevance of at least 10 items for each search based on the surrogate(s) available, then re-judged the relevance of two of those items based on viewing the full video. Transaction logs and post-search and post-session questionnaires provided data on user interactions, including relevance judgments, and user perceptions. All of the surrogates provided a basis for accurate relevance judgments, though they varied (in expected ways) in terms of their efficiency. User perceptions favored the system with all three surrogates available, even though it took longer to use; they found it easier to learn and easier to use, and it gave them more confidence in their judgments. Based on these results, we can conclude that it's important for digital video collections to provide multiple surrogates, each providing a different view of the video. |
| |
| Keywords: | |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
