|
|||||
|
|
PREDICTING TEST--RETEST RELIABILITY FROM BEHAVIOR CODING |
|
| Authors: | Hess Jennifer; Singer Eleanor; Bushery John |
| Institution: | Jennifer Hess is a Survey Statistication at the U.S. Census Bureau's Center for Survey Methods Research. She works in the area of questionnaire design and measurement research an demographic household surveys. Eleanor Singer is a Senior Research Scientist at the Survey Research Center, Institute for Social Research, University of Michigan, with a special interest in survey methodology. John Bushery is chief of the Quality Assurence and Evaluation Branch in the U.S. Census Bureau's Demographic Statistical Methods Division. He directs the Bureau's work to evaluate test-retest reliability in survey data and to provide interviewer quality control. |
| Abstract: | In attempting to move questionnaire design from art to science,researchers use different evaluation techniques to help determinehow well questions are working. Techniques such as behaviorcoding, respondent debriefing, interviewer debriefing, cognitiveinterviewing, and nonresponse analysis all provide informationto help the questionnaire designer assess whether respondentsunderstand questions as intended and whether they are able toprovide adequate answers to them. However, these techniquesdo not actually measure question reliability. It is assumedthat questions that pass the screen of the questionnaire evaluationtechniques described above are also more likely to produce datathat are reliable and valid. In this paper, we use behaviorcoding data to predict test–retest reliability. Respondentbehavior codes significantly predict such reliability whereasinterviewer codes—at least in this survey—do not.We also report the results of sensitivity testing to determinewhat percentage of adequate respondent answers best predictstest—retest reliability. |
| Keywords: | |
| 本文献已被 Oxford 等数据库收录！ | |