Difference between revisions of "Sensitive Topics"
Maria jones (talk | contribs) |
Maria jones (talk | contribs) |
||
| Line 22: | Line 22: | ||
"Now, during the height of the conflict in 2007 and 2008, did you know any militants, like a family member, a friend, or someone you talked to on a regular basis. Please, before you answer, take note of the number you rolled on the dice." | "Now, during the height of the conflict in 2007 and 2008, did you know any militants, like a family member, a friend, or someone you talked to on a regular basis. Please, before you answer, take note of the number you rolled on the dice." | ||
See Blair, Imai and Zhou (2015) for additional examples and applications, e.g. mirrored question design, disguised response design, and unrelated question design. | |||
=== List Experiments === | === List Experiments === | ||
Revision as of 22:33, 3 February 2017
This article provides guidance for how to collect data on sensitive topics.
Read First
For certain topics, respondents will have incentives to conceal the truth, due to taboos, social pressure (e.g. Social Desirability Bias, fear of retaliation, etc. This can create bias, the size and direction of which can be hard to predict. To avoid this, it is essential to guarantee anonymity / confidentiality, and to develop Survey Protocols to guarantee privacy and maximize trust. If this is not sufficient, experimental methods such as Randomized Response Technique, List Experiments and Endorsement Experiments can be used.
Guidelines
Survey Protocols for Collecting Sensitive Data
- Make sure the respondent knows that responses will never be personally identified. This should be part of the Informed Consent module.
- Interviews should be done privately, without even family members around (especially for discussing issues such as domestic violence)
- Enumerators who share characteristics with the respondent (same gender, age, ethnic group, background) may garner increased trust
- Survey mode: self-administered questionnaires may provide more accurate data than interviews
Randomized Response Technique
Randomized response technique protects respondents by introducing random noise. For example, from Blair, Imai and Zhou (2015).[1] "For this question, I want you to answer yes or no. But I want you to consider the number of your dice throw. If 1 shows on the dice, tell me no. If 6 shows, tell me yes. But if another number, like 2 or 3 or 4 or 5 shows, tell me your own opinion about the question that I will ask you after you throw the dice. [TURN AWAY FROM THE RESPONDENT] Now you throw the dice so that I cannot see what comes out. Please do not forget the number that comes out. [ WAIT TO TURN AROUND UNTIL RESPONDENT SAYS YES TO: ] Have you thrown the dice? Have you picked it up?"
Thus, when the respondent rolls a one, they are forced to respond “no” to the question; when respondents roll a six, they are forced to respond “yes.” Finally, when respondents roll two, three, four, or five, they are instructed to truthfully answer the following sensitive question.
"Now, during the height of the conflict in 2007 and 2008, did you know any militants, like a family member, a friend, or someone you talked to on a regular basis. Please, before you answer, take note of the number you rolled on the dice."
See Blair, Imai and Zhou (2015) for additional examples and applications, e.g. mirrored question design, disguised response design, and unrelated question design.
List Experiments
Endorsement Experiments
Back to Parent
This article is part of the topic Questionnaire Design
Additional Resources
- Survey Methods for Sensitive Topics: https://graemeblair.com/papers/sensitive.pdf
- Bowling, Ann. "Mode of questionnaire administration can have serious effects on data quality." Journal of public health 27.3 (2005): 281-291. [2]
- Frauke Kreuter, Stanley Presser, Roger Tourangeau; Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity. Public Opin Q 2009; 72 (5): 847-865. doi: 10.1093/poq/nfn063