Sensitive Topics
This article provides guidance for how to collect data on sensitive topics.
Read First
For certain topics, respondents will have incentives to conceal the truth, due to taboos, social pressure (e.g. Social Desirability Bias, fear of retaliation, etc. This can create bias, the size and direction of which can be hard to predict. To avoid this, it is essential to guarantee anonymity / confidentiality, and to develop Survey Protocols to guarantee privacy and maximize trust. If this is not sufficient, experimental methods such as Randomized Response Technique, List Experiments and Endorsement Experiments can be used.
Guidelines
Survey Protocols for Collecting Sensitive Data
- Make sure the respondent knows that responses will never be personally identified. This should be part of the Informed Consent module.
- Interviews should be done privately, without even family members around (especially for discussing issues such as domestic violence)
- Enumerators who share characteristics with the respondent (same gender, age, ethnic group, background) may garner increased trust
- Survey mode: self-administered questionnaires may provide more accurate data than interviews
List Experiments
List experiments aggregate responses to sensitive questions with responses to non-sensitive questions, e.g. how many of the following statements do you agree with? For a control, the list of statements would not include any sensitive statements. The treatment group would choose from the same set of statements the control group had, plus additional sensitive statements. Subtracting the average response in control group from the average response in the treatment group yields the proportion of people who say 'yes' to the sensitive statements.
For example, from Gilens, M., Sniderman, P. M., and Kuklinski, J. H. (1998). Affirmative action and the politics of realignment. British Journal of Political Science 28, 1, 159– 183. The control group receives the list:
- The federal government increasing the tax on gasoline;
- Professional athletes earning large salaries;
- Requiring seat belts be used when driving;
- Large corporations polluting the environment
The treatment groups receive the above with either:
- Black leaders asking the government for affirmative action
or
- Awarding college scholarships on the basis of race
Endorsement Experiments
Back to Parent
This article is part of the topic Questionnaire Design
Additional Resources
- Survey Methods for Sensitive Topics: https://graemeblair.com/papers/sensitive.pdf
- Bowling, Ann. "Mode of questionnaire administration can have serious effects on data quality." Journal of public health 27.3 (2005): 281-291. [1]
- Frauke Kreuter, Stanley Presser, Roger Tourangeau; Social Desirability Bias in CATI, IVR, and Web Surveys: The Effects of Mode and Question Sensitivity. Public Opin Q 2009; 72 (5): 847-865. doi: 10.1093/poq/nfn063