Survey Pilot Participants

The Field Coordinator plays a central role. Ideally other members of the research team will also participate (particularly important for pre-pilots and content-focused pilots). Staff from the relevant Government Ministry or implementing partner should be included as much as feasible (depending on availability and direct engagement). Typically, it is most productive for all pilot participants (field coordinator, PIs, local partners) to accompany skilled interviewers and observe and take notes, rather than conducting the interviews themselves.

Pilot Participants and Characteristics

		Stage 1 - Pre-Pilot	Stage 2 - Content-focused Pilot	Stage 3 - Data-focused Pilot
Respondents	Never use any respondents in the final sample. Neighboring villages / schools / firms are good options.	Respondents should be as similar as possible to actual respondents. Include variations in age, gender, education, and income / socioeconomic status.	Test sampling protocol by using it to select respondents. Helps troubleshoot (e.g. find out sampling frame is outdated) and reduces bias in selection.	Test your sampling protocol, including any revisions based on previous piloting stage
Interviewers	Language	Fully fluent (read/write/ speak) in local language and language of research team	Fully fluent (speaking and reading) in local language and language of research team	Fully fluent (speaking) in the local language and language of research team
	Experience	Experience as qualitative enumerator Sectoral knowledge	Experience as quantitative enumerator Sectoral knowledge	Experience as quantitative enumerator Experience with tablets
	Background	Diversity in age / race / religion / gender / etc	Be mindful of (and learn about) cultural requirements (should women interview women? Can women interview men?)	Interviewer pool should reflect decisions regarding composition of final survey team, based on previous stage
	Size of Team	Very small (~2). Always accompanied by research team member.	Small (~2-4). Ideally each enumerator accompanied by research team member or other observer.	Larger (~4-8). The more interviews the better for debugging and data checks.
	Who?	Typically done before survey firm is on board, using local research assistants (STCs hired through the WB or a local PI), local government staff, or university students	Typically done before survey firm is on board, using local research assistants (STCs hired through the WB or a local PI), local government staff, or university students	Best case scenario: survey firm leads. Staff who will be field supervisors for the upcoming survey act as interviewers. They gain experience with the instrument, which also helps for enumerator training.
Research Team	Field Coordinator participates in all stages	PI should participate directly. If not possible, plan for daily debriefs and discussions.	Research Manager or Impact Evaluation Coordinator should participate directly.	Programmer participates directly (to adapt / debug in real time)

Back to Parent

This article is a part of the topic Survey Pilot.

Additional Resources

• DIME Analytics’ guidelines on piloting surveys