Training Guidelines: Content and Structure

Content

The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the Impact Evaluation Team) and the Survey Firm. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda.

Project overview

Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue.

Core modules

The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension.

It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial.

Interviewing

Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:

• Eliciting good data: some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions.

• Time management: how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace.

• Respondent fatigue can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.

Using tablets

Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately.

Structure

Agenda for enumerator training

Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:

1. Introductions & Overview of Study (0.5 days)
2. Review of Survey Protocols (0.5 - 2 days)
3. Review of Questionnaire (paper version) (2.5-4 days)
   1. This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.
4. Review of research standards and confidentiality (0.5 days)
5. Introduction to tablets to be used for data collection (0.5 - 1 days)
6. Review of Questionnaire (electronic version) (2-3 days)
7. Mock interviews in-classroom (1-2 days)
8. Field testing (1-2 days)
9. Final team selection and logistics (1 day)

Training tips

The training should be highly interactive. Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.

Include both classroom training and field testing. Allow for anonymous questions.

Classroom training should include both large and small group sessions. Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback.

It will seems tedious to read through and practice every single question, but it is a key part of the training and very important.

Duration of Training

Allocate plenty of time for training! Survey firms often push for short training, but rushing the training will only cause problems and delays later on.

For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.

Enumerator Selection

Do train more enumerators than will ultimately be needed. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often.

Use objective measures of performance, such as:

• Active participation in training, punctual arrival every day
• Understanding of survey modules and underlying concepts
• Scores on quizzes
• Feedback from the Field Testing (including interviewing skills)

Explain the performance measures, so it is clear that the final selection is transparent.

Test early and often.

Modifying the Questionnaire & Enumerator Manual

Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.

Back to Parent

This article is part of the topic Enumerator Training