https://dimewiki.worldbank.org/api.php?action=feedcontributions&user=Aurel&feedformat=atomDimewiki - User contributions [en]2024-03-28T21:39:24ZUser contributionsMediaWiki 1.37.2https://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4967Training Guidelines: Content and Structure2019-02-01T15:15:22Z<p>Aurel: /* Modifying the Questionnaire & Enumerator Manual */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Duration of Training ===<br />
Although the training time frame depends on many issues, allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, the level of education of the enumerators, and the number of people being trained.<br />
<br />
While planning your training agenda, allow rest after sessions, include days for classroom and fieldwork, enumerator selection, etc. You will never need less time in training!<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4966Training Guidelines: Content and Structure2019-02-01T15:14:04Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Duration of Training ===<br />
Although the training time frame depends on many issues, allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, the level of education of the enumerators, and the number of people being trained.<br />
<br />
While planning your training agenda, allow rest after sessions, include days for classroom and fieldwork, enumerator selection, etc. You will never need less time in training!<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4965Training Guidelines: Content and Structure2019-02-01T15:13:45Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Duration of Training ===<br />
Although the training time frame depends on many issues, allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, the level of education of the enumerators, and the number of people being trained.<br />
<br />
While planning your training agenda, allow rest after sessions, include days for classroom and fieldwork, enumerator selection, etc. You will never need less time in training!<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4964Training Guidelines: Content and Structure2019-02-01T15:12:58Z<p>Aurel: /* Structure */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Duration of Training ===<br />
Although the training time frame depends on many issues, allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, the level of education of the enumerators, and the number of people being trained.<br />
<br />
While planning your training agenda, allow rest after sessions, include days for classroom and fieldwork, enumerator selection, etc. You will never need less time in training!<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4963Training Guidelines: Content and Structure2019-02-01T14:43:11Z<p>Aurel: /* Duration of Training */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Although the training time frame depends on many issues, allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, the level of education of the enumerators, and the number of people being trained.<br />
<br />
While planning your training agenda, allow rest after sessions, include days for classroom and fieldwork, enumerator selection, etc. You will never need less time in training!<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4962Training Guidelines: Content and Structure2019-02-01T14:37:38Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4961Training Guidelines: Content and Structure2019-02-01T14:36:51Z<p>Aurel: /* Quizzes */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage! Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4960Training Guidelines: Content and Structure2019-02-01T14:36:25Z<p>Aurel: /* Quizzes */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of training material (definitions of the project key terms, field procedures, etc.), reading comprehension in relevant languages, understanding of key questions, numeracy skills...<br />
<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage!<br />
Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are only one of the several evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4959Training Guidelines: Content and Structure2019-02-01T14:34:37Z<p>Aurel: /* Quizzes */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of <br />
**training material (definitions of the project key terms, field procedures, etc.), <br />
**Reading comprehension in relevant languages<br />
**Understanding of key questions<br />
**Numeracy skills<br />
*Be organized: <br />
**Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
**Edit the quizzes based on your daily observation at the training.<br />
**Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
*Always encourage!<br />
Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
**Assess progression, not performances<br />
**A way for you and the survey firm to re-orient the training sessions<br />
**Quizzes are not the only evaluation criteria<br />
**Allow time in the agenda to correct quizzes with all the participants and answer questions.<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4958Training Guidelines: Content and Structure2019-02-01T14:32:30Z<p>Aurel: /* Quizzes */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
==== Quizzes====<br />
<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of:<br />
- training material (definitions of the project key terms, field procedures, etc.)<br />
- Reading comprehension in relevant languages<br />
- Understanding of keyp questions<br />
- Numeracy skills<br />
*Be organized: <br />
- Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
- Edit the quizzes based on your daily observation at the training.<br />
- Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
*Always encourage!<br />
Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
- assess progression, not performances<br />
- A way for you and the survey firm to re-orient the training sessions<br />
- Quizzes are not the only evaluation criteria<br />
- Allow time in the agenda to correct quizzes with all the participants and answer questions.<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4957Training Guidelines: Content and Structure2019-02-01T14:31:53Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
==== Quizzes====<br />
Although it seems very academic the quiz remains an interesting way to track progress among every single participant and encourage concentration. Quizzes are helpful to improve the training materials and the content of the sessions. <br />
<br />
*Contents of the quiz:<br />
Assess the level of understanding of:<br />
- training material (definitions of the project key terms, field procedures, etc.)<br />
- Reading comprehension in relevant languages<br />
- Understanding of keyp questions<br />
- Numeracy skills<br />
<br />
*Be organized:<br />
- Create the quizzes before the training. One quiz per day, to test the topics covered the day before.<br />
- Edit the quizzes based on your daily observation at the training.<br />
- Correct the quiz quickly. Ideally, the same day, to share feedback almost in real time. This allows the participants to restudy and avoid delay in their learning process.<br />
<br />
*Always encourage!<br />
Quizzes are stressful. Make sure enumerators understand the aim of the quizzes:<br />
- assess progression, not performances<br />
- A way for you and the survey firm to re-orient the training sessions<br />
- Quizzes are not the only evaluation criteria<br />
- Allow time in the agenda to correct quizzes with all the participants and answer questions.<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4956Training Guidelines: Content and Structure2019-02-01T14:00:43Z<p>Aurel: /* Field practice observation */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[Survey_Pilot| Survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4955Training Guidelines: Content and Structure2019-02-01T13:59:18Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[https://dimewiki.worldbank.org/wiki/Survey_Pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4954Training Guidelines: Content and Structure2019-02-01T13:57:24Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. For some surveys, the field practice is part of the [[survey pilot]]. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4953Training Guidelines: Content and Structure2019-02-01T13:54:02Z<p>Aurel: /* Enumerator Selection */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed to ensure qualified replacements are available and to motivate the participants. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
*Previous experience as data collectors<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
====Evaluation of participation====<br />
Facilitators of the training should observe each participant and take regular notes. Some criteria to evaluate the participation:<br />
*Punctuality<br />
*Active participation and initiative<br />
*Communication skills and local language proficiency<br />
*Device literacy<br />
<br />
====Field practice observation====<br />
It is important to plan for one day of field practice. All participants should administer at least one interview. Split the enumerators into groups and have one facilitator in each group to monitor and observe interviews. Facilitators should take notes on each enumerators' performances and share their comments at the end of the day. <br />
Here is a non-exhaustive list of elements to observe:<br />
*Complete Equipment (pen, notebook,…)<br />
*Selecting the right respondent<br />
*Proper introduction of the survey goal to the respondent and consent<br />
* Introductory sentences and reading the questions correctly<br />
*Probing correctly and the right time<br />
*Familiarity with the survey and confidence<br />
*Language proficiency<br />
*Interactions with the respondent (verbally and non-verbally)<br />
*Objectivity, patience, attention to details<br />
*Creating a conducive environment (privacy)<br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4952Training Guidelines: Content and Structure2019-01-31T16:05:30Z<p>Aurel: /* Training tips */</p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
*The training should be highly interactive. <br />
**Include both classroom training and field testing. <br />
**Classroom training should include both large and small group sessions.<br />
**Take regular notes on participants' suggestions and comments to improve the survey instruments<br />
*Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
*Allow for anonymous questions<br />
*Give enough breaks between sessions<br />
*Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback. It will seem tedious to read through and practice every single question, but it is a key part of the training and very important<br />
*Have session(s) with the project counterparts for an explanation of the project, technical terms, and translation support. Participants should have a good understanding of the project in addition to being qualified enumerators<br />
*Enforce discipline: no mobile phone, no frequent movement in and out, participants should come on time...<br />
*Deliver a participation certificate and recommend your enumerators after the training for other research projects<br />
*Plan one retraining day to remind the team about survey procedures, staff organization, changes in the questionnaires, give per-diems and explain logistics (accommodation & transports, …)<br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
Test early and often. <br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Training_Guidelines:_Content_and_Structure&diff=4951Training Guidelines: Content and Structure2019-01-31T14:15:27Z<p>Aurel: </p>
<hr />
<div>== Content ==<onlyinclude><br />
The Enumerator Training is a joint effort between the Field Coordinator (often with other members of the [[Impact Evaluation Team]]) and the [[Survey Firm Procurement|Survey Firm]]. The Field Coordinator should prepare the Enumerator Manual or make sure to be involved in its approval process. It serves as a basis for the training content, and should help develop the training agenda. </onlyinclude><br />
<br />
===Project overview===<br />
<br />
Providing the team with an overview of the background, objectives and relevance of the project is a key way to ensure the team becomes engaged and motivated to conduct high quality data collection. Conveying the importance of their role in the research will allow enumerators to take ownership of the project, a key requirement in ensuring enumerators remain committed throughout the duration of the data collection phase. This will be particularly important for projects lasting several weeks or requiring a significant amount of travel, both of which can result in enumerator fatigue. <br />
<br />
===Core modules===<br />
<br />
The time dedicated to training on the questionnaire content will depend on the complexity of the questions themselves, the use of scales or experiments etc. For example, scoring scales or questions about perceptions, attitude or motivation, will require more in-depth instruction which will include a detailed review of what is being measured and how this should be captured, as well as various practical exercises which will allow the enumerators to test their understanding, and the trainers to tailor subsequent sessions to the areas in which there is a discrepancy or inconsistency in comprehension. <br />
<br />
It will be important not to assume that enumerators will understand questions in the same way, as even relatively straightforward questions or items can be interpreted differently, particularly if working with people with different levels and types of experience. It is better to dedicate time to going through all questions, however briefly, in the training than to deal with inconsistencies after the data collection has begun. Preparing and Enumerator manual and additional materials to support the training, on which enumerators can take notes to review after the training, and which they can refer to throughout the fielding of the survey, will be crucial. <br />
<br />
===Interviewing===<br />
<br />
Spending some time on interviewing techniques is vital. While the content of this part of the training will depend on the nature of the questionnaire, general tips on how to conduct a good interview will also be helpful. Some general topics for discussion include:<br />
<br />
*'''Eliciting good data''': some respondents are likely to have confidentiality concerns, so it is of utmost importance that the enumerators make it clear throughout the interview, both by stating so openly and in the way they approach sensitive topics, that there is no risk for them in participating as all answers will be anonymized and kept confidential. Further, respondents should be made to understand that the aim of the interview is to learn from them, capture their personal thoughts, opinions and beliefs, and not the official or sanctioned versions. <br />
<br />
*'''Time management''': how long interviews last will vary depending on the questionnaire and the respondent. While it is normal for the duration to vary, time management will be essential if enumerators are to complete their target number of interviews each day. Not only does an overly long interview have the potential to cut short another interview, it also risks not being completed. Enumerators should have an idea of approximately how long they should spend on each section of the questionnaire, and should be especially careful with the more complex sections as these risk taking longer if the respondent is not clear on what he or she is being asked. A good understanding of the questions and concepts underlying each one will allow enumerators to run through the interview at a good pace. <br />
<br />
*''Respondent fatigue'' can impact data quality and affect the results of the survey. It can result from respondents becoming bored, tired, or uninterested with the interview and begin to respond at a substandard level. This can be caused by several things, including an overly long interview, poor interviewing skills, or unease with the questions being asked. Enumerators can prevent this from happening by ensuring the respondents are fully aware of the value of their participation, by keeping the interview within a reasonable time and by interacting with the respondent in an engaging and interested manner.<br />
<br />
===Using tablets===<br />
<br />
Tablets and electronic data collection platforms such as Survey CTO are relatively straightforward to use, but time should be set aside to go through their correct use, as well as all data uploading protocols. While electronic methods provide a safe and easy way to collect and upload data quickly and efficiently, incorrect use of the tablet can lead to irretrievable data losses so it’s crucial that all enumerators are clear on the protocols to follow, such as saving, reviewing and uploading data. It is advisable to have a set of step-by-step instructions on how to do this rather than relying on the assumption that all enumerators will be comfortable using electronic devices. Before starting with Survey CTO on the tablets, it is important to ensure all the participants know how to turn on the device, unlock the screen, modify the screen brightness, activate and disable an app, etc. A good use of the electronic device and its settings allow an optimal use of the Survey CTO software. <br />
In case paper forms are used in the survey (e.g. for self-administered questionnaires), protocols should also be clearly set out to ensure all forms are labelled correctly and organized appropriately. <br />
<br />
Is is strongly recommended to go through the entire paper questionnaire before moving to the electronic questionnaire on the device. Enumerators should have a good understanding of the structure of the questionnaire and the modules before using the tablets. Even if skip parterns are programmed on Survey CTO, enumerators should be able to identify inconsistencies on the electronic version of the survey.<br />
<br />
Dime Analytic has developped a SurveyCTO user guide for data collectors. This manual can be use as training material and goes through all the important steps using SurveyCTO and the device for the data collection: life of the survey form, tablets preparation, process to send the forms… <br />
<br />
<br />
==Structure ==<br />
<br />
=== Agenda for enumerator training ===<br />
<br />
Use the Enumerator Manual as the guide for structuring the training agenda. A typical agenda includes:<br />
<br />
# Introductions & Overview of Study (0.5 days)<br />
# Review of Survey Protocols (0.5 - 2 days)<br />
# Review of Questionnaire (paper version) (2.5-4 days)<br />
## This is done module-by-module. Each question is read aloud and discussed. At the end of each module, a mock interview.<br />
# Review of research standards and confidentiality (0.5 days)<br />
# Introduction to tablets to be used for data collection (0.5 - 1 days)<br />
# Review of Questionnaire (electronic version) (2-3 days)<br />
# Mock interviews in-classroom (1-2 days)<br />
# Field testing (1-2 days)<br />
# Final team selection and logistics (1 day)<br />
<br />
=== Training tips ===<br />
<br />
The training should be highly interactive. Pop quizzes at the beginning of each day are a good way to keep people's attention, and to catch any comprehension gaps in real time.<br />
<br />
Include both classroom training and field testing. Allow for anonymous questions.<br />
<br />
Classroom training should include both large and small group sessions. Ensure that every participant practices all survey components (introductions, consent, survey modules) in front of others and receives feedback.<br />
<br />
It will seems tedious to read through and practice every single question, but it is a key part of the training and very important. <br />
<br />
=== Duration of Training ===<br />
Allocate plenty of time for training! [[Survey Firm Procurement|Survey firms]] often push for short training, but rushing the training will only cause problems and delays later on. <br />
<br />
For a typical complex, multi-module household surveys, 10 days is a good estimate for minimum training time. Exact duration will depend on the complexity of the survey instrument, level of education of the enumerators, and number of people being trained.<br />
<br />
=== Enumerator Selection ===<br />
Do train more enumerators than will ultimately be needed. Let the full group know in the beginning their selection into the final team will depend on their performance. Test them early and often. <br />
<br />
Use objective measures of performance, such as:<br />
* Active participation in training, punctual arrival every day<br />
* Understanding of survey modules and underlying concepts <br />
* Scores on quizzes<br />
* Feedback from the Field Testing (including interviewing skills)<br />
<br />
Explain the performance measures, so it is clear that the final selection is transparent.<br />
<br />
Test early and often. <br />
<br />
=== Modifying the Questionnaire & Enumerator Manual ===<br />
Throughout training, mistakes may be found in questions, translations, programming, or the manual. Take notes each day on necessary changes, and updated materials daily if possible. Do not underestimate the value of feedback from enumerators- if they have concerns or issues of understanding, it is likely respondents will too. <br />
Print an updated Manual at the end of training, and provide it to all selected enumerators in a plastic (waterproof) folder.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[Enumerator Training]]<br />
<br />
== Additional Resources ==<br />
Please add here any articles related to this topic, with a brief description and link <br />
<br />
[[Category: Primary Data Collection]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Multiple_Questions_Displayed_at_the_Same_Time&diff=4137Multiple Questions Displayed at the Same Time2018-01-25T16:16:15Z<p>Aurel: </p>
<hr />
<div>== Best Practice ==<br />
Sometimes a set of questions should be displayed at the same time on the tablet during the interview, without swiping. This is useful if the answer to a question has two parts, for example, a question of distance where both an amount and a unit of that amount is asked. Other examples in addition to distance is time duration (in minutes, hours, days...), land area (in acres, hectares...), salary (per week, per month, per year...). The respondent will have to choose between all these unitS of measurement after announcing the amount. The idea of this best practice is to enter the integer (amount, price, quantity...) and select the unit on the same sreen for an easier reading. In these cases data is collected with less error if both amount and unit can be recorded on the same screen. See link to an example in the next section.<br />
<br />
Another reason to display multiple questions on one screen could be that a set of yes and no questions are asked with a better flow if the enumerator does not have to swipe and re-read the full question for each question. An example could be if we are asking about a households assets and we ask, "Does your household own any of the following assets?". See link to an example in the next section.<br />
<br />
== Coding Example ==<br />
<br />
Here is a [https://docs.google.com/spreadsheets/d/1iNutIXqvjd87Uyikc_I5b9lD2C-CM8m245cKF6JoSy0 code example] that shows example of both cases mentioned above.<br />
<br />
Note that both the answer option meter and kilometer is provided as distance unit despite the conversion between the two is simple. We always want to record the answer the way the respondent answered the question and we should never ask the enumerator to do arithmetic in the field. Later, we can convert all the amount of the dataset to standardize the quantity, distance, time across the observation. <br />
<br />
An "other specify" option can be selected in the list of units of measurement if the respondent's answer is not available on the list. <br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[SurveyCTO Coding Practices]]<br />
<br />
[[Category: SurveyCTO Coding Practices ]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=Relevance_Condition_to_Multiple_Fields&diff=4136Relevance Condition to Multiple Fields2018-01-25T16:08:00Z<p>Aurel: </p>
<hr />
<div>== Best Practice ==<br />
<br />
There are ways to apply the same relevance code to multiple fields without copying a code. Copying the same code to a couple of fields could be OK depending on personal preference, but copying to 5 or more fields should always be avoided as it increases the likelihood of making programming mistakes.<br />
<br />
It is recommended to use a begin group field to apply the same relevance code to all the field inside the group. Then, the code relevance is indicated '''only''' for the begin group field and there is no need to repeat it for all the fields concerned by this code relevance. A questionnaire coded like this will be much easier to be updated during the development phase or during the field work where there is little time as many other tasks are keeping the project team pre-occupied.<br />
<br />
In general, using begin groups field in a programming form avoids the repetition of codes and makes the whole survey easy to read and to understand.<br />
<br />
== Code example ==<br />
<br />
Here is a [https://docs.google.com/spreadsheets/d/17U64Bu3oUyfa8MmJ7_tM8DQ5_ZUO_MPzx9vT28hfpgk code example] that shows how a group is used so that the relevance condition does not have to be applied to each field inside the group.<br />
<br />
Note that there is no problem to have a field to be required that is not always shown. Required mean that '''''if''''' the field is displayed then data needs to be recorded for this field before the enumerator is allowed to swipe pass this question.<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[SurveyCTO Coding Practices]]<br />
<br />
[[Category: SurveyCTO Coding Practices ]]</div>Aurelhttps://dimewiki.worldbank.org/index.php?title=SurveyCTO_Dynamically_Populated_Choice_Lists&diff=4135SurveyCTO Dynamically Populated Choice Lists2018-01-25T15:20:48Z<p>Aurel: </p>
<hr />
<div>== Best Practice == <br />
Sometimes we want to ask a respondent to select one or several answers out of answers the respondent have given earlier in the interview. For example, we might want to ask who in the household out of the household members listed in the household roster module is currently employed. It is possible to do this by dynamically load previous answers as answer options.<br />
<br />
Any answer can be used in dynamic choice lists, but when using variables inside a repeat group, one more extra step is required because we cannot reference a field that was inside a repeat group directly. We ned to first store the value of this field so that SurveyCTO knows what is the item we are referring to. The calculate field is the intermediate step required. The same applied if you want to build a relevance with the value of a field that filled inside a repeat group. <br />
<br />
== Coding Example == <br />
<br />
Here is a [https://docs.google.com/spreadsheets/d/1jkqL2gUGlOGWXPyUF940V4BjH0iDjsxMt6168ncSr_s code example] of how the answers to a field inside a repeat group are used to dynamically load the answer options for a select_one or a select_multiple question.<br />
<br />
This example dynamically loads answers from a repeat group to be able to use them later in the questionnaire: as relevance, or dynamically populated choice lists for example. If you were to dynamically load answers from fields not inside a repeat group, then you simply reference those fields directly in the choice tab.<br />
<br />
Note that this coding example can be improved in many ways. It has excluded some possible improvements in order to highlight the functionality discussed in this article. The most obvious improvement would be to filter the answer options so that only the answer options needed are displayed. See the section about choice filters.<br />
<br />
Note that SurveyCTO will let you upload a form on the server even if you used directly an answer from a repeat group in your programming without referring it with a calculate field. The error message will appear only on the tablet, when swiping to the next question. In that respect, always test your form before the field data collection. <br />
<br />
<br />
== Back to Parent ==<br />
This article is part of the topic [[SurveyCTO Coding Practices]]<br />
<br />
[[Category: SurveyCTO Coding Practices ]]</div>Aurel