Difference between revisions of "Monitoring Data Quality"

Jump to: navigation, search
Line 16: Line 16:


Comparing server data to field logs makes sure that all the data collected during the survey has made it to your server. This can be done by writing code that generates a survey log which counts the number of surveys on the server and matching that log with the field logs.
Comparing server data to field logs makes sure that all the data collected during the survey has made it to your server. This can be done by writing code that generates a survey log which counts the number of surveys on the server and matching that log with the field logs.
=== Data Quality Checks===
====Comparing back checks with the main data ====


== Back to Parent ==
== Back to Parent ==

Revision as of 20:22, 24 January 2017

Read First

  • Data quality checks should be done before and during the survey, as there is little that we can do after a survey if the data contains errors.
  • Lots of preparation should be made before the survey and steps should be followed during the survey so any error that is caught can be changed quickly before it is too late.

Guidelines

Since there is little time during the actual survey, prioritizing what time should be spent is very important.

Verifying that all survey data is on the server

Removing Duplicates

Before analyzing the outcomes of quality checks or sometimes even before running real time quality checks, we need to check for duplicates in the data. Duplicates are common in ODK/SurveyCTO and need to be removed before starting other data quality checks.

To remove duplicates, you can use the DIME's Stata command ieduplicates which can be found in the ietoolkit Stata package.

Comparing Server Data to Field Logs

Comparing server data to field logs makes sure that all the data collected during the survey has made it to your server. This can be done by writing code that generates a survey log which counts the number of surveys on the server and matching that log with the field logs.

Data Quality Checks

Comparing back checks with the main data

Back to Parent

This article is part of the topic *topic name, as listed on main page*


Additional Resources

  • list here other articles related to this topic, with a brief description and link