Difference between revisions of "Sampling & Power Calculations"

Jump to: navigation, search
m (Maria jones moved page Power Calculations & Sampling to Sampling & Power Calculations without leaving a redirect)
Line 1: Line 1:
= Read First =
Sampling is a task that is impossible to do differently once the results have been used in the field. Therefore, always ask a second person to go over your code before you use the sampling it generated in the field. For DIME projects, you should always consult any member of DIME Analytics before sending a sample to the field.  
Sampling is a task that is impossible to do differently once the results have been used in the field. Therefore, always ask a second person to go over your code before you use the sampling it generated in the field. For DIME projects, you should always consult any member of DIME Analytics before sending a sample to the field.  


= Power Calculation =
 
= Guidelines=
 
 
== Power Calculations ==
[[Power Calculations]] are a statistical tool to estimate either sample size or minimum detectable effect. Which you should estimate depends on the research design and constraints of a specific impact evaluation. The types of questions you can answer through power calculations include:
[[Power Calculations]] are a statistical tool to estimate either sample size or minimum detectable effect. Which you should estimate depends on the research design and constraints of a specific impact evaluation. The types of questions you can answer through power calculations include:


Line 7: Line 12:
* Given that I only have budget to sample 1,000 households, what is the minimum effect size that I will be able to distinguish from a null effect?
* Given that I only have budget to sample 1,000 households, what is the minimum effect size that I will be able to distinguish from a null effect?


= Population Frame =
 
== Population Frame ==


First you need a population frame to sample from.
First you need a population frame to sample from.


= Stratification =
 
== Stratification ==
To ensure a representative sample you can use stratification. An typical variable to stratify on is gender. When you stratify on gender you guarantee that your sample has the same ratio of women as the population frame you are sampling from.
To ensure a representative sample you can use stratification. An typical variable to stratify on is gender. When you stratify on gender you guarantee that your sample has the same ratio of women as the population frame you are sampling from.


= Randomize in Stata =
 
== Randomization in Stata ==


All code work you produce should be reproducible. Any code that includes randomization needs version, seed and sort to be reproducible. See [[reproducible randomization in Stata]] for details.
All code work you produce should be reproducible. Any code that includes randomization needs version, seed and sort to be reproducible. See [[reproducible randomization in Stata]] for details.


= Save documentation =
 
= Additional Resources =
 
* [http://unstats.un.org/unsd/demographic/sources/surveys/Series_F98en.pdf Designing Household Survey Samples: Practical Guidelines] United Nations, Department of Economic and Social Affairs, Statistics Division - 2008

Revision as of 23:07, 17 January 2017

Read First

Sampling is a task that is impossible to do differently once the results have been used in the field. Therefore, always ask a second person to go over your code before you use the sampling it generated in the field. For DIME projects, you should always consult any member of DIME Analytics before sending a sample to the field.


Guidelines

Power Calculations

Power Calculations are a statistical tool to estimate either sample size or minimum detectable effect. Which you should estimate depends on the research design and constraints of a specific impact evaluation. The types of questions you can answer through power calculations include:

  • Given that I want to be able to statistically distinguish program impact of a 10% change in my outcome of interest, what is the minimum sample size needed?
  • Given that I only have budget to sample 1,000 households, what is the minimum effect size that I will be able to distinguish from a null effect?


Population Frame

First you need a population frame to sample from.


Stratification

To ensure a representative sample you can use stratification. An typical variable to stratify on is gender. When you stratify on gender you guarantee that your sample has the same ratio of women as the population frame you are sampling from.


Randomization in Stata

All code work you produce should be reproducible. Any code that includes randomization needs version, seed and sort to be reproducible. See reproducible randomization in Stata for details.


Additional Resources