Difference between revisions of "Stratified Random Sample"
| Line 1: | Line 1: | ||
Stratification is an ex-ante statistical technique that ensures that sub-groups of the population are represented in the final sample. In addition to ensuring representativeness, stratification allows researchers to disaggregate by subgroup during analysis. Stratification takes place when defining the sample during research design. This page outlines why and how to stratify. | Stratification is an ex-ante statistical technique that ensures that sub-groups of the population are represented in the final sample and treatment groups. In addition to ensuring representativeness, stratification allows researchers to disaggregate by subgroup during analysis. Stratification takes place when [[Sampling & Power Calculations | defining the sample]] and treatment assignments during [[Impact Evaluation Design | research design]]. This page outlines why and how to stratify. | ||
== Read First == | == Read First == | ||
*Stratified random sampling ensures that sub-groups of a population are represented in the sample | *Stratified random sampling ensures that sub-groups of a population are represented in the sample and in treatment groups. | ||
*Stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups. | *Stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups. | ||
*The Stata commands <code>egen strata</code> and <code>randtreat</code> are useful for stratification. | *The Stata commands <code>egen strata</code> and <code>randtreat</code> are useful for stratification. | ||
| Line 9: | Line 8: | ||
==Why Stratify?== | ==Why Stratify?== | ||
Stratification accomplishes two key goals. First, it ensures that the sample and treatment groups are representative of the broader population. Second, it allows researchers to identify if and to what extent a program differentially impacts distinct groups of the population. Say, for example, you are evaluating a mobile money program in Region Y. In addition to measuring the overall impact of mobile money accounts on households in Region Y, you would like to measure the specific impact of mobile money accounts on rural households in Region Y. However, only 20 percent of households in Region Y are rural. In this case, even a large random sample would likely fail to contain a sufficient number of rural households to reliably estimate the rural-specific impact of the program. Stratified random sampling provides a solution to this scenario by balancing treatment and control across sub-populations and thus facilitating statistically significant comparisons across groups. In general, stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups. | |||
==How to Stratify?== | ==How to Stratify?== | ||
| Line 20: | Line 15: | ||
Then, randomize within each strata. To obtain a stratified simple random sample, randomize within each strata via <code>randtreat</code>. | Then, randomize within each strata. To obtain a stratified simple random sample, randomize within each strata via <code>randtreat</code>. | ||
===Dealing with Misfits=== | ===Dealing with Misfits=== | ||
If your sample isn’t divisible by the number of strata, [http://blogs.worldbank.org/impactevaluations/tools-of-the-trade-doing-stratified-randomization-with-uneven-numbers-in-some-strata McKenzie and Bruhn] advise to randomly allocate the leftovers within each strata, in such a way that if you have X units left in a strata, you allocate the remaining X units per strata in a manner in which “a) no treatment or control group gets allocated more than one of these units within the strata, and b) we randomly choose which treatment groups get the extra units.” Stata’s <code>randtreat</code> command provides a number of options for dealing with misfits via the misfit option. | If your sample isn’t divisible by the number of strata, [http://blogs.worldbank.org/impactevaluations/tools-of-the-trade-doing-stratified-randomization-with-uneven-numbers-in-some-strata McKenzie and Bruhn] advise to randomly allocate the leftovers within each strata, in such a way that if you have X units left in a strata, you allocate the remaining X units per strata in a manner in which “a) no treatment or control group gets allocated more than one of these units within the strata, and b) we randomly choose which treatment groups get the extra units.” Stata’s <code>randtreat</code> command provides a number of options for dealing with misfits via the misfit option. | ||
Revision as of 21:25, 9 June 2019
Stratification is an ex-ante statistical technique that ensures that sub-groups of the population are represented in the final sample and treatment groups. In addition to ensuring representativeness, stratification allows researchers to disaggregate by subgroup during analysis. Stratification takes place when defining the sample and treatment assignments during research design. This page outlines why and how to stratify.
Read First
- Stratified random sampling ensures that sub-groups of a population are represented in the sample and in treatment groups.
- Stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups.
- The Stata commands
egen strataandrandtreatare useful for stratification.
Why Stratify?
Stratification accomplishes two key goals. First, it ensures that the sample and treatment groups are representative of the broader population. Second, it allows researchers to identify if and to what extent a program differentially impacts distinct groups of the population. Say, for example, you are evaluating a mobile money program in Region Y. In addition to measuring the overall impact of mobile money accounts on households in Region Y, you would like to measure the specific impact of mobile money accounts on rural households in Region Y. However, only 20 percent of households in Region Y are rural. In this case, even a large random sample would likely fail to contain a sufficient number of rural households to reliably estimate the rural-specific impact of the program. Stratified random sampling provides a solution to this scenario by balancing treatment and control across sub-populations and thus facilitating statistically significant comparisons across groups. In general, stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups.
How to Stratify?
To stratify, first divide the target population into subgroups, or stratum. You may stratify on variables that you believe may significantly impact the outcome variable and/or on subgroups that you are particularly interested in evaluating. You may stratify with one or multiple variables; as the number of variables increases, so does the number of strata. For example, if you are stratifying on Variable A (i.e. 3 education groupings), Variable B (i.e. 2 geographic groupings), and Variable C (i.e. 3 age groupings), you will have 18 distinct strata. You can generate strata using the Stata command egen strata=group(A B C). Note that since some combinations of stratification variables may be more common than others, the strata sizes may vary.
Then, randomize within each strata. To obtain a stratified simple random sample, randomize within each strata via randtreat.
Dealing with Misfits
If your sample isn’t divisible by the number of strata, McKenzie and Bruhn advise to randomly allocate the leftovers within each strata, in such a way that if you have X units left in a strata, you allocate the remaining X units per strata in a manner in which “a) no treatment or control group gets allocated more than one of these units within the strata, and b) we randomly choose which treatment groups get the extra units.” Stata’s randtreat command provides a number of options for dealing with misfits via the misfit option.
Back to Parent
This article is part of the topic Sampling & Power Calculations
Additional Resources
- DIME Analytics' presentations on randomization 1 and 2, the latter of which covers stratification
- JPAL's How to Randomize
- Gertler's Impact Evaluation in Practice
- JPAL's Overview of Methodology for Randomized Experiments
- The World Bank's Randomization “how to” in Stata (plus other random stuff)