Stratified Random Sample

Stratification is an ex-ante statistical technique that ensures representation of subpopulations in the final sample. If you intend to disaggregate by subgroup for the analysis, it is best practice to stratify by the same subgroups when sampling.

Read First

• Stratified random sampling allows researchers to identify if and to what extent a program differentially impacts distinct groups of the population.
• Stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups.
• The Stata commands egen strata and randtreat are useful for stratification.

Why Stratify?

Stratified random sampling allows researchers to identify if and to what extent a program differentially impacts distinct groups of the population. Say, for example, you are evaluating a mobile money program in Region Y. In addition to measuring the overall impact of mobile money accounts on households in Region Y, you would like to measure the specific impact of mobile money accounts on rural households in Region Y. However, only 20 percent of households in Region Y are rural. In this case, even a large random sample would likely fail to contain a sufficient number of rural households to reliably estimate the rural-specific impact of the program. Stratified random sampling provides a solution to this scenario by balancing treatment and control across sub-populations and thus facilitating statistically significant comparisons across groups. In general, stratified random sampling is essential for any evaluation that seeks to compare program impacts between subgroups.

How to Stratify?

To stratify, first divide the target population into subgroups, or stratum. You may stratify on variables that you believe may significantly impact the outcome variable and/or on subgroups that you are particularly interested in evaluating. You may stratify with one or multiple variables; as the number of variables increases, so does the number of strata. For example, if you are stratifying on Variable A (i.e. 3 education groupings), Variable B (i.e. 2 geographic groupings), and Variable C (i.e. 3 age groupings), you will have 18 distinct strata. You can generate strata using the Stata command egen strata=group(A B C). Note that since some combinations of stratification variables may be more common than others, the strata sizes may vary.

Then, randomize within each strata. To obtain a stratified simple random sample, randomize within each strata via randtreat.

Dealing with Misfits

If your sample isn’t divisible by the number of strata, McKenzie and Bruhn advise to randomly allocate the leftovers within each strata, in such a way that if you have X units left in a strata, you allocate the remaining X units per strata in a manner in which “a) no treatment or control group gets allocated more than one of these units within the strata, and b) we randomly choose which treatment groups get the extra units.” Stata’s randtreat command provides a number of options for dealing with misfits via the misfit option.

Back to Parent

This article is part of the topic Sampling & Power Calculations

Additional Resources

• DIME Analytics' presentations on randomization 1 and 2
• JPAL's to Randomize.pdf How to Randomize
• Gertler's Impact Evaluation in Practice
• JPAL's Overview of Methodology for Randomized Experiments
• The World Bank's Randomization “how to” in Stata (plus other random stuff)