Difference between revisions of "Randomization in Stata"

Jump to: navigation, search
 
(26 intermediate revisions by 9 users not shown)
Line 1: Line 1:
== Why use Stata to randomize ==
Randomization is a critical step for ensuring [[Exogeneity Assumption | exogeneity]] in [[Experimental Methods | experimental methods]] and [[Randomized Control Trials | randomized control trials (RCTs)]]. Stata provides a [[Reproducible Research | replicable]], reliable, and [[Data Documentation | well-documented]] way to randomize treatment before beginning fieldwork. This page describes how and why to use Stata to randomize.  
Using Stata to randomize and then preloading the generated data file into the survey software is the better option among the two. The main advantages of using Stata during randomization are as follows:
*Randomization in Stata is transparent and reproducible which is important for publishing research.  
*Randomization in Stata is done before the survey takes place. This provides an opportunity to double check the result of a randomization and fix bugs before using the software in the field.  
*Randomization in Stata provides the option of ensuring balance in the dataset i.e. it helps the researcher randomize while preserving the overall demographic/characteristic balances.  


==Steps needed for replicability when randomizing in Stata ==
==Read First==
* Common alternatives to using Stata for randomization include: (i) Using the Excel <code>Rand</code> command; (ii) Randomizing directly within a chosen electronic survey platform such as SurveyCTO; or (iii) randomization through a public lottery.
*Randomizing in Stata is preferred to [[Randomization in Excel | randomizing in Excel]] or [[Randomization in SurveyCTO | randomizing in survey software]] because it is transparent, reproducible, and gives the research more time to run [[Balance tests | balance tests]] and double check assignments.
*Make sure to set the version, set the seed, sort the data, and use unique IDs when randomizing in Stata
*For information how to draw a stratified random sample, see [[Stratified Random Sample]].


Here are a few steps that should be followed to create a reproducible randomization using Stata:
==Why Use Stata to Randomize?==
Randomizing in Stata and subsequently preloading the generated data file into the [[Computer-Assisted Personal Interviews (CAPI) | survey software]] is the preferred method to [[Randomization in Excel | randomizing in Excel]] or [[Randomization in SurveyCTO | randomizing in survey software]]. The main advantages of randomizing in Stata follow:
* The process is transparent and reproducible.
* The researcher has more control of the process and can check [[Balance tests | randomization balance]] and [[Stratified Random Sample | add stratification variables]] if needed.
* As opposed to randomizing in the survey software, randomizing in Stata allows for time between randomization, implementation and [[Primary Data Collection | data collection]], giving the research team the opportunity to double check assignments and fix bugs before using software in the field. 
==Implementation==
An example of a randomization do-file follows:
<nowiki>
    * Set the environment to make randomization replicable
    version 12.0  [SETS VERSION]
    isid unique_id, sort  [SORTS UNIQUE ID] 
    set seed 585506  [SETS THE RANDOM SEED FOR REPLICATION. Generated using https://bit.ly/stata-random ] 
   
    * Assign random numbers to the observations and rank them from the smallest to the largest
    gen random_number = uniform()  [GENERATES A RANDOM NUMBER BETWEEN 0 AND 1]
    egen ordering = rank(random_number) [ORDERS EACH OBSERVATION FROM SMALLEST TO LARGEST]
   
    * Assign observations to control & treatment group based on their ranks
    gen group = . 
    replace group = 1 if ordering <= N/2 [ASSIGNS TREATMENT STATUS TO FIRST HALF OF SAMPLE] 
    replace group = 0 if ordering > N/2  [ASSIGNS CONTROL STATUS TO SECOND HALF OF SAMPLE]
</nowiki>


* Use a dataset which has a unique ID [respondent ID, household number, etc.]
==Guidelines for Replicable Randomization==
To randomize with replicability in Stata, follow these guidelines:
* Make sure your dataset includes a [[ID Variable Properties | unique ID]] (i.e. respondent ID, household number, etc.). If one doesn't exist yet, create one using the <code> generate </code> command. The ID uniquely and fully identify all observations.
* While writing a do-file, pay close attention to the following things:
* While writing a do-file, pay close attention to the following things:
** Set version. Setting Stata's version in a do file ensures that the randomization algorithm is the same, as the alrogirthm sometimes changes between Stata versions. </br> For example - <code> version 12.0 </code>
** Set version: this ensures that the randomization algorithm is the same, since the randomization algorithm sometimes changes between Stata versions. See <code>[[ieboilstart]]</code> for boilerplate code that standardizes Stata version within do files.
** Set seed. This makes sure that the same random number is generated for the first observation, for the second observation, and so on, for every time the code is run. </br> For example - <code> set seed 12345 </code>
** [https://www.stata.com/manuals14/rsetseed.pdf Set seed]: this ensures that the same random number is generated for the first observation, for the second observation, and so on, for every time the code is run.  
** Properly sorting the data. The data should be sorted such that observations are in the same order every time the code is run. The most optimal situation is sorting using an ID variable which uniquely and fully identifies each observation.
** Sort the data by the unique ID: the data should be sorted such that observations are in the same order every time the code is run.  
*Convert the random numbers into categorical variables or dummy variables. This helps you check if the data is balanced.
*Convert the random numbers into categorical variables for treatment or control status.
 
After randomizing, output a CSV format file that contains the ID variable used for randomization and the categorical variables created from the random numbers generated. You can preload this file into SurveyCTO, so that once an enumerator enters the respondent ID at the start of a survey, the assignment will be loaded for the form and can be used for various sections of the survey.
The end goal is to have a CSV format file containing the ID variable used for randomization and the categorical variables created from the random numbers generated. This dataset will be preloaded into SurveyCTO, so that after an enumerator enters the respondent ID at the start of a survey, the result of the randomization will be loaded for the form and can be used for various sections of the survey.


== Back to Parent ==
== Back to Parent ==
This article is part of the topic [[Randomized Control Trials]]
This article is part of the topic [[Randomized Control Trials]].
 
==Additional Resources==
[[Category: Impact Evaluation Design]]
* DIME Analytics' presentations on randomization [https://github.com/worldbank/DIME-Resources/blob/master/stata1-5-randomization.pdf 1] and [https://github.com/worldbank/DIME-Resources/blob/master/stata2-5-randomization.pdf 2]
* Stata, [https://blog.stata.com/2016/03/10/how-to-generate-random-numbers-in-stata/ How to generate random numbers in Stata]
[[Category: Coding Practices]]
[[Category: Stata Coding Practices]]
[[Category: Research Design]]
[[Category: Reproducible Research]]

Latest revision as of 20:36, 20 July 2022

Randomization is a critical step for ensuring exogeneity in experimental methods and randomized control trials (RCTs). Stata provides a replicable, reliable, and well-documented way to randomize treatment before beginning fieldwork. This page describes how and why to use Stata to randomize.

Read First

  • Common alternatives to using Stata for randomization include: (i) Using the Excel Rand command; (ii) Randomizing directly within a chosen electronic survey platform such as SurveyCTO; or (iii) randomization through a public lottery.
  • Randomizing in Stata is preferred to randomizing in Excel or randomizing in survey software because it is transparent, reproducible, and gives the research more time to run balance tests and double check assignments.
  • Make sure to set the version, set the seed, sort the data, and use unique IDs when randomizing in Stata.
  • For information how to draw a stratified random sample, see Stratified Random Sample.

Why Use Stata to Randomize?

Randomizing in Stata and subsequently preloading the generated data file into the survey software is the preferred method to randomizing in Excel or randomizing in survey software. The main advantages of randomizing in Stata follow:

  • The process is transparent and reproducible.
  • The researcher has more control of the process and can check randomization balance and add stratification variables if needed.
  • As opposed to randomizing in the survey software, randomizing in Stata allows for time between randomization, implementation and data collection, giving the research team the opportunity to double check assignments and fix bugs before using software in the field.

Implementation

An example of a randomization do-file follows:

    * Set the environment to make randomization replicable
    version 12.0  [SETS VERSION] 
    isid unique_id, sort  [SORTS UNIQUE ID]  
    set seed 585506  [SETS THE RANDOM SEED FOR REPLICATION. Generated using https://bit.ly/stata-random ]  
    
    * Assign random numbers to the observations and rank them from the smallest to the largest
    gen random_number = uniform()  [GENERATES A RANDOM NUMBER BETWEEN 0 AND 1] 
    egen ordering = rank(random_number) [ORDERS EACH OBSERVATION FROM SMALLEST TO LARGEST] 
    
    * Assign observations to control & treatment group based on their ranks 
    gen group = .  
    replace group = 1 if ordering <= N/2 [ASSIGNS TREATMENT STATUS TO FIRST HALF OF SAMPLE]  
    replace group = 0 if ordering > N/2  [ASSIGNS CONTROL STATUS TO SECOND HALF OF SAMPLE]

Guidelines for Replicable Randomization

To randomize with replicability in Stata, follow these guidelines:

  • Make sure your dataset includes a unique ID (i.e. respondent ID, household number, etc.). If one doesn't exist yet, create one using the generate command. The ID uniquely and fully identify all observations.
  • While writing a do-file, pay close attention to the following things:
    • Set version: this ensures that the randomization algorithm is the same, since the randomization algorithm sometimes changes between Stata versions. See ieboilstart for boilerplate code that standardizes Stata version within do files.
    • Set seed: this ensures that the same random number is generated for the first observation, for the second observation, and so on, for every time the code is run.
    • Sort the data by the unique ID: the data should be sorted such that observations are in the same order every time the code is run.
  • Convert the random numbers into categorical variables for treatment or control status.

After randomizing, output a CSV format file that contains the ID variable used for randomization and the categorical variables created from the random numbers generated. You can preload this file into SurveyCTO, so that once an enumerator enters the respondent ID at the start of a survey, the assignment will be loaded for the form and can be used for various sections of the survey.

Back to Parent

This article is part of the topic Randomized Control Trials.

Additional Resources