Difference between revisions of "Reproducible Research"
Maria jones (talk | contribs) |
|||
| Line 2: | Line 2: | ||
=== Pre-registration === | === Pre-registration === | ||
[https://www.socialscienceregistry.org/ AEA RCT Registry] | [https://www.socialscienceregistry.org/ AEA RCT Registry] | ||
Trial registries offer researchers the chance to upload and timestamp their study designs before they have been conducted. The aim of these registries is to build research transparency by reducing selective reporting and provide researchers with an overview of ongoing studies in their field. While trial registration is commonplace in the clinical health trials (see, for example, https://clinicaltrials.gov/), their use in development economics is more recent. | |||
Where can I register? | |||
The American Economic Association (AEA) hosts a trial registry specifically for randomized controlled trials[https://www.socialscienceregistry.org/]. The international Initiative for Impact Evaluation (3ie) provides a registry for experimental and quasi-experimental research in developing countries [http://www.ridie.org/]. | |||
What information should be included? | |||
The information required for registering a trial typically includes the country and title, a brief description of the project, timeline, outcomes, sample size, study design, and ethical approval details. Some of the details provided can be uploaded and time stamped, but hidden from public view prior to study completion. A pre-analysis plan can be uploaded providing a detailed description of how the analysis will be conducted, but this is typically not mandatory for registration. | |||
When should I register? | |||
While clinical trials in health are expected to be registered before patient enrolment [http://icmje.org/recommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html], there is currently no formal requirement for development economics trials to be registered by a particular stage of the research. In cases where intervention delivery is uncertain, development economics researchers wait to register their trials after baseline and interventions have been completed, but before any follow up data collection or analysis [http://blogs.worldbank.org/impactevaluations/trying-out-new-trial-registries]. | |||
=== [[Pre-Analysis Plan]] === | === [[Pre-Analysis Plan]] === | ||
Revision as of 20:05, 6 November 2017
Guidelines
Pre-registration
AEA RCT Registry Trial registries offer researchers the chance to upload and timestamp their study designs before they have been conducted. The aim of these registries is to build research transparency by reducing selective reporting and provide researchers with an overview of ongoing studies in their field. While trial registration is commonplace in the clinical health trials (see, for example, https://clinicaltrials.gov/), their use in development economics is more recent.
Where can I register? The American Economic Association (AEA) hosts a trial registry specifically for randomized controlled trials[1]. The international Initiative for Impact Evaluation (3ie) provides a registry for experimental and quasi-experimental research in developing countries [2].
What information should be included? The information required for registering a trial typically includes the country and title, a brief description of the project, timeline, outcomes, sample size, study design, and ethical approval details. Some of the details provided can be uploaded and time stamped, but hidden from public view prior to study completion. A pre-analysis plan can be uploaded providing a detailed description of how the analysis will be conducted, but this is typically not mandatory for registration.
When should I register? While clinical trials in health are expected to be registered before patient enrolment [3], there is currently no formal requirement for development economics trials to be registered by a particular stage of the research. In cases where intervention delivery is uncertain, development economics researchers wait to register their trials after baseline and interventions have been completed, but before any follow up data collection or analysis [4].
Pre-Analysis Plan
A pre-analysis plan (PAP) lays out how the researcher will analyze data, at the design stage of an impact evaluation. The objective of a PAP is to prevent data mining and specification searching.
Code replication
Data publication
Software for reproducible research
Git is a free version-control software. Files are stored in Git Repositories, most commonly on GitHub. To learn GitHub, there is an introductory training available through GitHub Services, and multiple tutorials available through GitHub Guides
Additional Resources
From the Abul Latif Jameel Poverty Action Lab (JPAL)
From Innovations for Policy Action (IPA)
- Reproducible Research: Best Practices for Data and Code Management
- Guidelines for data publication
- Randomized Control Trials in the Social Science Dataverse
Center for Open Science
- Transparency and Openness Guidelines, summarized in a 1-Page Handout
Berkeley Initiative for Transparency in the Social Sciences
Johns Hopkins