Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
Publication pre-commitment devices such as Preregistration, Registered Reports, and Registered Revisions may substantially reduce publication biases, prepublication biases (e.g. p-hacking and HARKING), and other questionable research practices. In order to accurately evaluate the these tools' potentially transformative impact on the research process, the Center for Open Science, in collaboration with journals and supported by the National Science Foundation, is leading a semi-centrally organized set of within-journal randomized experiments on Registered Revisions. ***Registered Revisions*** Registered Revisions are a pre-comittment mechanism that occur during the process of journal peer review, much like a miniature Registered Report during peer review. When reviewers ask for additional data and/or analysis, authors can propose and detail a preregistered protocol of how those data additional revisions would be performed. Reviewers and editors can then agree to In-Principle Accept (IPA) the publication on the basis of this protocol, regardless of what the results are. Registered Reports may reduce uncertainty in the publication process, publication biases in reviewer/editorial decisions, and questionable research practices, and total time in review. ***Summary of the methodology*** During journal peer review of submitted papers, it is not uncommon for Editors to conclude that the submitted research is promising, but needs an additional study or studies to provide that final test or evidence to strengthen the conclusions. This is a naturalistic opportunity for a randomized intervention to evaluate Registered Revisions. In this circumstance, the purpose of the additional work is usually well-defined, making it quite appropriate for a Registered Revision. Also, the incentive circumstances for authors are very high--the Editor has determined that the evidence is interesting but wants a final study or studies for confirmation. In this trial, standard-submission papers that were peer-reviewed with a decision letter asking for a final study or studies will be eligible for inclusion in the trial. Authors agreeing to be part of the trial will be randomly assigned to a status quo (standard-of-care) control condition (what the journal would do anyway) or a RR condition. Those in the RR condition will submit the designs and analysis plans as a Stage 1 review to the journal and, if successful, earn provisional acceptance and follow the rest of the RR model. ***Current Status of the Project*** This project received funding from the US [National Science Foundation (NSF)][1]. As of June 2023, this project is about one year into our funding for this project (of four years). COS staff are speaking with editors at journals that currently offer Registered Reports to assess trial feasibility, adjust the design, and pilot journal-specific workflows. After establishing a feasible project design, the project will be preregistered and broader recruitment of journals (beyond those currently offering Registered Reports) will begin. [1]: https://osf.io/preprints/metaarxiv/jvxab/
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.