Main content
Open Science Talks and Workshops (Gilad Feldman) /
2024-05-01 Peer Community in Registered Report (PCIRR) is the future of science and should be integrated into mentoring and education: Sharing 3 years of running ~20 UG/MSc theses with PCIRR | RHUL
Date created: | Last Updated:
: DOI | ARK
Creating DOI. Please wait...
Category: Uncategorized
Description: Registered Reports (http://cos.io/rr) are a publication process now adopted by over 300 journals in psychological science and beyond, in which Stage 1 journal peer review occurs on a pre-registration plan prior to any data collection. Once the preregistration passes peer review and is approved, the journal grants authors an in-principle acceptance guaranteeing the publication of the article provided that data collection and analysis follows and intended plan. This emphasizes design, methods, and rigor, addressing issues of reviewers' and publication bias with publication of findings regardless of data collection outcomes, with the Stage 2 peer review focused solely on ensuring adherence to the Stage 1 plan (or documenting deviations). "Peer Community in Registered Report" (PCI-RR; https://rr.peercommunityin.org/) is a new initiative launched in 2021 that builds on Registered Reports and is aimed at improving further on Registered Reports. It provides community open identified peer-review on posted Registered Report Stage 1 preprints, led by open-science trained recommenders (editors), with in-principle acceptance from the community endorsed for publication by a variety of open-science supportive journals. This initiative also includes an option for a "scheduled review" path which allows timely community expert open-science supportive peer review within two weeks, short enough to fit into an academic year thesis schedule. PCIRR is nothing short of a revolution in science. In the last three years I guided ~20 UG/MSc students in conducting their theses as Replications and extensions Registered Reports with "Peer Community in Registered Report" manuscripts, with some already officially published, and most already granted an in-principle acceptance. Together, we have shown that it is possible to bring UG/MSc quantitative confirmatory work to the meet the highest levels of open-science in our field with a real contribution to the academic community. There have been some challenges, but overall I summarize it as a remarkable success, for all stakeholders. For me personally, it has been a very positive and rewarding experience. AFAIK, this model and the students’ achievements are unprecedented, and I truly hope would inspire many more researchers and departments to adopt a similar scheme. In this talk I will share a bit of our experience with Registered Reports, PCIRR, and embedding PCIRR in UG/MSc thesis process. I will also briefly mention the larger-scale replications and extensions project of over 120 classic studies in judgment and decision-making and social psychology. Information on this project and how to join us can be found on: https://mgto.org/core-team/