Date created: | Last Updated:

Category: Project

Description: As a response to the crisis of confidence in psychological science, Psychological Science adopted new statistical guidelines and mandatory research disclosure statements for all papers submitted starting from January 2014. With this study we want to document the effects of these new submission requirements comparing all empirical studies published in Psychological Science from 2013 to 2015. This period comprises 2013 with the old guidelines, 2014 where approximately half papers were accepted with the old guidelines and 2015 where all papers were accepted with the new ones. As a comparison to help estimate the effects of these new submission guidelines, we examined all empirical studies published in the same period in two comparable journals which did not adopt similar guidelines, APS’s Clinical Psychological Science and APA’s Journal of Experimental Psychology: General. Every empirical study will be examined with respect to the reporting of the following statistics: confidence intervals applied both to dependent variables and effect sizes; the following statistical approaches: cumulating meta-analytic approach, data interpretation based on the estimates of parameters and not on the dichotomic NHST statistical vs non-statistical significance, the following research practice disclosures: sample size determination and or stopping rule and the following Open Practices: raw data availability, preregistered design and analysis plan.