Broadly, we sought to estimate the prevalence of questionable and open research practices in education research. Estimates for the prevalence of questionable research practices (QRPs) have been conducted in psychology in American (John et al., 2012), German (Fiedler & Schwarz, 2016), and Italian (Agnoli, Wicherts, Veldkamp, Albiero, & Cubelli, 2017) samples. They have also been collected in ecology (Fraser, Parker, Nakagawa, Barnett, & Fidler, 2018). In our study, we sought to replicate these studies (most closely aligning with Fraser et al.’s methods) in a sample of education researchers to compare the reported practices of the education research community to other fields. Using Fraser et al.’s items along with 5 new items on open science practices (Open), we asked participants (researchers who have published in a top education research journal in the last 10 years) to:
A. Estimate the percentage of researchers in education who have engaged in various research practices
B. Estimate how often they have engaged in these practices
C. Share their opinion of whether these practices should be used
D. Share why they think the practice should or should not be used.
Preprint: https://edarxiv.org/f7srb/