Main content
The statistical significance filter leads to overoptimistic expectations of replicability (Vasishth, Mertzen, Jäger, Gelman, 2018)
Date created: 2018-06-01 02:58 PM | Last Updated: 2022-04-18 05:38 PM
Identifier: DOI 10.17605/OSF.IO/EYPHJ
Category: Project
Description: Shravan Vasishth, Daniela Mertzen, Lena A. Jäger, and Andrew Gelman. The statistical significance filter leads to overoptimistic expectations of replicability. Journal of Memory and Language, 103:151-175, 2018. Officlal open Access article: https://doi.org/10.1016/j.jml.2018.07.004
Video of talk given at ISBA 2018, Edinburgh
It is well-known in statistics (e.g., Gelman & Carlin, 2014) that treating a result as publishable just because the p-value is less than 0.05 leads to overop- timistic expectations of replicability. These overoptimistic expectations arise due to Type M(agnitude) error: when underpowered studies yield significant results, effect size estimates are guarant…
Files
Files can now be accessed and managed under the Files tab.
Citation
Recent Activity
Unable to retrieve logs at this time. Please refresh the page or contact support@osf.io if the problem persists.
Start managing your projects on the OSF today.
Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.