Using meta-analysis for evidence synthesis: The case of incomplete neutralization in German

Date created: | Last Updated:

: DOI | ARK

Creating DOI. Please wait...

Create DOI

Category: Project

Description: It is common practice in statistical analyses of phonetic data to draw conclusions based on statistical significance alone. Using incomplete neutralization of final devoicing in German as a case study, we illustrate the problems with this approach. If researchers find a significant acoustic difference between voiceless and devoiced obstruents, they conclude that neutralization is incomplete; and if they find no significant difference, they conclude that neutralization is complete. However, such strong claims regarding the existence or absence of an effect based on significant results alone can be misleading. Instead, the totality of evidence should be brought to bear on the question. Towards this end, we synthesize the evidence from 14 studies on incomplete neutralization in German using a Bayesian random-effects meta-analysis. Our meta-analysis provides evidence in favor of incomplete neutralization. We conclude with some suggestions for improving the quality of future research on phonetic phenomena: ensure that sample sizes allow for high-precision estimates of the effect; avoid the temptation to deploy researcher degrees of freedom when analyzing data; focus on estimates of the parameter of interest and the uncertainty about that parameter; attempt to replicate effects found; and seek to make both the data and analysis available publicly.

License: CC-By Attribution 4.0 International

This project represents an accepted preprint submitted to PsyArXiv . Learn more about how to work with preprint files. View preprint

Wiki

Project components: Data used in the meta-analysis: We store here all the data used in the meta-analysis and two files that describe the characteristics of the studies (issues.tsv and studies.tsv). The data from the studies are either complete datasets or summaries from tables in the papers. The component estimates extraction describes the datasets and the exact steps we took to extract the estima...

Files

Loading files...

Citation

Components

  • Data used in the meta-analysis

    Individual tsv files used in the meta-analysis. And summaries of the characteristics of the studies (studies.tsv and issues.tsv). The only piece o...

    Recent Activity

    Loading logs...

  • Estimates extraction

    Description of the way we extracted the estimates from the studies, including R code.

    Recent Activity

    Loading logs...

  • Meta-analysis example code

    Random-effect metan-analysis using brms

    Recent Activity

    Loading logs...

  • PRISMA

    Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.

    Recent Activity

    Loading logs...

Tags

Recent Activity

Loading logs...

This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.

Create an Account Learn More Hide this message