Main content

Date created: | Last Updated:

: DOI | ARK

Creating DOI. Please wait...

Create DOI

Category: Project

Description: It is common practice in statistical analyses of phonetic data to draw conclusions based on statistical significance alone. Using incomplete neutralization of final devoicing in German as a case study, we illustrate the problems with this approach. If researchers find a significant acoustic difference between voiceless and devoiced obstruents, they conclude that neutralization is incomplete; and if they find no significant difference, they conclude that neutralization is complete. However, such strong claims regarding the existence or absence of an effect based on significant results alone can be misleading. Instead, the totality of evidence should be brought to bear on the question. Towards this end, we synthesize the evidence from 14 studies on incomplete neutralization in German using a Bayesian random-effects meta-analysis. Our meta-analysis provides evidence in favor of incomplete neutralization. We conclude with some suggestions for improving the quality of future research on phonetic phenomena: ensure that sample sizes allow for high-precision estimates of the effect; avoid the temptation to deploy researcher degrees of freedom when analyzing data; focus on estimates of the parameter of interest and the uncertainty about that parameter; attempt to replicate effects found; and seek to make both the data and analysis available publicly.

License: CC-By Attribution 4.0 International

Wiki

Add important information, links, or images here to describe your project.

Files

Loading files...

Citation

Components

Data used in the meta-analysis

Individual tsv files used in the meta-analysis. And summaries of the characteristics of the studies (studies.tsv and issues.tsv). The only piece o...

Recent Activity

Loading logs...

Estimates extraction

Description of the way we extracted the estimates from the studies, including R code.

Recent Activity

Loading logs...

Meta-analysis example code

Random-effect metan-analysis using brms

Recent Activity

Loading logs...

PRISMA

Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.

Recent Activity

Loading logs...

knitr files

knitr files to compile the paper with analyses and plots.

Recent Activity

Loading logs...

Tags

Recent Activity

Loading logs...