Bulletproof Bias? Considering the Type of Data in Common Proportion of Variance Effect Sizes

Date created: | Last Updated:


Creating DOI. Please wait...

Create DOI

Category: Project

Description: As effect sizes gain ground as important indicators of practical significance and as a meta-analytic tool, we must critically understand their limitations and biases. This project expands on research by @Okada2013, which highlighted the positive bias of eta squared and suggested the use of omega squared or epsilon for their lack of bias. These variance overlap measures were examined for potential bias in different data scenarios (i.e. truncated and Likert type data) to elucidate differences in bias from previous research. We found that data precision and truncation affected effect size bias, often lowering the bias in eta squared. This work expands our understanding of bias on variance overlap measures and allows researchers to make an informed choice about the type of effect to report given their research study. Implications for sample size planning and power are also discussed.

License: CC-By Attribution 4.0 International

This project represents a preprint. Learn more about how to work with preprint files. View preprint


View the Shiny App here: go here. Notes on how to recreate our work: - To recreate the manuscript, you will need to download the manuscript files folder and run the Rmarkdown within that folder (you can open this file with RStudio). The markdown includes the simulation code that created the files in the output folder. - We suggest starting by searching for "library" within our document to install ...


Loading files...




Recent Activity

Loading logs...


Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.

Create an Account Learn More Hide this message