Published with Collabra: https://doi.org/10.1525/collabra.87489
Clarifications/corrections:
In January 2024, Adrien Fillon reported a minor ambiguity with the following reported statistic:
> “Bold” (M = 8.23, SD = 1.71) was rated higher than “The Flirt” (M =
> 7.96, SD = 1.66), F(1, 600) = 16.99, p < .001, d = 0.17, 95% CI [0.09, 0.25].
Which reports a Cohen's d for an ANOVA F test.
We traced this to the "Kruger et al. (2004) Data Analysis After-Exclusion Experiment 2 Kit" file:
https://osf.io/jxmw7
And the effect reported is based on a supplementary paired samples t-test: t(601) = 4.08, p < .001, d = 0.17, 95% CI [0.09, 0.25].
We are unsure why we reported a Cohen's d here, and it would have been preferable to report the following with partial ETA squared:
> “Bold” (M = 8.23, SD = 1.71) was rated higher than “The Flirt” (M =
> 7.96, SD = 1.66), F(1, 600) = 16.99, p < .001, η2p = 0.03, 90% CI [0.01, 0.05].
We thanked Adrien Fillon for his reporting, and given the "Check me, replicate me" pledge (https://mgto.org/check-me-replicate-me/), Adrien decided to donate the awarded USD5, which we matched, and donated USD10 overall to Givewell Top Impact Fund.