Date created: | Last Updated:

Category: Project

Description: In the present article, we explore the influence of undisclosed flexibility in the analysis of reaction times (RT). RTs entail some degrees of freedom of their own, due to the several techniques present, their skewed distribution and the potential presence of outliers. Moreover, these degrees of freedom are usually not considered part of the analysis itself, but preprocessing steps that are contingent on data. We analysed the impact of these degrees of freedom on the false-positive rate using simulations over real and simulated data. When several preprocessing methods are used in combination, the false-positive rate can easily rise to 17%. This figure becomes more concerning if we consider that more degrees of freedom are awaiting down the analysis pipeline, potentially making the final false-positive rate much higher.