Main content
Bayesian alternatives for common null-hypothesis significance tests in psychiatry: A non-technical guide using JASP
Date created: 2017-04-05 06:13 AM | Last Updated: 2018-08-19 05:49 AM
Category: Project
Description: This article has now been published in BMC Psychiatry https://doi.org/10.1186/s12888-018-1761-4 Background: Despite its popularity as an inferential framework, classical null hypothesis significance testing (NHST) has several restrictions. Bayesian analysis can be used to complement NHST, however, this approach has been underutilized largely due to a dearth of accessible software options. JASP is a recently developed open-source statistical package that facilitates both Bayesian and NHST analysis using a graphical interface. This article provides an applied introduction to Bayesian inference with Bayes factors using JASP. Methods: We use JASP to compare and contrast Bayesian alternatives for several common classical null hypothesis significance tests: correlations, frequency distributions, t-tests, ANCOVAs, and ANOVAs. These examples are also used to illustrate the strengths and limitations of both NHST and Bayesian hypothesis testing. Results: A comparison of NHST and Bayesian inferential frameworks demonstrates that Bayes factors can complement p-values by providing additional information for hypothesis testing. Namely, Bayes factors can quantify relative evidence for both alternative and null hypotheses. Moreover, the magnitude of this evidence can be presented as an easy-to-interpret odds ratio. Conclusions: While Bayesian analysis is by no means a new method, this type of statistical inference has been largely inaccessible for most psychiatry researchers. JASP provides a straightforward means of performing reproducible Bayesian hypothesis tests using a graphical “point and click” environment that will be familiar to researchers conversant with other graphical statistical packages, such as SPSS.
This project contains a preprint with associated .jasp file and dataset. The dataset was sourced from van Cappellen and colleagues' Open Science Framework project page. For pedagogic purposes, a number of variables were removed from the original dataset, an additional categorical variable was added (a “yes” or “no” response on whether participants were religiously affiliated), and another variable…
Files
Files can now be accessed and managed under the Files tab.
Citation
Recent Activity
Unable to retrieve logs at this time. Please refresh the page or contact support@osf.io if the problem persists.