Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
## Many Labs 4 Abstract: Interpreting a failure to replicate is complicated by the fact that the failure could be due to the original finding being a false positive, unrecognized moderating influences between the original and replication procedures, or faulty implementation of the procedures in the replication. One strategy to maximize replication quality is involving the original authors in study design. We (N = 17 Labs and N = 1,578 participants, after exclusions) experimentally tested whether original author involvement improved replicability of a classic finding from Terror Management Theory (Greenberg et al., 1994). Our results were non-diagnostic of whether original author involvement improves replicability because we were unable to replicate the finding under any conditions. This suggests that the original finding was either a false positive or the conditions necessary to obtain it are not yet understood or no longer exist. Data, materials, analysis code, preregistration, and supplementary documents can be found on the OSF page: https://osf.io/8ccnw/ Citation: This page hosts supplements, data and materials for the Many Labs 4 publication (in-progress). Various pages with more information are available: Access [Data][1], [Analysis Scripts][2], and [Codebooks][3]. Standardized materials as well as more information from each site of data collection are available in two components: [Expert materials/instructions][4], and [In-house instructions][5]. Supplements including results from additional analyses are available under the [Supplements component][6]. Supplements specific to for Richard Klein's Dissertation based on ML4 are available in the [Dissertation component][7]. View the [ML4 proposal][8]. This project is an attempt to replicate prominent Terror Management Theory research across a number of labs, and investigate the role of expertise and/or standardization of procedure on obtaining effects. The effect being replicated is: Greenberg, J., Pyszczynski, T., Solomon, S., Simon, L., & Breus, M. (1994). Role of consciousness and accessibility of death-related thoughts in mortality salience effects. Journal of Personality and Social Psychology, 67(4), 627. (Study 1) Each participating lab administered a replication of Greenberg et al., 1994. However, labs were randomly assigned between two conditions: 1. *"Expert-designed" materials condition*: These labs will use materials/procedures provided by the lead team. These materials have been produced in consultation with experts and original authors. 2. *In-house condition*: These labs will replicate the exact same study, but each lab will be responsible for generating all materials and procedures independently. They will be barred from consulting with experts or accessing the expert materials. Labs were encouraged to run both versions if they could ensure the replications would be independent (e.g., different PI's conduct the expert and in-lab version within a lab). Teams were asked to collect data from 80 participants by May 1st, 2017. All contributing collaborators will earn authorship on any resulting publication. [1]: https://osf.io/ua2nb/ [2]: https://osf.io/4n53k/ [3]: https://osf.io/jd8xh/ [4]: https://osf.io/bq4n4/ [5]: https://osf.io/drfg2/ [6]: https://osf.io/xtg4u/ [7]: https://osf.io/s6dqw/ [8]: https://docs.google.com/document/d/1nMNUT_bXfr8z7kzx7apOcnTTOsi8jL8d62TUaLbtFi0/edit?usp=sharing