Main content
Many Labs 3: Evaluating participant pool quality across the academic semester via replication /
Observe, hypothesize, test, repeat: Luttrell, Petty, and Xu (2017) demonstrate good science
Date created: | Last Updated:
: DOI | ARK
Creating DOI. Please wait...
Category: Project
Description: Many Labs 3 (Ebersole et al., 2016) failed to replicate a classic finding from the Elaboration Likelihood Model of persuasion (Cacioppo, Petty, & Morris, 1983; Study 1). Petty and Cacioppo (2016) noted possible limitations of the Many Labs 3 replication (Ebersole et al., 2016) based on the cumulative literature. Luttrell, Petty, and Xu (2017) subjected some of those possible limitations to empirical test. They observed that a revised protocol obtained evidence consistent with the original finding that the Many Labs 3 protocol did not. This observe-hypothesize-test sequence is a model for scientific inquiry and critique. To test whether these results advance replicability and knowledge transfer, we conducted direct replications of Luttrell et al. in nine locations (Total N = 1,219). We successfully replicated the interaction of need for cognition and argument quality on persuasion using Luttrell et al.’s optimal design (albeit with a much smaller effect size; p < .001; f2 = .025, 95%CI [.006, .056]) but failed to replicate the interaction that indicated that Luttrell et al.’s optimal protocol performed better than the Many Labs 3 protocol (p = .135, pseudo R2 = .002). Nevertheless, pragmatically, we favor the Luttrell et al. protocol with large samples for future research using this paradigm.