How can we trust research produced by others, and how can we show others
that the research we produce can be trusted? What would it take for you to
trust a result that directly contradicts your prior beliefs? A host of
credibility enhancing approaches will be discussed including crowdsourced
research design, automation, trusted third party oversight, tamper evident
seals on data and software, documented training, lab logs, and radical
transparency about the whole research pipeline. These techniques and their
consequences are presented in the context of a massive multilab replication
of one of Bem’s 2011 parapsychology experiments investigating human
precognitive abilities that shocked psychological science and contributed
to the initiation of the reformist movement on the field.