Analyzing data of a multi-lab replication project with individual participant data meta-analysis: A tutorial


Date created: | Last Updated:


Creating DOI. Please wait...

Create DOI

Category: Project

Description: Multi-lab replication projects such as Registered Replication Reports and Many Labs projects are used to replicate an effect in different labs. Data of these projects are usually analyzed using conventional meta-analysis methods. This is certainly not the best approach, because it does not make optimal use of the available data as summary data are analyzed rather than the participant data. I propose to analyze data of multi-lab replication projects by using individual participant data (IPD) meta-analysis where the participant data are analyzed directly. Two important advantages of IPD meta-analysis are that it generally has larger statistical power to detect moderator effects and allows drawing conclusions regarding moderators at the participant rather than lab level. I illustrate IPD meta-analysis using the published Registered Replication Report by McCarthy et al. (2018) and provide R code and offer recommendations to facilitate researchers to apply these methods to their own data.

License: CC-By Attribution 4.0 International


Loading files...


Recent Activity

Loading logs...

OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.