Date created: | Last Updated:

Category: Project

Description: This project is a living study within a review (living SWAR) that aims to assess the performance of generative AI tools for selecting eligible study reports for inclusion in systematic reviews or maps of research. This .osf project page (https://osf.io/g7mkb/) hosts a repository of datasets from each replication of this SWAR (see 'Files' tab). It will also host datasets from the prospective meta-analysis component of this living SWAR (i.e. once we have data from multiple replications of this SWAR from multiple host reviews / maps). Datasets from one replication of the retrospective version of this living SWAR to date are currently available in this repository (see 'Files' tab). The latter dataset was updated on 22nd August 2025 to incorporate one further comparison group ('Intervention 7'). This comparison group has been added to enable the retrospective version of this SWAR to be replicated in host reviews in which duplicate screening was conducted where only the final screening decision is available (and not also the independent decisions of multiple researchers). A copy of the SWAR registration form / protocol for the retrospective version of this living SWAR is also published in the 'Files' tab (accepted version - 22nd August 2025). A copy of the registration form / protocol for the prospective version will also be published here when ready. For all enquiries, contact: Ian Shemilt (i.shemilt@ucl.ac.uk).