Main content



Loading wiki pages...

Wiki Version:
Link to email list of those interested in & working on this project. Link to Quality Assessment for Meta-Analysis/Systematic Review: [][1] Link to Pre-Registration Draft (NAC, June 29, 2018): Unstructured notes (KSC, June 25, 2018) Link to pre-registration of ultimately published meta-analysis by Brandt et al on relationship of brightness to recall of moral behav. - One idea is to form a consortium similar to Cochrane and Campbell but for psychology - Cochrane has a service called Cochrane Cloud which allows citizen science ( - ZPID is running an OA platform that will do registered reports for meta-analyses ( They will make a generic structure for publishing Stage 1 protocols. - Develop standards for registered reports protocols (for meta-analyses) and standards for review. - PROSPERO protocols ( - Quality standards need to be articulated (we have PRISMA and MARS). - We need a list of best practices, a resource for people. John Sakaluk has a document that we crowdsourced as a syllabus document. - Reporting standards are badly needed. Greg Webster, 51 meta-analyses have been published in PSPR. The quality is very very low. - There is a need for a risk of bias or critical appraisal tool for psychology (Cooper & Valentine, 2008) - Study Diet for Experiments - but this is cumbersome to use (and we need extensions for correlational or observational studies). - Here is the syllabus that John S. mentioned: - Evidence Gap Map / Mapping Reviews ( - What do we do about weak reporting in primary studies? Complex designs also make it difficult to choose the appropriate contrast. - More specificity in inclusion/exclusion criteria would be beneficial. Perhaps attention to studies with primary data available. - Could a consortium that reviews stage 1 protocols work as a service for journals? Existing Guidelines - Conduct standards: ( - PRISMA / MARS (Reporting Standards) - PRESS (Search Quality Review Checklist) Unstructured notes (KSC, June 26, 2018) - A consortium could develop standards and practices similar to a registered reports model. - Search in psych is often incomplete. - Health researchers use PROSPERO to log their stage 1 protocols; you check PROSPERO before you commence your project - EVIDENT Framework: a paper about different methods of research synthesis - A policy or position paper could be framed as best practices in meta-analysis and systematic review. - We could use a template or guide for registered reports at journals in psych. - We could use guidance with interpreting effect sizes. This would be a best practice. - RAYYAN QCRI: dual coding system (also metagear package) [1]: