@[toc](Resources for Implementing TOP) ## TOP Checklists ## - Checklists for an editor verifying an author submission ([level 1][1]; [mixed levels][2]) - Checklist for an author submitting to a TOP signatory journal ([level 1][3]) - [Suggested tools and checklists][4] in ecology and evolution. ## Data Reproducibility Policies ## The following **16** journals use shared data and code to reproduce the computational findings reported in articles prior to publication. **This represents level 3 of the TOP Guidelines for Data, Materials, and Code.** - The nine journals of the [American Economic Association][5] - Author instructions and guidance available [here][6] - [American Journal of Political Science][7] - [Biostatistics][8] - [Journal of Experimental Political Science][9] - [Journal of Peace Research][10] - [Meta-Psychology][11] - [Organic Syntheses][12] - [Quarterly Journal of Political Science][13] ## Data Sharing: Practices and Repositories ## - [Data Authorship as an Incentive to Data Sharing][14] - De-Identification - [De-identification Guidelines for Structured Data][15] - [Anonymisation Decision-making Framework][16] - Data Repositories - [COPDESS][17] Directory of Data Repositories - [Re3Data][18] Registry of Research Data Repositories - [Data-PASS][19] - [Dryad][20] - [Figshare][21] - [OAD][22] (Open Access Data Repositories) - [OSF][23] - Nature Scientific Data, recommended [repositories][24] ## Reporting Guidelines ## - See the [Open Science Literature][25] for research on the effectiveness of reporting guidelines. Our recommended best practice is to include items deemed essential into the article submission process. - See the [Equator Network][26] for a large, searchable collection of reporting guidelines. ### Community Created Guidelines ### - [CONSORT][27] (Consolidated Standards of Reporting Trials) - For meta-analysis: [PRISMA][28] or [AMSTAR][29] - [NIH Reporting Guidelines By Organization][30] - Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups [COREQ][31] - STrengthening the Reporting of OBservational studies in Epidemiology ([STROBE][32]) - An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies ([STARD][33]) - [Experimental design and analysis and their reporting: new guidance for publication in BJP][34] - [ARRIVE][35] (Animal Research: Reporting of In Vivo Experiments) - [TIDieR-PHP: a reporting guideline for population health and policy interventions][36] - [Standardization in Metabolomics Experiments][37] - Minimum Information for reporting: - Proteomics Experiments ([MIAPE][38]) - Genotyping Experiments ([MIGen][39]) - Flow Cytometry Experiments ([MIFlowCyt][40]) - Minimal Information About T cell Assays ([MIATA][41] project) - Quantitative Real-Time PCR Experiments ([MIQE][42]) - RNAi Experiment ([MIARE][43]) - [BRISQ][44] (Biospecimen reporting for improved study quality) - [Citation of Bioresources in Journal Articles (CoBRA)][45] ### Journal and Society Created Guidelines ### - From Cell Press: Structured, Transparent, Accessible Reporting (STAR) guidelines from Cell Press: [Website][46], [Methods Guide][47], and the [Key Resources Table][48] - American Psychological Association: Journal Article Reporting Standards ([JARS][49] 2018 Update; [JARS][50] 2008) - BioMedCentral's [Minimum Standards of Reporting Checklist][51] - [Guidelines for Reporting Quantitative Methods and Results in Primary Research][52] at Language Learning - [Reporting Guidelines for Experimental Research: A Report from the Experimental Research Section Standards Committee][53] of the American Political Science Association - Association for Psycholgical Science's [reporting guidelines][54] - Journal of Experimental Social Psychology [reporting guidelines][55] - Journal of Neuroscience [Policy on Reporting Experimental Design and Statistical Analysis][56] - [Reporting Checklist for Life Sciences Articles][57] at Nature Publishing Group - [eLife's Transparent Reporting form][58] - Biophysical Journal's [Guidelines for the Reproducibility of Biophysics Research][59] - [A checklist for writing up research reports][60] in the journal Addiction - PLOS One's [Reporting Guidelines for Specific Study Types][61] ## Registries ## - [American Economics Association RCT Registry][62] - [ClinicalTrials.gov][63] - [EGAP][64] (Evidence in Governance and Politics) - [OSF][65] - [PROSPERO][66] International prospective register of systematic reviews - [Research Registry][67] - [RIDIE][68] (Registry for International Development Impact Evaluations) - [Registry of Efficacy and Effectiveness Studies][69] in education ## Editorials announcing TOP ## - [Association for Psychological Society][70] - [Ecology Letters][71] - [Experimental Psychology][72] - [International Journal of Primatology][73] - Journal of Research in Personality ([preprint][74]) - [Nature][75] - [Royal Society Open Science][76] - [Science][77] - [Survey Research Methods][78] ## Examples of author guidelines using TOP ## - [Science][79] | AAAS - [Brain and Behavior][80] | Wiley - [Collabra][81] | UC Press - [Cultural Diversity & Ethnic Minority Psychology][82] | APA - [Journal of Cognition][83] | Ubiquity Press - [Nicotine & Tobacco Research][84] | Oxford University Press - [Evolution and Human Behavior][85] | Elsevier ---------- ## Disclosure Statements ## ### Data, Materials, and Code Disclosures ### | Type of Disclosure | Example Language | | ------ | ---------- | | Data created for the study are available in a persistent repository. | All data and materials have been made publicly available at the [repository name] and can be accessed at [persistent URL or DOI] | | Anonymized data created for the study are available in a persistent repository. | Anonymized data and materials have been made publicly available at the [repository name] and can be accessed at [persistent URL or DOI] | | Some data available | In order to minimize the possibility of unintentionally sharing information that can be used to re-identify private information, a subset of the data generated for this study are available at [repository name] and can be accessed at [persistent URL or DOI] | | Data available upon request from a third party | Because of the sensitive nature of the data collected for this study, requests to access the dataset from qualified researchers trained in human subject confidentiality protocols may be sent to [name of organization] at [contact information]. | ---------- Other examples of data disclosure statements - [The Impact on Authors and Editors of Introducing Data Availability Statements at Nature Journals][86] - [Nature Research][87] - [American Geophysical Union][88] ---------- ### Preregistration of Study or Analysis Plan Disclosure ### | Type of Disclosure | Example Language | | ------ | ---------- | | Both the study and analysis plan were preregistered | This paper reports the results of [N] preregistered studies with complete analysis plans. The preregistration(s) can be accessed at [persistent URL]. We certify that the results of all preregistered analyses are reported, and that any unregistered analyses are clearly indicated as being [unregistered, exploratory, hypothesis-generating]. | | The study was preregistered without an analysis plan | This paper reports the results of [N] preregistered studies, which can be accessed at [name of repository] here [persistent URL or DOI]. | | No preregistration | No preregistration exists for the reported studies reported in this article. | ---------- ## Persistent Identifiers ## - [ARK][89] (Archival Resource Key) - [DOI][90] (Digitial Object Identifier) - [IGSN][91] (International Geo Sample Number) - [RRIDs][92] (Research Resource Identifiers) - [PURL][93] (Persistent Uniform Resource Locators) Please contact us if you would like to add to this list: contact@cos.io [1]: https://osf.io/hcnme/ [2]: https://osf.io/87v93/ [3]: https://osf.io/55eu7/ [4]: https://osf.io/y8aqx/ [5]: https://www.aeaweb.org/journals/data [6]: https://aeadataeditor.github.io/aea-de-guidance/ [7]: https://ajps.org/ajps-replication-policy/ [8]: https://academic.oup.com/biostatistics/pages/General_Instructions [9]: https://www.cambridge.org/core/journals/journal-of-experimental-political-science/information/instructions-contributors [10]: https://www.prio.org/JPR/Datasets/ [11]: https://open.lnu.se/index.php/metapsychology/about [12]: http://www.orgsyn.org/instructions.aspx [13]: http://www.nowpublishers.com/Journal/AuthorInstructions/QJPS [14]: http://www.nejm.org/doi/full/10.1056/NEJMsb1616595 [15]: https://www.ipc.on.ca/resource/de-identification-guidelines-for-structured-data/ [16]: http://ukanon.net/ukan-resources/ukan-decision-making-framework/ [17]: https://copdessdirectory.osf.io/ [18]: http://www.re3data.org/ [19]: http://www.data-pass.org/ [20]: http://datadryad.org/ [21]: https://figshare.com/ [22]: http://oad.simmons.edu/oadwiki/Data_repositories [23]: https://osf.io [24]: http://www.nature.com/sdata/policies/repositories [25]: https://osf.io/kgnva/wiki/Open%20Science%20Literature/ [26]: http://www.equator-network.org/ [27]: http://www.consort-statement.org/ [28]: http://prisma-statement.org/PRISMAStatement/Checklist.aspx [29]: https://amstar.ca/Amstar_Checklist.php [30]: https://www.nlm.nih.gov/services/research_report_guide.html [31]: https://academic.oup.com/intqhc/article/19/6/349/1791966/Consolidated-criteria-for-reporting-qualitative [32]: https://www.strobe-statement.org/index.php?id=strobe-home [33]: http://www.stard-statement.org/ [34]: http://onlinelibrary.wiley.com/doi/10.1111/bph.12856/full [35]: https://www.nc3rs.org.uk/arrive-guidelines [36]: https://www.bmj.com/content/361/bmj.k1079 [37]: http://metabolomicssociety.org/index.php/resources/metabolomics-standards [38]: http://www.psidev.info/index.php?q=node/91 [39]: https://osf.io/4nryf/ [40]: https://osf.io/edwhp/ [41]: http://miataproject.org/ [42]: https://osf.io/kjqtf/ [43]: http://miare.sourceforge.net/HomePage [44]: http://onlinelibrary.wiley.com/doi/10.1002/cncy.20147/abstract [45]: http://www.equator-network.org/reporting-guidelines/cobra/ [46]: http://www.cell.com/star-methods [47]: http://www.cell.com/pb-assets/journals/research/cell/methods/Methods%20Guide_general.pdf [48]: https://www.star-methods.com/key-resources/webform/els_key_resources_table [49]: http://www.apa.org/pubs/journals/releases/amp-amp0000191.pdf [50]: http://www.apastyle.org/manual/related/apa-jars-2008.pdf [51]: http://resource-cms.springer.com/springer-cms/rest/v1/content/7117202/data/v2/Minimum+standards+of+reporting+checklist [52]: http://onlinelibrary.wiley.com/doi/10.1111/lang.12104/full [53]: https://www.cambridge.org/core/journals/journal-of-experimental-political-science/article/reporting-guidelines-for-experimental-research-a-report-from-the-experimental-research-section-standards-committee/F09D4BEC6E9F493DC7E048BB252366F2 [54]: http://www.psychologicalscience.org/publications/psychological_science/ps-submissions#DISC [55]: https://www.journals.elsevier.com/journal-of-experimental-social-psychology/news/jesp-editorial-guidelines/ [56]: http://www.jneurosci.org/content/general-information#policies [57]: https://www.nature.com/authors/policies/ReportingSummary-flat.pdf [58]: https://submit.elifesciences.org/html/transparent_reporting.pdf [59]: http://www.cell.com/pb/assets/raw/journals/society/biophysj/PDFs/reproducibility-guidelines.pdf [60]: http://onlinelibrary.wiley.com/doi/10.1046/j.1360-0443.2000.951217594.x/epdf [61]: http://journals.plos.org/plosone/s/submission-guidelines#loc-guidelines-for-specific-study-types [62]: https://www.socialscienceregistry.org/ [63]: https://clinicaltrials.gov/ [64]: http://egap.org/ [65]: https://osf.io [66]: https://www.crd.york.ac.uk/prospero/ [67]: http://www.researchregistry.com/ [68]: http://ridie.3ieimpact.org/ [69]: https://sreereg.icpsr.umich.edu/ [70]: http://www.psychologicalscience.org/publications/observer/obsonline/aps-commits-to-promoting-transparent-science.html#.WG-9ObYrJBw [71]: http://onlinelibrary.wiley.com/doi/10.1111/ele.12611/full [72]: http://econtent.hogrefe.com/doi/10.1027/1618-3169/a000317 [73]: http://link.springer.com/article/10.1007/s10764-016-9925-x [74]: https://osf.io/preprints/psyarxiv/ay59f [75]: http://www.nature.com/news/announcement-transparency-upgrade-for-nature-journals-1.21627 [76]: http://rsos.royalsocietypublishing.org/content/royopensci/4/1/160979.full.pdf [77]: http://science.sciencemag.org/content/352/6290/1147 [78]: https://ojs.ub.uni-konstanz.de/srm/article/view/6256/5679 [79]: http://science.sciencemag.org/content/sci/suppl/2016/06/01/352.6290.1147.DC1/aag2359-editorial.McNutt.SM.pdf [80]: http://onlinelibrary.wiley.com/journal/10.1002/%28ISSN%292157-9032/homepage/ForAuthors.html [81]: http://www.collabra.org/about/editorialpolicies/ [82]: http://www.apa.org/pubs/journals/cdp/?tab=4 [83]: https://www.journalofcognition.org/about/editorialpolicies/ [84]: https://www.oxfordjournals.org/our_journals/nictob/for_authors/ntr%20top%20guidelines.pdf [85]: https://www.elsevier.com/journals/evolution-and-human-behavior/1090-5138/transparency-and-openness [86]: http://www.ijdc.net/article/view/614 [87]: http://www.nature.com/authors/policies/data/data-availability-statements-data-citations.pdf [88]: http://publications.agu.org/author-resource-center/publication-policies/data-policy/data-policy-faq/ [89]: https://confluence.ucop.edu/display/Curation/ARK [90]: https://www.doi.org/ [91]: http://www.geosamples.org/ [92]: https://scicrunch.org/resources [93]: https://www.isoc.org/inet96/proceedings/a4/a4_1.htm