@[toc](Resources for Implementing TOP)
## TOP Checklists ##
- Checklists for an editor verifying an author submission ([level 1][1]; [mixed levels][2])
- Checklist for an author submitting to a TOP signatory journal ([level 1][3])
- [Suggested tools and checklists][4] in ecology and evolution.
## Data Reproducibility Policies ##
The following **16** journals use shared data and code to reproduce the computational findings reported in articles prior to publication. **This represents level 3 of the TOP Guidelines for Data, Materials, and Code.**
- The nine journals of the [American Economic Association][5]
- Author instructions and guidance available [here][6]
- [American Journal of Political Science][7]
- [Biostatistics][8]
- [Journal of Experimental Political Science][9]
- [Journal of Peace Research][10]
- [Meta-Psychology][11]
- [Organic Syntheses][12]
- [Quarterly Journal of Political Science][13]
## Data Sharing: Practices and Repositories ##
- [Data Authorship as an Incentive to Data Sharing][14]
- De-Identification
- [De-identification Guidelines for Structured Data][15]
- [Anonymisation Decision-making Framework][16]
- Data Repositories
- [COPDESS][17] Directory of Data Repositories
- [Re3Data][18] Registry of Research Data Repositories
- [Data-PASS][19]
- [Dryad][20]
- [Figshare][21]
- [OAD][22] (Open Access Data Repositories)
- [OSF][23]
- Nature Scientific Data, recommended [repositories][24]
## Reporting Guidelines ##
- See the [Open Science Literature][25] for research on the effectiveness of reporting guidelines. Our recommended best practice is to include items deemed essential into the article submission process.
- See the [Equator Network][26] for a large, searchable collection of reporting guidelines.
### Community Created Guidelines ###
- [CONSORT][27] (Consolidated Standards of Reporting Trials)
- For meta-analysis: [PRISMA][28] or [AMSTAR][29]
- [NIH Reporting Guidelines By Organization][30]
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups [COREQ][31]
- STrengthening the Reporting of OBservational studies in Epidemiology ([STROBE][32])
- An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies ([STARD][33])
- [Experimental design and analysis and their reporting: new guidance for publication in BJP][34]
- [ARRIVE][35] (Animal Research: Reporting of In Vivo Experiments)
- [TIDieR-PHP: a reporting guideline for population health and policy interventions][36]
- [Standardization in Metabolomics Experiments][37]
- Minimum Information for reporting:
- Proteomics Experiments ([MIAPE][38])
- Genotyping Experiments ([MIGen][39])
- Flow Cytometry Experiments ([MIFlowCyt][40])
- Minimal Information About T cell Assays ([MIATA][41] project)
- Quantitative Real-Time PCR Experiments ([MIQE][42])
- RNAi Experiment ([MIARE][43])
- [BRISQ][44] (Biospecimen reporting for improved study quality)
- [Citation of Bioresources in Journal Articles (CoBRA)][45]
### Journal and Society Created Guidelines ###
- From Cell Press: Structured, Transparent, Accessible Reporting (STAR) guidelines from Cell Press: [Website][46], [Methods Guide][47], and the [Key Resources Table][48]
- American Psychological Association: Journal Article Reporting Standards ([JARS][49] 2018 Update; [JARS][50] 2008)
- BioMedCentral's [Minimum Standards of Reporting Checklist][51]
- [Guidelines for Reporting Quantitative Methods and Results in Primary Research][52] at Language Learning
- [Reporting Guidelines for Experimental Research: A Report from the Experimental Research Section Standards Committee][53] of the American Political Science Association
- Association for Psycholgical Science's [reporting guidelines][54]
- Journal of Experimental Social Psychology [reporting guidelines][55]
- Journal of Neuroscience [Policy on Reporting Experimental Design and Statistical Analysis][56]
- [Reporting Checklist for Life Sciences Articles][57] at Nature Publishing Group
- [eLife's Transparent Reporting form][58]
- Biophysical Journal's [Guidelines for the Reproducibility of Biophysics Research][59]
- [A checklist for writing up research reports][60] in the journal Addiction
- PLOS One's [Reporting Guidelines for Specific Study Types][61]
## Registries ##
- [American Economics Association RCT Registry][62]
- [ClinicalTrials.gov][63]
- [EGAP][64] (Evidence in Governance and Politics)
- [OSF][65]
- [PROSPERO][66] International prospective register of systematic reviews
- [Research Registry][67]
- [RIDIE][68] (Registry for International Development Impact Evaluations)
- [Registry of Efficacy and Effectiveness Studies][69] in education
## Editorials announcing TOP ##
- [Association for Psychological Society][70]
- [Ecology Letters][71]
- [Experimental Psychology][72]
- [International Journal of Primatology][73]
- Journal of Research in Personality ([preprint][74])
- [Nature][75]
- [Royal Society Open Science][76]
- [Science][77]
- [Survey Research Methods][78]
## Examples of author guidelines using TOP ##
- [Science][79] | AAAS
- [Brain and Behavior][80] | Wiley
- [Collabra][81] | UC Press
- [Cultural Diversity & Ethnic Minority Psychology][82] | APA
- [Journal of Cognition][83] | Ubiquity Press
- [Nicotine & Tobacco Research][84] | Oxford University Press
- [Evolution and Human Behavior][85] | Elsevier
----------
## Disclosure Statements ##
### Data, Materials, and Code Disclosures ###
| Type of Disclosure | Example Language |
| ------ | ---------- |
| Data created for the study are available in a persistent repository. | All data and materials have been made publicly available at the [repository name] and can be accessed at [persistent URL or DOI] |
| Anonymized data created for the study are available in a persistent repository. | Anonymized data and materials have been made publicly available at the [repository name] and can be accessed at [persistent URL or DOI] |
| Some data available | In order to minimize the possibility of unintentionally sharing information that can be used to re-identify private information, a subset of the data generated for this study are available at [repository name] and can be accessed at [persistent URL or DOI] |
| Data available upon request from a third party | Because of the sensitive nature of the data collected for this study, requests to access the dataset from qualified researchers trained in human subject confidentiality protocols may be sent to [name of organization] at [contact information]. |
----------
Other examples of data disclosure statements
- [The Impact on Authors and Editors of Introducing Data Availability Statements at Nature Journals][86]
- [Nature Research][87]
- [American Geophysical Union][88]
----------
### Preregistration of Study or Analysis Plan Disclosure ###
| Type of Disclosure | Example Language |
| ------ | ---------- |
| Both the study and analysis plan were preregistered | This paper reports the results of [N] preregistered studies with complete analysis plans. The preregistration(s) can be accessed at [persistent URL]. We certify that the results of all preregistered analyses are reported, and that any unregistered analyses are clearly indicated as being [unregistered, exploratory, hypothesis-generating]. |
| The study was preregistered without an analysis plan | This paper reports the results of [N] preregistered studies, which can be accessed at [name of repository] here [persistent URL or DOI]. |
| No preregistration | No preregistration exists for the reported studies reported in this article. |
----------
## Persistent Identifiers ##
- [ARK][89] (Archival Resource Key)
- [DOI][90] (Digitial Object Identifier)
- [IGSN][91] (International Geo Sample Number)
- [RRIDs][92] (Research Resource Identifiers)
- [PURL][93] (Persistent Uniform Resource Locators)
Please contact us if you would like to add to this list: contact@cos.io
[1]: https://osf.io/hcnme/
[2]: https://osf.io/87v93/
[3]: https://osf.io/55eu7/
[4]: https://osf.io/y8aqx/
[5]: https://www.aeaweb.org/journals/data
[6]: https://aeadataeditor.github.io/aea-de-guidance/
[7]: https://ajps.org/ajps-replication-policy/
[8]: https://academic.oup.com/biostatistics/pages/General_Instructions
[9]: https://www.cambridge.org/core/journals/journal-of-experimental-political-science/information/instructions-contributors
[10]: https://www.prio.org/JPR/Datasets/
[11]: https://open.lnu.se/index.php/metapsychology/about
[12]: http://www.orgsyn.org/instructions.aspx
[13]: http://www.nowpublishers.com/Journal/AuthorInstructions/QJPS
[14]: http://www.nejm.org/doi/full/10.1056/NEJMsb1616595
[15]: https://www.ipc.on.ca/resource/de-identification-guidelines-for-structured-data/
[16]: http://ukanon.net/ukan-resources/ukan-decision-making-framework/
[17]: https://copdessdirectory.osf.io/
[18]: http://www.re3data.org/
[19]: http://www.data-pass.org/
[20]: http://datadryad.org/
[21]: https://figshare.com/
[22]: http://oad.simmons.edu/oadwiki/Data_repositories
[23]: https://osf.io
[24]: http://www.nature.com/sdata/policies/repositories
[25]: https://osf.io/kgnva/wiki/Open%20Science%20Literature/
[26]: http://www.equator-network.org/
[27]: http://www.consort-statement.org/
[28]: http://prisma-statement.org/PRISMAStatement/Checklist.aspx
[29]: https://amstar.ca/Amstar_Checklist.php
[30]: https://www.nlm.nih.gov/services/research_report_guide.html
[31]: https://academic.oup.com/intqhc/article/19/6/349/1791966/Consolidated-criteria-for-reporting-qualitative
[32]: https://www.strobe-statement.org/index.php?id=strobe-home
[33]: http://www.stard-statement.org/
[34]: http://onlinelibrary.wiley.com/doi/10.1111/bph.12856/full
[35]: https://www.nc3rs.org.uk/arrive-guidelines
[36]: https://www.bmj.com/content/361/bmj.k1079
[37]: http://metabolomicssociety.org/index.php/resources/metabolomics-standards
[38]: http://www.psidev.info/index.php?q=node/91
[39]: https://osf.io/4nryf/
[40]: https://osf.io/edwhp/
[41]: http://miataproject.org/
[42]: https://osf.io/kjqtf/
[43]: http://miare.sourceforge.net/HomePage
[44]: http://onlinelibrary.wiley.com/doi/10.1002/cncy.20147/abstract
[45]: http://www.equator-network.org/reporting-guidelines/cobra/
[46]: http://www.cell.com/star-methods
[47]: http://www.cell.com/pb-assets/journals/research/cell/methods/Methods%20Guide_general.pdf
[48]: https://www.star-methods.com/key-resources/webform/els_key_resources_table
[49]: http://www.apa.org/pubs/journals/releases/amp-amp0000191.pdf
[50]: http://www.apastyle.org/manual/related/apa-jars-2008.pdf
[51]: http://resource-cms.springer.com/springer-cms/rest/v1/content/7117202/data/v2/Minimum+standards+of+reporting+checklist
[52]: http://onlinelibrary.wiley.com/doi/10.1111/lang.12104/full
[53]: https://www.cambridge.org/core/journals/journal-of-experimental-political-science/article/reporting-guidelines-for-experimental-research-a-report-from-the-experimental-research-section-standards-committee/F09D4BEC6E9F493DC7E048BB252366F2
[54]: http://www.psychologicalscience.org/publications/psychological_science/ps-submissions#DISC
[55]: https://www.journals.elsevier.com/journal-of-experimental-social-psychology/news/jesp-editorial-guidelines/
[56]: http://www.jneurosci.org/content/general-information#policies
[57]: https://www.nature.com/authors/policies/ReportingSummary-flat.pdf
[58]: https://submit.elifesciences.org/html/transparent_reporting.pdf
[59]: http://www.cell.com/pb/assets/raw/journals/society/biophysj/PDFs/reproducibility-guidelines.pdf
[60]: http://onlinelibrary.wiley.com/doi/10.1046/j.1360-0443.2000.951217594.x/epdf
[61]: http://journals.plos.org/plosone/s/submission-guidelines#loc-guidelines-for-specific-study-types
[62]: https://www.socialscienceregistry.org/
[63]: https://clinicaltrials.gov/
[64]: http://egap.org/
[65]: https://osf.io
[66]: https://www.crd.york.ac.uk/prospero/
[67]: http://www.researchregistry.com/
[68]: http://ridie.3ieimpact.org/
[69]: https://sreereg.icpsr.umich.edu/
[70]: http://www.psychologicalscience.org/publications/observer/obsonline/aps-commits-to-promoting-transparent-science.html#.WG-9ObYrJBw
[71]: http://onlinelibrary.wiley.com/doi/10.1111/ele.12611/full
[72]: http://econtent.hogrefe.com/doi/10.1027/1618-3169/a000317
[73]: http://link.springer.com/article/10.1007/s10764-016-9925-x
[74]: https://osf.io/preprints/psyarxiv/ay59f
[75]: http://www.nature.com/news/announcement-transparency-upgrade-for-nature-journals-1.21627
[76]: http://rsos.royalsocietypublishing.org/content/royopensci/4/1/160979.full.pdf
[77]: http://science.sciencemag.org/content/352/6290/1147
[78]: https://ojs.ub.uni-konstanz.de/srm/article/view/6256/5679
[79]: http://science.sciencemag.org/content/sci/suppl/2016/06/01/352.6290.1147.DC1/aag2359-editorial.McNutt.SM.pdf
[80]: http://onlinelibrary.wiley.com/journal/10.1002/%28ISSN%292157-9032/homepage/ForAuthors.html
[81]: http://www.collabra.org/about/editorialpolicies/
[82]: http://www.apa.org/pubs/journals/cdp/?tab=4
[83]: https://www.journalofcognition.org/about/editorialpolicies/
[84]: https://www.oxfordjournals.org/our_journals/nictob/for_authors/ntr%20top%20guidelines.pdf
[85]: https://www.elsevier.com/journals/evolution-and-human-behavior/1090-5138/transparency-and-openness
[86]: http://www.ijdc.net/article/view/614
[87]: http://www.nature.com/authors/policies/data/data-availability-statements-data-citations.pdf
[88]: http://publications.agu.org/author-resource-center/publication-policies/data-policy/data-policy-faq/
[89]: https://confluence.ucop.edu/display/Curation/ARK
[90]: https://www.doi.org/
[91]: http://www.geosamples.org/
[92]: https://scicrunch.org/resources
[93]: https://www.isoc.org/inet96/proceedings/a4/a4_1.htm