### [Using Grant Agreements to Maximize Research Impact, Transparency, and Reproducibility][1] ### ---------- #### Overview #### - [Link to meeting notes][2] - Barriers to data sharing: IP concerns, mandates that are unenforced, need for - Ideas to move these issues forward: dedicate a portion of funding for a pilot call that broadly supports increased rigor and replicability. That call will include TOP standards for data/materials/code transparency, preregistration, and replication. - Replications: when a grant comes in proposing to build up study X, offer more money to first replicate X before attempting the proposed extension. - Possible improvements without policy change: when reviewers mention topics related to transparency, take that as a justification to make it part of the substantial grant feedback needed for revision or, if rejected, for future proposals. ---------- ## Creative solutions to addressing these issues ## - Dedicate funds or a pilot period to test various actions boardly related to transparency - Pair "extension" funded research proposal with a replication of the original work in order to measure those boundary conditions - Use peer review feedback as an opportunity to recommend openness - Talking points, education resources, rubrics, checklists, 1 pagers, infographics for the researcher right before they submit a grant: "What to do to make your proposal more competitive" - Onboarding for recently accepted grantees: meeting your pgroam officers - Internal tracking tools of openness - OSF registration form desiged for a grant report. Contains questions to guide researcher to include outputs (data, pubs, preregistrations) in that registration metadata - DOI- include metadata that can score a research output via its DOI on openness via SHARE. Add openness data to that DOI ---------- #### Resources #### - [PCORI][3] grant agreement - [LJAF][4] grant agreement - TOP Guidelines [homepage][5] and [language for funders][6] - [Resources][7] that enable actions covered in the TOP Guidelines - OSF [Youtube Channel][8] - [Background materials for preregistration][9] - [NIH education modules on rigor and reproducibility][10] - [Outreach language][11] for starting a dialogue with journals and publishers ---------- [1]: https://osf.io/p3gjm/wiki [2]: https://docs.google.com/document/d/1s_67FU0N2qi_sdc4JF-rZ7fddzx0spjC0Z-hNSJ4n3Q/edit?ts=5846effe#bookmark=id.9e3pot87w3l5 [3]: http://www.pcori.org/sites/default/files/PCORI-PFA-Standard-Contract-for-Funded-Research-Projects.pdf [4]: http://www.arnoldfoundation.org/wp-content/uploads/Request-for-Proposals-RCTs-to-Evaluate-Social-Programs-Whose-Delivery-Will-Be-Funded-by-Government-or-Other-Entities.pdf [5]: http://cos.io/top [6]: https://osf.io/bcj53/ [7]: https://osf.io/kgnva/wiki/home [8]: https://www.youtube.com/channel/UCGPlVf8FsQ23BehDLFrQa-g [9]: https://osf.io/x5w7h/wiki/03%20Supplemental%20material/ [10]: https://www.nih.gov/research-training/rigor-reproducibility/training [11]: https://osf.io/hnp6x/wiki/home/