Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
Open and reproducible research practices can be evaluated at the journal level and by examining individual researcher's output. However, the clearest picture of institutional and/or departmental support for these improvements to research practice is demonstrated by efforts made to **_teach_** these practices. _Undergraduates can only be expected to know what they are taught about open and reproducible science._ We therefore propose a scoring framework for these teaching practices (with inspiration from the Transparency and Openness Promotion guidelines). Our framework currently includes six principles core to the teaching of reproducible and open science practices; * Reproducible research understanding * Conceptual statistics and methods knowledge * preregistration * data sharing * reproducible analyses and pipelines * replications Each principle will be by two dimensions; Breadth and Depth. Breadth describes how widely teaching is distributed and takes three levels; * Not yet enacted, or minimal breadth * Opportunities for some * Course requirement for all Depth describes the degree to which students interact with the core principles and takes four levels; * Not yet enacted, or minimal depth * knowledge * practice * application Departments will be scored for each principle across the breadth and depth dimensions. An averaged or composite score will then be created for that department. Also included will be a y/n item recording whether that institution/department has a statement supporting open and reproducible research practices (this may later become an essential requirement for evaluation of that department and issue of framework scoring). Note that while the highest standards for teaching these principles would be _course required application_ of reproducible and open research; we acknowledge that this is not possible across courses. However, this is a tool intended to evaluate the current teaching practices in a given department. Further to the evaluation of teaching given, and some minor incentives using a badge or ranking system; this framework will act as a resource for instructors wishing to implement reproducible and open science principles into their teaching. At present, we are drafting the initial framework, which can be found here; https://docs.google.com/spreadsheets/d/1cDpGkqAAu7G91Q_Y81PrFHBjRV8LPVzrwLyvJ_oOtuk/edit?usp=sharing google doc for comments here: https://docs.google.com/document/d/1DYAeQ2-veg4AQqLHMCdOyLoAU2WH2I_oaJIKc9StXXE/edit?usp=sharing Immediate goals; * Finalise version 1 of the framework * Request feedback on the framework * Revise framework as necessary, * Develop detailed example of an evidence document for the revised framework * Pilot the evaluation and create preliminary rankings
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.