# CRS Resources #
by Simon Schwab, Eva Furrer & Leonhard Held<br>
Center for Reproducible Science (CRS) at University of Zurich (UZH).
Contact:<br>
[eva.furrer@uzh.ch](mailto:eva.furrer@uzh.ch)<br>
[leonhard.held@uzh.ch](mailto:leonhard.held@uzh.ch)
The Center for Reproducible Science (CRS) provides teaching materials and an overview of external resources related to reproducibility and open science (e.g., slides, videos, code). The information collected here is aimed to provide a starting point for anyone to find important information and resources related to reproducibility.
@[toc]
## Resources provided by the CRS ##
### CRS Talks ###
Our talks and teaching materials are available [here](https://osf.io/sa3fp/).
### CRS Library ###
The paper [Munafò et al. (2017)](https://doi.org/10.1038/s41562-016-0021) is a good starting point to the topic of reproducibility and open science. However, have created and are constantly updating a library containing an list of relevant papers related to reproducibility and open science. A [PDF](https://github.com/crsuzh/library/blob/master/crsbib.pdf) can be downloaded, and the list is managed on Github at https://github.com/crsuzh/library.
### Reproducipedia ###
Reproducipedia is a collection of important terms related to reproducibility and contains concise explanations with further readings. Reproducipedia can be accessed [here](https://osf.io/5cmfa/wiki/home/).
## External Resources ##
### Special Issues ###
Several journals have dedicated a special issue about reproducibility.
- *Science* special issue [Metaresearch-Science under Scrutiny](http://science.sciencemag.org/content/361/6408) (2018).
- *Nature* special issue [Challenges in Irreproducible Research](https://www.nature.com/collections/prbfkwmwvz) (2018).
- *PNAS* [Sackler Colloquium on Improving the Reproducibility of Scientific Research](https://www.pnas.org/content/115/11#SacklerColloquiumonImprovingtheReproducibilityofScientificResearchFreeOnline) (2018).
- *Nature* collection [Statistics in Biology & Practical Guides](https://www.nature.com/collections/qghhqm) (2017).
### Organizations and Institutions ###
Here is a incomplete list of organizations and institutions that promote reproducibility and open science:
- [COS](https://cos.io/) - Center for Open Science, Charlottesville, USA
- [CRS](https://www.crs.uzh.ch) - Center for Reproducible Science, University of Zurich, Switzerland
- [METRICS](https://metrics.stanford.edu/) - Meta-Research Innovation Center at Stanford, Stanford University, USA
- [OSC](https://www.osc.uni-muenchen.de) - Open Science Center, LMU Munich, Germany
- [QUEST](https://www.bihealth.org/de/quest-center/) - Center for Transforming
Biomedical Research, Berlin Institute of Health, Germany
- [Reproducible Research Oxford](https://rroxford.github.io/) - University of Oxford, UK
- [Stanford Center for Reproducible Neuroscience](http://reproducibility.stanford.edu/) - University of Stanford, USA
- [UK Reproducibility Network](http://www.bristol.ac.uk/news/2018/september/reproducibility-network-.html) - University of Bristol and others, UK
### Projects ###
- [FOSTER](https://www.fosteropenscience.eu) is a e-learning platform about Open Science funded by EU.
- [PubPeer](https://pubpeer.com/) is a platform that allows users to discuss and review scientific publications. In that sense, it is a post-publication peer-review. It highlighted shortcomings in various high-profile papers which ultimately led to the retraction of these papers.
- [
Retraction Watch](http://retractionwatch.com/) is a website that reports retractions of scientific papers.
### Teaching Materials ###
This section provides some resources for teaching materials, mostly slides.
- The COS provides some excellent resources such as their [Reproducible Research Workshop](https://osf.io/qsb2c/). There is a [collection of presentations](https://osf.io/zvp8k/) given by COS staff members, including the slides from the OSF Workshop with Ian Sullivan held at the Psychology Department, University of Zurich in November 2018.
- There is a Webinar on [Licensing Your Research](https://osf.io/6uupa/) which explains and provides useful information on copyrights and licences.
- Excellent materials for conducting replication classes can be found here [Teaching replicable and reproducible science](https://osf.io/x7d45/).
- Benjamin Le's [Open Science Manual](https://docs.google.com/document/d/1oMkTCEFtOq_DB0eoNiyk-B5QCgL6sVSF5pVvD1ONZDc/edit) provides a model for research lab guidelines.
- [PRAXIS Australia Ltd](http://praxisaustralia.com.au/) offers a large range of courses for ethics committee, researchers and others involved in the planning, review and conduct of research.
### Video Resources ###
This section provides links to videos that are suitable for teaching and talks.
- The *nature video* [Is there a reproducibility crisis in science?](https://www.youtube.com/watch?v=j7K3s_vi_1Y)
- Simine Vazire (UC Davis) talks about [Open Science](https://www.youtube.com/watch?v=1rFWeTryiW4)
- Michael Nielsen's TEDx Talk on [Open Science](https://www.youtube.com/watch?v=DnWocYKqvhw)
- Daniel J. Simons on [Preregistration and Registered Reports](https://www.youtube.com/watch?v=LYfZr5poCkQ)
- [Scientific Studies: Last Week Tonight with John Oliver (HBO)](https://www.youtube.com/watch?v=0Rnq1NpHdmw) Comedian John Oliver discusses how and why media outlets so often report untrue or incomplete information as science (warning: language not safe for work).
- The Economist [Unlikely results](https://www.youtube.com/watch?v=TosyACdsh-g)
### Tools and Software ###
There is a report [Digital tools and services to support research replicability and verifiability](http://repository.jisc.ac.uk/7055/1/Digital_tools_and_services_to_support_research_replicability_and_verifiability.pdf).
