Wanting to start a journal club, but don't have time to find journals? Why not borrow someone else's reading list? Here is a collection of readings on open sciences collected from around the web, let us know if you find more! We are in the process of making this a [Zotero library here](https://www.zotero.org/groups/2336553/anzorn). ## Existing Reading lists - [Srivistava (2016) - Everything is fucked](https://thehardestscience.com/2016/08/11/everything-is-fucked-the-syllabus/) - [David Mellor's "Open Science in the Literature"](https://osf.io/kgnva/wiki/Open%20Science%20Literature/) - ["Replication Concerns are not new"](https://morn.netlify.com/replconcernsnotnew) - [How to become a Bayesian in eight easy steps](https://alexanderetz.com/2016/02/07/understanding-bayes-how-to-become-a-bayesian-in-eight-easy-steps/) - [Eight Easy Steps to Open Science: An Annotated Reading List](https://psyarxiv.com/cfzyx) - [Brent Roberts and Dan Simons' exhaustive reading list](https://docs.google.com/document/d/14lBD0aZDPij2Z6AOpAharOAtmt6ZBI0EuF3_tu8m66I/) - [Reproducibility Biography](https://reproducibility.dash.umn.edu/) - [The global benefits of Open research](https://www.mdpi.com/books/pdfview/edition/914) ### Open Science - [A Short (Personal) Future History of Revolution 2.0](https://journals.sagepub.com/doi/full/10.1177/1745691615609918) ^ Recommended "intro to open science" article - [Open Science, Bropen Science](https://thepsychologist.bps.org.uk/volume-33/november-2020/bropenscience-broken-science) A thoughtful, pro-openness cricitism of open science. - [Open Science: One Term, Five Schools of Thought](https://link.springer.com/chapter/10.1007%2F978-3-319-00026-8_2) Teasing out the traditions of openness and how they relate to one another. - [Practical Tools and Strategies for Researchers to Increase Replicability](https://psyarxiv.com/emyux/) How to get started in open research practices - [Open science: What, Why, and how?](https://psyarxiv.com/ak6jr/) - [Implications of the Credibility Revolution for Productivity, Creativity, and Progress](https://psyarxiv.com/2yphf) - [Open Science Is Liberating and Can Foster Creativity](http://journals.sagepub.com/doi/abs/10.1177/1745691618767878) - [How open science helps researchers succeed](https://cdn.elifesciences.org/articles/16800/elife-16800-v1.pdf) What can open research practices do for you (cynically) - [Open Science challenges, benefits and tips in early career and beyond](https://psyarxiv.com/3czyt/) - [The new statistics: why and how.](https://www.ncbi.nlm.nih.gov/pubmed/24220629) - [The Tao of open science for ecology](https://esajournals.onlinelibrary.wiley.com/doi/abs/10.1890/ES14-00402.1) - [Open Education Science](http://journals.sagepub.com/doi/full/10.1177/2332858418787466) - [PsychDisclosure.org: Grassroots support for reforming reporting standards in psychology](https://etiennelebel.com/documents/lbghprs(2013,pps).pdf) - [Enhancing transparency of the research process to increase accuracy of findings: A guide for relationship researchers](https://etiennelebel.com/documents/cl&l(2014,pr).pdf) - [A new replication norm for psychology](https://etiennelebel.com/documents/l(2015,collabra).pdf) - [Psychological and institutional obstacles toward more transparent reporting of psychological science](https://etiennelebel.com/documents/l&j(inpress,chapter).pdf) - [Benefits of open and high-powered research outweigh costs](https://etiennelebel.com/documents/lcl(2017,jpsp).pdf) - [Reproducibility of Scientific results](https://plato.stanford.edu/entries/scientific-reproducibility/) - [A Model-Centric Analysis of Openness, Replication, and Reproducibility](https://arxiv.org/abs/1811.04525) Complex, but addresses the relationship between openness and reproducibility in great detail. - [Discovery of truth is not implied by reproducibility but facilitated by innovation and epistemic diversity in a model-centric framework](https://arxiv.org/abs/1803.10118) - [Sound Inference in Complicated Research: A Multi-Strategy Approach](https://psyarxiv.com/bwr48) - [Reproducibility and Replicability in Science](https://doi.org/10.17226/25303) by National Academies of Sciences, Engineering, and Medicine. - [Cultural Psychology, Diversity, and Representation in Open Science](https://psyarxiv.com/t7hp2/) ### p-values and statistical significance - [Redefine statistical significance](https://www.nature.com/articles/s41562-017-0189-z) - [Justify Your Alpha](https://psyarxiv.com/9s3y6/) - [Redefine or Justify? Comments on the alpha debate](https://psyarxiv.com/rbm8y) - [Remove, rather than redefine, statistical significance](https://www.researchgate.net/publication/320021624_Remove_rather_than_redefine_statistical_significance) - [Scientists rise up against statistical significance](https://www.nature.com/articles/d41586-019-00857-9) - [Is the call to abandon p-values the red herring of the replicability crisis?](https://www.frontiersin.org/articles/10.3389/fpsyg.2015.00245/full) ### Theory testing - [What Social Scientists Don't Understand](http://meehl.umn.edu/sites/g/files/pua1696/f/128socscientistsdontunderstand.pdf) ### False-positive inflation - [Measuring the prevalence of questionable research practices with incentives for truth telling](http://journals.sagepub.com/doi/abs/10.1177/0956797611430953) - [Researcher Requests for Inappropriate Analysis and Reporting: A U.S. Survey of Consulting Biostatisticians](http://annals.org/aim/article-abstract/2706170/researcher-requests-inappropriate-analysis-reporting-u-s-survey-consulting-biostatisticians) - [False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant](http://journals.sagepub.com/doi/pdf/10.1177/0956797611417632) - [Fearing the future of empirical psychology: Bem's (2011) evidence of psi as a case study of deficiencies in modal research practice](https://etiennelebel.com/documents/l&p(2011,rgp).pdf) ### Replicability and Credibility - [The Turing Way - A How-to guide to reproducible data science](https://github.com/alan-turing-institute/the-turing-way#about-the-project) - [Minimizing Mistakes in Psychological Science](https://psyarxiv.com/gxcy5) - [The Economics of Reproducibility in Preclinical Research](https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002165) - [Reproducibility in science: improving the standard for basic and preclinical research.](https://www.ncbi.nlm.nih.gov/pubmed/25552691) - [Estimating the reproducibility of psychological science](http://science.sciencemag.org/content/349/6251/aac4716) - [Replication in Empirical Economics: The Journal of Money, Credit and Banking Project (1986)](https://www.jstor.org/stable/1806061) - [A unified framework to quantify the credibility of scientific findings](https://etiennelebel.com/documents/lebeletal(2018,ampss)a-unified-framework-to-quantify-the-credibility-of-scientific-findings.pdf) - [Raise standards for preclinical cancer research](https://www.nature.com/articles/483531a) ## Publication reforms - [Exploratory reports: A new article type for Cortex](https://www.sciencedirect.com/science/article/pii/S0010945217302393) - [A practical guide for transparency in psychological science](https://www.collabra.org/articles/10.1525/collabra.158/) ### Preregistration - [Bold conjectures meet open science: Accelerating theory development in social psychology by testing riskier predictions via pre-registration](https://etiennelebel.com/documents/l&c(2015,abstract).pdf) - [The preregistration revolution](https://www.pnas.org/content/115/11/2600) - [An Agenda for Purely Confirmatory Research](https://journals.sagepub.com/doi/full/10.1177/1745691612463078) - [Preregistration is redundant, at best](https://psyarxiv.com/x36pz) - A contrarian but thoughtful discussion of the role of preregistration in science. ### Open Materials - [Practical Solutions for Sharing Data and Materials From Psychological Research](http://journals.sagepub.com/doi/pdf/10.1177/2515245917746500) ### Open Data - [Practical Tips for Ethical Data Sharing](https://journals.sagepub.com/doi/full/10.1177/2515245917747656) - [Nine simple ways to make it easier to (re)use your data](https://ojs.library.queensu.ca/index.php/IEE/article/view/4608) - [Data Organization in Spreadsheets](https://www.tandfonline.com/doi/abs/10.1080/00031305.2017.1375989) - [Data Authorship as an Incentive to Data Sharing](https://www.nejm.org/doi/full/10.1056/NEJMsb1616595) - [How to share data for collaboration](https://peerj.com/preprints/3139/) - [Responsible practices for data sharing](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5967383/) - [Badges for sharing data and code at Biostatistics: an observational study](https://f1000research.com/articles/7-90/v1) - [What incentives increase data sharing in health and medical research? A systematic review](https://researchintegrityjournal.biomedcentral.com/articles/10.1186/s41073-017-0028-9) - [The FAIR Guiding Principles for scientific data management and stewardship](https://www.nature.com/articles/sdata201618) - [Using OSF to Share Data: A Step-by-Step Guide](https://journals.sagepub.com/doi/abs/10.1177/2515245918757689) ### Open Publication - [The open access advantage considering citation, article usage and social media attention](https://link.springer.com/article/10.1007/s11192-015-1547-0) ### Open Educational Resources - [Models for Sustainable Open Educational Resources](https://www.learntechlib.org/p/44796/) ## Research Process Changes - [Striving for transparent and credible research: practical guidelines for behavioral ecologists](https://academic.oup.com/beheco/article/28/2/348/3069145) - [Robust modeling in cognitive science](https://psyarxiv.com/dmfhk/) - [A Quick Guide to Organizing Computational Biology Projects](https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1000424) ### Computational Reproducibility - [Good enough practices in scientific computing](https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005510) - [Best practices in computational science](https://openresearchsoftware.metajnl.com/articles/10.5334/jors.ay/) - [What is missing from descriptions of treatment in trials and reviews?](https://www.bmj.com/content/336/7659/1472) - [An empirical analysis of journal policy effectiveness for computational reproducibility](http://www.pnas.org/content/115/11/2584) - [Packaging data analytical work reproducibly using R (and friends)](https://peerj.com/preprints/3192/)) - [How rOpenSci uses Code review to promote reproducible science](https://ropensci.org/blog/2017/09/01/nf-softwarereview/) - [An introduction to Docker for reproducible research, with examples from the R environment](https://arxiv.org/abs/1410.0846) ### Version Control - [Git can facilitate greater reproducibility and increased transparency in science](https://scfbm.biomedcentral.com/articles/10.1186/1751-0473-8-7) - [Excuse me, do you have a moment to talk about version control?](https://peerj.com/preprints/3159/) ### Open Source - [Building Software Building Community: Lessons from the rOpenSci Project](https://openresearchsoftware.metajnl.com/articles/10.5334/jors.bu/print/) - [Our path to better science in less time using open data science tools](https://www.nature.com/articles/s41559-017-0160) ### Teaching Open Practices - [Teaching Replication](https://journals.sagepub.com/doi/10.1177/1745691612460686) ### Examples of practice - [Civic Laboratory for Environmental Action Research (CLEAR)](https://civiclaboratory.nl/) - [Onboarding in the Language and Cognition Lab](http://babieslearninglanguage.blogspot.com/2017/01/onboarding.html)