Home

Menu

Loading wiki pages...

View
Wiki Version:
# Welcome to the ReproducibiliTea Toronto Journal Club This journal club is based at York University, Toronto, Canada. We aim to be as inclusive as possible. If you want to join our conversation during a particular meeting, then just follow the link on the Google Calendar event to join the Google Hangout. Don't forget to keep up to date by subscribing to our calendar. Follow us on Twitter [@TorontoTea1][1] **Each Google calendar event has a link to our weekly reading and anyone can join our conversation virtually by requesting the Zoom link via email at reproducibiliteatoronto@gmail.com** [Google Calendar][2] ## **Readings** ### **Fall 2020** **Week 1** - Oct 30, 2020 @ 2:30 PM EST *When Personality Psychologists are High* Post from Dr. Ulrich Schimmack’s Blog about Replicability [https://replicationindex.com/2019/08/13/when-personality-psychologists-are-high/][3] **Week 2** - Nov 13, 2020 @ 2:30 PM EST *Personality Measurement with the Big Five Inventory* [https://replicationindex.com/2019/08/10/personality-measurement-with-the-big-five-inventory/][4] Post from Dr. Ulrich Schimmack’s Blog about Replicability **Week 3** - Nov 27, 2020 @ 2:30 PM EST *When a “Replication” Is Not a Replication. Commentary: Sequential Congruency Effects in Monolingual and Bilingual Adult* [https://www.frontiersin.org/articles/10.3389/fpsyg.2019.00797/full][5] Supplemental reading: [Null results in bilingualism research:What they tell us and what they don’t][6] ### **Winter 2021** Many of our readings this semester were pulled from a fantastic [Twitter thread][7] by [@zerdeve][8] highlighting some non-mainstream work on reproducibility, open science, replication crisis, meta-science by women **Week 4** - Jan 22, 2021 @ 2:30 PM EST *Paths in strange spaces: A comment on preregistration*: Part 1 A blog post by Daniel Navarro preserved as a preprint on psyarxiv. [https://psyarxiv.com/wxn58][9] **Week 5** - Feb 5, 2021 @ 2:30 PM EST *Paths in strange spaces: A comment on preregistration*: Part 2 A blog post by Daniel Navarro preserved as a preprint on psyarxiv. [https://psyarxiv.com/wxn58][10] **Week 6** - Feb 19, 2021 @ 1:oo PM EST Workshop on conducting Monte Carlo Simulations using the SimDesign package. [https://www.tqmp.org/RegularArticles/vol16-4/p248/p248.pdf][11] **Week 7** - Mar 5, 2021 @ 2:3o PM EST *Credibility of preprints: an interdisciplinary survey of researchers* [https://royalsocietypublishing.org/doi/10.1098/rsos.201520][12] **Week 8** - Mar 19, 2021 @ 2:30 PM EST *Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis* [https://osf.io/preprints/metaarxiv/sbv3q][13] - Note might have to be read within your web broswer as the pdf had issues opening using some software. **Week 9** - Apr 2, 2021 @ 2:3o PM EST *An empirical analysis of journal policy effectiveness for computational reproducibility* [https://www.pnas.org/content/115/11/2584?ijkey=b785383d7b8d79876ed4fec4be93992ada5c50ca&keytype2=tf_ipsecsha][14] ---------- ## Last Year's Readings **Week 1** - Jan 17, 2020 @ 2:30 PM *A Manifesto for Reproducible Science* The Problem Defined: The general overview [https://www.nature.com/articles/s41562-016-0021][15] **Week 2** - Jan 24, 2020 @ 2:30 PM *False Positive Psychology* Examining Analytic Flexibility And why it is a problem [http://journals.sagepub.com/doi/abs/10.1177/0956797611417632][16] **Week 3** - Jan 31, 2020 @ 2:30 PM *Measuring the Prevalence of Questionable Research Practices with Incentives for Truth Telling* Questionable Research Practices: are they really that common? And why are they problematic? [http://journals.sagepub.com/doi/abs/10.1177/0956797611430953][17] **Week 4** - Feb 7, 2020 @ 2:30 PM *Estimating the Reproducibility of Psychological Science* Reproducibility Now: Why many studies are not reproducible. [http://science.sciencemag.org/content/349/6251/aac4716][18] **Week 5** - Feb 14, 2020 @ 2:30 PM *Is the Replicability Crisis Overblown? Three Arguments Examined* How has the debate gone to far? Things will just turn out fine. [http://journals.sagepub.com/doi/pdf/10.1177/1745691612463401][19] **Week 6** - Feb 28, 2020 @ 2:30 PM *Open Science: What, Why and How Open Data and Materials* [https://psyarxiv.com/ak6jr][20] **Week 7** - Mar 6, 2020 @ 2:30 PM *The Natural Selection of Bad Science* And what about the future? [http://rsos.royalsocietypublishing.org/content/3/9/160384][21] **Week 8** - Mar 13, 2020 @ 2:30 PM *The Preregistration Revolution* Preregistration as a solution [http://www.pnas.org/content/pnas/early/2018/03/08/1708274114.full.pdf][22] **Week 9** - Mar 20, 2020 @ 2:30 PM *Introduction to Monte Carlo Simulation* A brief workshop about running Monte Carlo Simulations using the SimDesign package. [https://github.com/philchalmers/SimDesign/wiki][23] **Week 10** - Mar 27, 2020 @ 2:30 PM *The garden of forking paths* Researcher degrees of freedom [http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf][24] **Week 11** - Apr 3, 2020 @ 2:30 PM *Increasing Transparency Through a Multiverse Analysis* [http://www.stat.columbia.edu/~gelman/research/published/multiverse_published.pdf][25] **Week 12** - Apr 17, 2020 @ 1:30 PM *Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them* [https://psyarxiv.com/hs7wm/][26] **Week 13** - May 1, 2020 @ 1:30 PM *Good enough practices in scientific computing* [https://doi.org/10.1371/journal.pcbi.1005510][27] **Week 14** - May 8, 2020 @ 1:30 PM (GMT-4) *How (and Whether) to Teach Undergraduates About the Replication Crisis in Psychological Science* [https://journals.sagepub.com/doi/pdf/10.1177/0098628318762900?casa_token=-otISLbatjIAAAAA:ijtyknmdprbA5xYIsKF7_qzW8ugt4gdx0t2D8iw4yGAq0FsNJ5HSgXBvSxgBKGolBAqCNNsWWdw][28] **Week 15** - May 15, 2020 @ 1:30 PM (GMT-4) *Fallibility in Science: Responding to Errors in the Work of Oneself and Others* [https://journals.sagepub.com/doi/pdf/10.1177/2515245918776632?casa_token=1iG5YNtHYgIAAAAA:8HnvnF4JW5qTM95uqu6_Vplz3GyO5kiOJFtH19BgRPUO6ismdQiqRYGg41QRAtnFIfvMRTZSvCk][29] **Week 16** - May 22, 2020 @ 1:30 PM (GMT-4) *Practical Solutions for Sharing Data and Materials From Psychological Research* [https://journals.sagepub.com/doi/pdf/10.1177/2515245917746500][30] **Week 17** - June 5, 2020 @ 1:30 PM (GMT-4) *What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science* [https://journals.sagepub.com/doi/10.1177/1745691616646366][31] *** ### **ReproducibiliTea Toronto Mini Series:** A "conversation" between Tal Yarkoni and Daniël Lakens **Part 1 of 3** - June 12, 2020 @ 1:30 PM (GMT-4) (Week 18) [*The Generalizability Crisis*][32]; a preprint by Tal Yarkoni **Part 2 of 3** - June 19, 2020 @ 1:30 PM (GMT-4) (Week 19) [*Review of "The Generalizability Crisis" by Tal Yarkoni*][33]; a blog post by Daniël Lakens **Part 3 of 3** - June 26, 2020 @ 1:30 PM (GMT-4) (Week 20) [*Induction is not optional (if you’re using inferential statistics): reply to Lakens*][34]; a blog post by Tal Yarkoni *** Please email us to request a specific article/source to discuss. The only stipulation to this is that the article/source MUST be open and freely available. [1]: https://twitter.com/TorontoTea1 [2]: https://calendar.google.com/calendar?cid=M3Uxb283bHZjZjU0MzExb2hkNWxma2s4MjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ [3]: https://replicationindex.com/2019/08/13/when-personality-psychologists-are-high/ [4]: https://replicationindex.com/2019/08/13/when-personality-psychologists-are-high/ [5]: https://www.frontiersin.org/articles/10.3389/fpsyg.2019.00797/full [6]: https://journal.equinoxpub.com/JMTP/article/view/17104/20400 [7]: https://twitter.com/zerdeve/status/1234906668036608000 [8]: https://twitter.com/zerdeve [9]: https://psyarxiv.com/wxn58 [10]: https://psyarxiv.com/wxn58 [11]: https://www.tqmp.org/RegularArticles/vol16-4/p248/p248.pdf [12]: https://royalsocietypublishing.org/doi/10.1098/rsos.201520 [13]: https://osf.io/preprints/metaarxiv/sbv3q [14]: https://www.pnas.org/content/115/11/2584?ijkey=b785383d7b8d79876ed4fec4be93992ada5c50ca&keytype2=tf_ipsecsha [15]: https://www.nature.com/articles/s41562-016-0021 [16]: http://journals.sagepub.com/doi/abs/10.1177/0956797611417632 [17]: http://journals.sagepub.com/doi/abs/10.1177/0956797611430953 [18]: http://science.sciencemag.org/content/349/6251/aac4716 [19]: http://journals.sagepub.com/doi/pdf/10.1177/1745691612463401 [20]: https://psyarxiv.com/ak6jr [21]: http://rsos.royalsocietypublishing.org/content/3/9/160384 [22]: http://www.pnas.org/content/pnas/early/2018/03/08/1708274114.full.pdf [23]: https://github.com/philchalmers/SimDesign/wiki [24]: http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf [25]: http://www.stat.columbia.edu/~gelman/research/published/multiverse_published.pdf [26]: https://psyarxiv.com/hs7wm/ [27]: https://doi.org/10.1371/journal.pcbi.1005510 [28]: https://journals.sagepub.com/doi/pdf/10.1177/0098628318762900?casa_token=-otISLbatjIAAAAA:ijtyknmdprbA5xYIsKF7_qzW8ugt4gdx0t2D8iw4yGAq0FsNJ5HSgXBvSxgBKGolBAqCNNsWWdw [29]: https://journals.sagepub.com/doi/pdf/10.1177/2515245918776632?casa_token=1iG5YNtHYgIAAAAA:8HnvnF4JW5qTM95uqu6_Vplz3GyO5kiOJFtH19BgRPUO6ismdQiqRYGg41QRAtnFIfvMRTZSvCk [30]: https://journals.sagepub.com/doi/pdf/10.1177/2515245917746500 [31]: https://journals.sagepub.com/doi/10.1177/1745691616646366 [32]: https://psyarxiv.com/jqw35 [33]: http://daniellakens.blogspot.com/2020/01/review-of-generalizability-crisis-by.html [34]: https://www.talyarkoni.org/blog/2020/05/06/induction-is-not-optional-if-youre-using-inferential-statistics-reply-to-lakens/
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.