Documentation ============= This project site contains data and materials for a research study currently under review. Here we provide documentation and explanation of the contents of this project site. If you are viewing this from the main page of the project site, click [here](https://osf.io/t5ma3/wiki), or click "Read More" below, to view full documentation. @[toc] # Terracotta The current study was conducted in [Terracotta](https://terracotta.education) (a portmanteau of Tool for Education Research with RAndomized COnTrolled TriAls). Terracotta is an open source web application, the full source code is available at https://github.com/terracotta-education/. Terracotta is a learning management system (LMS) plug-in that enables rapid experimental research on instructional practices, educational materials, and learning activities; and yields insights into what works for whom, for improving student performance. It does this by allowing different versions of class assignments to be randomly assigned to different students, and by supporting customization at the class-level. In this way, the research remains flexible and relevant to the teacher’s natural instructional practice, and fits within the course’s regular structure and norms. In our study, implemented in Terracotta, we collaborated with teachers to experimentally manipulate whether their students saw ungraded prequestions prior to watching an instructional video within a class assignment. Terracotta implemented a complete informed consent workflow, recorded fine-grained trace data as students interacted with experimental materials, mapped exam scores onto experimental treatment periods, and exported de-identified data in a standard format. # Institutional Review Board (IRB) Protocol - [Protocol Questionnaire](https://osf.io/9aj8h) - [Protocol Approval](https://osf.io/jxz46) - [Recruitment Materials](https://osf.io/fe98k) - [Informed Consent Statement for College Students](https://osf.io/se9wh) - [Assent Statement for Precollege Students](https://osf.io/x8fqs) - [Informed Consent Statement for Parents](https://osf.io/z8hfr) # Registrations # - [Wave 1](https://osf.io/mutxd) - [Wave 2](https://osf.io/q53rv) - [Wave 3](https://osf.io/q2hjf) - [Wave 4](https://osf.io/m5d2j) The words "phase" and "wave" are interchangeable. In the manuscript (and in the links above) we refer to them as waves, but the waves are referred to as "phases" in the preregistrations. # Materials # | Wave | Course ID | Questions | Video 1 | Video 2 | | |-------|------------|-----------------------|-----------------------|-----------------------|---| | 1 | 38 | https://osf.io/5zgxe | https://osf.io/kjhuc | https://osf.io/6w2ea | | | 2 | 47 | https://osf.io/5zgxe | https://osf.io/kjhuc | https://osf.io/6w2ea | | | 2 | 48 | https://osf.io/5zgxe | https://osf.io/kjhuc | https://osf.io/6w2ea | | | 2 | 49 | https://osf.io/5zgxe | https://osf.io/kjhuc | https://osf.io/6w2ea | | | 2 | 50 | https://osf.io/5zgxe | https://osf.io/kjhuc | https://osf.io/6w2ea | | | 2 | 51 | https://osf.io/5zgxe | https://osf.io/kjhuc | https://osf.io/6w2ea | | | 3 | 95 | https://osf.io/3mbuf | https://osf.io/3nrg8 | https://osf.io/ngcz4 | | | 4 | 116 | https://osf.io/4785b | https://osf.io/gn4p6 | https://osf.io/vb7ur | | | 4 | 97 | https://osf.io/wvxmg | https://osf.io/3k52p | https://osf.io/q69w2 | | | 4 | 98 | https://osf.io/4gqmb | https://osf.io/29n3v | https://osf.io/gduan | | | 4 | 99 | https://osf.io/35be4 | https://osf.io/wux49 | https://osf.io/rqzwv | | | 4 | 117 | https://osf.io/jx3kh | https://osf.io/z4qsf | https://osf.io/jkyd9 | | | 4 | 69 | https://osf.io/qjwzh | https://osf.io/7ux58 | https://osf.io/ca6nf | | | 4 | 346 | https://osf.io/ysfb6 | https://osf.io/h34uv | https://osf.io/6r48s | | | 4 | 60 | https://osf.io/3yheg | https://osf.io/k84n6 | https://osf.io/vqyzk | | | 4 | 62 | https://osf.io/wz97g | https://osf.io/q3td8 | https://osf.io/ypqv6 | | | 4 | 114 | https://osf.io/5smfy | https://osf.io/wh487 | https://osf.io/mg32u | | | 4 | 115 | https://osf.io/3dhpw | https://osf.io/2gk7a | https://osf.io/qcsdh | | | 4 | 347 | https://osf.io/27duv | https://osf.io/zytvb | https://osf.io/rgt4n | | | 4 | 113 | https://osf.io/5jahx | https://osf.io/nv8g9 | https://osf.io/thr8a | | | 4 | 135 | https://osf.io/fvmw7 | https://osf.io/dxhsn | https://osf.io/2t6r9 | | | 4 | 109 | https://osf.io/v2qwb | https://osf.io/vtxnb | https://osf.io/dyrms | | | 4 | 122 | https://osf.io/pkes5 | https://osf.io/p7utv | https://osf.io/7d6sc | | | 4 | 146 | https://osf.io/ca3hm | https://osf.io/yruvb | https://osf.io/23uwq | | | 4 | 226 | https://osf.io/9us82 | https://osf.io/tzkyp | https://osf.io/79py8 | | | 4 | 227 | https://osf.io/u6ke2 | https://osf.io/xvw8f | https://osf.io/vgpe2 | | | 4 | 163 | https://osf.io/58cqy | https://osf.io/wt5cr | https://osf.io/zsd2w | | | 4 | 170 | https://osf.io/jhy28 | https://osf.io/2v54n | https://osf.io/uz2wa | | | 4 | 289 | https://osf.io/vjzt3 | https://osf.io/5r8kg | https://osf.io/sxu8m | | | 4 | 191 | https://osf.io/p8mvq | https://osf.io/6maux | https://osf.io/jc6sb | | | 4 | 160 | https://osf.io/g2ctm | https://osf.io/67xsj | https://osf.io/65mhw | | | 4 | 174 | https://osf.io/3wyvg | https://osf.io/8g5qj | https://osf.io/gnbmz | | # Data Files # | Wave | Course ID | Data Export Files | |-------|-----------|-----------------------| | 1 | 38 | https://osf.io/ecpg7 | | 2 | 47 | https://osf.io/kp846 | | 2 | 48 | https://osf.io/ec6js | | 2 | 49 | https://osf.io/93q75 | | 2 | 50 | https://osf.io/bjnhf | | 2 | 51 | https://osf.io/nsmd4 | | 3 | 95 | https://osf.io/vs7ca | | 4 | 116 | https://osf.io/bckuj | | 4 | 97 | https://osf.io/mhgxr | | 4 | 98 | https://osf.io/xnufp | | 4 | 99 | https://osf.io/yxq5k | | 4 | 117 | https://osf.io/ex29d | | 4 | 69 | https://osf.io/6kxpd | | 4 | 346 | https://osf.io/z8aj6 | | 4 | 60 | https://osf.io/78mvk | | 4 | 62 | https://osf.io/pjk87 | | 4 | 114 | https://osf.io/aup9h | | 4 | 115 | https://osf.io/crw3d | | 4 | 347 | https://osf.io/7kymz | | 4 | 113 | https://osf.io/me8k2 | | 4 | 135 | https://osf.io/3nm7d | | 4 | 109 | https://osf.io/t4qcu | | 4 | 122 | https://osf.io/khgf9 | | 4 | 146 | https://osf.io/4nujv | | 4 | 226 | https://osf.io/74ndr | | 4 | 227 | https://osf.io/m9v8f | | 4 | 163 | https://osf.io/zts67 | | 4 | 170 | https://osf.io/hfv2j | | 4 | 289 | https://osf.io/38e2k | | 4 | 191 | https://osf.io/xsm6f | | 4 | 160 | https://osf.io/2qbdg | | 4 | 174 | https://osf.io/8x2uf | # Final Analysis The rendered Quarto document of the final analysis can be [viewed online here](https://jodeleeuw.github.io/many-classes-2-analysis/analysis.html)