For our first submission, coding was done by two coders and disagreements resolved via mutual discussion. For our revision, we developed [a coding sheet][1] and three coders coded the variables in three phases: the first 10%, the first 50%, and finally, the full 100%.
Interrater reliability was calculated after each phase. If interrater reliability was below 90%, variables were discussed in coding discussions. If the coding sheet was insufficiently clear, then it was adapted during this discussion (in other cases, either coders adapted their coding if they had misunderstood or retained their coding in case of disagreement). Finally, the coders checked each other's files for accuracy.
The version history of the coding document is available in Google Docs and the different versions of the coding files is available under [files][2].
[1]: https://docs.google.com/spreadsheets/d/1zL6eu_9Pdc26kgaLMYnz3Cq1kvWJ_KsX-g62hbgcGms/edit#gid=0
[2]: https://osf.io/2kz5q/files/