Participants first read (taken directly from Hoogeveen et al., 2020): In this study you’ll be asked to judge the robustness of the findings of 23 studies based on a short description. This description contains the question that the researchers were interested in, the methods used to measure the effect[, and the *test they gave to people afterwards*]. on the next page In this study you’ll be asked to judge the robustness of the findings of 23 studies based on a short description. This description contains the question that the researchers were interested in, the methods used to measure the effect, and the findings of the study. You will be asked whether you think that the described study will replicate. This means: if an independent lab will do this study again with a large number of participants, using the same materials, will they find convincing evidence for same effect? If the effect really exists, it should be found by a different lab. However, it seems that not all studies can be replicated, because some results are based on coincidence, or poorly designed or executed studies. on the next page In this study you’ll be asked to judge the robustness of the findings of 23 studies based on a short description. This description contains the question that the researchers were interested in, the methods used to measure the effect, and the findings of the study. You will be asked whether you think that the described study will replicate. This means: if an independent lab will do this study again with a large number of participants, using the same materials, will they find convincing evidence for same effect? If the effect really exists, it should be found by a different lab. However, it seems that not all studies can be replicated, because some results are based on coincidence, or poorly designed or executed studies. Your task is to read the description of each study, and predict if the findings will be replicated (yes or no). You also indicate how confident you are about your answer, where 0% means extremely uncertain, 50% is an educated guess and 100% is extremely certain. Some descriptions may seem complicated. Please try to read carefully. If you really do not understand the description, you can check the box “I don’t understand this description”. This means your answer cannot be used. On the next page, participants read a random subset of [23] of the 45 studies. Participants read each description on a separate page. Each description has the same format: **Research question** [a brief description of the research question written in a way that does not show the direction of effects] **How was this measured?** [a description of what participants did in each group] For each study description, participants read: Please indicate whether you believe the scores would be higher in group A, higher in group B, or scores would be the same between the two groups. [response options: scores higher in group A, scores higher in group B, scores the same in both groups]. After the a study's description, participants then read: The original researchers found that [scores were higher when [what group A did]/scores were higher when [what group B did]/scores were the same in the two groups]. [Option 1, taken from Hoogeveen et al., 2020] Will this study replicate? [No/Yes] [Option 2, taken from the description given to mTurkers] If an independent lab will do this study again with a large number of participants, using the same materials, will they find convincing evidence for same effect? [No/Yes] **References** Hoogeveen, S., Sarafoglou, A., & Wagenmakers, E. J. (2020). Laypeople Can Predict Which Social-Science Studies Will Be Replicated Successfully. *Advances in Methods and Practices in Psychological Science*, 3(3), 267-285.