HYPOTHESIS
We predict a smaller percentage of participants in the forewarned condition will report watching five or more live sporting events on television during the previous 12 months than participants in the not forewarned condition.
We will collect 1500 participants drawn in a stratified way with unequal probabilities of selection, so that the people who complete each survey will resemble the nation's adult population (according to the most recently available Current Population Survey, conducted by the U.S. Census Bureau) in terms of gender, age, education, ethnicity (Hispanic vs. not), race (allowing each respondent to select more than one race), region, and income, if possible.
The total size of the drawn sample should be sufficiently large to include more than enough respondents to achieve 1,500 completed interviews (and passing attention checks) within 2 weeks of inviting all of those people to complete the survey.
Furthermore, data must be collected in two immediate waves of 750 respondents instead of collecting all 1,500 respondents at the same time. Hence, after the full sample has been drawn, it must be divided into two truly random halves.
The only permitted way to make this division is by using random numbers obtained from the Random.org random integer generator (https://www.random.org/integers/?mode=advanced/).
Specifically, the survey firm should be instructed to download random numbers from the generator in batches of 10,000, with each integer having a random value between 1 and 10,000, using 1 column, decimal numeral system, and having “Generate your own personal randomization right now” checked.
Note, that the sequence generator at random.org is not a valid approach to download random numbers, the survey firm must use the integer generator.
Each number drawn should be appended to one respondent in the full sample, until all respondents has been assigned one number each. Respondents who are assigned even random numbers should be treated as belonging to the sample that is first invited to complete the questionnaire and people who are assigned odd random numbers should be treated as belonging to the second sample.
Respondents in the first sample should be sorted in an ascending order according to the random.org number assigned to each person.
Respondents in the second sample should be sorted in an ascending order according to the random.org number assigned to each person.
Beginning with the first person in the sorted list of first sample respondents, enough respondents should be invited so that 750 completed interviews, with respondents passing the attention check(s), is finished collecting within two weeks of the first invitation sent.
Each day of data collection, the host university will update the survey respondent providing firm with two numbers: (1) the number of completed questionnaires that passed the attention check(s); and (2) the number of completed questionnaires that did not pass the attention check(s).
The survey firm will monitor these numbers and send out additional invitations if necessary in order to achieve 750 completed interviews passing the attention check(s) by the end of the 14th day after the data collection begins,
After 750 respondents from the first sample have completed the questionnaire and passed the attention check(s), the second sample will be invited using the same procedure to yield 750 completed interviews passing the attention check(s) by the end of the 14th day after the data collection begins. None of the respondents in the second sample are allowed to be invited before the first sample has finished collecting and been closed for further collection.
After each wave, labs may have their participant company replace participants who failed an attention check.
River sampling and routers may not be used to obtain respondents for these studies, because those methods do not allow selection of the entire potential sample and randomly splitting it in half before data collection begins.
At the end of the survey, we will administer a basic seriousness check:
It would be very helpful if you could tell us at this point whether you have taken part seriously, so that we can use your answers for our scientific analysis, or whether you were just clicking through to take a look at the survey? You will still be compensated no matter your answer. [I have participated in this survey seriously/I have just clicked through, please throw my data away].
Any participant who fails this will be removed from the study. In addition, we will administer a captcha at the end of the survey to prevent non-human responses.
A participant will be excluded if any of the following conditions was met:
1. The participant failed to select “Slightly disagree” when answering the attention check question.
2. The participant failed to successfully complete the verification task.
3. The participant completed the questionnaire more than once.
4. The participant reported completing the questionnaire more than once.
5. The participant did not submit a completed questionnaire.
6. The participant submitted a completed questionnaire more than 60 minutes after opening the questionnaire.