Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
We tested whether asking participants to answer quickly vs. slowly caused an increase in social desirability. Our analysis was completed as an ANOVA with 10,000 bootstrap resamples to take into account any possible non-normalities in the data. Effect sizes were calculated using the means and bootstrapped standard errors of the two groups. There has been discussion about compliance in speeded judgment literature (see for example Rand, 2017). The most conservative and unbiased approach to compliance in experimental trials is the Intention-To-Treat analysis (ITT), which simply ignores compliance and analyzes the data as the participants were randomized. The benefit of this approach is that it preserves randomization across conditions (see Gelman & Hill, 2006). Thus, we pursued an ITT analysis. All procedures, data decisions, and analysis code was pre-registered prior to data collection (https://osf.io/jse68/). Participants were randomly assigned to take the study as part of the 1st 750 participants or the 2nd 50 participants. For the critical DV, the effect of the speeded manipulation was the same for both groups of data collection (not moderated, p > .11). As a manipulation check, on average participants in the fast condition answered questions faster (M = 6.299, SD = 9.222) than in the slow condition (M = 16.263, SD = 27.704, tseparate-varainces (912.756) = 9.346, p = 6.8*10-20) and were the same in both data collection groups (not moderated, p > .5). Thus, the manipulation was successful. We analyzed the 2nd 750 first, then the 1st 750, then combined the two into the complete analysis. Both 750s were opened simultaneously on February 18 at 6:42am. Data analysis of the 2nd 750 began at 6:49 am, analysis of the 1st 750 began at 7:31am that same day. 2nd 750 Contrary to our hypothesis, asking people to answer quickly did not cause them to give more socially desirable responses (M = 5.063, SEbootstrap = .119, n = 378) than asking them to answer slowly (M = 4.909, SEbootstrap = .129, n = 373; F (1, 749) < 1, p > .38, d = .064). 1st 750 In the 1st 750 participants collected, asking people to answer quickly caused them to give more socially desirable responses (M = 54.965, SEbootstrap = .123, n = 373) than asking them to answer slowly (M = 4.408, SEbootstrap = .14, n = 377; F (1, 748) = 9.047, p = .003, d = .218, 95%CI = .362 to .075). Full 1500 In the full dataset, asking people to answer quickly caused them to give more socially desirable responses (M = 5.015, SEbootstrap = .085, n = 751) than asking them to answer slowly (M = 4.657, SEbootstrap = .095, n = 750; F (1, 1499) = 7.789, p = .005, d = .145, 95%CI = .246 to .043). To answer the question: “What does making people respond quickly do?” we can answer that the evidence here suggests time pressure causes an increase in socially desirable responding.
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.