Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
**Principal Investigator(s):** Jon A. Krosnick Stanford University Email: [krosnick@stanford.edu][1] Home page: [https://comm.stanford.edu/faculty-krosnick/][2] Henning Silber GESIS – Leibniz-Institute for the Social Sciences, Germany Email: [henning.silber@gesis.org][3] Tobias Stark University of Utrecht, Netherlands Email: [t.h.stark@uu.nl][4] Home page: [http://www.tobiasstark.nl/][5] Annelies Blom University of Mannheim, Germany Email: [blom@uni-mannheim.de][6] Home page: [http://blom.sowi.uni-mannheim.de/english/][7] **Sample size:** 1029 **Field period:** 02/10/2015-04/17/2015 **Abstract:** The Multi-National Study of Questionnaire Design (MSQD) explored whether the principles of question design derived from primarily US American research a few decades ago still apply today. Moreover, it utilized the availability of probability-based online panels around the world to test whether these principles can be legitimately generalized across countries. **Hypotheses:** Should survey researchers from other countries expect the same effects across countries, or should they expect different effects? The answer to this question ultimately hinges on the mechanism(s) that explain why the effects occurred in the US. If some question design effects occur because of culture-specific aspects of response behavior (e.g., the tendency to defer to seemingly higher-status researchers; the tendency to express opinions regardless of confidence in them), then we expect to see the same effects in countries whose cultures work according to the same social norms and might not see them in countries with different social norms. If some question design effects occur because of global strategies that respondents implement when they lack the motivation and/or ability to answer questions optimally (e. g., Krosnick 1991), then we expect to see the same effects across all countries. **Experimental Manipulations:** The experiments tested for the differences in response behavior by (a) altering the order in which the response options are presented, (b) altering the order in which questions are asked, (c) varying question wording to test for acquiescence response bias (a tendency to agree with a presented statement), (d) varying the presence or absence of various no opinion filters (filter 1: not enough information; filter 2: no opinion; filter 3: don’t know), (e) varying the mentioning of “some people” and “other people” in an effort to balance a question (e. g., “Some people feel the government should see to it that all people have adequate housing, while others feel each person should provide for his or her own housing. Which comes closest to how you feel about this?”), and (f) for the impact of adding a counter-argument. **Key Dependent Variables:** The outcome variables covered a wide range of political issues including oil prices, climate change, and unions. **Findings from this study:** Stark, T. H., Silber, H., Krosnick, J. A., Blom, A. G., Aoyagi, M., Belchior, A., Bosnjak, M., Clement, S. L., John, M., Jónsdóttir, G. A., Lawson, K., Lynn, P., Martinsson, J., Shamshiri-Petersen, D., Tvinnereim, E., & Yu, R.-r.(2018): “Cross-National Replication of Question Order Experiments.” Sociological Research & Methods. Silber, H., Stark, T. H., Blom, A. G., & Krosnick, J. A. (2018): “Implementing a Multi-National Study of Questionnaire Design.” Pp. 161-179 in: T. P. Johnson, B.-E. Pennell, I. Stoop, & B. Dorer (Eds.), Advances in Comparative Survey Methods: Multinational, Multiregional and Multicultural Contexts, Hoboken, NJ: Wiley. Krosnick, J., Silber, H., Stark, T., & Blom, A. (2018): “Generalization of Classic Response Order Effects Across Countries.” American Association for Public Opinion Research, Denver, USA. Stark, T. H., Silber, H., Krosnick, J. A., & Blom, A. G. (2017): “Cross-National Replication of Question Order Experiments” American Association for Public Opinion Research, New Orleans, USA Silber, H., Krosnick, J. A., Stark, T. H., & Blom, A. G. (2016): “Cross-National Replication of Acquiescence Experiments” American Association for Public Opinion Research, Austin, USA. Silber, H., Krosnick, J. A., Stark, T. H., & Blom, A. G. (2016): “Multi-national Study of Questionnaire Design” Second International Conference on Survey Methods in Multinational, Multiregional and Multicultural Contexts, Chicago, USA. [1]: mailto:krosnick@stanford.edu [2]: https://comm.stanford.edu/faculty-krosnick/ [3]: mailto:henning.silber@gesis.org [4]: mailto:t.h.stark@uu.nl [5]: http://www.tobiasstark.nl/ [6]: mailto:blom@uni-mannheim.de [7]: http://blom.sowi.uni-mannheim.de/english/
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.