Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
This OSF project is associated with the following study, which is available on [PsyArXiv](https://psyarxiv.com/nc26v/): - Sönning, Lukas. 2024. *Ordinal response scales: Psychometric grounding for design and analysis.* PsyArXiv. https://psyarxiv.com/nc26v/ The study was presented at *BICLCE 2024* in Alicante, Spain. The **presentation slides** can be found [here](https://osf.io/vdj7f). This is the **abstract**: - *Ordinal scales are commonly used in applied linguistics. To summarize the distribution of responses provided by informants, these are usually converted into numbers and then averaged or analyzed with ordinary regression models. This approach has been criticized in the literature; one caveat (among others) is the assumption that distances between categories are known. The present paper illustrates how empirical insights into the perception of response labels may inform the design and analysis stage of a study. We start with a review of how ordinal scales are used in linguistic research. Our survey offers insights into typical scale layouts and analysis strategies, and it allows us to identify three commonly used rating dimensions (agreement, intensity, and frequency). We take stock of the experimental literature on the perception of relevant scale point labels and then demonstrate how psychometric insights may direct scale design and data analysis. This includes a careful consideration of measurement-theoretic and statistical issues surrounding the numeric-conversion approach to ordinal data. We focus on the consequences of these drawbacks for the interpretation of empirical findings, which will enable researchers to make informed decisions and avoid drawing false conclusions from their data. We present a case study on yous(e) in British and Scottish English, which shows that reliance on psychometric scale values can alter statistical conclusions, while also giving due consideration to the key limitations of the numeric-conversion approach to ordinal data analysis..* The datasets underlying this study are available in the TROLLing archive: - Krug, Manfred, Ole Schützler, Fabian Vetter & Lukas Sönning. 2024. *Background data for: The morpho-syntax of Scottish Standard English: Questionnaire-based insights*. https://doi.org/10.18710/B3NJBT, DataverseNO, V1. - Sönning, Lukas, 2024. *Background data for: Ordinal response scales: Psychometric grounding for design and analysis*. https://doi.org/10.18710/0VLSLW, DataverseNO, V1. **Images** created for this study can be found in the folder "figures". They are published under a Creative Commons Attribution 4.0 licence (**CC BY 4.0**), which means that the licence terms for their use are quite generous (see http://creativecommons.org/licenses/by/4.0).
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.