These dynamic stimuli were developed in the framework of Pernelle Lorette's PhD project, which was conducted under Jean-Marc Dewaele's supervision at the Department of Applied Linguistics and Communication at Birkbeck, University of London.
They were used in the study reported in Lorette, P. & Dewaele, J.-M. (2023). Valence and arousal perception among first language users, foreign language users, and naïve listeners of Mandarin across various communication modalities. *Bilingualism: Language and Cognition*. **Please cite this article if you want to use these stimuli in your own research.**
One main emotion was intended to be conveyed in each of the twelve stimuli, namely h**appiness, sadness, disgust, (positive) surprise, fear, anger, embarrassment, contempt, pride, hope, and jiu jié 纠结** -- which might be translated to feeling tangled together or in a knot, feeling confusion and chaos due to a difficult situation in which one cannot take a decision -- a**nd wěi qu 委屈** -- which might be translated to feeling wronged or feeling unfairly treated.
The stimuli were recorded in the **visual-vocal-verbal modality** (i.e. video + sound). Three additional versions of each stimulus were then created by making one or two modalities unavailable at a time – i.e **vocal–verbal modality** (audio without visuals), **visual-only modality** (visuals without audio), and **vocal-only modality** (low-pass-filtered audio recordings making the words indecipherable but retaining prosodic information such as intonation and rhythm).
More information about the background of the actor and the development process of the scenario's can be obtained from Pernelle Lorette (p [dot] lorette [ at] uni-mannheim [dot] de).