Modality switch effects emerge early and increase throughout conceptual processing: Evidence from ERPs

Contributors:
  1. Max M Louwerse

Date created: | Last Updated:

: DOI | ARK

Creating DOI. Please wait...

Create DOI

Category: Project

Description: This repository contains all of the data from our study, including: conference paper and poster, stimuli norming, experiment set-up, behavioural pretest, main behavioural and electrophysiological data, and extensive R code for descriptives, plots, and statistical analysis. The main analyses files may be found in the folder path: "ERPs" then "Analyses of ERPs averaged across trials". Paper: https://mindmodeling.org/cogsci2017/papers/0318/index.html Abstract We tested whether conceptual processing is modality-specific by tracking the time course of the Conceptual Modality Switch effect. Forty-six participants verified the relation between property words and concept words. The conceptual modality of consecutive trials was manipulated in order to produce an Auditory-to-visual switch condition, a Haptic-to-visual switch condition, and a Visual-to-visual, no-switch condition. Event-Related Potentials (ERPs) were time-locked to the onset of the first word (property) in the target trials so as to measure the effect online and to avoid a within-trial confound. A switch effect was found, characterized by more negative ERP amplitudes for modality switches than no-switches. It proved significant in four typical time windows from 160 to 750 milliseconds post word onset, with greater strength in the Slow group, in posterior brain regions, and in the N400 window. The earliest switch effect was located in the language brain region, whereas later it was more prominent in the visual region. In the N400 and Late Positive windows, the Quick group presented the effect especially in the language region, whereas the Slow had it rather in the visual region. These results suggest that contextual factors such as time resources modulate the engagement of linguistic and embodied systems in conceptual processing. Bernabeu, P., Willems, R. M., & Louwerse, M. M. (2017). Modality switch effects emerge early and increase throughout conceptual processing: Evidence from ERPs. In G. Gunzelmann, A. Howes, T. Tenbrink, & E. J. Davelaar (Eds.), Proceedings of the 39th Annual Conference of the Cognitive Science Society (pp. 1629-1634). Austin, TX: Cognitive Science Society. See also further analyses available in this repository. These will be included in a forthcoming journal article. References Collins, J., Pecher, D., Zeelenberg, R., & Coulson, S. (2011). Modality switching in a property verification task: an ERP study of what happens when candles flicker after high heels click. Frontiers in Psychology, 2. Hald, L. A., Marshall, J.-A., Janssen, D. P., & Garnham, A. (2011). Switching modalities in a sentence verification task: ERP evidence for embodied language processing. Frontiers in Psychology, 2. Hauk, O. (2016). Only time will tell—Why temporal information is essential for our neuroscientific understanding of semantics. Psychonomic Bulletin & Review, 23. Louwerse, M., & Connell, L. (2011). A taste of words: linguistic context and perceptual simulation predict the modality of words. Cognitive Science, 35, 2, 381-98. Mahon, B.Z., & Hickok, G. (2016). Arguments about the nature of concepts: Symbols, embodiment, and beyond. Psychonomic Bulletin & Review, 23, 941-958. The modality exclusivity norms used for the stimuli are attached to this project as a linked component. Plot waveforms within any sections of the data (https://pablobernabeu.shinyapps.io/ERP-waveform-visualization_CMS-experiment/), see the more general visualizations (https://figshare.com/articles/EEG_study_on_conceptual_modality-switching_Bernabeu_et_al_in_prep_/4210863), and see modality norms used for the stimuli of the modality switch experiment (https://pablobernabeu.shinyapps.io/dutch-modality-exclusivity-norms/).

License: CC-By Attribution 4.0 International

Wiki

Modality switch effects emerge early and extend late in conceptual processing: Evidence from ERPs This repository contains all of the data from our study, including: conference paper and poster, stimuli norming, experiment set-up, behavioural pretest, main behavioural and electrophysiological data, and extensive R code for descriptives, plots, and statistical analysis. The main analyses files may ...

Files

Loading files...

Citation

Components

  • Modality exclusivity norms for 747 properties and concepts in Dutch: a replication of English

    Bernabeu, Louwerse & Willems
    Contains all data from this psycholinguistic study, including original surveys, compiled data, and analysis R code. This study is a cross-linguistic,...

    Recent Activity

    Loading logs...

Tags

Recent Activity

Loading logs...

OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.