Main content

Home

Menu

Loading wiki pages...

View
Wiki Version:
**Poster A41** We are happy to answer questions via Zoom, through the comments bubble in OSF (upper-right hand corner), or you can email us at shohini@umd.edu. Under the Files section, you will find a video spiel along with a pdf version of the poster and abstract. ---------- **Introduction** ---------------- The notion of surprisal from information theory has been very prevalent in psycholinguistic modeling, following the work of Hale (2001) and Levy (2008). Generally, the theory of surprisal proposes that probabilistic predictions made by comprehenders yield variability in word-by-word processing difficulty: when surprisal is high, the current word is unexpected and cognitive processing effort increases accordingly. While previous work has probed the neural correlates of lexical and syntactic surprisal using computational measures (Brennan et al. 2016), to our knowledge modelling with surprisal has not been extended beyond sentences to include broader context. Xu. et al (2005) note, “important, but thus far unexplored, is the role of context within narrative, as cognitive demands evolve and brain activity changes dynamically as subjects process different narrative segments.” In this study, our main goal is to investigate how topical context affects our predictions about the next word--and based on those predictions, our processing--using an analysis of fMRI timecourses collected during naturalistic language comprehension. We propose a new metric, “topical surprisal”, which we define using the weighted average of a word's probability given a topic, where weights are the (posterior) probability the context is about that topic; topics can be defined and probabilities estimated using a topic model (LDA, Blei et al., 2003). Using this metric, we can represent how expected the word is given what has been discussed previously in the context and more broadly, study the role of context in comprehending language. **Methods** ----------- Participants (n=51, 32 female) listened to The Little Prince’s audiobook for 1 hour and 38 minutes. Participants' comprehension was confirmed through multiple-choice questions (90% accuracy, SD = 3.7%). Functional scans were acquired using multi-echo planar imaging sequence (ME-EPI) (TR=2000ms; TE's=12.8, 27.5, 43ms; FA=77 degrees; FOV=240.0mm X 240.0mm; 2X image acceleration; 33 axial slices, voxel-size 3.75 x 3.75 x 3.8mm). Preprocessing was done with AFNI16 and ME-ICAv3.2 (Kundu et al. 2012). Using the wrapper for Mallet LDA (McCallum, 2002) in the Gensim toolkit (Rehurek & Sojka 2010), we estimated a 100-topic model using the Brown corpus (Francis & Kučera 1964), which covers diverse topics in 500 texts across 15 genres. We compute topical surprisal for each of the 6,243 non-function words in the audio sample using the paragraph containing the word as its context (Fig. 1B). In addition to this regressor, we included in the GLM analysis (SPM12) four regressors of non-interest: timestamp of each word offset, log-frequency of each word in movie subtitles (Brysbaert & New 2009), and pitch (f0) and intensity (rms) of the narrator's voice. **Results** ----------- We observe the largest clusters for topical surprisal in the right Precuneus and right Middle Temporal Gyrus (Fig. 1A). The whole-brain effects were FWE-corrected (T-score > 5.3). **Conclusion** -------------- Our results corroborate previous work on lexical access and semantic integration (Binder et al. 2009, Graves et al. 2010, Hickok & Poeppel 2007, Hagoort & Indefrey 2014) which illustrates the scope of these cognitive processes beyond the sentence level. Specifically in terms of context and discourse-level phenomena, Raposo et al. (2013) observed significant activation in the right MTG while investigating semantic processing of sentences with a preceding context. Similarly, the right Precuneus has been implicated in various language processing tasks utilizing context such as an fMRI study on narrative shifts (Whitney et al. 2009), an fMRI study contrasting sentences and narratives (Xu et al. 2005), and a PET study on processing incoherent narratives (Maguire et al. 1999). The pattern of activation for topical surprisal also differs from those reported for lexical surprisal (bilateral ATL & left IFG) and syntactic surprisal (bilateral ATL & left IPL) by Brennan et al. (2016). Thus, our results support the centrality of these two regions in processing contextual information during language comprehension and suggest topical surprisal as a cognitively plausible metric. [1]: https://umd.zoom.us/my/shohini
OSF does not support the use of Internet Explorer. For optimal performance, please switch to another browser.
Accept
This website relies on cookies to help provide a better user experience. By clicking Accept or continuing to use the site, you agree. For more information, see our Privacy Policy and information on cookie use.
Accept
×

Start managing your projects on the OSF today.

Free and easy to use, the Open Science Framework supports the entire research lifecycle: planning, execution, reporting, archiving, and discovery.