**Poster A41**
We are happy to answer questions via Zoom, through the comments bubble in OSF (upper-right hand corner), or you can email us at shohini@umd.edu.
Under the Files section, you will find a video spiel along with a pdf version of the poster and abstract.
----------
**Introduction**
----------------
The notion of surprisal from information theory has been very prevalent in
psycholinguistic modeling, following the work of Hale (2001) and Levy
(2008). Generally, the theory of surprisal proposes that probabilistic
predictions made by comprehenders yield variability in word-by-word
processing difficulty: when surprisal is high, the current word is
unexpected and cognitive processing effort increases accordingly. While
previous work has probed the neural correlates of lexical and syntactic
surprisal using computational measures (Brennan et al. 2016), to our
knowledge modelling with surprisal has not been extended beyond sentences
to include broader context. Xu. et al (2005) note, “important, but thus far
unexplored, is the role of context within narrative, as cognitive demands
evolve and brain activity changes dynamically as subjects process different
narrative segments.”
In this study, our main goal is to investigate how topical context
affects our predictions about the next word--and based on those
predictions, our processing--using an analysis of fMRI timecourses
collected during naturalistic language comprehension. We propose a new
metric, “topical surprisal”, which we define using the weighted average of
a word's probability given a topic, where weights are the (posterior)
probability the context is about that topic; topics can be defined and
probabilities estimated using a topic model (LDA, Blei et al., 2003). Using
this metric, we can represent how expected the word is given what has been
discussed previously in the context and more broadly, study the role of
context in comprehending language.
**Methods**
-----------
Participants (n=51, 32 female) listened to The Little Prince’s audiobook
for 1 hour and 38 minutes. Participants' comprehension was confirmed
through multiple-choice questions (90% accuracy, SD = 3.7%). Functional
scans were acquired using multi-echo planar imaging sequence (ME-EPI)
(TR=2000ms; TE's=12.8, 27.5, 43ms; FA=77 degrees; FOV=240.0mm X 240.0mm; 2X
image acceleration; 33 axial slices, voxel-size 3.75 x 3.75 x 3.8mm).
Preprocessing was done with AFNI16 and ME-ICAv3.2 (Kundu et al. 2012).
Using the wrapper for Mallet LDA (McCallum, 2002) in the Gensim toolkit
(Rehurek & Sojka 2010), we estimated a 100-topic model using the Brown
corpus (Francis & Kučera 1964), which covers diverse topics in 500 texts
across 15 genres. We compute topical surprisal for each of the 6,243
non-function words in the audio sample using the paragraph containing the
word as its context (Fig. 1B). In addition to this regressor, we included
in the GLM analysis (SPM12) four regressors of non-interest: timestamp of
each word offset, log-frequency of each word in movie subtitles (Brysbaert
& New 2009), and pitch (f0) and intensity (rms) of the narrator's voice.
**Results**
-----------
We observe the largest clusters for topical surprisal in the right
Precuneus and right Middle Temporal Gyrus (Fig. 1A). The whole-brain
effects were FWE-corrected (T-score > 5.3).
**Conclusion**
--------------
Our results corroborate previous work on lexical access and semantic
integration (Binder et al. 2009, Graves et al. 2010, Hickok & Poeppel 2007,
Hagoort & Indefrey 2014) which illustrates the scope of these cognitive
processes beyond the sentence level. Specifically in terms of context and
discourse-level phenomena, Raposo et al. (2013) observed significant
activation in the right MTG while investigating semantic processing of
sentences with a preceding context. Similarly, the right Precuneus has been
implicated in various language processing tasks utilizing context such as
an fMRI study on narrative shifts (Whitney et al. 2009), an fMRI study
contrasting sentences and narratives (Xu et al. 2005), and a PET study on
processing incoherent narratives (Maguire et al. 1999). The pattern of
activation for topical surprisal also differs from those reported for
lexical surprisal (bilateral ATL & left IFG) and syntactic surprisal
(bilateral ATL & left IPL) by Brennan et al. (2016). Thus, our results
support the centrality of these two regions in processing contextual
information during language comprehension and suggest topical surprisal as
a cognitively plausible metric.
[1]: https://umd.zoom.us/my/shohini