Breaking down the cocktail party: Attentional modulation of cerebral audiovisual speech processing

Patrik Wikman, Elisa Sahari, Viljami Salmela, Alina Leminen, Miika Leminen, Matti Laine, Kimmo Alho

Forskningsoutput: TidskriftsbidragArtikelVetenskapligPeer review

Sammanfattning

Recent studies utilizing electrophysiological speech envelope reconstruction have sparked renewed interest in the cocktail party effect by showing that auditory neurons entrain to selectively attended speech. Yet, the neural networks of attention to speech in naturalistic audiovisual settings with multiple sound sources remain poorly understood. We collected functional brain imaging data while participants viewed audiovisual video clips of lifelike dialogues with concurrent distracting speech in the background. Dialogues were presented in a full-factorial design, comprising task (listen to the dialogues vs. ignore them), audiovisual quality and semantic predictability. We used univariate analyses in combination with multivariate pattern analysis (MVPA) to study modulations of brain activity related to attentive processing of audiovisual speech. We found attentive speech processing to cause distinct spatiotemporal modulation profiles in distributed cortical areas including sensory and frontal-control networks. Semantic coherence modulated attention-related activation patterns in the earliest stages of auditory cortical processing, suggesting that the auditory cortex is involved in high-level speech processing. Our results corroborate views that emphasize the dynamic nature of attention, with task-specificity and context as cornerstones of the underlying neuro-cognitive mechanisms.
OriginalspråkEngelska
Artikelnummer117365
TidskriftNeuroImage
Volym224
DOI
StatusPublicerad - 1 jan 2021
MoE-publikationstypA1 Tidskriftsartikel-refererad

Fingeravtryck Fördjupa i forskningsämnen för ”Breaking down the cocktail party: Attentional modulation of cerebral audiovisual speech processing”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här