Neurophysiological evidence for the interplay of speech segmentation and word-referent mapping during novel word learning

Clément François, Toni Cunillera, Enara Garcia, Matti Laine, Antoni Rodriguez-Fornells

Research output: Contribution to journalArticleScientificpeer-review

31 Citations (Scopus)

Abstract

Learning a new language requires the identification of word units from continuous speech (the speechsegmentation problem) and mapping them onto conceptual representation (the word to world mappingproblem). Recent behavioral studies have revealed that the statistical properties found within and acrossmodalities can serve as cues for both processes. However, segmentation and mapping have been largely studied separately, and thus it remains unclear whether both processes can be accomplished at the same time and if they share common neurophysiological features. To address this question, we recorded EEG of 20 adult participants during both an audio alone speech segmentation task and an audiovisual word-to-picture association task. The participants were tested for both the implicit detection of online mismatches (structural auditory and visual semantic violations) as well as for the explicit recognition of words and word-to-picture associations. The ERP results from the learning phase revealed a delayed learning-related fronto-central negativity (FN400) in the audiovisual condition compared to the audio alone condition. Interestingly, while online structural auditory violations elicited clear MMN/N200 components in the audio alone condition, visual-semantic violations induced meaning-related N400 modulations in the audiovisual condition. The present results support the idea that speech segmentation and meaning mapping can take place in parallel and act in synergy to enhance novel word learning.

Original languageUndefined/Unknown
Pages (from-to)56–67
JournalNeuropsychologia
Volume98
DOIs
Publication statusPublished - 2017
MoE publication typeA1 Journal article-refereed

Cite this