Adaptive processing of spoken language: flexible communication in health, disease and disorder

Lead Research Organisation: UNIVERSITY OF CAMBRIDGE
Department Name: UNLISTED

Abstract

Speech is the most important and complex sound that we hear every day. Impairments of speech comprehension have a devastating effect on our social and intellectual lives and are insufficiently treated by sensory prostheses (e.g. hearing aids for age-related hearing loss), or rehabilitation (e.g. speech therapy for developmental language disorders, or aphasia). To understand and ameliorate these difficulties we take inspiration from the success of healthy listeners who can achieve successful comprehension despite many everyday challenges. We comprehend speech produced with a marked accent, or heard in a noisy environment, demonstrating robustness of sensory processing. Linguistic robustness is illustrated when we correctly interpret unfamiliar words in sentences or infer the correct meaning of ambiguous words like “bark” or “bank”. The brain systems that achieve resilient speech understanding in the face of these challenges may be responsible for comprehension impairments when they are damaged. If, conversely, these brain systems remain available to impaired listeners then they may permit new forms of rehabilitation. We work with a range of clinical populations with sensory and language impairments to test these hypotheses and to develop new methods of detecting speech comprehension impairments, discovering their underlying causes and suggesting new interventions.

Technical Summary

Understanding speech quickly and accurately is a fundamental human ability and the foundation for all our social, educational, and economic achievements. This programme of research explores the computational and neurobiological mechanisms that explain the success of speech perception, comprehension and learning in healthy individuals. By revealing mechanisms that enable listeners to successfully comprehend despite everyday sensory challenges (e.g. noisy or degraded speech) and linguistic challenges (e.g. unfamiliar or ambiguous words) we gain insights into adaptive neural mechanisms that support the acquisition of language skills, their maintenance and retention in adulthood, and the resilience or rehabilitation of language skills after brain injury or disease. This work is important due to the prevalence of language disorders in development and in later life (e.g. following stroke or neurodegeneration), and the severe consequences of language disorders for educational outcomes, economic and social success, and lifelong well-being.

Recent research has established two key mechanisms that contribute to successful speech processing in challenging listening situations: (1) predictive computations by which listeners integrate prior knowledge and sensory signals to arrive at optimal interpretations of noisy and ambiguous speech, and (2) neural oscillations that track the rhythm and timing of connected speech. We are exploring these mechanisms as explanations of deficits observed in developmental language disorders, and in neurodegenerative or post-stroke aphasia. Ongoing work seeks to expand our understanding of these predictive and oscillatory computations in other aspects of speech processing including speech production, and higher-level lexical or semantic processing of speech. Our work combines brain imaging (fMRI, MEG) and brain stimulation (TMS, tACS) to determine the causal mechanisms by which neural activity leads to successful spoken language understanding, and to develop new behavioural and neural methods for exploring individual differences in these mechanisms. Findings have application to the development of new diagnostic methods and for language interventions in the classroom, home or clinic.

Publications

10 25 50
publication icon
Aller M (2022) Differential Auditory and Visual Phase-Locking Are Observed during Audio-Visual Benefit and Silent Lip-Reading for Speech Perception. in The Journal of neuroscience : the official journal of the Society for Neuroscience

publication icon
Pérez A (2023) Speaking and listening to inter-brain relationships. in Cortex; a journal devoted to the study of the nervous system and behavior

 
Description Finding the Flow: Temporal Contributions to Speech Perception
Amount £100,000 (GBP)
Organisation The Leverhulme Trust 
Sector Charity/Non Profit
Country United Kingdom
Start 09/2023 
End 09/2026
 
Description Improving comprehension through tailored speech
Amount £498,563 (GBP)
Organisation The British Academy 
Sector Academic/University
Country United Kingdom
Start 12/2023 
End 11/2026
 
Description Learning to perceive: Optimally sampling our dynamic environment
Amount £326,991 (GBP)
Funding ID RPG-2022-358 
Organisation The Leverhulme Trust 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2023 
End 03/2026
 
Title MNE-BIDS methods for MEG research 
Description Methods for automated/enhanced analysis of BIDS formatted MEG data implemented in the MNE pipeline 
Type Of Material Technology assay or reagent 
Year Produced 2023 
Provided To Others? Yes  
Impact Cognestic and other presentations Contributions to MNE-BIDS and BIDS conversions software 
URL https://github.com/allermat
 
Description Learning and consolidation of novel spoken words 
Organisation University College London
Country United Kingdom 
Sector Academic/University 
PI Contribution Supervised the design, collection, analysis and interpretation of functional brain imaging studies resulting in peer-reviewed publications on empirical data. Contributed to the development of a complementary learning systems account of word learning published in a peer-reviewed theoretical/review paper.
Collaborator Contribution Provided methods, materials and theoretical insights that are driving current and planned research.
Impact 18578598 19933145 (many others in publications)
Start Year 2006
 
Description Learning and consolidation of novel spoken words 
Organisation University of York
Department Department of Psychology
Country United Kingdom 
Sector Academic/University 
PI Contribution Supervised the design, collection, analysis and interpretation of functional brain imaging studies resulting in peer-reviewed publications on empirical data. Contributed to the development of a complementary learning systems account of word learning published in a peer-reviewed theoretical/review paper.
Collaborator Contribution Provided methods, materials and theoretical insights that are driving current and planned research.
Impact 18578598 19933145 (many others in publications)
Start Year 2006
 
Description Learning to perceive: Optimally sampling our dynamic environment 
Organisation Birkbeck, University of London
Department Department of Psychological Sciences
Country United Kingdom 
Sector Academic/University 
PI Contribution My group have contributed knowledge of behavioural and neural mechanisms supporting speech perception to this collaborative research.
Collaborator Contribution Collaborative research exploring parallels and differences between perception and neural processing of auditory and visual action related stimuli (speech and manual movements) led by Professor Clare Press (Birkbeck College, UCL Institute of Neurology) with support from Dr Peter Kok (UCL Institute of Neurology).
Impact Leverhulme project grant funding awarded from April 2023 to March 2026.
Start Year 2023
 
Description Learning to perceive: Optimally sampling our dynamic environment 
Organisation University College London
Department Institute of Neurology
Country United Kingdom 
Sector Academic/University 
PI Contribution My group have contributed knowledge of behavioural and neural mechanisms supporting speech perception to this collaborative research.
Collaborator Contribution Collaborative research exploring parallels and differences between perception and neural processing of auditory and visual action related stimuli (speech and manual movements) led by Professor Clare Press (Birkbeck College, UCL Institute of Neurology) with support from Dr Peter Kok (UCL Institute of Neurology).
Impact Leverhulme project grant funding awarded from April 2023 to March 2026.
Start Year 2023
 
Description Re-Entraining the brain: Exploring and exploiting oscillatory models of speech perception in Wernicke's aphasia 
Organisation University College London
Department Division of Psychology & Language Sciences
Country United Kingdom 
Sector Academic/University 
PI Contribution I'm a co-supervisor of an MRC Clinician Scientist Fellowship award given to Dr Holly Robson based in the Department of Language and Cognition at UCL (value: £934,407, award reference: MR/T028629/1). This award supports research applying theories of speech entrainment to the assessment and rehabilitation of individuals with language impairment (Wernicke's Aphasia) following stroke or brain injury.
Collaborator Contribution Contributions to design, implementation, analysis and dissemination of research projects.
Impact None to date
Start Year 2021
 
Description Semantic ambiguity in speech comprehension 
Organisation University College London
Department Division of Psychology & Language Sciences
Country United Kingdom 
Sector Academic/University 
PI Contribution Contributed expertise in functional brain imaging, computational modelling and cognitive psychology
Collaborator Contribution Joint contributions to behavioural and neuroimaging research based in Cambridge, London (UK) and London (Ontario, Canada).
Impact Recent publications with Jenni Rodd and others listed. Collaboration is multi-disciplinary, and has resulted in publications in journals covering Cognitive Psychology and Cognitive Neuroscience
 
Description Semantic ambiguity in speech comprehension 
Organisation Western University
Department Brain and Mind Institute
Country Canada 
Sector Academic/University 
PI Contribution Contributed expertise in functional brain imaging, computational modelling and cognitive psychology
Collaborator Contribution Joint contributions to behavioural and neuroimaging research based in Cambridge, London (UK) and London (Ontario, Canada).
Impact Recent publications with Jenni Rodd and others listed. Collaboration is multi-disciplinary, and has resulted in publications in journals covering Cognitive Psychology and Cognitive Neuroscience
 
Description Testing prediction as a unified framework for speech production and perception 
Organisation University College London
Department Division of Psychology & Language Sciences
Country United Kingdom 
Sector Academic/University 
PI Contribution Collaborative research applying predictive processing theories to speech production
Collaborator Contribution Contributions to experimental design, and theoretical interpretation
Impact Leverhulme Trust, Early Career Fellowship awarded to Abbie Bradshaw
Start Year 2022
 
Description Top-down influences on speech perception 
Organisation University College London
Country United Kingdom 
Sector Academic/University 
PI Contribution Contributed to design, analysis and interpretation of behavioural and functional imaging data.
Collaborator Contribution Collaborative research on cognitive and neural processes involved in speech perception in challenging listening situations. Collaborative research on the perception of vocoded speech
Impact 18377182 18211243 17317056 15869347 12716950 21077718 20661456 (many others listed in publications)
Start Year 2006
 
Description Top-down influences on speech perception 
Organisation University of Geneva
Department Department of Basic Neurosciences
Country Switzerland 
Sector Academic/University 
PI Contribution Contributed to design, analysis and interpretation of behavioural and functional imaging data.
Collaborator Contribution Collaborative research on cognitive and neural processes involved in speech perception in challenging listening situations. Collaborative research on the perception of vocoded speech
Impact 18377182 18211243 17317056 15869347 12716950 21077718 20661456 (many others listed in publications)
Start Year 2006
 
Description Top-down influences on speech perception 
Organisation Washington University in St Louis
Country United States 
Sector Academic/University 
PI Contribution Contributed to design, analysis and interpretation of behavioural and functional imaging data.
Collaborator Contribution Collaborative research on cognitive and neural processes involved in speech perception in challenging listening situations. Collaborative research on the perception of vocoded speech
Impact 18377182 18211243 17317056 15869347 12716950 21077718 20661456 (many others listed in publications)
Start Year 2006
 
Description Top-down influences on speech perception 
Organisation Western University
Country Canada 
Sector Academic/University 
PI Contribution Contributed to design, analysis and interpretation of behavioural and functional imaging data.
Collaborator Contribution Collaborative research on cognitive and neural processes involved in speech perception in challenging listening situations. Collaborative research on the perception of vocoded speech
Impact 18377182 18211243 17317056 15869347 12716950 21077718 20661456 (many others listed in publications)
Start Year 2006
 
Description tACS studies of speech perception 
Organisation Brain and Cognition Research Center
Country France 
Sector Public 
PI Contribution tACS methods for perturbing and enhancing speech perception were developed with Benedikt Zoefel, now in Toulouse, France.
Collaborator Contribution With funding from the French Foundation Pour L'Audition this research will continue through behavioural and neural experiments conducted in collobaration.
Impact Ekhtiari, H. et al including Davis, M.H. (2022) A checklist for assessing the methodological quality of concurrent tES-fMRI studies (ContES checklist): a consensus study and statement. Nature Protocols, van Bree, S., Sohoglu, E., Davis, M.H., Zoefel, B. (2021) Sustained neural rhythms reveal endogenous oscillations supporting speech perception. PLoS-Biology, 19(2), e3001142
Start Year 2016
 
Description Communication of research on prediction in speech production 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Presentation at CBU Science Night
Year(s) Of Engagement Activity 2023