Selective Attention: How does Neural Response Modulation in Auditory Cortex Enable Auditory Scene Analysis?

Lead Research Organisation: University College London
Department Name: Ear Institute

Abstract

Listening to conversation in a crowded room is one of the greatest challenges that the auditory system faces, and the most common cause of complaint for many of the 10 million people in the UK who suffer hearing loss. For example, to fully appreciate the piece of gossip that your friend is telling you in a restaurant, you must be able to separate his voice from the voices of other people, the clatter of glasses, and the music playing in the background. Your brain is able to 'select' the voice of your friend over all these other sounds - perhaps on the basis of where he is standing, or the pitch of his voice. Normal hearing listeners achieve this feat effortlessly, although engineers have yet to create a machine that can successfully match such signal separation in noisy backgrounds. In this proposal we try to understand how the neural machinery of the brain is able to extract sounds of interest while ignoring others. Our work focuses on a brain area called the auditory cortex; an area that is thought to be necessary for listening in complex situations like the one described above. Our goal is to understand how the responses of neurons in auditory cortex represent multiple competing sounds, and how the neural responses can be shaped in order to best represent sounds according to the listener's current demands.

In this proposal we train animals in a series of listening tasks that will enable us to impose different demands on auditory cortex. Animals will listen for a target word amongst a series of non-target words. In some cases they will do this in silence, in others in the presence of background noise. In further variations they will listen to two streams of speech, each from a different talker, and from different locations, and be asked to selectively attend to one talker over the other (equivalent to trying to listen to your friend while ignoring the loud man behind her). We will record from neurons in auditory cortex while animals perform these tasks in order to understand how the different task requirements change the way in which sounds evoke neural activity. Auditory cortex is made of multiple, hierarchically organised areas that are thought to perform different functions. We will determine whether areas early in this hierarchy are affected by attention differently from those in higher areas.

In the second part of this project we will use a technique called optogenetics to selectively silence neural activity in particular regions of auditory cortex. We will test the hypothesis that different areas of Auditory Cortex facilitate different sorts of attention - for example separating sounds according to their location in space, as opposed to the pitch or timbre or a particular talker's voice. Finally we will determine whether feedback from higher auditory areas to primary auditory areas is essential for active listening. This work would represent a fundamental advance in our knowledge of the role of these 'feedback' projections and the role that they play in active listening.

Our work has the potential to enable the development of more sophisticated, biologically inspired, signal processing devices for hearing aids and cochlear implants - both of which perform poorly in many real-world listening conditions. Listeners whose hearing is assessed via an audiogram as normal can still struggle with listening in noisy situations - this problem is particularly acute in aged listeners. Problems in processing complex sounds underlie Central Auditory Processing Disorder, and disorders of attention are thought to underpin a variety of developmental disorders including autism, attention related hyperactivity disorder, as well as dementia and other neuropsychiatric conditions. Understanding the neural mechanisms in the healthy brain responsible for engaging attention to select sources in a sound scene will lay the foundation for understanding, and potentially treating, conditions in which these mechanisms are impaired.

Technical Summary

Our goal is to understand how active listening shapes neural responses in auditory cortex (AC), and to determine whether and when feedback connections from non-primary to primary areas facilitate selective attention. Real-world hearing is made challenging by the presence of multiple competing sound sources. Thus, listeners must direct their attention to a source of interest while ignoring others. Recent studies, utilising imaging techniques or ECoG recordings in humans, have demonstrated that neural activity in non-primary AC represents predominantly attended sound sources, yet little is known about the physiological mechanisms that facilitate this.

In this proposal we seek to determine how single cell responses in AC are shaped by current task demands. We will record from the AC of animals actively discriminating speech sounds and trained to report the occurrence of a target word. By employing different variants of the same paradigm we will determine how attentional mechanisms influence stimulus representation. These include a single stimulus stream in silence, conditions in which there is a competing stream of masking noise and a selective-attention task where animals discriminate one of two competing speech streams. We will test the hypothesis that spatial and feature based attentional mechanisms have different auditory cortical loci. We will assess whether changes to single neuron receptive fields are best summarised as gain changes.

Attention related changes in sensory representations are thought to result from feedback connections from secondary to primary Auditory Cortex areas. We will address this hypothesis by determining the behavioural consequences of inactivating each of the secondary and primary auditory cortical areas, and selectively targeting feedback projections (while leaving feedforward processing intact) during behaviour using spatially and temporally precise optogenetic neural silencing.

Planned Impact

Hearing loss affects more than 300 million people world-wide and as such is the most common sensory disorder. Even people with mild hearing loss consider understanding speech in the presence of competing sounds to be a challenge. Hearing loss has profound social and economic implications, which will only be compounded by an ageing population and an increasing prevalence of hearing loss in younger listeners. Currently, hearing aids and cochlear implants can compensate (albeit poorly) for hearing loss at the level of the ear. While a degraded signal reaching the brain (as in the case of hearing loss) will have a clear negative impact upon listening in complex situations problems successfully engaging neural mechanisms to segregate or select a source from a mixture will also cause difficulties in listening in noise. Even normal hearing listeners differ in their ability to process complex sounds and a significant proportion of this variability is explained by the ability of listeners to employ auditory attention effectively. However, very little is known about how central mechanisms contribute to listening in healthy adults, let alone in those with impaired hearing or in ageing listeners for whom declining central processing and/or cognitive function may additionally contribute. Impaired central mechanisms are known to underlie perceptual impairments in children with Central Auditory Processing Disorder (CAPD). 5% of children presenting at Audiological clinics receive a diagnosis of CAPD, characterised by a normal audiogram but impaired performance in complex listening tasks such as sound localisation or speech-in-noise. In some cases CAPD patients exhibit marked cortical abnormalities highlighting the importance of a better understanding of the mechanism by which auditory cortex facilitates complex listening.

A better knowledge of the principles used by the brain to separate and select sources will provide knowledge for engineers working on signal processing devices for auditory prosthesis including hearing aids, cochlear and mid-brain implants. Currently technology exists to equip implants with multiple microphone arrays that should in theory facilitate better source separation and selection, but their utilization is limited by the requirement to 'steer' such devices. Our work could lead to the development of brain computer interfaces capable of detecting cortical signatures associated with an attended auditory object. Such signals could potentially be 'read-out' non-invasively and be used in conjunction with multi-microphone arrays for source steering. Furthermore, understanding how the brain processes sounds is pivotal for designing and optimizing devices that are biologically compatible at a computational level.

Technology beneficiaries will include communications companies and electrical engineers for whom a better understanding of how to extract one signal from many may lead to developments in machine-listening. In particular, biologically inspired signal decomposition techniques could find broader applications in fields of science and engineering where multiple signal sources must be identified from a single input signal.

We are keen to promote our science to the public: the PI actively participates in public engagement work to communicate our science to a variety of audiances and will encourage the PDR to do so.

We will be able to deliver impact within the duration of the grant in the form of disseminating information to academic beneficiaries and to lay audiences. Our impact upon telecommunications, hearing prosthesis manufacturers and clinical beneficiaries will be on a longer timescale but the Ear Institute offers the appropriate links with industry to be able to do so when appropriate. UCL has a proactive and effective media office which we will work with in order to ensure the impact of our work beyond the academic community.
 
Description The purpose of this grant is to understand how listening to one sound in a mixture shapes activity in auditory cortex. To allow us to observe and manipulate neural activity we must perform experiments in animal models and so the first stage of this award has been developing and training a speech identification task that our animal model can perform. We have a cohort of trained animals and have implanted electrodes in the first set of animals. We have a second cohort of animals who have learned the more complicated 'dual stream' variant of this task who will be implanted over the next few months. We have invested considerable efforts in establishing optogenetic methods to allow us to manipulate neural activity in a spatially and temporally precise way in the ferret but have yet to yield much success- we have recently been able to obtain a new promotor that will allow us to activate inhibitory interneurons (using the mDlx sequence), and made several refinements in our approach to optimise methods for the ferret model. We currently have two animals in which we are performing behavioural tests to establish the efficacy of this method.

We are currently preparing the behavioural work for publication; we have demonstrated that animals can learn to recognise a complex spectrotemporal pattern (i.e. target word) and are able to do so across a range of pitch values and in the presence of competing noise. Moreover, animals make characteristic patterns of errors on this task with false alarms showing consistency within and across animals (many of which are phonetically similar words - e.g. the target is "instruments" and animals often false alarm to "incontrast". The neural data to accompany this is also being prepared for publication. The progress of this project was slowed by a viral outbreak of ECE (a coronavirus that causes gastrointestinal damage) in 2019 which resulted in the loss of two animals in this project and a nearly 2 month break in testing. A new PhD student has taken animals forward to continue this work beyond the lifetime of the grant allowing data collection to be extended beyond the lifetime of the grant.

The delivery of outputs from this award have been significantly delayed due to COVID-19; the post-doc on the award likely had covid in march 2020 and was significantly impacted for many weeks. He is now setting up his own lab and therefore juggling his own research group's needs with writing up publications.
Exploitation Route The paradigm has already been adapted by other labs (with our assistance).
Sectors Digital/Communication/Information Technologies (including Software),Healthcare

 
Description The data generated and skills developed during this grant supported the post-doctoral researcher to be successful in obtaining a fellowship position (and now permanent position) at the University of Nottingham. A normative dataset of ferret seasonal weight fluctuation was published (and is openly available) to support the use of weight as a welfare measure by other research groups, pet owners or other users of ferrets thus contributing to animal welfare. Human behavioural data has been published inspired by our animal work; this data is openly available and represents the first step in the pathway towards translational work. The data generated in this grant has led to two further PhD student's projects, supported multiple in2science students and been discussed at various scientific outreach events.
First Year Of Impact 2018
Sector Education
Impact Types Societal

 
Description How does the brain organize sounds into auditory scenes?
Amount € 1,999,999 (EUR)
Funding ID 771550 
Organisation European Research Council (ERC) 
Sector Public
Country Belgium
Start 09/2018 
End 08/2023
 
Title Seasonal weight changes in laboratory ferrets 
Description Archive of weight measurements from female ferrets collected over a 8 year period to document the typical seasonal fluctuation in body weight. This data is likely to be useful to other laboratories using ferrets as an animal model providing a more nuanced ability to use weight as an indicator of health. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact Weight is often used as a proxy for wellbeing in animal experimentation and is a key metric for monitoring the impact of e.g. water regulation on health. For animals such as ferrets that show large seasonal fluctuations in weight (as much as ±30% of their mean) any change in weight should be viewed within the context of whether they should typically be gaining weight (in winter) or losing weight (in summer). This data is likely to be useful to other laboratories using ferrets as an animal model providing a more nuanced ability to use weight as an indicator of health. 
URL https://doi.org/10.1371/journal.pone.0232733
 
Title The role of temporal coherence and temporal predictability in the build-up of auditory grouping 
Description Human psychoacoustics data looking at tone detection thresholds in a variety of masker conditions designed to manipulate auditory scene analysis. Data available on figshare https://figshare.com/s/619b2bb486a4d226c3b3 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
Impact Too early. Potential for reuse. 
URL https://www.nature.com/articles/s41598-022-18583-0
 
Description BBC documentary 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Participated in the making of a BBC4 documentary on sound "Soundwaves: the symphony of physics". Developed demos, participated in filming both performing demos and being interviewed about hearing. Broadcast in March 2017.
Year(s) Of Engagement Activity 2016
URL http://www.bbc.co.uk/programmes/b08h5gk8
 
Description BBC news online associated with BBC2's "Trust me I'm a Doctor" episode. 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Interview for a news article related to a BBC documentary.
Year(s) Of Engagement Activity 2018
URL http://www.bbc.co.uk/news/health-42620387
 
Description BBC2 Trust me I'm a Doctor appearance 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I was invited onto the program as a neuroscientist to provide an explanation for how lip reading can help deaf and hearing impaired listeners to listen more effectively.
Year(s) Of Engagement Activity 2018
URL https://www.bbc.co.uk/iplayer/episode/b09m62j5/trust-me-im-a-doctor-series-7-episode-2
 
Description Biology Society talk, University of Cambridge 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Undergraduate students
Results and Impact This was an invited lecture to the undergraduate Biology Society at the University of Cambridge. Audience members included students as well as local teachers and humanities faculty with an interest in hearing.
Year(s) Of Engagement Activity 2019
 
Description Cafe Scientific 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Cafe Scientific as part of Manchester Science festival.
Year(s) Of Engagement Activity 2016
 
Description Cafe Scientific 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Cafe Scientific at the Royal Society. Event was full to capacity with a large audience of interested members of the public and hearing impaired listeners.
Year(s) Of Engagement Activity 2016
 
Description Cafe Scientific, The Barbican Centre 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Cafe Scientific as part of the Royal Society sponsered Barbican's Life Rewired series. Roughly 20 people attended including a mix of interested individuals and patients with relevant healthcare concerns.
Year(s) Of Engagement Activity 2019
URL https://royalsociety.org/science-events-and-lectures/2019/02/is-hearing-believing/
 
Description Interview for national news paper (The Times) 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Article written for the Saturday Times about our recent Neuron paper which demonstrated that visual inputs can help auditory cortex process sound mixtures - and therefore potentially help listening in everyday noisy situations.
Year(s) Of Engagement Activity 2018
URL https://www.thetimes.co.uk/edition/news/read-my-lips-visual-clues-amplify-sound-3wgzdbq89
 
Description Primary school visit 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Visit to a local primary school as part of STEM week 2020. Spoke about a career in science and about how hearing works.
Year(s) Of Engagement Activity 2020
 
Description School visit ( Dr Challoner' High School) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Cafe Scientific as part of Brain awareness week.
Year(s) Of Engagement Activity 2017
 
Description Schools talks, Summer Science Exhibition 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact Delivered 5 talks as part of the Royal Society Summer Science Exhibition, forming one of the three sets of talks that are run for school groups to attend during their visit. Each talk was full to capacity (60 people).
Year(s) Of Engagement Activity 2016