Over-Hear: assessing functionality of hearing aids in complex listening environments

Lead Research Organisation: University College London
Department Name: Ear Institute

Abstract

The World Health Organization (WHO) estimates around 360 million people world-wide have a disabling hearing loss, with significant negative impact on the social and emotional health of individuals and their families, lost education and employment opportunities, and a substantial economic burden for deaf individuals and broader society. Currently, hearing aids are the most common form of therapeutic intervention for hearing loss. Nonetheless, even in high-income countries with established social- or insurance-based health care provision, the uptake and retention of hearing aids remains low; this is despite the lack of alternative treatments and therapies and the enormous personal and societal cost. Independent of differences in culture, economics of health-care provision or even whether or not someone has been provided with or purchased a hearing aid, a principle reason given for stopping using them (or not considering them in the first place) is the broadly held view that they provide little in terms of understanding speech in background noise. Since this is precisely the problem for which most hearing-impaired listeners seek help in the first place, it is unsurprising that this failure to deliver often leads to non-use of hearing aids. Several reasons likely contribute to disappointment with hearing aids, including unrealistic expectations of the devices' capabilities, intermittent use potentially compromising the extent to which the hearing brain adapts to the device, and the undeniable fact that hearing aids, whilst performing an adequate job in terms of amplifying sounds, do not make them very much easier to distinguish from each other; although hearing aids can provide the extra amplification of sounds that is lost when the inner ear is damaged, they cannot restore the frequency resolution (the ability to distinguish one sound from another) that accompanies the loss of sensitivity to quiet sounds. This is compounded by the fact that hearing aids are generally fitted with respect to increasing the audibility of pure tones (the pure-tone audiogram) with little or no regard to the natural listening environments in which most listeners need to perform. Although many putative strategies for enhancing listening in noise are implemented across a range of hearing aids, their rationale and their efficacy are only poorly understood, not least because they are inadequately assessed with respect to individual users' listening and communication strategies. We will establish a consortium of researchers, engineers and clinicians called 'Over-Hear' in order to understand and develop the best means of assessing how individual listeners utilise their hearing aids in complex listening environments. Through a series of Workshops, Over-Hear will seek to determine:- how best measures of listening performance can be assessed; how listeners behave in complex listening environments; the evidence needed to determine whether technological advances in hearing-aid processing are effective; the range of different performance levels in hearing-aid use by individual listeners. Our consortium will also conduct a Pilot Study in a specially designed arena that can recreate different sound and physical environments whilst simultaneously measuring behavioural (e.g. head movements towards or away from sound sources) and objective neural measures (e.g. brain activity that informs us as to how well hearing-aid users are listening and communicating). This might inform, for example, which selectable signal-processing strategies ('settings') a user employs, how this alters understanding of speech and communication strategies in complex listening environments, and could lead to the development of 'smart' hearing aids sensitive to users' listening intentions.

Technical Summary

Hearing aids are generally fitted with respect to increasing the audibility of pure tones (the pure-tone audiogram) with little or no regard to the natural listening environments in which most listeners need to perform. Although many putative strategies for enhancing listening in noise are implemented across a range of hearing aids, their rationale and their efficacy are only poorly understood, not least because they are inadequately assessed with respect to individual users' listening and communication strategies.
We will develop a collaborative network 'Over-Hear' to determine how listeners behave in complex listening environments and how measures of listening performance can be assessed and analysed. A Working Group (the co-PIs plus the two additional core partners) will develop and drive the programme of activity, including scoping and developing 3 key Workshop topics assessing technical requirements and feasibility of acquiring and analysing physiological/behavioural data from users in complex listening conditions. The Working Group will also develop and deliver a Pilot Study to assess the feasibility of recording a range of user-generated data in the UCL 'PAMELA' (http://www.ucl.ac.uk/arg/pamela) environment. Running over the course of the Over-Hear project, the Pilot Study will provide the first steps in developing a larger-scale study to generate the data required to inform, for example, which selectable signal-processing strategies ('settings') a user employs and how this alters understanding of speech and communication strategies in complex listening environments. Given the relatively short (18 months) of the project, and the need first to scope the specific forms of auditory and physiological measurement that need to be undertaken, the Pilot Study will necessarily be relatively constrained in its scope, but will inform future research projects and grant-funding applications.

Planned Impact

We envisage three main groups/areas of benefit from this project.

First, Scientists, engineers and clinicians interested in advancing hearing-aid technologies and in understanding current limits, and future potential, of new perspectives on hearing aids, for example through augmented sources of brain or behavioural information to help 'steer' hearing aids. Engineers such as those overseeing the PAMELA facility will also helped in developing new technologies and techniques for assessing performance of hearing aids (and hearing-aid users) in more 'life-like' listening conditions. The PAMELA facility could form a national centre for assessment in this regard.

Second, hearing-aid users and their families. Our engagement with 'evidENT' (http://www.ucl.ac.uk/ear/evident) has the potential for significant impact, not least because this is a NIHR-funded programme strongly links with local and national clinical and research centres, and with a remit for increasing the number of clinical trials in ENT medicine, including for hearing devices. 'evidENT' is also well connected to commercial groups in the field. With regard to public policy on hearing aids, two specific groups will be engaged, not least because they have a strong advocacy perspective, including within Whitehall. Action on Hearing Loss (AoHL, http://www.actiononhearingloss.org.uk/), the largest support and research group for hearing and deafness, and the Ear Foundation (http://www.earfoundation.org.uk/) based in Nottingham are both influential with user groups (e.g. hearing-aid users, teachers of the deaf) as well as with policy makers and the academic, clinical and commercial sectors. The Ear Foundation, for example, is championing a cross-parliamentary drive for adult hearing screening, and we will support this perspective by providing evidence of hearing function with hearing aids 'beyond the audiogram'. Another level of engagement is with groups like the Department of Transport, with whom Professor Nick Tyler has long-standing interactions (including research and contributions to policy). Hearing-aid users in public spaces (from railway stations to banks) are at a severe disadvantage given the often complex and noisy listening conditions (railway-station announcements being a particular problem, for example). Understanding how environments might be arranged so as to better help hearing-impaired listeners is within the scope of the project, and we will explore the means of engaging the Department of Transport and other Whitehall entities in understanding and ameliorating the problem of impaired listening-in-noise.

Third, at a commercial level, we consider the potential impact on the UK's commercial activities to be potentially critical. Not one of the hearing aid manufacturers (or cochlear implant companies) is British, and none of the companies has a large R&D base in the UK (despite cross-national and cross-continental seeding of large research centres by the various companies). This is a clear anomaly, especially given the strong research base across the UK in hearing research. Through demonstrating the potential for high-quality, commercially important (i.e. translational) research within the UK academic sector, Over-Hear has the potential to change this by i) bringing commercial partners to the UK to establish larger R&D programmes and, ii) by providing a forum in which new technological advances in hearing/medical devices can be explored. There is significant interest by 'start-ups' in engaging hearing devices with 'smart-phones' and other mobile devices, and Over-Hear provides a potential forum for exploring new commercial perspectives, including how best to assess multi-sensory/behavioural data and to exploit it in devices.
 
Description Leverhulme Doctoral Training Programme for the Ecological Study of the Brain (ECOLOGICAL BRAIN DTP)
Geographic Reach Local/Municipal/Regional 
Policy Influence Type Influenced training of practitioners or researchers
Impact The OverHear award and team contributed to the development of a new training programme that has been established to bring together supervisors from various areas sharing the view to explain the richness of human experiences it is critical to understand how humans operate in the real-world. The DTP aims to equip the next generation of brain scientists in harnessing and further developing new methods and technologies - part of the digital revolution - to measure behaviour and brain activity in the wild, to bring real-world complexity into the lab and to analyse the wealth of data these methods produce.
URL http://ecologicalbrain.org/
 
Description Alzheimer's Research UK. Treating Auditory impairment and CogniTion(TACT): a pilot trial of hearing aids for dementia risk.
Amount £608,402 (GBP)
Funding ID ARUK-PRRF2017-001 
Organisation Alzheimer's Research UK 
Sector Charity/Non Profit
Country United Kingdom
Start 01/2018 
End 08/2020
 
Description NIHR UCLH BRC Capital Projects
Amount £120,000 (GBP)
Organisation National Institute for Health Research 
Department NIHR Biomedical Research Centre
Sector Public
Country United Kingdom
Start  
 
Description NIHR UCLH Biomedical Research Centre Deafness and Hearing Problems Theme
Amount £2,700,000 (GBP)
Organisation National Institute for Health Research 
Department UCLH/UCL Biomedical Research Centre
Sector Academic/University
Country United Kingdom
Start 04/2017 
End 04/2022
 
Description NIHR University College London Hospitals Biomedical Research Centre Capital Fund to Prof Maria Chait Title: "Mobile high-tech audiology, brain imaging, autonomic response, conversation tracking and movement monitoring gear"
Amount £120,000 (GBP)
Organisation National Institute for Health Research 
Sector Public
Country United Kingdom
Start 12/2017 
End 11/2018
 
Description UKCRIC - SuperPAMELA (PEARL) to Professor Nick Tyler
Amount £9,000,000 (GBP)
Funding ID EP/P018629/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 04/2017 
End 03/2018
 
Title PAMELA 1 facility 
Description The PAMELA laboratory (set up by Prof Nick Tyler) is a novel and highly flexible facility allowing full-scale pedestrian infrastructure to be built and tested to enable thorough assessment and evaluation. The structure includes a flexible floor surface that represents real ground conditions with interchangeable surface materials and is supported by a range of sensing equipment. Prof Tyler is an OverHear team member and activities of the OverHEar network (including the 2 day conference with 1 day workshop held at the PAMELA facility) has result in enhanceents to the acoustic capability of PAMELA 1. Moreover it identified the needs for further enhancements that will be included in the PAMELA 2 (PEARL). 
Type Of Material Improvements to research infrastructure 
Year Produced 2006 
Provided To Others? Yes  
Impact The auditory related impacts will be realised in the coming years. 
 
Title PEARL - Person-Environment-Activity Research Laboratory 
Description SuperPAMELA - PEARL uperPAMELA (PEARL) is a configurable platform, divisible into multiple spaces, consisting of modules, each of which will provide a range of interchangeable surface types (including concrete, wood, asphalt, resin, experimental materials, various paving formats), which can be raised, lowered or tilted in any direction. Importnantly - it includes a new acoustic system, consisting of four isolatable ambisonic systems to create 3D ambient sound in each laboratory space, and locational speakers to provide physical sound sources at identifiable locations in the facility. The sound systems will be mixable, with a frequency range of 30-20,000Hz and be able to replicate sounds such as low-flying aircraft, trains, street scenes. 
Type Of Material Improvements to research infrastructure 
Year Produced 2018 
Provided To Others? Yes  
Impact PEARL is due to open in 2018. It is part of the £140m UK Co-laboratorium for Research on Infrastructure and Cities (UKCRIC), which is led by Professor Brian Collins and was announced by the previous Chancellor of the Exchequer in 2016 and involves the development of 11 new or upgraded facilities in 14 universities around the UK. 
 
Description Auditory research in PAMELA 2 (PEARL) 
Organisation Medical Research Council (MRC)
Department MRC Institute of Hearing Research
Country United Kingdom 
Sector Academic/University 
PI Contribution The OverHEar network activity and final conference has generated a collaboration between Graham Naylor, Bill Whitmer (both MRC IHR) and Nick Tyler to continue to work together on the next iteration of PAMELA.
Collaborator Contribution Significant input into the new PAMELA lab from OverHear workshop and network activities.
Impact None to date.
Start Year 2017
 
Description MRC Glasgow 
Organisation Medical Research Council (MRC)
Department MRC Institute of Hearing Research
Country United Kingdom 
Sector Academic/University 
PI Contribution I will contribute to experiment design, signal processing and patient recruitment for the pilot study we are going to conduct at UCL.
Collaborator Contribution Owen Brimijoin is the co-investigator for this network project. We are in collaboration to conduct a localisation experiment at PAMELA UCL. He will bring his most updated research equipment and a researcher here in UCL to conduct the experiment.
Impact An workshop about the pilot study has been conducted in collaboration with the partner.
Start Year 2015
 
Description PAMELA Ear Institute 
Organisation University College London
Department Centre For Transport Studies
Country United Kingdom 
Sector Academic/University 
PI Contribution I will contribute to hearing research design to investigate how the signal processing in hearing aids affect the hearing aid users' performance in a close to real life situation. My previous on signal processing and audiology will also help to contribute to the recruitment of appropriate patients.
Collaborator Contribution The PAMELA institute is led by Prof. Nick Tyler. He is going to contribute to the design of a close to real life physical space for a hearing experiment. The experiment facility will be provided by the PAMELA institute, which has been involving multi-displinary research, such as evaluating the patients' outcome after gene therapy invention for certain eye disease.
Impact The first workshop was hold at Ear Institute in March, with the participation of Nick Tyler from PAMELA. The first workshop invited key stake holders for evaluation and further development of future hearing aids. We also invited the other hearing aid network grant holder from Cardiff: Prof. John Culling here. The collaboration on the first pilot study will include the following area of research from different research background: 1 EEG recording (UCL Ear Institute) 2 Balance assessment (UCL Ear Institue) 3 Head movement (MRC glasgow, Owen Brimijo) 4 Oticon hearing Industry partner (Eriksholm in Denmark) 5 Aging and Dementia
Start Year 2016
 
Description PEARL - Person-Environment-Activity Research Laboratory 
Organisation University College London
Country United Kingdom 
Sector Academic/University 
PI Contribution The new People-Environment-Activity Research Laboratory (PEARL) was significantly affected by the OverHear team and network activity. As a result of the OverHear Network activity the new facility will house a completely overhauled sound system and the acoustics environment will have much more flexibility and power for a wider range of hearing issues in the environment. This will include the ability to locate and move sound sources around the environment in more detail.
Collaborator Contribution Professor Nick Tyler (OverHEar Network contributor) was awarded a £9m grant by EPSRC as part of the UK Collaboratorium for Research on Infrastructure and Cities (UKCRIC)
Impact None yet
Start Year 2017
 
Description "The importance of the compatibility of devices and interventions with natural behaviour" 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Owen Brimijoin opened the OVERHEAR: Real-world assessment of hearing aids and listening behaviour workshop giving an overview of the programme and the impact the research has and will continue to have.
Year(s) Of Engagement Activity 2017
 
Description ARO San Diego 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I attended ARO in order to have a better pictures of how we can broaden the impact of the hearing aid network. I discussed the network activity with Prof. Fangang Zen and a few other key scientists in the hearing aid research field.
Year(s) Of Engagement Activity 2016
 
Description BAA conference meeting key members of the network 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact I attended the BAA conference in Dec 2015 to meet the key stake holder in hearing aid industry and partners I would like to invited to be in the network. For example, I discussed the network activity with Prof.Anne Schilder from EvidENT and we followed that up later.
Year(s) Of Engagement Activity 2015
 
Description Beneficial behaviours and interventions 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact As part of the OVERHEAR: Real-world assessment of hearing aids and listening behaviour that took place on the 6th March the second section focused on the Beneficial behaviours and interventions with the following lectures:
Deborah Vickers "Training spatial listening to improve real world hearing for cochlear implant users"
John Culling and Jacques Grange "Optimal head orientation of hearing-impaired listeners in noisy environments"
Anne Schilder "Hearing loss and hearing aids: what matters to patients?
Sergi Costafreda Gonzalez "What support do people with cognitive impairment need to use hearing aids?"
Year(s) Of Engagement Activity 2017
 
Description Denmark Erikshom Oticon visit 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact I went to Eriksholm Oticon hearing research centre to give a presentation for researchers there about the hearing aid network.
I also discussed plans on how we can move forward to collaborate with Oticon Eriksholm hearing research centre to design the pilot study and make further funding application for the project.
They are committed to provide equipment and relevant support for the pilot study research.
Year(s) Of Engagement Activity 2015
 
Description Invited speaker - Translational Hearing Research Summit: Biological and Pharmacological Approaches 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Translational Hearing Research Summit: Biological and Pharmacological Approaches 22 March 2018, Wellcome Collection, London, UK
A unique, one-day summit that brings together opinion leaders and stakeholders from around the world to share and discuss the biggest challenges and opportunities in the translation of hearing loss and tinnitus research.
The summit, organised by Action on Hearing Loss, the UCL Ear Institute and the NIHR UCLH BRC Deafness and Hearing Loss theme is a full-day meeting consisting of presentations, networking sessions and a panel-led discussion. The programme brings together academia, industry, investors, commissioners, clinicians and patients to discuss strategies to accelerate the development of pharmaceutical and biological treatments for hearing loss and tinnitus.
Year(s) Of Engagement Activity 2008,2018
URL https://www.actiononhearingloss.org.uk/finding-cures/translational-research-initiative-for-hearing/t...
 
Description Listening behaviour and Communication Ecology 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact As part of the OVERHEAR: Real-world assessment of hearing aids and listening behaviour that took place on the 6th March the first section focused on the Listening behaviour and Communication Ecology and the following presentations were given:
Alan Archer-Boyd "Head movements during conversation in different acoustic environments"
Ian Wiggins "Brain activity during effortful listening in naturalistic scenes"
Volker Hohmann and Giso Grimm "Active motion behaviour in complex listening environments"
William Whitmer "What thrilling headgear can tell us about natural conversations in noise"
Year(s) Of Engagement Activity 2017
 
Description MRC OverHear Network conference 6-7th October 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The MRC OverHear Network held its final conference on Friday the 6th and Saturday the 7th of October at UCL and at the PAMELA facility in London. The Network's ongoing discussions as a whole reflected a need for future work to be able to tackle questions surrounding the integration of hearing device design with the design of public spaces to address real-world issues with hearing impairment, listening effort, and anxiety. The ability to examine large-scale interactions among people and between people and design should be central to any grant proposals going forward for PAMELA and its successor. This goes beyond specific aims of providing a platform for the real-life evaluation of novel hearing devices or algorithms, but examining also communication as an ecology, involving interaction between devices, talkers, listeners, and their environments. Four major themes were discussed over the course of the conference, Listening behaviour and Communication Ecology, Beneficial behaviours and interventions, Multimodal Factors, and Evaluating Hardware. Please see details of all presentations that took place on the day as part of the workshop.
Year(s) Of Engagement Activity 2017
 
Description Multimodal Factors 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact As part of the OVERHEAR: Real-world assessment of hearing aids and listening behaviour that took place on the 6th March the third section focused on the Multimodal Factors with the following lectures:
Jennifer Bizley "How does seeing improve listening?"
Valerie Hazan "Effects of aging on speech production and speaker intelligibility"
Theo Goverts "Binaural acoustic recordings from a number of complex, multi-source environments"
Tobias Busch Filiep Vanpoucke, "Using automatic data logging to investigate the auditory environment of children with cochlear implants"
Year(s) Of Engagement Activity 2017
 
Description Poster Session and Cocktail Party 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact As part of the OVERHEAR: Real-world assessment of hearing aids and listening behaviour. on 7th October there were poster prsentations through the duration of the workshop which were as follows:
Axel Ahrens Torsten Dau, and Marton Marschall "Speech intelligibility and perceived width of sound sources in simulated anechoic and reverberant environments"
Rhiannon Brook, Michael Akeroyd, Owen Brimijoin, Padraig Kitterick and Johanna Barry "Speech Localisation in Noise: A Developmental Perspective"
Octave Etard and Tobias Reichenbach "EEG-measured correlates of comprehension in speech-in-noise listening"
Antonio Elia Forte, Octave Etard, Tobias Reichenbach "Complex auditory-brainstem response to the fundamental frequency of continuous natural speech"
Lorna F. Halliday, Axelle Calcus, & Stuart Rosen "Aided Sensitivity to Temporal Fine Structure Predicts Language Outcomes in Children with Mild to Moderate Sensorineural Hearing Loss"
Maartje Hendrikse, Gerard Llorach, Giso Grimm and Volker Hohmann "Measuring realistic head and eye movement in the lab for the evaluation of hearing aids"
Ulrik Kowalk, Sven Kissner, Petra von Gablenz, Inga Holube, and Joerg Bitzer. "An improved privacy-aware system for objective and subjective ecological momentary assessment"
Gerard Llorach, Maartje Hendrikse, Giso Grimm and Volker Hohmann "Comparison of Head and Gaze Behavious in a Multi-Talker Listening Task with a Head-Mounted Display and Cylindrical Screen"
Paul Reinhart, Pavel Zahorik, and Pamela Souza "The relationship between hearing aid compression and working memory under realistic reverberant conditions"
Alan Sanderson, Carl Verschuur, Tracey Newman, Edward Rogers "Cochlear Implant Electrode Impedance: A biomarker of localised tissue changes"
L. Simon, R. Giurda, E. Georganti, P. Derleth, H. Wüthrich, and N. Dillier "Evaluation of hearing instruments in 3-D complex environments."
Terrin N. Tamati "The Perception of Foreign-Accented Speech by Cochlear Implant Users"
Year(s) Of Engagement Activity 2017