Novel directional microphone design for speech enhancement in complex environments

Lead Research Organisation: University of Strathclyde
Department Name: Electronic and Electrical Engineering

Abstract

In the UK, more than 50% of people over 60 suffer from hearing loss, but only 20% of them actually use hearing aids. Part of this poor take-up is due to issues with current hearing aids, including poor sound quality and poor performance in noisy and complex environments. But one feature of hearing aids that does help people is a "directional microphone", made-up from a combination of digital signal processing and two (at least) separate actual microphones. These can reject noises from the back or the side of the user. They help the user but come with severe problems. They add extra cost, weight, and power requirements. They have to be a certain distance apart, severely constricting the design of the hearing aid as a whole. And, with just two microphones accuracy is quite limited: they can tell whether a sound source is in front or behind, but struggle to detect sounds from below or above, such as echoes in a large room.

Despite remarkable advances in sound analysis in hearing aids, the actual microphone itself has remained essentially unchanged for decades. Here, we aim to solve the problems of current directional technology by instead using a new type of miniature directional microphone, inspired by how some insects tackle the problem of locating sounds. This new device retains its directionality while keeping the miniature dimensions similar to an insect ear. The research project will take the new insect-inspired microphone design and evaluate it as a component for hearing aids. From this initial evaluation, there will be an iterative process of new, improved, designs being simulated, fabricated, lab tested, and then evaluated. The end result will be microphones that can significantly solve the problems faced in hearing aid design.

The primary objective is to create a hearing aid system that can reduce or control unwanted noises, focusing the hearing aid on only the sound arriving from in front of the user. This includes reducing noises not only from behind, but above, below and distant, so for example reducing the problems caused by echoes from floors and ceilings. The research will also look at problems caused by the distance from which a sound emanates, for example how to separate a sound from a loud source far away, like a train or plane, from a quiet sound from nearby, like a human voice. Finally, the new microphones will require new mounting methods in hearing aid devices. The project will investigate using 3D printing techniques to achieve this. This allows the research to consider how to optimise the hearing aid housing so that it works best acoustically in conjunction with the new microphone, and how it might be possible to extend that to produce hearing aids that are personalised for both the user's ear and their user's sense of hearing.

Planned Impact

This research will develop new hearing aid systems with significantly increased performance compared to traditional devices, using a novel, bio-inspired miniature wideband directional microphone. The use of this microphone design will not only increase performance, but also drastically reduce the signal processing and physical dimensions required in traditional approaches to this problem area. The usefulness of these new hearing aid system designs will be demonstrated by evaluation at the laboratories of the MRC Institute for Hearing Research (Glasgow) through listening trials. This research therefore has multiple impacts as it aims to investigate and develop the acoustic capabilities of the miniature microphone as a component of an overall hearing aid system in order to improve the noise-control capability of hearing aids. This research will thus directly benefit the international academic community, industry, and end-users in the general public.

The project goal is ultimately to produce new technological solutions which will improve the quality of life associated with improved hearing aid performance and usability. This will require commitment from both end-users and supply chain companies in the future development of the technology. The proposed approach will find application across a wide range of hearing aid types and user profiles. By so improving the performance, delivery and usability of hearing aid systems the project will have an obvious impact on UK society and, importantly, will lead to an increase in the adoption of hearing aids by patients from their current low levels of uptake.

Further beneficiaries would be in academia. Given the multidisciplinary characteristics of the proposed research involving aspects of both engineering and hearing research, this research would benefit people working in these areas. Engineers would take advantage of the ideas and improvements at the core of the new miniature microphone devices since using the directivity of the microphones as proposed in this research represents a novel, and useful approach to numerous problems. The ultimate aim of implementing this system within hearing aids will produce a transformational change in the academic understanding of hearing aid systems.

All staff involved will gain new knowledge and improve skills in techniques such as the three dimensional dynamic measurement of the vibrations of the microphone structures, the acoustic simulations of their responses, and the experiments to evaluate their capabilities for new hearing aid systems. Expertise in the electroacoustic signal evaluation techniques for the hearing aid systems, and the behavioural testing of hearing-aid technologies will also be developed and enhanced. Finally, the implementation of the hearing aid systems through 3D printing will provide for the first time customization techniques using miniature directional microphones integrated into custom-built hearing aid structures.

The project's researcher will have the opportunity to strengthen their skills in MEMS design and simulation, performing experiments, and setting up complex scenarios when evaluating the new hearing aid systems in the lab. These skills are useful for both industrial engineering positions, as well as academia. The collection of all these skills will have a great impact on their employability at the end of the project and help to cement strong future links between academia and industry in key sectors. The researcher would have the opportunity of publishing in high quality journals and of attending both engineering and hearing conferences. The researcher will be encouraged to develop Fellowship applications during this work to further their ambition of progressing into an academic career. Overall, the researcher will have the opportunity to develop a unique skill set, combining an engineering outlook with hearing research. The investigator team will provide mentoring support to help achieve this aim.
 
Description The most significant achievements from this award centre around the frequency response and spatial directionality of the miniature directional microphones created as part of the research program. The research team achieved the lowest recorded directional frequency for such a miniature directional microphone design. Miniature directional microphones were also created for the first time that responded across a broad range of frequencies. Also, a completely new miniature directional microphone was created by the team that provided full three-dimensional spatial directionality, although only for a single narrow frequency band. The research also explored the use of 3D printing. This provided the first recorded investigations of the effects a microphone housing, like a hearing aid, would have on this type of miniature directional microphone. This was followed by completely new work to create the miniature microphones using 3D printing. Overall the award objectives were met, with the creation of new miniature directional microphone designs that could be used in a hearing aid system to help control unwanted sound or noise.
Exploitation Route Further work could be done to examine how the microphone's capabilities can be harnessed for used in a hearing aid type device. The research findings can be used by existing or new entrants to the miniature microphone market, or companies involved in the application of such microphones, such as hearing aid manufacturers, or mobile phone, computing and smart device companies.
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Electronics,Healthcare

 
Description This project entailed work on insect-inspired microphone designs to tackle the problem of locating sounds and eliminating background noise. The project's outputs helped support the development of several ongoing industrial partnerships with international companies. This ranges from work on the fundamentals of miniature directional microphone design through to the application of novel microphone technology to different industrial sectors, including consumer electronics, defence and healthcare. Th
First Year Of Impact 2015
Sector Aerospace, Defence and Marine,Electronics,Healthcare
Impact Types Economic

 
Title 3D-printed housing influence on directional acoustic response of MEMS microphone 
Description The dataset contains simulations and experimental data of investigations looking at the acoustic response influence of various 3D-printed housings for bio-inspired MEMS microphones. It contains .opj (Origin Pro) files clustering the simulated and experimental data for easy comparison of the frequency response and directional response of the microphone-housing combinations. 
Type Of Material Database/Collection of data 
Year Produced 2017 
Provided To Others? Yes  
Impact n/a 
 
Title Ormia-inspired piezoelectric MEMS microphone operating at low frequencies 
Description The dataset contains simulation and measured data of both mechanical and acoustic response as well as directionality of the low frequency dual-band operational microphone that mimics the hearing mechanism of insect, Ormia ochracea. It includes the .mat and .fig files (Matlab) to give much more details of experimental results. 
Type Of Material Database/Collection of data 
Year Produced 2018 
Provided To Others? Yes  
Impact
 
Description MRC Network (Cardiff) 
Organisation Cardiff University
Country United Kingdom 
Sector Academic/University 
PI Contribution We are collaborators on a MRC Network grant for a Hearing Aid Research Network, contributing presentations and discussions on the topic of disruptive technologies for hearing aids.
Collaborator Contribution Attendance, presentations at meetings, etc.
Impact No outputs yet.
Start Year 2015
 
Description Hearing in Nature: Models for creating new acoustic systems 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Hearing in Nature: Models for creating new acoustic systems - To share information
Year(s) Of Engagement Activity 2015
 
Description Insect Ears as Inspiration for Acoustic Systems 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Insect Ears as Inspiration for Acoustic Systems. Comsol Day Edinburgh
Year(s) Of Engagement Activity 2018
 
Description MRC Hearing Aid Network (Cardiff) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentations and discussions of from Stirling and Strathclyde EPSRC projects as well as provided expertise on directional microphones.
Year(s) Of Engagement Activity 2015,2016,2017,2018
URL https://www.mrc.ac.uk/documents/pdf/hearing-aid-research-networks/
 
Description MRC Network OverHear (London) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentations, demonstrations and discussions on large-scale behaviour studies possible in a large, multi-modal measurement facility such as PAMELA in London, including insights from EPSRC projects at Stirling and Strathclyde universities
Year(s) Of Engagement Activity 2015,2016,2017,2018
URL http://h2020evotion.eu/wp-content/uploads/2017/10/Over-Hear-Programme-Final.pdf
 
Description Tinnitus and Hearing Show 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Presented an overview of research at the Institute, including work with Universities of Strathclyde and Stirling. Also presented as part of a panel
Year(s) Of Engagement Activity 2018
URL https://invizear.com/tinnitus-and-hearing-this-scotland-2018/
 
Description University of Southampton Physics Invited Talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Invited talk to the University of Southampton School of Physics & Astronomy Colloquia.

Not recorded
Year(s) Of Engagement Activity 2014