Novel directional microphone design for speech enhancement in complex environments
Lead Research Organisation:
University of Strathclyde
Department Name: Electronic and Electrical Engineering
Abstract
In the UK, more than 50% of people over 60 suffer from hearing loss, but only 20% of them actually use hearing aids. Part of this poor take-up is due to issues with current hearing aids, including poor sound quality and poor performance in noisy and complex environments. But one feature of hearing aids that does help people is a "directional microphone", made-up from a combination of digital signal processing and two (at least) separate actual microphones. These can reject noises from the back or the side of the user. They help the user but come with severe problems. They add extra cost, weight, and power requirements. They have to be a certain distance apart, severely constricting the design of the hearing aid as a whole. And, with just two microphones accuracy is quite limited: they can tell whether a sound source is in front or behind, but struggle to detect sounds from below or above, such as echoes in a large room.
Despite remarkable advances in sound analysis in hearing aids, the actual microphone itself has remained essentially unchanged for decades. Here, we aim to solve the problems of current directional technology by instead using a new type of miniature directional microphone, inspired by how some insects tackle the problem of locating sounds. This new device retains its directionality while keeping the miniature dimensions similar to an insect ear. The research project will take the new insect-inspired microphone design and evaluate it as a component for hearing aids. From this initial evaluation, there will be an iterative process of new, improved, designs being simulated, fabricated, lab tested, and then evaluated. The end result will be microphones that can significantly solve the problems faced in hearing aid design.
The primary objective is to create a hearing aid system that can reduce or control unwanted noises, focusing the hearing aid on only the sound arriving from in front of the user. This includes reducing noises not only from behind, but above, below and distant, so for example reducing the problems caused by echoes from floors and ceilings. The research will also look at problems caused by the distance from which a sound emanates, for example how to separate a sound from a loud source far away, like a train or plane, from a quiet sound from nearby, like a human voice. Finally, the new microphones will require new mounting methods in hearing aid devices. The project will investigate using 3D printing techniques to achieve this. This allows the research to consider how to optimise the hearing aid housing so that it works best acoustically in conjunction with the new microphone, and how it might be possible to extend that to produce hearing aids that are personalised for both the user's ear and their user's sense of hearing.
Despite remarkable advances in sound analysis in hearing aids, the actual microphone itself has remained essentially unchanged for decades. Here, we aim to solve the problems of current directional technology by instead using a new type of miniature directional microphone, inspired by how some insects tackle the problem of locating sounds. This new device retains its directionality while keeping the miniature dimensions similar to an insect ear. The research project will take the new insect-inspired microphone design and evaluate it as a component for hearing aids. From this initial evaluation, there will be an iterative process of new, improved, designs being simulated, fabricated, lab tested, and then evaluated. The end result will be microphones that can significantly solve the problems faced in hearing aid design.
The primary objective is to create a hearing aid system that can reduce or control unwanted noises, focusing the hearing aid on only the sound arriving from in front of the user. This includes reducing noises not only from behind, but above, below and distant, so for example reducing the problems caused by echoes from floors and ceilings. The research will also look at problems caused by the distance from which a sound emanates, for example how to separate a sound from a loud source far away, like a train or plane, from a quiet sound from nearby, like a human voice. Finally, the new microphones will require new mounting methods in hearing aid devices. The project will investigate using 3D printing techniques to achieve this. This allows the research to consider how to optimise the hearing aid housing so that it works best acoustically in conjunction with the new microphone, and how it might be possible to extend that to produce hearing aids that are personalised for both the user's ear and their user's sense of hearing.
Planned Impact
This research will develop new hearing aid systems with significantly increased performance compared to traditional devices, using a novel, bio-inspired miniature wideband directional microphone. The use of this microphone design will not only increase performance, but also drastically reduce the signal processing and physical dimensions required in traditional approaches to this problem area. The usefulness of these new hearing aid system designs will be demonstrated by evaluation at the laboratories of the MRC Institute for Hearing Research (Glasgow) through listening trials. This research therefore has multiple impacts as it aims to investigate and develop the acoustic capabilities of the miniature microphone as a component of an overall hearing aid system in order to improve the noise-control capability of hearing aids. This research will thus directly benefit the international academic community, industry, and end-users in the general public.
The project goal is ultimately to produce new technological solutions which will improve the quality of life associated with improved hearing aid performance and usability. This will require commitment from both end-users and supply chain companies in the future development of the technology. The proposed approach will find application across a wide range of hearing aid types and user profiles. By so improving the performance, delivery and usability of hearing aid systems the project will have an obvious impact on UK society and, importantly, will lead to an increase in the adoption of hearing aids by patients from their current low levels of uptake.
Further beneficiaries would be in academia. Given the multidisciplinary characteristics of the proposed research involving aspects of both engineering and hearing research, this research would benefit people working in these areas. Engineers would take advantage of the ideas and improvements at the core of the new miniature microphone devices since using the directivity of the microphones as proposed in this research represents a novel, and useful approach to numerous problems. The ultimate aim of implementing this system within hearing aids will produce a transformational change in the academic understanding of hearing aid systems.
All staff involved will gain new knowledge and improve skills in techniques such as the three dimensional dynamic measurement of the vibrations of the microphone structures, the acoustic simulations of their responses, and the experiments to evaluate their capabilities for new hearing aid systems. Expertise in the electroacoustic signal evaluation techniques for the hearing aid systems, and the behavioural testing of hearing-aid technologies will also be developed and enhanced. Finally, the implementation of the hearing aid systems through 3D printing will provide for the first time customization techniques using miniature directional microphones integrated into custom-built hearing aid structures.
The project's researcher will have the opportunity to strengthen their skills in MEMS design and simulation, performing experiments, and setting up complex scenarios when evaluating the new hearing aid systems in the lab. These skills are useful for both industrial engineering positions, as well as academia. The collection of all these skills will have a great impact on their employability at the end of the project and help to cement strong future links between academia and industry in key sectors. The researcher would have the opportunity of publishing in high quality journals and of attending both engineering and hearing conferences. The researcher will be encouraged to develop Fellowship applications during this work to further their ambition of progressing into an academic career. Overall, the researcher will have the opportunity to develop a unique skill set, combining an engineering outlook with hearing research. The investigator team will provide mentoring support to help achieve this aim.
The project goal is ultimately to produce new technological solutions which will improve the quality of life associated with improved hearing aid performance and usability. This will require commitment from both end-users and supply chain companies in the future development of the technology. The proposed approach will find application across a wide range of hearing aid types and user profiles. By so improving the performance, delivery and usability of hearing aid systems the project will have an obvious impact on UK society and, importantly, will lead to an increase in the adoption of hearing aids by patients from their current low levels of uptake.
Further beneficiaries would be in academia. Given the multidisciplinary characteristics of the proposed research involving aspects of both engineering and hearing research, this research would benefit people working in these areas. Engineers would take advantage of the ideas and improvements at the core of the new miniature microphone devices since using the directivity of the microphones as proposed in this research represents a novel, and useful approach to numerous problems. The ultimate aim of implementing this system within hearing aids will produce a transformational change in the academic understanding of hearing aid systems.
All staff involved will gain new knowledge and improve skills in techniques such as the three dimensional dynamic measurement of the vibrations of the microphone structures, the acoustic simulations of their responses, and the experiments to evaluate their capabilities for new hearing aid systems. Expertise in the electroacoustic signal evaluation techniques for the hearing aid systems, and the behavioural testing of hearing-aid technologies will also be developed and enhanced. Finally, the implementation of the hearing aid systems through 3D printing will provide for the first time customization techniques using miniature directional microphones integrated into custom-built hearing aid structures.
The project's researcher will have the opportunity to strengthen their skills in MEMS design and simulation, performing experiments, and setting up complex scenarios when evaluating the new hearing aid systems in the lab. These skills are useful for both industrial engineering positions, as well as academia. The collection of all these skills will have a great impact on their employability at the end of the project and help to cement strong future links between academia and industry in key sectors. The researcher would have the opportunity of publishing in high quality journals and of attending both engineering and hearing conferences. The researcher will be encouraged to develop Fellowship applications during this work to further their ambition of progressing into an academic career. Overall, the researcher will have the opportunity to develop a unique skill set, combining an engineering outlook with hearing research. The investigator team will provide mentoring support to help achieve this aim.
Publications
Bauer R
(2017)
Influence of Microphone Housing on the Directional Response of Piezoelectric MEMS Microphones Inspired by Ormia Ochracea
in IEEE Sensors Journal
Zhang Y
(2017)
Development of a biologically inspired MEMS microphone
Zhang Y
(2018)
A Low-Frequency Dual-Band Operational Microphone Mimicking the Hearing Property of Ormia Ochracea
in Journal of Microelectromechanical Systems
Zhang Y
(2018)
Insect-inspired acoustic micro-sensors.
in Current opinion in insect science
Zhang Y
(2017)
New O r mia -inspired directional microelectromechanical systems microphone operating in a low-frequency band
in The Journal of the Acoustical Society of America
Zhang, Y
(2017)
Development of a biologically inspired MEMS microphone
Description | The most significant achievements from this award centre around the frequency response and spatial directionality of the miniature directional microphones created as part of the research program. The research team achieved the lowest recorded directional frequency for such a miniature directional microphone design. Miniature directional microphones were also created for the first time that responded across a broad range of frequencies. Also, a completely new miniature directional microphone was created by the team that provided full three-dimensional spatial directionality, although only for a single narrow frequency band. The research also explored the use of 3D printing. This provided the first recorded investigations of the effects a microphone housing, like a hearing aid, would have on this type of miniature directional microphone. This was followed by completely new work to create the miniature microphones using 3D printing. Overall the award objectives were met, with the creation of new miniature directional microphone designs that could be used in a hearing aid system to help control unwanted sound or noise. |
Exploitation Route | Further work could be done to examine how the microphone's capabilities can be harnessed for used in a hearing aid type device. The research findings can be used by existing or new entrants to the miniature microphone market, or companies involved in the application of such microphones, such as hearing aid manufacturers, or mobile phone, computing and smart device companies. |
Sectors | Aerospace Defence and Marine Digital/Communication/Information Technologies (including Software) Electronics Healthcare |
Description | This project entailed work on insect-inspired microphone designs to tackle the problem of locating sounds and eliminating background noise. The project's outputs helped support the development of several ongoing industrial partnerships with international companies. This ranges from work on the fundamentals of miniature directional microphone design through to the application of novel microphone technology to different industrial sectors, including consumer electronics, defence and healthcare. Th |
First Year Of Impact | 2015 |
Sector | Aerospace, Defence and Marine,Electronics,Healthcare |
Impact Types | Economic |
Title | 3D-printed housing influence on directional acoustic response of MEMS microphone |
Description | The dataset contains simulations and experimental data of investigations looking at the acoustic response influence of various 3D-printed housings for bio-inspired MEMS microphones. It contains .opj (Origin Pro) files clustering the simulated and experimental data for easy comparison of the frequency response and directional response of the microphone-housing combinations. |
Type Of Material | Database/Collection of data |
Year Produced | 2017 |
Provided To Others? | Yes |
Impact | n/a |
Title | Ormia-inspired piezoelectric MEMS microphone operating at low frequencies |
Description | The dataset contains simulation and measured data of both mechanical and acoustic response as well as directionality of the low frequency dual-band operational microphone that mimics the hearing mechanism of insect, Ormia ochracea. It includes the .mat and .fig files (Matlab) to give much more details of experimental results. |
Type Of Material | Database/Collection of data |
Year Produced | 2018 |
Provided To Others? | Yes |
Impact | . |
Description | MRC Network (Cardiff) |
Organisation | Cardiff University |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | We are collaborators on a MRC Network grant for a Hearing Aid Research Network, contributing presentations and discussions on the topic of disruptive technologies for hearing aids. |
Collaborator Contribution | Attendance, presentations at meetings, etc. |
Impact | No outputs yet. |
Start Year | 2015 |
Description | Hearing in Nature: Models for creating new acoustic systems |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | Hearing in Nature: Models for creating new acoustic systems - To share information |
Year(s) Of Engagement Activity | 2015 |
Description | Insect Ears as Inspiration for Acoustic Systems |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Other audiences |
Results and Impact | Insect Ears as Inspiration for Acoustic Systems. Comsol Day Edinburgh |
Year(s) Of Engagement Activity | 2018 |
Description | MRC Hearing Aid Network (Cardiff) |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Presentations and discussions of from Stirling and Strathclyde EPSRC projects as well as provided expertise on directional microphones. |
Year(s) Of Engagement Activity | 2015,2016,2017,2018 |
URL | https://www.mrc.ac.uk/documents/pdf/hearing-aid-research-networks/ |
Description | MRC Network OverHear (London) |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Presentations, demonstrations and discussions on large-scale behaviour studies possible in a large, multi-modal measurement facility such as PAMELA in London, including insights from EPSRC projects at Stirling and Strathclyde universities |
Year(s) Of Engagement Activity | 2015,2016,2017,2018 |
URL | http://h2020evotion.eu/wp-content/uploads/2017/10/Over-Hear-Programme-Final.pdf |
Description | Tinnitus and Hearing Show 2018 |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Public/other audiences |
Results and Impact | Presented an overview of research at the Institute, including work with Universities of Strathclyde and Stirling. Also presented as part of a panel |
Year(s) Of Engagement Activity | 2018 |
URL | https://invizear.com/tinnitus-and-hearing-this-scotland-2018/ |
Description | University of Southampton Physics Invited Talk |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other academic audiences (collaborators, peers etc.) |
Results and Impact | Invited talk to the University of Southampton School of Physics & Astronomy Colloquia. Not recorded |
Year(s) Of Engagement Activity | 2014 |