Understanding British Accents in Noise

Lead Research Organisation: University College London
Department Name: Speech Hearing and Phonetic Science

Abstract

Accent differences among speakers and listeners can interfere with the ability of individuals to understand each other under noisy conditions. For example, listeners are best at understanding speech that matches either their own accent or standard accents (e.g., southern British accents that are frequently used in the media), but other accents can rapidly deteriorate in noise. These accent effects can be large, similar to the effect of having a mild hearing loss. Noise and accents can be particularly problematic for children, older adults, and individuals with hearing impairments. These accent effects in noise thus have practical importance for real-world speech communication, but the investigation of these effects also has broader scientific implications, allowing us to address fundamental issues of speech plasticity and the architecture of human speech processing.

The overall aim of this research is to understand why and how accent differences among British English speakers and listeners can make speech recognition difficult in noisy conditions. We will test whether (i) listeners are multidialectal (i.e., able to understand many different accents, not only ones that are similar to their own), and (ii) whether the difficulties with accents and noise come from early stages of speech processing in the brain, or at later processing stages associated with the recognition of words. Our experiments will involve testing individuals with a wide range of British English accents. We will test their ability to recognize speech spoken in different accents and mixed with noise, acoustically analyze their own speech in terms of accent, and use neurophysiological measures (Electroencephalography; EEG) to assess different types of speech processing. This interdisciplinary collection of measures and techniques will be used to address questions that are relevant to sociophonetics (e.g., why certain accents become standards, and the impacts of multidialectal experience), speech science (e.g., which factors explain speech intelligibility) and psychology (e.g., how speech is processed in the brain, and the perceptual learning abilities of adults), and do so in a way that will have practical relevance to understanding how people communicate in the UK.

Planned Impact

Audiological testing. This project will investigate the intelligibility of standard accents by a range of UK accent groups under challenging conditions. This is significant from an audiological perspective, because standard accents predominate among the speech materials that are used for hearing testing. Many of the standard UK speech test materials are distributed by the MRC Institute of Hearing Research, with some of these materials being produced in our department at UCL by Andrew Faulkner. If we find that non-standard accents are required by some listener groups for accurate assessment (i.e., standard accents would underestimate their hearing abilities), the sentence recordings generated in our proposed work can be repackaged to create a new battery of clinical test materials, although additional small-grant support (e.g., RNID, Deafness Research UK) will likely be required to validate the tests. In addition, the findings from this project will be disseminated at a meeting of the British Society of Audiology, with an audience of clinicians and hearing researchers.

Speech Synthesis. Telecommunications and speech synthesis companies also tend to use standard accents for their applications. As in the audiology impact described above, our work will produce data on which of these accents are likely to be most intelligible to different listener groups. We will make our work known to leading telecommunication and speech technology companies, by disseminating our results at workshops that we will hold as part of the new Marie Curie Initial Training Network INSPIRE (Investigating Speech Processing In Realistic Environments, 2012-2016). The network will support postgraduate research on speech processing under realistic conditions, and our network includes many industrial partners (e.g., Philips Research Laboratories, Nokia, Nuance, Toshiba, Cochlear) as well as academic partners who are engaged in commercial speech applications (e.g., Edinburgh). The network workshops will thus be ideal for disseminating our results, and allow us to discuss commercial exploitation of our findings.

General public and society. Accents and speech are topics that are of general popular interest. We have been active in public dissemination, with interviews given for radio (BBC Radio Four, BBC World Service, BBC Scotland, BBC London), UK national newspapers (Guardian, Observer, Telegraph), international news media (Die Zeit, Germany), and the popular-science press (Scientific American). We have recently presented our work at a fully booked public science evening at the British Library (http://www.bl.uk/reshelp/experthelp/science/science@blevents/previousevents/auditoryillusions/yourbrainandsound.html), and at the 2011 Royal Society Summer Exhibition (http://royalsociety.org/summer-science/2011/noisy-world/). We have written an iPhone App for second-language vowel training based on one of our previous ESRC-funded projects (RES-000-23-0838); it has had more than 3,000 downloads thus far (http://itunes.apple.com/gb/app/british-english-vowel-training/id401156507?mt=8).

Any newsworthy findings from the present project will be disseminated to the media via a UCL press release and accompanying interviews. We will also produce an iPhone App to evaluate the accent of the listener (e.g., Which British English accent do you have?) or demonstrate the effects of noise on speech recognition, either of which could serve as an opportunity for press contacts. Given our experience with writing successful iPhone Apps, this will not require significant expenditure beyond the research funding that is requested (e.g., PI effort and software updates). Our next scheduled public science event is in summer 2016 (after this grant is completed), but public engagement is a regular part of our academic practice, and we will promote the findings of this project at these types of events as they arise.
 
Description We have completed a study in which we have created an accent map of speakers in the UK, based on the acoustic distances between their speech. This accent map relates to how easily listeners can be understood in noisy conditions; listeners understand speakers better when they are nearby in the map (i.e., similar accents), but all listeners find speakers toward the center of the space to be more intelligible overall. We thus think that some of the high overall intelligibility of prestige accents, like southern English, come from their position within the acoustic landscape of accents, and not just because of their overall familiarity.

We have also completed a series of studies in which we use brain measures (EEG) to understand how accent differences are processed. We've demonstrated that accent differences primarily affect auditory areas of the brain rather than affecting later stages related to recognizing words. We've also developed new methodologies to see how listening effort (i.e., focused attention to a speaker) changes neural processing for speech.
Exploitation Route Our new measures of listening effort have inspired new research by PhD students, additional grants, and interest from hearing aid manufacturers.
Sectors Digital/Communication/Information Technologies (including Software),Education,Healthcare

 
Description As described in our original Pathways to Impact document, our main upgrade activities were to be through communication of our accent findings to audiologists, dissemination to speech technology companies, and dissemination to the general public and society. Audiologists. One of the main purposes of this project was to explore the interaction of talker and listener accents during the perception of speech in noise. Audiological test materials are typically produced in standard accents, and we expected that we'd show that these materials would underestimate the abilities of individuals with non-standard accents (e.g., Glaswegian). Although our investigation produced interesting scientific results, we found that the current use of standard accents in audiology was likely complete fine; our results showed that such standard accents are intelligible to a wide range of listeners regardless of their own accent, to a much stronger extent than we expected. Thus, we didn't further explore the development of audiological test materials in non-standard accents, or make other efforts to change current audiological practice. Speech technology companies. We stated that we were in contact with speech technology companies through the Marie Curie Initial Training Network INSPIRE, and would communicate our results with these companies. We've been in particularly close contact with SONOVA (Phonak) in Zurich. There has not yet been a direct commercial benefit, but one of my current students is doing a three-month placement there this summer, using the electrophysiological methods developed during this grant to test their hearing-aid patients and evaluate signal-processing methods to reduce background noise. Based on the same work, we've become members of a new Marie Curie network, ENRICH. General public and society. We participated in a sold-out event at the Royal Institution in London January 2015, Good listeners and smooth talkers: Spoken communication in a challenging world (http://www.rigb.org/whats-on/events-2015/january/public-good-listeners-and-smooth-talkers). Our participation was to demonstrate electrophysiological testing, discuss speech in noise, and discuss accent. As promised, we also produced a vowel trainer for second-language learners that used multiple accents from the present project, that runs on the iPhone; this software has been developed but it is currently being packaged and approved by the iPhone App store.
First Year Of Impact 2015
Sector Digital/Communication/Information Technologies (including Software),Healthcare,Other
Impact Types Societal,Economic

 
Description ESRC Project Grant
Amount £570,626 (GBP)
Funding ID ES/P010210/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 10/2017 
End 09/2020
 
Description Marie Curie Individual Fellowship
Amount £119,245 (GBP)
Funding ID H2020-MSCA-IF-2014-659204 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 11/2015 
End 11/2017
 
Title Data from the article "Development of neural perceptual vowel spaces during the first year of life", McCarthy, Skoruppa, and Iverson 2019. 
Description This is a spreadsheet of data from the paper: McCarthy KM, Skoruppa K, and Iverson P. (2019). Development of neural perceptual vowel spaces during the first year of life, Scientific Reports, 2045-2322. http://dx.doi.org/10.1038/s41598-019-55085-y 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact This is a documentation of the data for our paper, rather than being a stand-alone database. 
 
Description Participation in Marie Curie Initial Training Network ENRICH 
Organisation European Commission
Country European Union (EU) 
Sector Public 
PI Contribution Based on research conducted under our ESRC grant, I've been invited to participate in the Marie Curie Initial Training Network ENRICH, which brings together researchers from across Europe to investigate technologies to reduce listening effort (hearing aids, speech synthesis). I am not listing this as a separate grant, as I am not a PI. However, I am a named collaborator who has access to a share of the grant funds awarded to UCL.
Collaborator Contribution I am supervising a PhD student who participates in this network, and will participate in network meetings.
Impact None. The grant started two months ago.
Start Year 2016
 
Description Disseminating work to industrial partners 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact We were members of the Marie Curie network INSPIRE, which involved industrial partners from throughout Europe, primarily hearing-device manufacturers (Phonak, Cochlear, Oticon) but including other companies who work with sound (Philips, Toshiba UK). We presented our work to representatives of these companies in regular meetings (every 6 months). In particular, we had discussions with Phonak that is leading to additional work, as they are interested in our EEG measures of listening effort and auditory processing.
Year(s) Of Engagement Activity 2013,2014,2015
 
Description Presentation at language learning technology company (Rosetta Stone) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact I was invited by Rosetta Stone to present my latest work to their company, as part of a regular seminar series for their company to be exposed to research in the field. I gave it at their London office, but it was live streamed to their international offices, particularly to the US where their main research activities take place.
Year(s) Of Engagement Activity 2018
 
Description Public engagement by participating in Royal Institution event 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact We presented our work to the general public by participating in an evening at the Royal Institution in London. It was a sold-out event that combined talks and presentations from a range of researchers on speech perception under adverse conditions. Mostly the audience consisted of adults with a general interest in the topic, but we also provided subsidized places for secondary school children.
Year(s) Of Engagement Activity 2015
URL http://www.rigb.org/whats-on/events-2015/january/public-good-listeners-and-smooth-talkers