📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

MICA: Understanding and alleviating hearing disability: A cognitive-behavioural model of miscommunication in everyday conversation

Lead Research Organisation: University of Nottingham
Department Name: School of Medicine

Abstract

By 2050 there will be 2.5 billion people worldwide with hearing loss, mostly of older age. Untreated hearing loss is linked to greater cognitive decline with age, possibly because of the role hearing loss plays in social isolation. Difficulty engaging in conversation is the most often-reported problem of hearing loss, but currently treatment with hearing aids does not adequately fix this. There is a clear and unmet need for understanding why and how older adults with hearing loss experience problems in conversation. With such understanding, better treatments will become possible, improving the social participation of people with hearing loss. In this programme we will develop an in-depth explanation of how miscommunications happen in everyday conversation, and how people behave in response to them. That is, we will unravel the connections between the basic mishearings experienced by those with hearing loss in everyday conversation and the emotional (and hence social) consequences that limit their quality of life. The results will provide inspiration for treatments that limit these miscommunications and promote greater health through the lifespan.

Conversation is much more than an exchange of perfect messages; most often it is actually a gradual process of coming to mutual understanding. Words matter, but so does behaviour: timing, gesture, gaze, facial expression, and incidental signals ("uh-huh").
We focus on three key aspects of everyday conversation that have not yet been adequately addressed - especially for people with hearing loss.
The first is that when miscommunication occurs, conversational partners typically adjust how they behave or speak, to overcome the obstacle. Hence it is not only the person with hearing loss who experiences consequences.
The second is that flowing conversation depends on very rapid comprehension, formulation, and prediction of opportunities to speak. If any of these go too slowly, the result is a 'bottleneck', and one is left out of the conversation.
The third is that conversational context (e.g., acoustical environment, type of conversation, group composition) affects the way people communicate, and how they respond to difficulty. This means there is no single universal mechanism in action, nor a single solution.

In previous work we have identified a diverse array of communication behaviours and their potential functions. Crucially, we found initial signs that all the above aspects operate differently for people with vs. without hearing loss.
We therefore propose a comprehensive series of studies to reveal the mental processes and behaviours that take place in conversation, focussing on how hearing loss affects the occurrence and negotiation of miscommunication. The final result will be a conceptual 'model' linking hearing loss itself to social consequences through a chain of explanatory mechanisms.

In order to create such a model, we will apply multiple approaches, all relying on natural conversation, to illuminate key aspects in different ways. We will map out the scope and emotional cost of miscommunication through in-depth interviews and surveys. We will quantify the occurrences and effects of miscommunication in the real world through novel mobile assessment techniques. We will identify the specific patterns of behaviour that lead to and follow from miscommunication through state-of-the-art laboratory measurements. We will test under what time constraints miscommunication happens. The model will combine all these insights to span perceptual, mental, behavioural and emotional aspects of miscommunication.
The in-depth understanding provided by this model will inspire novel, personalised hearing rehabilitations and technologies to support problem-free communication. By so doing, it will advance the maintenance of social engagement in an ageing population, improving mental health, employment prospects, and quality of life for millions of older adults.

Technical Summary

Our primary objective is to develop a cognitive-behavioural model of miscommunication in everyday conversation for people with hearing loss. To develop this model, we will (1) identify which behaviours trigger accommodation in their communication partners, (2) study the impact of the temporal demands of conversation, and (3) investigate how behavioural responses to difficulty change according to the conversation context.
We will use a variety of methodologies. We will use interviews and surveys to understand the experience of challenging conversations for people with hearing loss, their significant others, normal-hearing cohorts, and clinicians. Second, we will conduct field studies using ecological momentary assessment coupled with expanded data-logging from hearing aids, gathering real-world contexts, behaviours and affective responses. Third, we will conduct laboratory studies recording video, audio, body and eye tracking of trios holding conversations, while manipulating conversation type, acoustical environment and group composition to examine the context dependence of cognitive processes and behaviour. As the work progresses, we will accumulate and combine the insights gained to build and refine a cognitive-behavioural model, finally verifying the model through observer ratings of the same data.
We will use reflexive thematic analyses for qualitative data, a combination of appropriate standard (e.g., multivariate LMM) and novel (e.g., ICA-based pattern similarity) analyses for the behavioural field and lab data, and will additionally use state-of-art machine learning (e.g., automatic relevance determination) to model miscommunication phenotypes.
Primary fields of application are in hearing devices and clinical counselling. Results will be published in general and field-specific journals, conveyed at workshops for patients, clinicians and academics. Anonymised datasets will be released for use by the academic and industrial research community.

Publications

10 25 50
publication icon
Ala TS (2023) Alpha Oscillations During Effortful Continuous Speech: From Scalp EEG to Ear-EEG. in IEEE transactions on bio-medical engineering

publication icon
Fernandez LB (2024) Is there a cost when predictions are not met? A VWP study investigating L1 and L2 speakers. in Quarterly journal of experimental psychology (2006)

publication icon
Kubba H (2023) Measuring benefit from non-surgical interventions in otolaryngology for different conditions, using the revised 5-factor Glasgow Benefit Inventory. in Clinical otolaryngology : official journal of ENT-UK ; official journal of Netherlands Society for Oto-Rhino-Laryngology & Cervico-Facial Surgery

 
Title Co-produced brochure 
Description Together with a group of study participants and their partners, we co-produced a brochure describing the effects of hearing loss on daily life, encouraging people to get their hearing tested, and signposting ways for them to do that. This brochure is now distributed in various public locations (libraries etc.) where relevant populations might come across them. 
Type Of Art Artefact (including digital) 
Year Produced 2024 
Impact We have noted some new 'recruits' into our pool of participant volunteers. We cannot measure any impact on behaviour amongst the general public as we have no follow-up possibilities. 
 
Description Bill & Graham NHS Scotland dementia guidelines
Geographic Reach Local/Municipal/Regional 
Policy Influence Type Contribution to a national consultation/review
 
Description A context-dependent approach to measuring hearing-aid benefit in real-life conversations
Amount $300,000 (USD)
Organisation Hearing Industry Research Consortium 
Sector Private
Start  
 
Description Conversations in dual-task situations: an under-researched aspect of hearing disability and a platform for novel outcome measures
Amount £282,000 (GBP)
Organisation Widex A/S 
Sector Private
Country Denmark
Start 09/2024 
End 09/2026
 
Description Development of an attentional hearing outcome for group conversations
Amount £108,000 (GBP)
Organisation Widex A/S 
Sector Private
Country Denmark
Start 01/2023 
End 12/2023
 
Title NOTE v2 
Description NOTE (Nottingham Online Testing Environment) supports online (i.e. off-site) execution of studies, be they with questionnaires, images, videos or auditory stimuli. It controls timing, sequencing and data marshalling. 
Type Of Material Improvements to research infrastructure 
Year Produced 2024 
Provided To Others? Yes  
Impact Colleagues in our group and other research groups within the University can plan and deploy online studies more cheaply and effectively. 
 
Description JH & McCann SPHSU 
Organisation University of Glasgow
Department Institute of Health and Wellbeing
Country United Kingdom 
Sector Academic/University 
PI Contribution Data and insights
Collaborator Contribution Methodological expertise
Impact Publication of first output 'in press'
Start Year 2023
 
Description ManCAD (Perfect) 
Organisation University of Manchester
Country United Kingdom 
Sector Academic/University 
PI Contribution Sharing of evolving systematisation of a topic area.
Collaborator Contribution Sharing of evolving systematisation of a topic area.
Impact Outputs (papers) to be submitted imminently
Start Year 2024
 
Title Word Monitoring task software 
Description Word Monitoring task software 
Type Of Technology Webtool/Application 
Year Produced 2024 
Impact Shared with external institution to accelerate their research 
 
Description Bill - Boys Town National Research Hospital seminar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Seminar for researchers, clinicians and policymakers, presenting some of our work and facilitating discussion around the benefits of different approaches to hearing device fitting.
Year(s) Of Engagement Activity 2024
 
Description Bill - Eriksholm Summer Camp 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact About 30 early-career audiologists from around the world gathered to learn about and try out new developments in their field of practice. Our presentation was one of several during the week, discussing how some traditional treatment methods (still in habitual use) may not be very effective.
Year(s) Of Engagement Activity 2024
URL https://www.demant.com/about/latest-news/eriksholm-summer-camp-experience
 
Description Govan Arts Cafe talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Talk by researchers from our group at a weekly 'Arts Cafe' for older citizens (i.e. target group for participation in our studies). About 20 people attended. Discussion afterwards.
Outcome: New volunteers added to our pool; raised awareness of hearing loss in gnereal public.
Year(s) Of Engagement Activity 2025
URL https://www.impactarts.co.uk/project/craft-cafe-govan/
 
Description Jack & Bill GNH Complex Needs Roadshow - Clinical Professional Development 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Workshops in London, Bristol, Manchester & Dunfermline attracting clinical audiologists and industry stakeholders. Overall approx. 200 attendees earned CPD points learning about our research into the effectiveness of certain clinical procedures. They went away with new insights and ideas.
Year(s) Of Engagement Activity 2024
 
Description Jack - Sound Exchange workshop in Melbourne 26-28 May 2024 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Workshop for 120 practising audiologists in Australia (would have been more, but session was sold out to capacity). Interactive session questioning clinical habits and exploring alternative approaches to certain aspects. High level of interest and interaction.
Year(s) Of Engagement Activity 2024
URL https://www.soundexchange.com.au/
 
Description World Hearing Day event 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Study participants or study members
Results and Impact 25 study participants and spouses attended presentations about our work and participated in idea-generating activities for further outreach
Year(s) Of Engagement Activity 2024
URL https://worldhearingday.org/reported-events-2024/entry/9246/