Measuring outcomes from a peer-led social communication skills intervention for adults following brain injury

Lead Research Organisation: University College London
Department Name: Psychology

Abstract

Acquired brain injury is a principal cause of life-long disability worldwide. Chronic cognitive and communication problems can follow injury, adversely impacting previous relationships and the ability to build new ones. Reduced social acceptance and social isolation are commonly reported problems. Intervention for social communication skills is recommended as a practice standard in programmes of rehabilitation, but the evidence of gain from more traditional models of intervention is mixed. In particular, automatic transfer of skills learned in the training setting to everyday life cannot be assumed. Community re-integration entails the ability to build relationships with other people independently of family members and professionals. In order to play a valued social role, the person needs to be able to engage as an equal partner in conversation, and have an ability to speak on their own behalf.

My PhD research developed and investigated the efficacy of a new approach, training a peer with a severe ABI to facilitate communication in an expert discussion group. Outcomes were compared to a control group (a traditional staff-led social activity group for individuals with severe ABI). Existing outcome measurement tools are designed to evaluate change in paired conversations rather than groups, so a new digital measurement tool (the INT) was developed and tested, using social network methodologies, to quantitatively measure change in group social participation over time.

Results showed that a trained peer can successfully facilitate group interaction without direct support from a neurotypical communication partner. The intervention group showed an improved ability to socially connect and participate collaboratively over time. Conversely, there was no change over time in the staff-led group. Overall, these findings show initial evidence of benefit in independent relationship-building within complex encounters and in new social networks with multiple communication partners, consistent with the communication demands of everyday life.

Developing findings from this PhD research has the potential to inform clinical practice in the following ways. It meets current recommendations for new interventions that address communication needs in real-world environments and a fully powered study is now required to increase confidence in these initial findings. A key objective for this fellowship is to produce a grant application for a multi-centre trial. Measurement of change in group social interaction is a new field of investigation and the INT meets current recommendations for new tools to measure social participation outcomes. My first mentor, Professor Joseph Devlin, as Vice Dean of Innovation and Enterprise is well placed to advise me on networking opportunities and the formulation of a contact plan to develop the INT. The measure also requires validation to demonstrate reliability and responsiveness with increased volumes of data, and to test its application to wider clinical contexts and groups. My secondary mentor, Dr Joshua Stott, brings experience of managing grant funded projects in dementia and mental health conditions
 
Description Two journal articles were published as a result of this award. The first reported on a new peer-led intervention for social communication skills. Findings showed preliminary evidence of advantage for peer-led groups over staff-led groups. Research into validated instruments to measure group outcomes is a new field of investigation, and the second paper reported on the reliability of three existing measures (previously used to measure change in dyadic conversation) for use with group interaction data. Reliability of the Interactional Network Tool (INT), a new digital tool designed for group conversational interaction that enables group interaction patterns to be visualised, was also evaluated. Findings showed acceptable reliability was achieved on the Measure of Participation in Conversation and the INT.

Funding through this award has enabled the Interactional Network Tool (INT) to move forward from its prototype form for research use and into a web-based application suitable for clinical and research use with different clinical populations. A road map is now in place for further development to improve existing functionality and towards its final iteration as a downloadable app, accessible from the App Stores for Android and Apple devices.
Exploitation Route Preliminary findings from the new peer-led intervention, disseminated as an outcome of this funding, show that a future study with an increased sample size is warranted and that a multi-centre study that broadens recruitment to include post-acute and community settings is feasible. Participant selection was biased to individuals with severe acquired brain injury. Future research to investigate effectiveness with individuals with mild and moderate impairment, and with a longer follow-up period, would provide more information on longer-term effects across differing profiles of impairment.

Further development of the Interactional Network Tool is underway. Future validation research with new clinical data is indicated. Opportunities for collaboration with digital health engineers to explore automated data collection would open up new opportunities in research and clinical settings to evaluate large data sets and remove judgment variability.
Sectors Healthcare

 
Title Interactional Network Tool 
Description The Interactional Network Tool is a new digital tool to measure participation in group interaction. This has evolved from a prototype form using bespoke macros in NodeXL and into a web-based application. A roadmap is also in place for further development and validation to widen application for clinical and research use. 
Type Of Technology Webtool/Application 
Year Produced 2020 
Impact Impact activity has generated interest in the Interactional Network Tool and its measurement methodology (through demonstration to professionals working across clinical populations, and invitations for book chapter contributions co-ordinated by senior scholars in the aphasia/ABI field) but impact awaits further software development prior to testing and a formal launch. 
URL http://interactionalnetworks.org
 
Title Multicam INT 
Description Multicam INT is a recording app designed to enable simultaneous multi-view recording of a group interaction, for use with the Interactional Network Tool 
Type Of Technology Webtool/Application 
Year Produced 2023 
Impact Trial pending 
 
Title Phase 2 development of the web-based application. 
Description Refinements to the web-based app include: an improved visual layout; amendments to the existing functionality to improve log-in, data entry and importation and results formats. The development of new features and functions include a data filtering option and a new talk time function. Re-worked sociogram functionality includes improved export options to share the results with users in a variety of formats for clinical/research purposes. Refinements also include a newly developed seven item coding system to improve coding speed and rater reliability. 
Type Of Technology Webtool/Application 
Year Produced 2021 
Impact Interest from researchers and clinicians working with a range of clinical groups. A learning disability day centre is currently a beta test site. 
 
Description Demonstration of the tool in third sector day centre 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Initial trial of the measure in a day centre conversation group setting using a new filming protocol (and technical set-up), designed for novice users without technical experience, to improve speed and efficiency of data collection.
Year(s) Of Engagement Activity 2022
 
Description On-line demonstration to special interest group 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Demonstration of the Interactional Network Tool (digital outcome measure) to a special interest group of speech and language therapists working in clinical settings with adults with acquired brain injury. Discussion sparked interest in using the tool for on-line groups currently delivered under lockdown conditions.
Year(s) Of Engagement Activity 2021
 
Description Seminar 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other audiences
Results and Impact Participants (including potential users from clinical and research backgrounds) attended an on-line presentation and demonstration of the Interactional Network Tool (INT): as a new way to measure group interactional behaviour. The presentation comprised an overview of the development of the tool (for people with acquired brain injury), developments to widen its use across clinical populations, an introduction to the newly launched website as the gateway to the INT and a practical demonstration of the tool.

A lengthy question and answer session preceded subsequent meetings with researchers considering options for the measurement of interactional behaviour in future projects.
Year(s) Of Engagement Activity 2022
 
Description User input (recurring activity) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Individual meetings with clinicians and researchers interested in using the INT and its measurement methodology who work in clinical and research settings. Input from these meetings continues to shape the development of the INT.
Year(s) Of Engagement Activity 2020,2021,2022