Delivering the digital ambition: Exploring how we can design, implement and evaluate digital technologies in healthcare.
Lead Research Organisation:
University of Lancashire
Department Name: Sch of Nursing
Abstract
Digital health technologies (DHT) comprise a broad range of applications such as telehealth, wearable devices and smart-phone and tablet applications (apps). However, whilst national and international policies present ambitious plans for DHT to revolutionise healthcare, there has been little consideration of how they can be successfully integrated into healthcare systems and processes. This is important as many reports show that even well designed DHT fail to be adopted or are quickly abandoned in clinical practice, meaning that their potential to transform healthcare is lost.
Stroke rehabilitation presents an ideal opportunity to use DHT to improve patient outcomes. Pressures on services mean that the amount of rehabilitation that can be directly delivered by staff, particularly for the arm, falls far short of that known to be beneficial resulting in sub-optimal outcomes for many people and reduced quality of life. With the numbers of people surviving a stroke set to double in the next 15 years, DHT provides an attractive, innovative, practical and engaging way for staff to prescribe additional rehabilitation and improve recovery for people after stroke, within current service constraints. However, DHT are not widely used in rehabilitation and the factors that influence their use in clinical practice are not known.
This project seeks to identify and understand the factors that will influence the use of DHT in healthcare. It will employ this knowledge to design, implement and evaluate a DHT intervention, using rehabilitation after stroke as a case example.
The project has 3 initial phases.
In phase 1, the evidence considering if and how DHT are used in healthcare will be reviewed, to explore the factors influencing their use. A national survey, observations of practice, questionnaires and interviews will describe current practice and explore the behaviours and beliefs of people after stroke, rehabilitation staff and service managers about using DHT. This information will be used to develop a theory about, and framework of, the factors influencing the use of DHT in healthcare rehabilitation.
In phase 2, the theory and framework will be used to co-design, create and undertake initial testing of an app and intervention to supplement routine rehabilitation for the arm after stroke with rehabilitation staff, stroke survivors and DHT developers from our in-house innovation lab.
In phase 3, the initial feasibility, acceptability and costs of the app and intervention to supplement stroke rehabilitation at a single NHS trust will be evaluated. Data from interviews, questionnaires and generated by the app will investigate how it was used in practice. These findings will be used to further refine the theory and framework developed in Phase 1 and the app and intervention developed in Phase 2.
In the second period of the fellowship (Phase 4), a multi-site feasibility study of the app and intervention will be conducted. The project outputs will also be used to guide and assess the use of other forms of DHT (e.g. virtual reality) in stroke rehabilitation and their transferability to support and evaluate DHT in other healthcare settings will be evaluated.
This project will transform how DHT can be used in healthcare by generating a clear theory and framework and providing practical tools which detail the factors that must be considered in the design, implementation and evaluation of DHT. It will provide guidance on how patients and healthcare staff can co-design DHT and design a future trial of the effectiveness of the app and intervention. Its results will benefit technology developers and researchers by helping them design and utilise DHT to improve patient outcomes and enable healthcare organisations and policy-makers to consider the vital processes and resources required to realise the vision of a truly innovative and DHT-enabled healthcare service.
Stroke rehabilitation presents an ideal opportunity to use DHT to improve patient outcomes. Pressures on services mean that the amount of rehabilitation that can be directly delivered by staff, particularly for the arm, falls far short of that known to be beneficial resulting in sub-optimal outcomes for many people and reduced quality of life. With the numbers of people surviving a stroke set to double in the next 15 years, DHT provides an attractive, innovative, practical and engaging way for staff to prescribe additional rehabilitation and improve recovery for people after stroke, within current service constraints. However, DHT are not widely used in rehabilitation and the factors that influence their use in clinical practice are not known.
This project seeks to identify and understand the factors that will influence the use of DHT in healthcare. It will employ this knowledge to design, implement and evaluate a DHT intervention, using rehabilitation after stroke as a case example.
The project has 3 initial phases.
In phase 1, the evidence considering if and how DHT are used in healthcare will be reviewed, to explore the factors influencing their use. A national survey, observations of practice, questionnaires and interviews will describe current practice and explore the behaviours and beliefs of people after stroke, rehabilitation staff and service managers about using DHT. This information will be used to develop a theory about, and framework of, the factors influencing the use of DHT in healthcare rehabilitation.
In phase 2, the theory and framework will be used to co-design, create and undertake initial testing of an app and intervention to supplement routine rehabilitation for the arm after stroke with rehabilitation staff, stroke survivors and DHT developers from our in-house innovation lab.
In phase 3, the initial feasibility, acceptability and costs of the app and intervention to supplement stroke rehabilitation at a single NHS trust will be evaluated. Data from interviews, questionnaires and generated by the app will investigate how it was used in practice. These findings will be used to further refine the theory and framework developed in Phase 1 and the app and intervention developed in Phase 2.
In the second period of the fellowship (Phase 4), a multi-site feasibility study of the app and intervention will be conducted. The project outputs will also be used to guide and assess the use of other forms of DHT (e.g. virtual reality) in stroke rehabilitation and their transferability to support and evaluate DHT in other healthcare settings will be evaluated.
This project will transform how DHT can be used in healthcare by generating a clear theory and framework and providing practical tools which detail the factors that must be considered in the design, implementation and evaluation of DHT. It will provide guidance on how patients and healthcare staff can co-design DHT and design a future trial of the effectiveness of the app and intervention. Its results will benefit technology developers and researchers by helping them design and utilise DHT to improve patient outcomes and enable healthcare organisations and policy-makers to consider the vital processes and resources required to realise the vision of a truly innovative and DHT-enabled healthcare service.
Planned Impact
Digital health technologies (DHT) hold significant promise to promote and protect health. Over 200 new health applications (apps) come to market each day and the UK DHT market is estimated to be worth £28 billion. However, despite their clear potential and wide availability, DHT have repeatedly failed to be successfully implemented in clinical practice. This constitutes a significant challenge in realising the ambition for DHT to transform healthcare.
This fellowship project will address this challenge by developing and evaluating a programme theory and framework that brings together engineers, clinicians and healthcare organisations to design, implement and evaluate DHT interventions in the NHS, with the ultimate aim of increasing the success of DHT implementation in healthcare. These initial outputs will be developed and evaluated using stroke rehabilitation as a case example; by the end of the fellowship the validated programme theory, framework and associated tools will be ready for use to develop and evaluate DHT for use in other healthcare settings.
Tangible outputs include:
A. a programme theory, framework, tool-kit and road-map that describes the active ingredients and processes of DHT implementation and evaluation in healthcare
B. a critically evaluated and clearly articulated process to inform DHT co-design;
C. a co-designed DHT application (app) and intervention.
Based on a stakeholder analysis, the beneficiaries of this research are:
-Healthcare organisations: NHS Confederation, The King's Fund, The Health Foundation, commissioners and NHS trusts
-Funders of research: e.g. the NIHR and UKRI councils
-Policy influencers, makers and enactors: All Parliamentary Group on Stroke, NHS digital, NHSX, NICE, Department of Health and Social Care.
-Innovation industry: the local and national Innovation Agencies, digital technology companies, digital health groups
-Professional and training bodies and the staff they represent: Health Education England, NHS leadership academy, Chartered Society for Physiotherapy, Royal College of Occupational Therapists and Royal College of Nursing
-Patients: People after stroke, their carers and the bodies that represent them e.g. the Stroke Association.
The timed impact goals, with reference to the key outputs (listed above and denoted by the letter in brackets), are to:
Medium to long term (Phase 2 and beyond):
1. Support the innovation industry to produce DHT with high usability and acceptability by ensuring that the needs of users can be incorporated in their design. This will provide competitive advantages and economic benefits as products have a greater likelihood of being widely and sustainably used (B)
2. Use DHT to provide beneficial, supplementary rehabilitation for thousands of people after stroke in the UK and millions worldwide (A, C)
3. Enable professional bodies to plan and develop the healthcare workforce by describing the behaviors, resources and training required to use DHT and increase the workforce's experience and expertise in using DHT (A)
Long term (Phase 3,4 and beyond):
1. Empower policy-makers to realise their ambition of using DHT to revolutionise healthcare by enabling them to articulate the procedural processes of how DHT are designed, implemented and evaluated, ultimately increasing their use in clinical practice in the NHS and globally (A, B)
2. Support healthcare organisations to identify the factors in their service that influence the success of DHT implementation (A)
3. Produce time and cost savings by designing and managing DHT projects to actively reduce the risk of failure and enabling learning from failure by the innovation industry and healthcare organisations (A)
4. Facilitate research funders and innovation agencies to judiciously invest into DHT development and/or evaluation by enabling them to assess the stage of DHT development and readiness for successful implementation into healthcare settings (A).
This fellowship project will address this challenge by developing and evaluating a programme theory and framework that brings together engineers, clinicians and healthcare organisations to design, implement and evaluate DHT interventions in the NHS, with the ultimate aim of increasing the success of DHT implementation in healthcare. These initial outputs will be developed and evaluated using stroke rehabilitation as a case example; by the end of the fellowship the validated programme theory, framework and associated tools will be ready for use to develop and evaluate DHT for use in other healthcare settings.
Tangible outputs include:
A. a programme theory, framework, tool-kit and road-map that describes the active ingredients and processes of DHT implementation and evaluation in healthcare
B. a critically evaluated and clearly articulated process to inform DHT co-design;
C. a co-designed DHT application (app) and intervention.
Based on a stakeholder analysis, the beneficiaries of this research are:
-Healthcare organisations: NHS Confederation, The King's Fund, The Health Foundation, commissioners and NHS trusts
-Funders of research: e.g. the NIHR and UKRI councils
-Policy influencers, makers and enactors: All Parliamentary Group on Stroke, NHS digital, NHSX, NICE, Department of Health and Social Care.
-Innovation industry: the local and national Innovation Agencies, digital technology companies, digital health groups
-Professional and training bodies and the staff they represent: Health Education England, NHS leadership academy, Chartered Society for Physiotherapy, Royal College of Occupational Therapists and Royal College of Nursing
-Patients: People after stroke, their carers and the bodies that represent them e.g. the Stroke Association.
The timed impact goals, with reference to the key outputs (listed above and denoted by the letter in brackets), are to:
Medium to long term (Phase 2 and beyond):
1. Support the innovation industry to produce DHT with high usability and acceptability by ensuring that the needs of users can be incorporated in their design. This will provide competitive advantages and economic benefits as products have a greater likelihood of being widely and sustainably used (B)
2. Use DHT to provide beneficial, supplementary rehabilitation for thousands of people after stroke in the UK and millions worldwide (A, C)
3. Enable professional bodies to plan and develop the healthcare workforce by describing the behaviors, resources and training required to use DHT and increase the workforce's experience and expertise in using DHT (A)
Long term (Phase 3,4 and beyond):
1. Empower policy-makers to realise their ambition of using DHT to revolutionise healthcare by enabling them to articulate the procedural processes of how DHT are designed, implemented and evaluated, ultimately increasing their use in clinical practice in the NHS and globally (A, B)
2. Support healthcare organisations to identify the factors in their service that influence the success of DHT implementation (A)
3. Produce time and cost savings by designing and managing DHT projects to actively reduce the risk of failure and enabling learning from failure by the innovation industry and healthcare organisations (A)
4. Facilitate research funders and innovation agencies to judiciously invest into DHT development and/or evaluation by enabling them to assess the stage of DHT development and readiness for successful implementation into healthcare settings (A).
Organisations
- University of Lancashire (Lead Research Organisation)
- University of Nottingham (Collaboration)
- Newcastle University (Collaboration)
- UNIVERSITY COLLEGE LONDON HOSPITALS NHS FOUNDATION TRUST (Collaboration)
- Royal College of Art (Collaboration)
- University of Nottingham (Project Partner)
- Lancashire Teaching Hospitals NHS Foundation Trust (Project Partner)
- Johns Hopkins University (Project Partner)
Publications
Gooch HJ
(2024)
Behavior Change Approaches in Digital Technology-Based Physical Rehabilitation Interventions Following Stroke: Scoping Review.
in Journal of medical Internet research
Jarvis K
(2024)
Understanding the Barriers and Facilitators of Digital Health Technology (DHT) Implementation in Neurological Rehabilitation: An Integrative Systematic Review.
in Health services insights
Sheehan, K
(2021)
Toolkits to enable managers to support early career researchers
Stockley RC
(2023)
The importance of embracing complexity in rehabilitation.
in Journal of evaluation in clinical practice
Stockley RC
(2022)
Why complexity matters in physiotherapy research.
in Physiotherapy
| Description | Digital health technologies have a huge potential to change how we deliver healthcare in the NHS and can transform patient outcomes but often struggle to be adopted successfully into routine clinical practice. This study whihc is the first Phase of my UKRI FLF fellowship, sought to understand the barriers and facilitators to the adoption and continued use of digital health technologies in rehabilitation in the NHS. To do this, we spoke to a range of people who are involved in process of building, selecting, buying and using DHT in 10 NHS sites across England, Wales and Scotland. We undertook 48 interviews with people who have used technologies (clinicians and service users*), those who developed technologies for rehabilitation, people within the organisation that support and regulate technology use (information technology and governance) and people that lead and manage NHS and innovation services (organisational leaders and innovation teams). We analysed what they said and identified common experiences and opinions. We then used evidence from other research and our own reviews to develop a model - called the RiTe model - which comprised the key areas that influence the implementation of DHT into rehabilitation. We identified five areas that were important to DHT implementation. They were: The evidence, The team who will use DHT, the Users (including both clinical staff and service users), The technology being implemented and the Organisation. All were important to enable successful implementation. We have shared our findings with clinical and academic audiences and are now working with different groups to develop tailored resources based on these five areas. This will ensure that this work helps service users, clinicians, organisational leaders and digital developers can help ensure that promising technologies can get into clinical practice quickly and so benefit the people who need them as part of their rehabilitation. These resources will be housed on the study website and available for free at www.advancingrehab.com |
| Exploitation Route | The RiTe model will be available to use to guide, support and enable staff who want to adopt technologies into practice. By highlighting the important factors that influence the success of adoption, we anticipate that teh RiTe model will improve the process of adoption, and ultimately patient outcomes. |
| Sectors | Healthcare |
| URL | http://www.advancingrehab.com |
| Description | Development of the Rehabilitation Technologies Implementation (RiTe) Model |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Contribution to new or improved professional practice |
| Description | Sharing knowledge and resources on mental practice for the upper limb after stroke |
| Geographic Reach | Multiple continents/international |
| Policy Influence Type | Contribution to new or improved professional practice |
| Description | MEntal practice for the RehabIliTation of the upper limb in acute Stroke: a feasibility randomised controlled trial with process evaluation (MERITS) |
| Amount | £298,688 (GBP) |
| Funding ID | NIHR208158 |
| Organisation | National Institute for Health and Care Research |
| Sector | Public |
| Country | United Kingdom |
| Start | 09/2025 |
| End | 09/2027 |
| Description | NIHR HTA Development Scheme |
| Amount | £96,030 (GBP) |
| Funding ID | NIHR153944 |
| Organisation | National Institute for Health and Care Research |
| Sector | Public |
| Country | United Kingdom |
| Start | 02/2024 |
| End | 07/2025 |
| Description | Evaluating reticulospinal plasticity in neural circuits post stroke |
| Organisation | Newcastle University |
| Department | Newcastle University Medical School |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | This project seeks to evaluate reticulospinal plasticity in neural circuits from a novel wearable treatment ('PowerBead') as a potential method for regaining finger extension post-stroke. My role is to provide insights and advice on the clinical elements of this potential product, methodological advice and ensure that the experiences of people after stroke and those that care for them are heard in the research process. |
| Collaborator Contribution | Collaborators are overseeing the day to day running of the project including recruitment, collecting data and undertaking analysis. |
| Impact | None yet |
| Start Year | 2025 |
| Description | Evaluating reticulospinal plasticity in neural circuits post stroke |
| Organisation | Royal College of Art |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | This project seeks to evaluate reticulospinal plasticity in neural circuits from a novel wearable treatment ('PowerBead') as a potential method for regaining finger extension post-stroke. My role is to provide insights and advice on the clinical elements of this potential product, methodological advice and ensure that the experiences of people after stroke and those that care for them are heard in the research process. |
| Collaborator Contribution | Collaborators are overseeing the day to day running of the project including recruitment, collecting data and undertaking analysis. |
| Impact | None yet |
| Start Year | 2025 |
| Description | Evaluating reticulospinal plasticity in neural circuits post stroke |
| Organisation | University College London Hospitals NHS Foundation Trust |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | This project seeks to evaluate reticulospinal plasticity in neural circuits from a novel wearable treatment ('PowerBead') as a potential method for regaining finger extension post-stroke. My role is to provide insights and advice on the clinical elements of this potential product, methodological advice and ensure that the experiences of people after stroke and those that care for them are heard in the research process. |
| Collaborator Contribution | Collaborators are overseeing the day to day running of the project including recruitment, collecting data and undertaking analysis. |
| Impact | None yet |
| Start Year | 2025 |
| Description | TELSTAR |
| Organisation | University of Nottingham |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | I am a co-applicant on a Stroke Association funded bid looking at a realist evaluation of telerehabilitation in stroke rehabilitation. I contribute knowledge of technology adoption in rehabilitation, whilst I will gain a deeper understanding of challenges and facilitators to using technologies in practice that can be incorporated into our outputs. |
| Collaborator Contribution | The team will carry out day to day running of the project, including data collection and initial analysis. |
| Impact | No outputs as only commenced in December 2023. It is a multi-disciplinary project comprising health care clinicans, policy leads from NHS England and academic researchers. |
| Start Year | 2023 |
| Title | MyArm |
| Description | The MyArm application is a codesigned product that delivers mental practice for the self management of the upper limb after stroke. It comprises verbal scripts, recorded in different languages, which people after stroke can listen to to instruct them to imagine performing a movement of their arm. Our previous work has shown mental practice to be beneficial to the recovery of the arm and so, by enabling people to use this alone, the app may enable self management. The content, look and feel of the app has been co-designed with stroke survivors and clinicians to be optimally usable and practical and is, to our knowledge, the only app that delivers this type of intervention. |
| Type Of Technology | Webtool/Application |
| Year Produced | 2025 |
| Impact | None yet. |
