CHI+MED: Multidisciplinary Computer-Human Interaction research for the design and safe use of interactive medical devices
Lead Research Organisation:
University College London
Department Name: UCL Interaction Centre
Abstract
Patient safety is a major concern. Reliance on interactive medical devices is growing, both in clinical settings and, increasingly, for patients without direct clinical supervision. The usability and reliability of such devices is critical. For example, decimal points are a well-known source of error (e.g., .5mg misread as 5mg), yet few devices detect decimal keying errors. Considering the broader context of use, a nurse familiar with one kind of infusion pump may absent-mindedly use the same set-up procedure on a similar one, leading to incorrect dosage. These and other user programming errors cause patient deaths. Even when devices are programmed correctly, interaction difficulties raise workload and stress, increasing overall system vulnerability. For example, it is common for clinicians to turn pumps off and on to reset the state, but patient data may be lost in the process and need to be re-entered. Better interaction design, the focus of CHI+MED, will improve safety by a scientific approach to understanding and designing out latent errors. It will have very broad impact because interactive systems are encroaching everywhere in healthcare. CHI+MED complements other initiatives on the ergonomics and engineering of safer devices.CHI+MED is multidisciplinary. A combination of empirical approaches, drawn from the disciplines of HCI, computer science, psychology and the social sciences, will be applied. Empirical findings will build on, be subjected to, and be challenged by precise computational representation and reasoning. This will support integration across perspectives and generalisation of findings, as well as enforcing a distinctive rigour in all aspects of analysis. The CHI+MED approach will advance, and transform, the science of user-device interactions and the design of interactive medical devices.We will investigate which device properties are most important from safety and usability perspectives (relating to whether adverse incidents can occur, whether there are unsafe inconsistencies between device behaviours under similar conditions, etc.), and which system descriptions best support reasoning about them. We will study the causes of errors when interacting with devices and how a better science of error can improve design. This will include factors affecting slips such as stress, attention, task structure and the design of cues and feedback. We will also study the broader situational factors that provoke or mitigate interaction errors (interruptions may provoke errors; colleagues checking may mitigate them, etc.). CHI+MED will deliver a significantly better understanding of interaction design and associated cognitive and situational factors, new tools to support design and evaluation, underlying better informed standards and incident investigations, and more resilient practices.As well as addressing new scientific questions that generalise beyond the medical domain, CHI+MED will develop a dialogue with stakeholders, to raise awareness of the role of interaction design in medical errors and to develop evidence-based techniques for designing medical devices that mitigate potential errors while accommodating the cultures and processes of stakeholder groups. It will draw on research in Public Engagement and Knowledge Transfer, and explore the appropriateness and effectiveness of different approaches for different contexts. We will investigate how informed principles and tools can help developers to design more reliable and usable devices, identify factors that influence design and procurement decisions, and explore how stakeholders can be better informed about interaction design.CHI+MED involves and integrates three leading groups on a single, focused problem. It will contribute to the UK's status as an international leader in research in multidisciplinary, rigorous HCI, and make significant and informed contributions to the international agenda on design for patient safety.
Publications

Abigail Cauchi (Co-Author)
(2011)
Towards dependable number entry for medical devices

Aceves C
(2013)
Are prescribed infusions running as intended? Quantitative analysis of log files from infusion pumps used in a large acute NHS hospital
in British Journal of Nursing

Alsaeed D
(2018)
Carers' experiences of home enteral feeding: A survey exploring medicines administration challenges and strategies.
in Journal of clinical pharmacy and therapeutics

Ament M
(2011)
Frankenstein and human error

Ament MG
(2013)
Making a task difficult: evidence that device-oriented steps are effortful and error-prone.
in Journal of experimental psychology. Applied

Ann Blandford (Author)
(2010)
When I get older: Interaction design for medical devices
in Interfaces

Ann Blandford (Co-Author)
(2011)
The biggest challenges are the social ones: Workshop report from EICS4Med 2011


Ann Blandford (Co-Author)
(2011)
Comparing actual practice and user manuals: A case study based on programmable infusion pumps

Ann Blandford (Co-Author)
(2010)
Who's looking? Invisible problems with interactive medical devices
Title | HCI engineering: Upfront effort and downstream payback |
Description | [An abstract of this video is published in: Proceedings of the 2013 Conference on Human Factors in Computing Systems (CHI-2013), Extended Abstracts, 2807. New York: ACM. (Video showcase abstract.) Also available at http://www.chi-med.ac.uk/researchers/bibdetail.php?docID=648. In an age where HCI research is embracing softer approaches, we must not neglect the practical value of engineering research for HCI. This video challenges the assumption that engineering interactive systems takes a lot of effort with little pay-back or reward. We take CANCEL as an example. Not many people think about the challenges of implementing CANCEL effectively even though CANCEL buttons pervade modern life. Adding CANCEL is not just about adding a button: the processes behind the button needs to work, accurately, reliably, and in a timely way. Engineering research for HCI combines science, guidance and tools to make better products faster. In one study a company measured their return on investment as high as 17 to 1. This video provokes debate about the importance of engineering for HCI. |
Type Of Art | Image |
Description | This project studied the use, usability and safety of interactive medical devices. These include infusion devices for delivering drugs and fluids intravenously, machines used to support people with chronic kidney disease, and measuring devices used by people with diabetes. We have developed methods for assessing the user interfaces, and also ways of better understanding the needs of people using these devices. |
Exploitation Route | This work is of immediate relevance to people concerned with patient safety, particularly in relation to the use of interactive medical devices (such as infusion devices and haemodialysis machines). This includes clinicians, those involved in health policy, those responsible for procurement of new equipment, and also design and development teams working on the next generation of interactive medical devices. See http://www.chi-med.ac.uk/insights/index.php for a summary of the outcomes from the programme. We have produced a collection of resources for health services professionals, including developers, policy makers, and those involved in procurement, focusing on infusion technology. See http://www.chi-med.ac.uk/research/industrypublications.php |
Sectors | Digital/Communication/Information Technologies (including Software),Healthcare |
URL | http://www.chi-med.ac.uk/ |
Description | The findings are being used for checking the safety of current and future medical devices and have informed MHRA policy on human factors for medical devices (https://www.gov.uk/government/publications/guidance-on-applying-human-factors-to-medical-devices). Our methodological work is advancing methods for identifying user needs for future devices. Results from the follow-on study (NIHR-funded) have been widely discussed and are informing national policy on the adoption of smart infusion pumps in the NHS. CHI+MED findings have featured in a recent text by Harold Thimbleby: "Fix IT: See and solve the problems of digital healthcare" (https://oxford.universitypressscholarship.com/view/10.1093/oso/9780198861270.001.0001/oso-9780198861270). |
First Year Of Impact | 2013 |
Sector | Digital/Communication/Information Technologies (including Software),Healthcare |
Impact Types | Societal,Policy & public services |
Description | MHRA Keynote talk |
Geographic Reach | National |
Policy Influence Type | Contribution to a national consultation/review |
Impact | The outcomes of that meeting have included the establishment of a Task and Finish Group (on which I now serve) to review the role of human factors in medical device regulation. |
Description | MHRA Task & Finish group on Human Factors in device regulations |
Geographic Reach | National |
Policy Influence Type | Membership of a guideline committee |
Description | CareErrs (Furniss) |
Amount | £2,000 (GBP) |
Organisation | University College London |
Sector | Academic/University |
Country | United Kingdom |
Start | 05/2014 |
End | 06/2015 |
Description | Exploring the Current Landscape of Intravenous Infusion Practices and Errors (ECLIPSE) |
Amount | £556,803 (GBP) |
Funding ID | 12/209/27 |
Organisation | National Institute for Health Research |
Sector | Public |
Country | United Kingdom |
Start | 06/2014 |
End | 06/2017 |
Description | FP7 - TACTIC |
Amount | £242,552 (GBP) |
Organisation | European Commission |
Sector | Public |
Country | European Union (EU) |
Start | 05/2014 |
End | 10/2017 |
Description | PAMBAYESIAN |
Amount | £1,538,497 (GBP) |
Funding ID | EP/P009964/1 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 04/2017 |
End | 04/2020 |
Description | Travel Award (Blandford) |
Amount | £6,000 (GBP) |
Organisation | The Royal Society |
Sector | Charity/Non Profit |
Country | United Kingdom |
Start | 02/2013 |
End | 02/2014 |
Description | FDA |
Organisation | Food and Drug Administration (FDA) |
Department | Center for Devices and Radiological Health |
Country | United States |
Sector | Public |
PI Contribution | Applying research findings to regulatory policy in interaction design of medical devices. |
Collaborator Contribution | Ensuring practical relevance of research findings. |
Impact | A joint publication (listed elsewhere). Formal methods & Human-Computer Interaction |
Start Year | 2010 |
Description | MHRA |
Organisation | Medicines and Healthcare Regulatory Agency |
Country | United Kingdom |
Sector | Public |
PI Contribution | Advising on human factors for medical device design, contributing to MHRA consultation meetings on this topic, and contributing to the authoring of MHRA guidance on human factors for medical devices (currently in draft form). |
Collaborator Contribution | Facilitating the impact of research on practice in medical device regulation. |
Impact | Report still at draft stage. |
Start Year | 2015 |
Description | NHS England |
Organisation | NHS England |
Country | United Kingdom |
Sector | Public |
PI Contribution | New interpretations of NRLS data to inform future incident reporting. |
Collaborator Contribution | Data sharing agreement giving access to NRLS incident data to complement other data sources informing research |
Impact | Ongoing. HCI and Pharmacy |
Start Year | 2014 |
Description | Acharya magazine article |
Form Of Engagement Activity | A magazine, newsletter or online publication |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | Publication in (members-only) magazine of British Academy of Audiology: Hearing aid battery ingestion: Medical error or poor design? Authors: Chitra Acharya, Vinaya K. C. Manchaiah, Alexis Lewis, and Harold Thimbleby Summer 2014, 31, 27-28 |
Year(s) Of Engagement Activity | 2014 |
Description | Errordiary |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | Yes |
Geographic Reach | National |
Primary Audience | Public/other audiences |
Results and Impact | Errordiary is about sharing errors so people can think about human error in a new way. We already know that the same psychological principles lie behind everyday errors and those errors of a more serious nature. Whether they are funny, frustrating or fatal depends on the context. Whatever context you find yourself in you can share your errors via Twitter. You can also favourite and comment on the ones already displayed on this site. Reflecting on the errors we make may lead to insights, which can be used to develop a more detailed understanding of their causes. |
Year(s) Of Engagement Activity | 2010,2011,2012 |
URL | http://www.errordiary.org/ |
Description | Final report "glossy" |
Form Of Engagement Activity | A magazine, newsletter or online publication |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | This booklet summarises the key outcomes from the CHI+MED programme grant, as realised in its final year. It is too early to assess significant impact of the booklet, but a range of practitioners have received it and requested copies. |
Year(s) Of Engagement Activity | 2016 |
URL | http://www.chi-med.ac.uk/insights/index.php |
Description | Magic of HCI |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Schools |
Results and Impact | A school talk on Human Computer Interaction on Healthcare using examples from Curzon's research projects and building on the approach developed on the cs4fn project. |
Year(s) Of Engagement Activity | 2018,2019 |
Description | NHS England / MHRA symposium for Medication Safety Officers and Medical Device Safety Officers (MSOs / MDSOs) |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | This is one of a series of interactive presentations to obtain feedback on preliminary findings from ECLIPSE and build dialogue with key practitioners. Also presented findings from CHI+MED study of NRLS incident reports. |
Year(s) Of Engagement Activity | 2017 |
Description | Standing up for science |
Form Of Engagement Activity | A magazine, newsletter or online publication |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other academic audiences (collaborators, peers etc.) |
Results and Impact | Performing stand up comedy has allowed me to share my work with people who otherwise I'd never have had a chance to talk to. I'd recommend the experience to anyone who wants to improve their presentation skills, or get more involved in public engagement. tbc |
Year(s) Of Engagement Activity | 2013 |
URL | http://www.chi-med.ac.uk/researchers/bibdetail.php?docID=695 |
Description | Trends talk for TATA |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Industry/Business |
Results and Impact | Gave an online talk on Trends in HCI and Healthcare as part of their trends series with both a live audience (with Q&A session) and video archived for others to watch. |
Year(s) Of Engagement Activity | 2019 |
Description | cs4fn magazine - Machines making medicine safer |
Form Of Engagement Activity | A magazine, newsletter or online publication |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Schools |
Results and Impact | cs4fn is an outreach magazine which aims to enthuse school age children about computing. Issue 17 was specifically about the CHI+MED project and how computer scientists work with ergonomists and human factors researchers to make interactive medical devices safer. The electronic copy has been downloaded over 6,000 times and around 14,000 print copies were sent (as class sets) to schools and given away at events (science festivals and fairs etc). Most of the feedback is from teachers who tell us that they use articles in the magazine in their classroom for discussion, or leave copies in the library for pupils to read. We've been asked to send copies in bulk to events at Microsoft Research Ltd, TeenTech and the Computing At Schools conference. |
Year(s) Of Engagement Activity | 2014 |
URL | http://chimedblog.wordpress.com/2014/04/03/machines-making-medicine-safer-chi_med-joins-forces-with-... |