📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

MCPS-VeriSec: Model-based Security of Medical Cyber-Physical Systems

Lead Research Organisation: King's College London
Department Name: Informatics

Abstract

Medical conditions requiring treatment via implantable and wearable devices are becoming increasingly prevalent in the UK and worldwide. Examples include arrhythmia treatment with cardiac devices and glucose regulation in diabetes with artificial pancreas systems. Such devices have experienced dramatic technological advancements, evolving into complex computing systems - which we call medical cyber-physical systems (medCPSs) - that include control algorithms for automated therapy delivery as well as internet connectivity for remote patient monitoring and communication with smart devices and clinical systems.

The complexity of medCPSs introduces broad attack surfaces that can jeopardize patient safety. This is exacerbated by the rapid adoption of machine learning (ML) to aid therapy decisions, which are particularly susceptible to stealthy adversarial inputs.

Prior work on medCPS security has mainly focused on the practical feasibility of the attacks (e.g., how to use a radio transmitter to reconfigure the device), resulting in simple, easy to detect, attacks (such as suspending therapy). This leads us to ask whether more sophisticated attacks can be derived that, for instance, are stealthier or better tailored to the target patient. Our aim is to investigate these and other previously unexplored dimensions in medCPS security.

In MCPS-VeriSec we propose to develop a framework to provide verified defence mechanisms against stealthy attacks on medCPSs, sensor spoofing attacks specifically. We will take a model-based approach to enable systematic exploration of the attack space and safety threats. In particular, we will focus on the following directions:
- Pareto-optimal attacks and defences. There is a natural trade-off between attack effectiveness (i.e., how much it disrupts the intended therapy) and stealthiness (how hard it is to detect). MCPS-VeriSec will enable automated synthesis of Pareto-optimal attacks (i.e., for which said trade-off is optimal) and corresponding defences. This can be viewed as a multi-objective (MO) two-player game, which we will solve by introducing a novel MO variant of generative adversarial nets.
- Defense mechanisms. We will consider two coordinated defences, designed to respectively detect and mitigate malicious signal perturbations.
- Verified defences. We propose to apply formal verification to certify the safety probability of the defences, using the verification results to retrain and enhance the defences. In particular, we will introduce the first probabilistic verification method of its kind to support reasoning about causal effects, which we will use to precisely assess the effectiveness of the defences w.r.t. the no-attack condition.
- Personalization. We will derive personalized attacks and defences by incorporating information about the victim's physiological state and medical device into the medCPS model used for synthesis. Leveraging our model-based approach, we will explore a range of adversary capabilities, from white-box attacks (synthesized using models with full and accurate information about the victim) to black-box attacks (using surrogate or uncertain models).

We will apply our approach to two of the most prevalent medCPSs: ICDs (Implantable Cardioverter Defibrillators) for cardiac arrhythmia treatment and artificial pancreas control algorithms for insulin therapy. For each case study, we will compare the robustness to adversarial attacks of traditional (non-ML) device controllers against ML-based ones.

MCPS-VeriSec will be the first in the medical context to investigate Pareto attacks, victim personalization, ML vulnerabilities, and formally verified defenses, thereby targeting the soon-to-come generation of connected and ML-enabled medical devices. The novel synthesis and verification methods resulting from this project will be highly relevant not just for medical applications, but for the field of model-based CPS security in general.

Related Projects

Project Reference Relationship Related To Start End Award Value
EP/W014785/1 30/06/2022 30/08/2022 £424,397
EP/W014785/2 Transfer EP/W014785/1 29/09/2022 31/12/2025 £424,397
 
Title Assume-Guarantee Reinforcement Learning 
Description An approach based on the assume-guarantee paradigm where the optimal control for the individual components of a complex environment is synthesized in isolation by making assumptions about the behaviors of neighboring components, and providing guarantees about their behavior. 
Type Of Material Computer model/algorithm 
Year Produced 2024 
Provided To Others? Yes  
Impact N/A 
URL https://zenodo.org/records/10377136
 
Title BioForge 
Description An approach that leverages a cycle-consistent generative adversarial network to synthesize realistic physiological signals for a given user without relying on simultaneously collected supervision data. The approach is used to demonstrate vulnerabilities of authentication systems based on cardiovascular biosignals. 
Type Of Material Computer model/algorithm 
Year Produced 2024 
Provided To Others? Yes  
Impact N/A 
URL https://github.com/Ethos-lab/biosignal-auth-harmful
 
Title Certified Guidance 
Description An algorithm to certify deep generative models used for planning tasks. The algorithm identifies sub-regions of the latent space of the model such that the resulting generative model has 100% probability of satisfying some temporal logic property of interest. 
Type Of Material Computer model/algorithm 
Year Produced 2025 
Provided To Others? Yes  
Impact none 
URL https://arxiv.org/pdf/2501.12815
 
Title Counterfactual Influence 
Description When counterfactual paths deviate from observed ones, observations don't inform the counterfactual world any longer (i.e., counterfactuals reduce to interventions). This happens for the popular Gumbel-max structural causal models used for Markov Decision Processes (MDPs). Our approach derives counterfactual policies that are both optimal and are guaranteed to remain "under the influence of observations". 
Type Of Material Computer model/algorithm 
Year Produced 2024 
Provided To Others? No  
Impact N/A 
URL https://github.com/ddv-lab/counterfactual-influence-in-MDPs
 
Title InjectICD 
Description model-based framework for the systematic construction of stealthy signal-injection attacks that can thwart ICD control software 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? No  
Impact N/A 
URL https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10002343
 
Title MA-COPP 
Description A method for reliable off-policy prediction in high-dimensional settings characterized by multiple interacting agents and long prediction horizons 
Type Of Material Computer model/algorithm 
Year Produced 2024 
Provided To Others? Yes  
Impact none 
URL https://arxiv.org/pdf/2403.16871v2
 
Title Probabilistic CounterFactual Temporal Logic (PCFTL) 
Description A new probabilistic temporal logic (and corresponding decision procedures) for the verification of Markov Decision Processes (MDP). PCFTL is the first to include operators for causal reasoning, allowing us to express interventional and counterfactual queries. 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? No  
Impact N/A 
URL https://doi.org/10.1017/cbp.2025.2
 
Title Sim_ICD 
Description A framework for closed-loop simulation of ICD therapy, integrating advanced PDE-based cardiac electrophysiology models with virtual models of implantable cardiac devices 
Type Of Material Computer model/algorithm 
Year Produced 2025 
Provided To Others? Yes  
Impact none 
URL https://github.com/janet-9/SimICD
 
Description Collaboration with Dr Bishop, School of Biomedical Engineering & Imaging Sciences, King's College London 
Organisation King's College London
Country United Kingdom 
Sector Academic/University 
PI Contribution PhD student in my team is developing methods for closed-loop simulation and optimization of ICD therapy (See Sim_ICD under `models' category)
Collaborator Contribution Providing support and training on PDE models for cardiac electrophysiology
Impact 1 submitted paper. 1 code library
Start Year 2023
 
Description Collaboration with Dr Francesca Cairoli 
Organisation University of Trieste
Country Italy 
Sector Academic/University 
PI Contribution Worked on a method for the certification of deep generative models used in planning tasks. Contributions: idea conception, method design, experiment design, paper writing
Collaborator Contribution Worked on a method for the certification of deep generative models used in planning tasks. Contributions: method design and development, experiment design and execution, paper writing
Impact 1 paper accepted
Start Year 2024
 
Description Collaboration with Dr Rahmati, Department of Computer Science, Stony Brook University 
Organisation Stony Brook University
Country United States 
Sector Academic/University 
PI Contribution We are actively collaborating on research on the security of cardiac devices and biometrics. We have developed a method for deriving stealthy signal injection attacks, published in the IEEE Access journal. We have studied vulnerabilities of biosignal-based authentication deriving cross-context attacks (using generative models) that successfully fool a variety of authentication systems based on cardiovascular signals (e.g., ECG, PPG).
Collaborator Contribution We are actively collaborating on research on the security of cardiac devices and biometrics. We have developed a method for deriving stealthy signal injection attacks, published in the IEEE Access journal. We have studied vulnerabilities of biosignal-based authentication deriving cross-context attacks (using generative models) that successfully fool a variety of authentication systems based on cardiovascular signals (e.g., ECG, PPG).
Impact 2 papers published
Start Year 2022
 
Description Collaboration with Prof Lo Muscio 
Organisation Imperial College London
Country United Kingdom 
Sector Academic/University 
PI Contribution Collaborated on methods for the verification of neural agents and for uncertainty-aware explainability Contributions: idea conception, method design and development, experiment design and execution, paper writing
Collaborator Contribution Collaborated on methods for the verification of neural agents and for uncertainty-aware explainability Contributions: idea conception, method design and development, experiment design and execution, paper writing
Impact 1 paper published, 1 paper submitted
Start Year 2023
 
Description Collaboration with Prof Mangharam, Department of Electrical and Systems Engineering, University of Pennsylvania 
Organisation University of Pennsylvania
Country United States 
Sector Academic/University 
PI Contribution Our team conceived the idea, designed and implemented the method, designed and performed experiments, wrote accompanying research paper and presented this at a conference
Collaborator Contribution Our partner's team contributed to the design and implementation of the method and experiments, contribute to writing accompanying research paper and presented this at a conference
Impact 1 published paper
Start Year 2023