📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

DeepGeM: Deep Generative Modelling for Understanding Cardiac Anatomy and Function from Large-Scale Imaging Datasets

Lead Research Organisation: Imperial College London
Department Name: Brain Sciences

Abstract

Cardiovascular disease is the leading cause of death globally. Structural and functional parameters derived from cardiac imaging data provide important indicators for diagnosing and managing cardiovascular disease. However, most of these parameters, such as the chamber volumes of the heart, only focus on the global description of its anatomy. Detailed analysis of the 3D-t (or 4D) cardiac anatomical data is often ignored in diagnosis due to the complexity of high-dimensional data modelling. This hinders our understanding of cardiac anatomy and function, as well as their longitudinal evolution in ageing and disease progression.

The ambition of this project is to develop a fundamentally new approach for analysing 4D cardiac imaging data to understand both the anatomy and function. We will develop novel generative machine learning methods for modelling the variations of cardiac anatomy among different people and across time. The generative machine learning model will be trained using large-scale cardiac imaging datasets. By combining both cardiac imaging data and non-imaging clinical data, the model will learn not only the spatio-temporal variations of cardiac anatomy but also how clinical factors influence the anatomy and function. We will demonstrate the clinical usefulness of the model in two tasks, namely to understand the cardiac anatomy in different groups of people and to predict the longitudinal change of cardiac anatomy and function. The ability to predict the cardiac anatomy and function in the future will potentially provide cardiologists with new tools for managing cardiac patients in personalised healthcare.

Publications

10 25 50
 
Description In this project, we developed a novel computational method for understanding information encoded in the images of the heart. The method is conditional generative model that can learn the complicated distribution of both the shape and motion of the heart, and understand how certain clinical factors (e.g. demographics, blood pressure etc) influence the heart shape and motion. From the generative model, we can extract useful features describing the heart, known as the latent features. The latent features provide discriminative values for cardiac disease classification, i.e. they can be used for classifying and predicting the status of heart health status. We have released the software for the developed computational method on GitHub (https://github.com/MengyunQ/CHeart), which push further research in this area. We have also collaborated with clinical researchers from Hammersmith Hospital, Imperial College London, using the software to generate digital heart models for clinical research. We have published the research outcomes in prominent medical imaging journals such as IEEE Transactions on Medical Imaging, and with a submission under review at Nature Machine Intelligence, a high-impact journal in the field. Built upon the project, we have started a follow-up research programme, CVD-Net, which aims to utilise digital heart models and computational models for predicting outcomes of pulmonary hypertension disease.
Exploitation Route The methods and software developed in this project can be taken forward to build digital models to describe the shape and motion of the heart, and to facilitate disease classification and prediction in clinical research. For the follow-up research programme, CVD-Net, we are looking at how such digital heart models can improve the understanding and outcome prediction for a particular kind of diseases, pulmonary hypertension disease.
Sectors Digital/Communication/Information Technologies (including Software)

Healthcare

 
Description Networks of Cardiovascular Digital Twins (CVD-Net)
Amount £8,844,328 (GBP)
Funding ID EP/Z531297/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2024 
End 09/2029
 
Description Population-level dynamic shape modelling of the whole heart
Amount £238,984 (GBP)
Funding ID NH/F/23/70013 
Organisation British Heart Foundation (BHF) 
Sector Charity/Non Profit
Country United Kingdom
Start 09/2024 
End 10/2027
 
Title A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy 
Description Given conditions such as gender, age etc, the model can generate a 3D-temporal cardiac anatomy or segmentation map that is associated with the conditions. 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? Yes  
Impact The GitHub repository contains the code of the generative model, which accompanies the paper titled, CHeart: A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy, published at the journal IEEE Transactions on Medical Imaging. 
URL https://github.com/MengyunQ/CHeart