DeepGeM: Deep Generative Modelling for Understanding Cardiac Anatomy and Function from Large-Scale Imaging Datasets
Lead Research Organisation:
Imperial College London
Department Name: Brain Sciences
Abstract
Cardiovascular disease is the leading cause of death globally. Structural and functional parameters derived from cardiac imaging data provide important indicators for diagnosing and managing cardiovascular disease. However, most of these parameters, such as the chamber volumes of the heart, only focus on the global description of its anatomy. Detailed analysis of the 3D-t (or 4D) cardiac anatomical data is often ignored in diagnosis due to the complexity of high-dimensional data modelling. This hinders our understanding of cardiac anatomy and function, as well as their longitudinal evolution in ageing and disease progression.
The ambition of this project is to develop a fundamentally new approach for analysing 4D cardiac imaging data to understand both the anatomy and function. We will develop novel generative machine learning methods for modelling the variations of cardiac anatomy among different people and across time. The generative machine learning model will be trained using large-scale cardiac imaging datasets. By combining both cardiac imaging data and non-imaging clinical data, the model will learn not only the spatio-temporal variations of cardiac anatomy but also how clinical factors influence the anatomy and function. We will demonstrate the clinical usefulness of the model in two tasks, namely to understand the cardiac anatomy in different groups of people and to predict the longitudinal change of cardiac anatomy and function. The ability to predict the cardiac anatomy and function in the future will potentially provide cardiologists with new tools for managing cardiac patients in personalised healthcare.
The ambition of this project is to develop a fundamentally new approach for analysing 4D cardiac imaging data to understand both the anatomy and function. We will develop novel generative machine learning methods for modelling the variations of cardiac anatomy among different people and across time. The generative machine learning model will be trained using large-scale cardiac imaging datasets. By combining both cardiac imaging data and non-imaging clinical data, the model will learn not only the spatio-temporal variations of cardiac anatomy but also how clinical factors influence the anatomy and function. We will demonstrate the clinical usefulness of the model in two tasks, namely to understand the cardiac anatomy in different groups of people and to predict the longitudinal change of cardiac anatomy and function. The ability to predict the cardiac anatomy and function in the future will potentially provide cardiologists with new tools for managing cardiac patients in personalised healthcare.
Organisations
Publications
Bai W
(2025)
Brain Imaging and Phenotyping for the China Phenobank Project
in Phenomics
Chen C
(2022)
Enhancing MR image segmentation with realistic adversarial data augmentation.
in Medical image analysis
Curran L
(2023)
Genotype-Phenotype Taxonomy of Hypertrophic Cardiomyopathy
in Circulation: Genomic and Precision Medicine
Liu C
(2025)
IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-Training
in IEEE Transactions on Medical Imaging
McGurk K
(2024)
Genetic and phenotypic architecture of human myocardial trabeculation
in Nature Cardiovascular Research
Meng Q
(2022)
MulViMotion: Shape-Aware 3D Myocardial Motion Tracking From Multi-View Cardiac MRI.
in IEEE transactions on medical imaging
| Description | In this project, we developed a novel computational method for understanding information encoded in the images of the heart. The method is conditional generative model that can learn the complicated distribution of both the shape and motion of the heart, and understand how certain clinical factors (e.g. demographics, blood pressure etc) influence the heart shape and motion. From the generative model, we can extract useful features describing the heart, known as the latent features. The latent features provide discriminative values for cardiac disease classification, i.e. they can be used for classifying and predicting the status of heart health status. We have released the software for the developed computational method on GitHub (https://github.com/MengyunQ/CHeart), which push further research in this area. We have also collaborated with clinical researchers from Hammersmith Hospital, Imperial College London, using the software to generate digital heart models for clinical research. We have published the research outcomes in prominent medical imaging journals such as IEEE Transactions on Medical Imaging, and with a submission under review at Nature Machine Intelligence, a high-impact journal in the field. Built upon the project, we have started a follow-up research programme, CVD-Net, which aims to utilise digital heart models and computational models for predicting outcomes of pulmonary hypertension disease. |
| Exploitation Route | The methods and software developed in this project can be taken forward to build digital models to describe the shape and motion of the heart, and to facilitate disease classification and prediction in clinical research. For the follow-up research programme, CVD-Net, we are looking at how such digital heart models can improve the understanding and outcome prediction for a particular kind of diseases, pulmonary hypertension disease. |
| Sectors | Digital/Communication/Information Technologies (including Software) Healthcare |
| Description | Networks of Cardiovascular Digital Twins (CVD-Net) |
| Amount | £8,844,328 (GBP) |
| Funding ID | EP/Z531297/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 09/2024 |
| End | 09/2029 |
| Description | Population-level dynamic shape modelling of the whole heart |
| Amount | £238,984 (GBP) |
| Funding ID | NH/F/23/70013 |
| Organisation | British Heart Foundation (BHF) |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 09/2024 |
| End | 10/2027 |
| Title | A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy |
| Description | Given conditions such as gender, age etc, the model can generate a 3D-temporal cardiac anatomy or segmentation map that is associated with the conditions. |
| Type Of Material | Computer model/algorithm |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | The GitHub repository contains the code of the generative model, which accompanies the paper titled, CHeart: A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy, published at the journal IEEE Transactions on Medical Imaging. |
| URL | https://github.com/MengyunQ/CHeart |
