Self-driving MRI

Lead Research Organisation: King's College London
Department Name: Imaging & Biomedical Engineering

Abstract

Chronic diseases such as hypertension, obesity and diabetes are rising steeply and increasingly individuals suffer from multiple conditions (comorbidities) - the treatment of the 15 million people in the UK accounts for 70% of inpatients in the NHS. The coexistence of several diseases makes diagnosis and treatment challenging, as they interact, hiding typical features or giving rise to additional pathologies. As a consequence, personalized diagnosis and treatment are becoming ever more important.

Similarly, pregnant women are increasingly affected by comorbidities, which contribute to major pregnancy complications. The success of care options such as planned delivery, medication and surgeries during pregnancy depends largely on personalized early diagnosis.

Fetal Magnetic Resonance Imaging (MRI) is a safe non-invasive imaging modality. It is perhaps the ultimate example where personalised examination is needed since both mother and baby routinely experience transient phenomena such as uterine contractions and sporadic exercising of the fetal chest muscles to train breathing.

MRI can produce images in any plane through the body with diverse contrasts reflecting different processes such as slow blood flow or oxygen concentration. Despite this flexibility, current fetal MRI examinations are surprisingly rigid in structure. The images are acquired in a predefined order, much of the time is spent inefficiently "chasing the baby" and repeating scans, all designed to present a static picture of an intrinsically dynamic situation. However, the way the baby moves, the frequency with which they 'breath' and the way they react to contractions can all provide information predictive of pregnancy outcome.

My project proposes a paradigm change, that turns MRI into a responsive, self-driving examination that embraces subject diversity and unpredictable processes to extract the most pertinent, eloquent and personalized information. Examinations in pregnancy are particularly challenging and feature unpredictable, but information rich, events. Instead of trying to make the baby behave in the way that is best for conventional MRI scans, I propose to put the MRI scanner into responsive mode. The whole womb will be assessed to automatically detect the position of the baby and any risk patterns such as previous C-section scars. The scanner will then be able to respond and adapt the scans. This is possible in real-time due to the recent development of 'machine learning (ML)', in which computer programs can be tuned to identify and respond to incoming information. ML requires lots of examples (in this case images with different anatomical features and behaviours) and fortunately I have access to a large data collection (>2000 fetal MRIs) from diverse pregnancies.

Furthermore, external sensor data (e.g. real-time Ultrasound) will allow the MRI to respond to important events such as contractions and fetal breathing while they happen. The entire MRI session will be changed from a series of blocks, which start and stop the flow of data, to a continuous responsive examination. We will deliberately include variation for a more comprehensive and personally focused examination and complement this with sophisticated analysis methods to quantify and present the gathered information.

My research will take place at King's College London, in a unique interdisciplinary environment with ML researchers, clinicians, and industry partners. After validation in healthy pregnancies, the methods I develop will be tested in 150 women with pregnancy complications and then put into clinical practise. At the end of this fellowship, this novel paradigm of "responsive self-driving MRI", in addition to providing richer indication-focused information, allow for the 1st time a comprehensive assessment and unique insight into the womb - crucial for best antenatal care. It aims to open up new avenues for personalized imaging well beyond the focused example.

Planned Impact

The proposed research stream aims to contribute an innovative and potentially disruptive technological capability for MRI acquisitions. It addresses a growing need of the UK population by offering individualized imaging - suited for the rise in comorbidities, obesity and advanced age. It is carefully crafted and embedded into a clinical context and structured as an active collaboration between scientists, clinicians and industrial partners with a capability to directly test emerging innovations on patients. The focus on fetal MRI is well aligned with the UK's leading role in this field.
The planned ambitious program thus has the potential to contribute to a unique world-leading research activity.

There are three main pathways to my impact strategy:
1) Healthcare system, NHS, Patients and clinicians: Promote and raise acceptance for accelerated personalized imaging and cost reductions and raise acceptance. Of course, the primary beneficiaries will be patients, in the chosen application of fetal imaging specifically the pregnant women and their babies as well as the entire family affected. This applies for all pregnant women at risk of pregnancy complication, but specifically the growing number of pregnant women with comorbidities such as hypertension, diabetes or threatened of preterm birth. Achieving the aim to improve imaging accuracy and robustness will ultimately result in earlier, more comprehensive and personalized diagnosis, which facilitates targeted intervention, delivery planning and thus ultimately reduces morbidity, mortality and the risk for long term developmental disabilities associated with preterm birth. The availability and exploitation of additional information at the time of the scan reduces the need for repeated scans, thus shortens the time to diagnosis and subsequently cost and emotional stress. The proposed paradigm provides another by reducing costs - thus potentially contributing to decreasing the substantial and growing economic cost of the 3.4m MRI scans per annum (2017-2018) for the UK economy. Gains in efficiency would have significant impact on healthcare delivery and costs. Embedding of the project in the clinical setting and close collaboration with obstetricians caring for the identified high-risk population will shorten the pathway to clinical implementation and thus realization of these impacts.

2) Medical imaging equipment manufacturers: Promote collaborations to support clinical and industrial translation of advanced technology. A major barrier to translation for MRI methods is the need to translate them to the proprietary software run by each vendor's hardware. For maximal impact, inclusion of the developed technology and software into vendor product pipelines is thus crucial. Collaboration with two industrial partners will ensure this.

3) Academic beneficiaries: Promote collaborations to facilitate new research opportunities and innovative products. To assure the widest possible academic impact all my results and anonymized data will be publicly accessible, the results will be disseminated through open access publications, conference presentations and media (see statement "academic beneficiaries").To increase the potential for uptake of the methods we develop, we propose to disseminate the models as open-source software where appropriate and have included funding to access the previously successfully used xnat platform. All software developed, such as the pretrained AI networks, e.g. for the fetal biometry and risk factor detection, image reconstruction code, and fully anonymized datasets will be made available as open source through github (algorithms) and xnat (data).

Publications

10 25 50
publication icon
Avena-Zampieri CL (2022) Assessment of the fetal lungs in utero. in American journal of obstetrics & gynecology MFM

publication icon
Avena-Zampieri CL (2023) Assessment of normal pulmonary development using functional magnetic resonance imaging techniques. in American journal of obstetrics & gynecology MFM

publication icon
Ciarrusta J (2022) The developing brain structural and functional connectome fingerprint. in Developmental cognitive neuroscience

publication icon
Hall M (2023) Adrenal volumes in fetuses delivering prior to 32 weeks' gestation: An MRI pilot study. in Acta obstetricia et gynecologica Scandinavica

 
Description Real-time tracking of the fetal brain on MRI using machine learning methods is possible and first significant steps have been made in this direction, with the feedback loop from sequence to real-time AI localization to feeding the information back to the sequence and change the Field of view is closed already!
Exploitation Route This already inspired eg PhD project and multiple grant proposals (3) in this area.
Sectors Healthcare

 
Description This award as well as a linked previous Wellcome fellowship have contributed to allowing functional multi-modal placental MRI and this has impacted a number of studies now using the techniques developed as part of this line of work. Furthermore, regular engagement with the non-academic public (eg soapbox science, Wellcome packed lunch, in2science, nuffield foundation placements) has contributed to enlarge the knowledge and awareness of pregnancy contributions and associated research into them.
First Year Of Impact 2022
Sector Healthcare
Impact Types Societal

 
Description Assessing Placental Structure and Function by Unified Fluid Mechanical Modelling and in-vivo MRI
Amount £1,124,022 (GBP)
Funding ID EP/V034537/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 01/2022 
End 12/2024
 
Description Magnetic resonance imaging of mother and fetus in late gestation to inform and optimise BIRTH management: the MIBIRTH study
Amount £2,300,000 (GBP)
Funding ID MR/X010007/1 
Organisation Medical Research Council (MRC) 
Sector Public
Country United Kingdom
Start 03/2023 
End 02/2027
 
Description The use of Advanced MRI techniques to evaluate antenatal lung development.
Amount £1,002,677 (GBP)
Funding ID MR/W019469/1 
Organisation Medical Research Council (MRC) 
Sector Public
Country United Kingdom
Start 11/2022 
End 10/2025
 
Title placental t2* to determine placental insufficiency during pregnancy 
Description A quick MRI techniques (<30 seconds for the entire uterus) is combined with AI to obtain a placental health score. The entire pipeline is automatic but transparent. 
Type Of Material Physiological assessment or outcome measure 
Year Produced 2021 
Provided To Others? Yes  
Impact Validated on additional cohorts and now deployed in various projects already. 
 
Title CARP data 
Description A comprehensive collection of cardiac and placental data acquired during pregnancy from low and high risk women. Recently passed ethics amendments allow to share this with the academic public. It contains both structural and functional data, eg diffusion, T2* and flow data from both organs together with anonymized outcomes. 
Type Of Material Database/Collection of data 
Year Produced 2021 
Provided To Others? Yes  
Impact This constitutes the first such comprehensive data collection and we hope that this will find interest in the research community. It is however too early to report on notable impact. 
 
Title Novel MRI acquisition technique 
Description new software on 2 vendor platforms was achieved, allowing to very efficiently acquire functional data with multiple contrasts on the human placenta and beyond. 
Type Of Technology New/Improved Technique/Technology 
Year Produced 2021 
Impact FOund notable interest in the community and was shared successfully with 2 research sites. 
 
Description I'm a scientist 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact Discussed my research with groups from three different school across the country as part of the "Health zone" during "I am a scientist". Similar activities in previous years led to positive feedback and possibly change in attitude "I never thought a scientific career is accessible for me - but now I am excited to work towards this aim!".
Year(s) Of Engagement Activity 2022
URL https://healthyworld22.imascientist.org.uk/profile/
 
Description coding workshop for local girls 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact Members of my team took part in this coding workshop aimed at girls in local schools.
Year(s) Of Engagement Activity 2022