Learning MRI and histology image mappings for cancer diagnosis and prognosis

Lead Research Organisation: University College London
Department Name: Computer Science

Abstract

This project aims to exploit recent advances in machine learning to address acute problems in cancer management - most directly prostate cancer. The current standard approach of making treatment decisions via biopsy and histology has two key limitations; it is invasive and subjective/inconsistent. We will develop the computational tools supporting new solutions that resolve both issues. Specifically, we aim to enable non-invasive MRI to become the primary diagnostic tool. This would avoid a large number of unnecessary biopsies, which carry significant risk of life-changing side-effects, reserving the procedure for only marginal cases. We also plan to relate MR signals to quantitative tissue features enabling consistent assessment and thus more reliable treatment decisions.

The use of MRI in prostate cancer has become routine only in the last few years. Thus, data relating MRI to patient outcome (e.g. 5-10 year survival) is not available. However, we are uniquely positioned to obtain i) associated MRI and histology images, and ii) associated histology and patient outcome. In combination, these support a two-step learning and estimation process: from MRI to histological features; and from histological features to patient prognosis. Such mappings can provide invaluable new information for clinical decision making, as well as guide the design of maximally informative future MRI protocols. Such protocols will enable long-term data collection initiatives that support direct mappings from MRI to outcome.

The project involves engineering challenges that demand innovations at the cutting edge of image-based machine learning technology: i) accommodating uncertainty in the alignment of training images; ii) quantification and visualization of uncertainty in the output of learned models; iii) salient feature selection in high-dimensional input data; iv) development of experiment design optimization algorithms driven by implicit computational models (such as neural networks). We build on the latest ideas in deep learning to address these challenges. We tailor solutions relevant to the immediate problems at hand in prostate cancer, but that extend to related tasks in cancer imaging and medical imaging in general.

Planned Impact

Prostate cancer is the most common type of cancer in males in many countries worldwide, including the UK. Currently more than 8 in 10 men in England and Wales survive prostate cancer for ten years or more since the time of diagnosis. Early and accurate diagnosis is key for improved prognosis. It is important to identify early both high-risk cases of invasive cancer that require immediate treatment and additionally low-risk cases that grow slowly and might never develop into a life-threatening disease. The latter becomes increasingly important as a large number of patients are subjected to unnecessary biopsies and treatments (over-treatment) and their associated side-effects.

Management and treatment of cancer is one of the biggest challenges in medicine worldwide, costing the UK economy more than £15bn a year. Prostate cancer is the most common type of cancer in males with around 47,300 cases diagnosed annually. This project advances towards the use of MRI for early and accurate patient stratification of prostate cancer patients with significant socio-economic impact.

From an economic point of view, early diagnosis minimises the negative impact of cancer on the active workforce, as it is associated with increased survival rates. In addition, addressing the problem of over-treatment, by identifying the patients with low-risk disease that will not progress to be life-threatening, has the advantage of avoiding costly treatments that are unnecessary.

From a societal point of view, the benefits of early patient stratification are evident both for the patients and their families. This project makes an important advance in early and accurate diagnosis based on patient-specific in-vivo imaging, enabling subsequent personalised treatment. This involves immediate cancer therapy options for high-risk cases, while potentially sparing severe discomfort and side-effects from unnecessary biopsy and loss of quality of life from unnecessary chemotherapy treatments and surgical interventions for low-risk prostate cancer cases. In both cases the patient will benefit from improved quality of life.

The project uses prostate cancer as its demonstrator, but the framework has wider applications with similar impact both in a range of other solid cancers (for example breast, brain, pancreas, liver etc) as well as other medical domains that currently rely on histology, such as neuroscience.

Publications

10 25 50

 
Description This award has helped the ongoing translation of microstructural MRI techniques, in particular VERDICT-MRI but also luminal water imaging, for prostate cancer imaging. VERDICT has been through a series of clinical trials. The most recent (Singh Radiology 2022) confirms that the technique can distinguish clinically significant cancer from benign non-invasively with sufficient accuracy to change clinical practice in particular by substantially reducing the number of patients that require invasive prostate biopsy.
Exploitation Route VERDICT MRI likely to move into clinical practice later this year (2023).
Sectors Healthcare

URL https://news.sky.com/story/prostate-scan-could-save-thousands-of-unnecessary-biopsies-charity-says-12664827
 
Description Assessing Placental Structure and Function by Unified Fluid Mechanical Modelling and in-vivo MRI
Amount £1,124,021 (GBP)
Funding ID EP/V034537/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 07/2021 
End 07/2024
 
Description EPSRC Centre for Doctoral Training in Intelligent, Integrated Imaging In Healthcare (i4health)
Amount £6,034,274 (GBP)
Funding ID EP/S021930/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2019 
End 03/2028
 
Description JPND: Stratification of presymptomatic amyotrophic lateral sclerosis: the development of novel imaging biomarkers
Amount € 1,600,000 (EUR)
Funding ID MR/T046473/1 
Organisation JPND Research 
Sector Academic/University
Country Global
Start 07/2020 
End 07/2023
 
Title 'Select and Retrieve via Direct Upsampling' Network (SARDU-Net) 
Description "Select and retrieve via direct up-sampling" network (SARDU-Net) is a new method for model-free, data-driven quantitative MRI (qMRI) experiment design. SARDU-Net identifies informative measurements within lengthy acquisitions and reconstructs fully-sampled MRI signals from a sub-protocol, without prior information on the MRI contrast. It combines two deep networks in an encoder-decoder fashion. Firstly, a selector selects a signal sub-sample, which is passed to a predictor, which retrieves fully sampled input signals. SARDU-Net can be run with standard computational resources and can increase the clinical appeal of qMRI. 
Type Of Material Computer model/algorithm 
Year Produced 2019 
Provided To Others? No  
Impact SARDU-Net has made important impacts: - it was used to submit an entry to the 2019 MICCAI Challenge on Computational Diffusion MRI known as 'MUDI' (MUlti-dimensional Diffusion MRI), which won the 1st prize in October 2019 - it was used for a submission for the 2020 annual meeting of the International Society for Magnetic Resonance in Medicine (ISMRM), which was accepted as an oral power pitch presentation and awarded the 2nd prize for Mansfield Innovation Award by the British & Irish chapter of the ISMRM; - it is being currently used as part of the same Researchfish Award to design prospective MRI acquisitions. 
 
Description Bloomsbury festival 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact My PhD student and myself along with other colleagues and Phd students from CMIC and WEISS presented "all things imaging and what it is for" to school kids and the general public at the Bloomsbury Festival this year. Our stall at the Discovery Hub (Senate House, Malet Street) illustrated our various imaging technics (and what we use them for), as well as addressing those fundamental questions around how do we know where the lungs sits, what an MRI image actually looks like, is AI faster than school kids. Also, of course, an opportunity to touch on more serious questions around the applications in medical context such as cancer imaging.

Bloomsbury Festival theme this year was "Breathe" and our exhibit - "From Top to Toe - the breathing body" . Thursday and Friday were dedicated to schools, who had booked tours and brought children aged 8-12 years. We had approximately 120 students visiting us. We had excellent feedback from the enthusiastic students. During the weekend we had general audience and approximately 200 people visited during the hours of the exhibition. All children were happy to engage with the activities while we had more in depth discussions about our methods and how they aid diagnosis with parents and grandparents, but also some independent patients.
Year(s) Of Engagement Activity 2022
URL https://bloomsburyfestival.org.uk/