AI-powered brain microstructure imaging

Lead Research Organisation: University College London
Department Name: Computer Science

Abstract

This fellowship develops innovative computational methods and magnetic resonance (MR) techniques to reveal new non-invasive markers of brain microstructure. The ultimate goal is to provide non-invasive tools for improved diagnostic information as powerful as invasive techniques.

Nature has built one of the most extraordinary machines we could ever conceive: the brain, using just basic cellular components of neurons and glia. Understanding how these individual components are designed (cell morphology) and assembled together (tissue microstructure) is the key to understanding both brain's structure and function, and more importantly its degeneration/dysregulation in diseases. However, it is currently impossible to quantify tissue microstructure in a non-invasive way. In fact, standard methods like histology can reveal microscopic characteristics of tissue architecture but at the cost of invasive interventions like biopsies and limited coverage of the investigated tissue, undermining diagnostic power. In contrast, sensitizing the MR imaging (MRI) contrast to water diffusion process, state-of-the-art technologies based on diffusion MRI (dMRI) provides an indirect but non-invasive probe of the tissue microstructure at the micrometer scale. This makes the acquired dMRI signal sensitive to tissue features like cellular size/shape, density, etc. Unfortunately, the tissue microstructure is highly complex while the dMRI signal is quite simple, so the mapping from signal to microstructure (inverse problem) is ill-posed. This represents a major obstacle for dMRI based techniques to replace histology as harmless diagnostic tools.

To overcome these limitations, the current paradigm of microstructure imaging uses mathematical models, which relate the dMRI signal to underlying tissue properties, to estimate and map those properties by fitting the models voxel-by-voxel to dMRI data. However, there are three main limitations hampering its diagnostic power: poor sensitivity to complex tissue features that cannot be described by mathematical models; a lack of specificity to different cell types, and ambiguity in the inverse problem's solution.

In this fellowship I propose a three-component shift of paradigm to address these key limitations: (i) employing detailed simulation of the tissue architecture to encode the forward problem (from tissue microstructure to MR signal), (ii) modern AI to solve the inverse problem and (iii) estimate of uncertainty to quantify ambiguity and significance of the results. I will demonstrate this in the brain by simulating normal tissue environments and those representing pathologies of common neurological diseases, like Multiple Sclerosis (MS) and Alzheimer's disease (AD). This will provide higher sensitivity to novel and important microstructural features like cell soma size/density and neurites size/complexity, leading to a new generation of quantitative imaging techniques based on water diffusion. To gain unprecedented specificity to different cell types in the brain and develop a new set of imaging markers for neurological conditions, I will combine the new paradigm with metabolites' diffusion measurements using dMR spectroscopy (dMRS). Indeed, metabolites are more cell-specific molecules than water: some are found mostly in neurons, others mostly in glia. I will prototype and validate the new technologies in controlled animal models of MS and AD and eventually provide proof-of-concept application in human patients. These innovative techniques offer great promise in the decades to come for the realisation of 'virtual histology' across a wide range of medical applications.

Although the fellowship focuses on neurological diseases, it also aims to initiate follow-on projects to explore other applications, like body cancer. Alternative contrast methods will extend the methods to other MR modalities beyond diffusion for complementary and additional information on healthy and diseased tissues.

Planned Impact

Neurological disorders like Multiple Sclerosis (MS) and Alzheimer's disease (AD) carry a significant burden to the individual, their families and carers, the National Health System (NHS), and to society as a whole. People with these conditions have the lowest health-related quality of life of any long-term condition. It has been estimated that 71% of patients experience severe pain or discomfort and 70% are restricted in their activities, with tremendous impact on their and their carers lifes (Falling Short 2016). The Hospital Activity Compendium has estimated over 1.5M hospital admissions and about 1M emergency admissions due to neurological disorders in 2016/17 (>20% increase over the five years to 2016/17). Mainly due to aeging population, the total number of neurological cases in England has now reached 14.7 million (Neuro Numbers 2019), and the number of deaths relating to neurological disorders rose by 39% over 13 years (Public Health England's 2018 Neurology Mortality). Resulting national costs are consistent: NHS spent £3.3 billion in 2012-13 (3.5% of NHS spend) and 14% of the social care budget on people living with neurological conditions (Neuro Numbers 2019). Main reason behind these numbers is that it is not always possible for patients who are experiencing neurological symptoms to get a diagnosis. Some people may have to wait a long time before the cause of their symptoms is identified, while others may not be able to get a diagnosis, and the prognosis as well as treatment options often follow a diagnosis. Thus, providing more effective tools for an earlier and more accurate diagnosis of neurological diseases is thus crucial to make an impact on patients life, their families and carers, and on society as a whole.

This project develops non-intrusive magnetic resonance imaging (MRI) methods to provide improved diagnostic information as powerful as invasive techniques. Primarily, this will ameliorate patient's quality of life, while assisting better clinical detection, staging and diagnosis by earlier and enhanced knowledge of what is happening at the tissue level. In particular, this project will ultimately give doctors powerful tools to diagnose disease and to test how well a particular therapy may be working. Improved characterization of the underpinning tissue microstructure can reduce the number of undiagnosed/misdiagnosed cases and support more accurate treatment planning. Better diagnosis can also decrease the cost of unnecessary or wrong treatments and contribute to the sustainability of the healthcare system by drastically reducing the number of emergency admissions.

The new microstructure MRI methods powered with artificial intelligence (AI) and information on uncertainty will provide new insight into the biology of neurodegenerative diseases, e.g. concerning the mechanisms of demyelination and glial scar in MS, neuronal atrophy, gliosis and protein entanglement in AD, and subtle or difficult to detect effects such as distinguishing changes in neuron and glial fine microstructure (soma size/density, neurites complexity), encouraging exciting new research prospects. Further exploitation of such computational methods can lead to identification of disease subgroups that when correlated with genetics could lead to the design of individualised therapies, achieving patient stratification for precision medicine.

The development of new AI-powered MRI techniques can impact the commercial and industrial sector, such as MRI manufacturers and software companies, offering opportunities that can drive future development of medical hardware/software. Siemens Healthineers and AInostics have already expressed their strong support and interest in the project. Finally, AI-powered microstructure imaging can also inform drug development and trials, revealing the effects of treatment earlier, moving trials more quickly to the final stages and accelerating the availability of new promising cancer treatments to patients.

Publications

10 25 50

 
Description As a result of the work funded through this award, we developed computational methods to generate controlled and flexible virtual models of the brain structure at the cellular scale (namely microstructure) and built on them novel inference techniques able to quantify histologically meaningful microstructural features of the brain tissue in health and disease non-invasively through Magnetic Resonance Imaging (MRI). These models are of uttermost importance to aid the development and validation of novel techniques for imaging the brain microstructure non-invasively and deliver the next-generation technologies for medical imaging in clinics.

Three major achievements can be highlighted:

1) Development and demonstration of the first-of-its-kind generative model of complex brain white matter tissue, able to create controlled and flexible ultra-realistic computational models of axonal bundles at the cellular scale. We called this new technology Contextual Fibre Growth (ConFiG), an approach to generate white matter virtual phantoms by mimicking natural axonal genesis. ConFiG represents an essential tool for designing more realistic numerical simulations that can aid the development and validation of novel techniques for imaging the brain microstructure non-invasively through Magnetic Resonance Imaging (MRI). As first demonstrator, we used ConFiG to investigate the limitations of current methods widely used for tractography, i.e. the mapping of long-range connections between brain areas. Using ConFiG we demonstrated that variable geometries of axonal bundles (like those expected in real brain tissue) leads to misestimation of the inferred bundle spatial orientation, resulting in further downstream errors in tractography and related applications (e.g. pre-surgical planning).

2) Development and validation of a new imaging technique based on simulation-driven inference and machine learning to estimate histologically meaningful features of axonal integrity in demyelinating pathologies such as Multiple Sclerosis. Performing controlled experiments in cuprizone mouse model of demyelination, we demonstrated experimentally (with direct comparison with histology) and in vivo, that our simulation-based inference technology can reliably estimate microstructure parameters directly linked to the integrity of the myelin sheath (e.g. myelin sheath thickness). The applicability of our approach extends to other myelin damaging pathologies such as spinal cord injury or leukodystrophies, potentially having a great impact on the understanding and diagnosis of neurological conditions of the white matter.

3) Via the establishment of a new collaboration with the Department of Electronics, Information and Bioengineering (DEIB) at Politecnico di Milano in Italy, we developed and demonstrated a new imaging technique based on simulation-driven inference and machine learning to estimate histologically meaningful features of brain tumors from conventional clinical MRI acquisitions. Our simulation-based inference allows clinicians to retrieve discriminative microstructural markers from routinely acquired diffusion-weighted MRI data of patients enrolled for proton therapy. As first demonstrators, we employed our technique for tumor grading and tumor response assessment in meningioma and chordoma, showing in both cases significant improvements in sensitivity and specificity with respect to the current clinical state-of-the-art.
Exploitation Route The computational methods which are the primary outcome of this project can be taken forward and used to develop, validate, and translate next-generation microstructure imaging techniques. The simulation of ultra-realistic computational models of biological tissues provides a general tool for informed development and rigorous validation. That validation gives users the confidence to adopt the innovative techniques and a sound understanding upon which to base solid and correct conclusions in experiments that use them.

Beneficiaries include:

Imaging scientists (mathematicians, physicists, computer scientists, and engineers) providing well-validated imaging techniques, enhancing precision of non-invasive measurements
and thus the confidence in biological/clinical conclusions.

Biomedical and clinical researchers providing new tools to further the understanding of neurological diseases, develop early and better stratified diagnoses, and investigate new disease-modifying treatments.

Pharmaceutical companies providing opportunities to design novel treatments and to conduct clinical trials with improved confidence for efficient design thus more economically.

Imaging system manufacturers and image computing SMSE providing opportunities to bring to market new imaging solutions that are tailored to provide insight on specific biological processes in health and disease.

Patients and carers, the ultimate beneficiaries, providing improved care and better quality of life.
Sectors Healthcare,Pharmaceuticals and Medical Biotechnology

 
Description The project had significant academic impact: 1) we have solved the long-standing challenge of developing a generative model of flexible and controllable realistic computational models of brain white matter (see ConFiG); 2) we have nucleated a new research area in mapping cell body density and size non-invasively and in vivo using Magnetic Resonance Imaging: MRI (see SANDI). These will be fundamental building blocks for the development and clinical translation of the next-generation quantitative MRI methods for characterizing both white and gray matter microstructure.
First Year Of Impact 2022
Sector Healthcare,Manufacturing, including Industrial Biotechology
 
Description Peer reviewer for Personalized Health and Related Technologies (PHRT) strategic focus area of the ETH Domain
Geographic Reach Europe 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Peer reviewer for Swiss Cancer Research foundation & Swiss Cancer League.
Geographic Reach Europe 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Peer reviewer for the Swiss National Science Foundation
Geographic Reach Europe 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Peer reviewer for the UKRI Future Leaders Fellowship
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Peer reviewer for the UKRI Future Leaders Fellowship
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Magnetic Susceptibility Interference MRI: developing new imaging methods to quantify axonal magnetic properties and myelin integrity
Amount £22,379 (GBP)
Funding ID BB/X005089/1 
Organisation Biotechnology and Biological Sciences Research Council (BBSRC) 
Sector Public
Country United Kingdom
Start 12/2022 
End 11/2023
 
Description Making the Invisible Visible: a Multi-Scale Imaging Approach to Detect and Characterise Cortical Pathology
Amount £1,003,042 (GBP)
Funding ID MR/W031566/1 
Organisation Medical Research Council (MRC) 
Sector Public
Country United Kingdom
Start 01/2023 
End 01/2025
 
Description Collaboration with the Department of Electronics, Information and Bioengineering (DEIB) at Politecnico di Milano in Italy 
Organisation Polytechnic University of Milan
Country Italy 
Sector Academic/University 
PI Contribution Expertise in machine learning, computational modelling, biophysical modelling and image processing of diffusion-weighted MRI (dMRI) data; intellectual input in developing the core methodology for mapping brain tumour microstructure from conventional dMRI clinical data; training and co-supervision of two PhD students at the collaborating Institution in Milan (Italy).
Collaborator Contribution Collection and access to dMRI data of patients with brain meningioma (N = 35) and chordoma (N = 44) undergoing radiotherapy; two PhD students' time for processing and analysis of the data.
Impact This collaboration produced: One paper on peer-reviewed scientific journal: https://doi.org/10.1002/mp.14689 Three abstract at international conferences: ISMRM 2020; MICCAI 2020; IEEE International Symposium on Biomedical Imaging (ISBI) 2021 One paper submitted to peer-reviewed scientific journal "Radiotherapy and Oncology", entitled: Microstructural parameters from DW-MRI for tumour characterization and treatment outcome prediction in skull-base chordoma treated with particle therapy
Start Year 2020
 
Title ConFiG: Contextual Fibre Growth to generate realistic axonal packing for diffusion MRI simulation 
Description ConFiG is a biologically motivated numerical phantom generator for white matter. ConFiG produces controllable and flexible virtual phantoms of the brain tissue, with state-of-the-art density and realistic microstructure. Simulations of the diffusion-weighted magnetic resonance imaging (dMRI) signals in ConFiG phantoms are comparable to real dMRI signals. 
Type Of Technology Physical Model/Kit 
Year Produced 2020 
Impact For the time being, we have demonstrated the feasibility of ConFiG to generate realistic synthetic diffusion MRI data. Once publicly released as open-source software (on-going work), we foresee that ConFiG will be widely used for developing and validating microstructure modelling approaches as well as inform on the design of the next-generation non-invasive imaging technologies based on MRI. 
URL https://rcallagh.github.io/projects/config/
 
Title Open-source toolbox for the fast Soma And Neurite Density Imaging (SANDI) with AMICO 
Description The software is an open-source toolbox to perform MRI image analysis using a technique I have developed, called Soma And Neurite Density Imaging (SANDI), using a fast and robust framework called Accelerated Microstructure Imaging via Convex Optimisation (AMICO). 
Type Of Technology Webtool/Application 
Year Produced 2021 
Open Source License? Yes  
Impact The release of this software tool makes the technique I have developed, called SANDI, available to any user requiring very minimal user intervention beyond the collection of the MRI data and acquisition information. Since its release, we have registered an average of 113 downloads per month, increasing every month. To date, 12 different institutions worldwide have contacted me to start collaborations and setup MRI studies which will employ my SANDI technique and the use of this software tool for the analysis. 
URL https://github.com/daducci/AMICO/wiki/Fitting-the-SANDI-model
 
Title SANDI: Soma And Neurite Density Imaging Toolbox 
Description The technique and accompanying open source software enable the quantification of neurite and cell body density in vivo non-invasively using Magnetic Resonance Imaging. The open source software allows users to process and analyse MRI data using the SANDI model and to obtain parametric maps of neurite and soma density indices that can be used to characterize the healthy and diseased brain. 
Type Of Technology New/Improved Technique/Technology 
Year Produced 2022 
Impact Several research teams across the world are using the SANDI technique and the released code for the characterization of brain diseases such as Multiple Sclerosis. 
URL https://www.sciencedirect.com/science/article/pii/S1053811920303220
 
Title SIREN-MRI for accurate data compression 
Description SIREN-MRI is a technique to compress large multimodal and multidimensional medical imaging data using implicit representation through simple and small deep learning models that can be trained and deployed on any device, also portable, low-energy and cheap devices. 
Type Of Technology New/Improved Technique/Technology 
Year Produced 2022 
Open Source License? Yes  
Impact Several groups have used SIREN-MRI as starting point for further developing data compression. Examples are: https://arxiv.org/abs/2210.14974 and https://www.mdpi.com/2076-3417/13/5/3242 
URL https://link.springer.com/chapter/10.1007/978-3-031-21206-2_3
 
Description Organised Hackathon entitled "Connecthon" 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact About 25 people participated to this hackathon organised to promote open and reproducible science practice and democratise access to unique imaging data acquired at Cardiff University using the Connectom MRI scanner. The event outcomes are: increased interest in open and reproducible science; new collaborations across different national institutes; wide dissemination of unique datasets; inspire and attract young students to the field of computational medical imaging; inspire others to organize similar events and promote open and reproducible science (e.g., UCL's CmicHacks - https://cmic-ucl.github.io/CMICHACKS/ was directly inspired and programmed during the Connecthon).
Year(s) Of Engagement Activity 2022
URL https://connecthon.github.io/2022/
 
Description Organised International Workshop MIML: Microstructure Imaging meets Machine Learning 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Approximately 60 undergrad/postgrad students, researchers and scientists from both academia and industry coming from all around the world participated to this workshop focussed on how modern machine learning can improve medical imaging. The event sparked questions and discussion which lead to fruitful collaborations and successful grant applications afterwards. Examples are the MRC grant MR/W031566/1 and the BBSRC grant BB/X005089/1.
Year(s) Of Engagement Activity 2022
URL http://cmic.cs.ucl.ac.uk/miml/index.html
 
Description Organiser of an hackathon on neuroimaging entitled "Micro2Macro". 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact To engage the higher education community, I organised a Hackathon (https://brainhack-micro2macro.github.io) which gathered over 100 academics and students from all over the world. Within this, I personally led a team of 13 people comprised of associate professors, postdocs and PhD students. Together, in three days we successfully managed to build, test and release a software toolbox for the analysis of MRI images (https://github.com/daducci/AMICO/wiki/Fitting-the-SANDI-model). Despite the lockdown complications, the team worked efficiently and I exploited the latest technology so everyone was able to meet and discuss virtually. We all thoroughly enjoyed the experience and team atmosphere and even submitted a joint abstract for the upcoming OHBM 2021 conference.
Year(s) Of Engagement Activity 2021
URL https://brainhack-micro2macro.github.io
 
Description Organiser of the Lorentz Workshop on "Best Practices & Tools for Diffusion MR Spectroscopy" 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Changes in specific brain cell structure and function are major hallmarks in brain development, plasticity and aging, and in pathological processes such as neurodegeneration and neuroinflammation. An accurate and quantitative method to disentangle cellular structural features is currently a major focus of research.

Diffusion-weighted MRI (DWI) and diffusion tensor imaging (DTI) are now part of the rich arsenal of MRI techniques available in research and in the clinic. The centrality of DWI and DTI has been made possible thanks to the involvement of the scientific community across many disciplines, from engineers to neuroscientists, from biologists to physicists. DTI is a powerful technique to study brain microstructure, however the signal originates from ubiquitous water molecules, thus limiting its specificity. Diffusion-weighted MR spectroscopy (DW-MRS) gives access to diffusion properties of endogenous intracellular brain metabolites that are preferentially located inside specific brain cell populations.

Despite its evident usefulness, DW-MRS remains a challenging technique on all levels: from data acquisition to the analysis, quantification, modeling and interpretation of results. In addition, the availability of DW-MRS to the MR community at large is severely limited by the lack of sequences on any of the commercially available MR scanners.

I organised a Lorentz Workshop on "Best Practices & Tools for Diffusion MR Spectroscopy" as a first step towards breaking the boundaries between the current group of DW-MRS developers and the wider scientific community, by making DW-MRS more accessible to the MR research community at large.

The aims of the workshop were:

(1) Launch a user-friendly open-source platform that will be used to process, analyze, and model experimental data acquired at different sites/vendor scanners/magnetic fields.

(2) Initiate a data repository attached to the open-platform to widen the accessibility of DW-MRS data. It will also contain a description of acquisition protocols, and contact of researchers working in the field.

(3) Write a 'consensus paper' summarizing practical principles of DW-MRS and providing protocol recommendations for different users' goals, with a description of the novel open-source platform
Year(s) Of Engagement Activity 2021
URL https://www.lorentzcenter.nl/best-practices-en-tools-for-diffusion-mr-spectroscopy.html
 
Description Organizer of the UCL Medical Image Computing Summer School (MedICSS) 2021 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact I organised the 2021 edition of the UCL Medical Image Computing Summer School (MedICSS). MedICSS 2021 allowed early career scientists to engage with world-leading medical imaging experts from academia and industry. Delegates learnt about the newest developments across the field through a series of lectures by scientific leaders, and engaged in active learning through interactive computational group projects encouraging collaboration, critical thinking, and scientific discovery.
Year(s) Of Engagement Activity 2021
URL https://medicss.cs.ucl.ac.uk/programme-2021/