Precision Modelling of Cortical Variation and its Association with Neurological/Psychiatric disease
Lead Research Organisation:
King's College London
Department Name: Imaging & Biomedical Engineering
Abstract
The aim of this proposal is to develop a novel medical imaging support tool to significantly improve rates of detection, of types of subtle brain abnormality, which give rise to complex brain conditions. Specifically, we are seeking to develop tools that improve the accuracy with which we can compare brain scans across populations. This will make it much easier to tell the difference between healthy and atypical brains, or detect diseased tissue.
The reason that this is challenging is because brains are extremely complex, made of billions of cells, and each one can look very different. This makes it hard to build a single model of what "healthy" brains should look like, and as a result it becomes very difficult to spot evidence of disease.
These challenges mean that radiologists require years of experience, reviewing countless examples, before they can reliably spot subtle brain abnormalities, and even so, for diseases such as focal childhood epilepsies, up to 30% of cases evade detection. For similar reasons, automated tools often also struggle: appearance of scans varies so extensively that simplifying assumptions must be made leading to coarse solutions.
The largest assumption is that all brains share a common organisational blueprint, where areas of the brain responsible for different functions appear in the same order. Such that if each brain scan was a jigsaw, with each piece a region, the shapes might change but they would in go together in the same way. However, in reality brains vary topographically, which means that areas representing different functions (such as language) can swap location. Methods assuming otherwise end up comparing completely different areas of the brain across individuals. Each area may look very different, with different definitions of what is normal. As a result, this leads to confusion, limiting the ability of any method to detect signs of disease.
In the past, methods were particularly limited as they built their model of regional organisation based simply on patterns of brain folding. However, it turns out that shape is a fairly coarse and non-specific model of brain organisation, and that brains often have very different patterns of brain folding for the same functional region.
Recently we developed a novel open-access tool, which instead learns how to map brains onto a model which takes into account, not just shape but also function, and other aspects of brain organisation (Robinson Neuroimage 2014, 2018). This has led to new, more accurate, models of cortical organisation (Glasser Nature 2016) and development (Garcia PNAS 2018, O'Muircheartaigh Brain 2020) and improved understanding of the links between brain organisation and behaviour (Bijsterbosch Elife 2018).
Now we propose to extend this tool, to account for variation of brain shape and appearance in a way that reflects the natural variation seen from one individual to another. Rather than learn a single model of brain organisation we will learn a family of models (modes) that try to describe how our brains vary. These will capture all biologically relevant modes of variation, allowing individual brain scans to be compared, for a given location, only against others with a common organisational blueprint. In this way we will support much more detailed comparison, than was ever possible before.
We will validate the power of the approach through three studies: 1) finding the source of epileptic seizures in the brain (to support surgical planning); 2) predicting cognitive outcomes for babies with developmental brain conditions; 3) identifying biological markers in the brain that may help predict mental health conditions. Ultimately, these tools will support researchers, medical doctors and healthcare workers to build more sensitive predictive models, fine tuned to detect signs of abnormality within individual brains. This will improve screening detection rates and lead to more accurate diagnosis of all brain conditions.
The reason that this is challenging is because brains are extremely complex, made of billions of cells, and each one can look very different. This makes it hard to build a single model of what "healthy" brains should look like, and as a result it becomes very difficult to spot evidence of disease.
These challenges mean that radiologists require years of experience, reviewing countless examples, before they can reliably spot subtle brain abnormalities, and even so, for diseases such as focal childhood epilepsies, up to 30% of cases evade detection. For similar reasons, automated tools often also struggle: appearance of scans varies so extensively that simplifying assumptions must be made leading to coarse solutions.
The largest assumption is that all brains share a common organisational blueprint, where areas of the brain responsible for different functions appear in the same order. Such that if each brain scan was a jigsaw, with each piece a region, the shapes might change but they would in go together in the same way. However, in reality brains vary topographically, which means that areas representing different functions (such as language) can swap location. Methods assuming otherwise end up comparing completely different areas of the brain across individuals. Each area may look very different, with different definitions of what is normal. As a result, this leads to confusion, limiting the ability of any method to detect signs of disease.
In the past, methods were particularly limited as they built their model of regional organisation based simply on patterns of brain folding. However, it turns out that shape is a fairly coarse and non-specific model of brain organisation, and that brains often have very different patterns of brain folding for the same functional region.
Recently we developed a novel open-access tool, which instead learns how to map brains onto a model which takes into account, not just shape but also function, and other aspects of brain organisation (Robinson Neuroimage 2014, 2018). This has led to new, more accurate, models of cortical organisation (Glasser Nature 2016) and development (Garcia PNAS 2018, O'Muircheartaigh Brain 2020) and improved understanding of the links between brain organisation and behaviour (Bijsterbosch Elife 2018).
Now we propose to extend this tool, to account for variation of brain shape and appearance in a way that reflects the natural variation seen from one individual to another. Rather than learn a single model of brain organisation we will learn a family of models (modes) that try to describe how our brains vary. These will capture all biologically relevant modes of variation, allowing individual brain scans to be compared, for a given location, only against others with a common organisational blueprint. In this way we will support much more detailed comparison, than was ever possible before.
We will validate the power of the approach through three studies: 1) finding the source of epileptic seizures in the brain (to support surgical planning); 2) predicting cognitive outcomes for babies with developmental brain conditions; 3) identifying biological markers in the brain that may help predict mental health conditions. Ultimately, these tools will support researchers, medical doctors and healthcare workers to build more sensitive predictive models, fine tuned to detect signs of abnormality within individual brains. This will improve screening detection rates and lead to more accurate diagnosis of all brain conditions.
Technical Summary
The purpose of this grant is to develop urgently needed new technologies for image processing of brain scans to support precise comparisons of populations of brain scans and sensitive localisation of pathologies within individual scans.
It is motivated by the fact that current methods for brain image analysis largely ignore considerable variation in brain shape and cortical organisation across individuals in order to deliver well-posed optimisations, which allow reliable but coarse scale comparisons of data across populations. Specifically, these compare brains through use of image registration algorithms which support smooth and invertible spatial mappings of all data into a global average space, where images may be directly compared. Alternative approaches, such as deep learning (which avoids this) require enormous data-sets, and return limited explainability (leaving ethical concerns over bias and generalisation).
The key problem with image registration to a single, global template is that this typically ignores subtle sources of individual variation leading to (in some circumstances very) low powered studies of complex phenomena. This is because there is nothing inherent in these algorithms constraining atypical variants of brain architecture to be in correspondence.
In this proposal, we therefore seek to develop new techniques for brain image registration which seek to learn all clinically or behaviourally relevant patterns of topographic variation, with the intent of matching these during alignment. In this way, images will be brought into much closer correspondence than possible before, allowing precision generative modelling of population variation for detection of cortical abnormalities in small populations. These frameworks will be used to test and validate development of novel explainable deep-learning frameworks.
It is motivated by the fact that current methods for brain image analysis largely ignore considerable variation in brain shape and cortical organisation across individuals in order to deliver well-posed optimisations, which allow reliable but coarse scale comparisons of data across populations. Specifically, these compare brains through use of image registration algorithms which support smooth and invertible spatial mappings of all data into a global average space, where images may be directly compared. Alternative approaches, such as deep learning (which avoids this) require enormous data-sets, and return limited explainability (leaving ethical concerns over bias and generalisation).
The key problem with image registration to a single, global template is that this typically ignores subtle sources of individual variation leading to (in some circumstances very) low powered studies of complex phenomena. This is because there is nothing inherent in these algorithms constraining atypical variants of brain architecture to be in correspondence.
In this proposal, we therefore seek to develop new techniques for brain image registration which seek to learn all clinically or behaviourally relevant patterns of topographic variation, with the intent of matching these during alignment. In this way, images will be brought into much closer correspondence than possible before, allowing precision generative modelling of population variation for detection of cortical abnormalities in small populations. These frameworks will be used to test and validate development of novel explainable deep-learning frameworks.
Publications

Ball G
(2024)
Molecular signatures of cortical expansion in the human foetal brain.
in Nature communications



Dahan S
(2024)
The Multiscale Surface Vision Transformers

Description | OHBM Educational course |
Geographic Reach | Multiple continents/international |
Policy Influence Type | Influenced training of practitioners or researchers |
URL | https://ww6.aievolution.com/hbm2401/index.cfm?do=ev.viewEv&ev=1539 |
Description | Wellcome Brain Connectivity Workshop |
Geographic Reach | Europe |
Policy Influence Type | Participation in a guidance/advisory committee |
URL | https://wellcomeopenresearch.org/documents/9-95 |
Description | Building sensitive models of cognition using interpretable Deep Learning |
Amount | |
Funding ID | 2322101 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 01/2020 |
End | 03/2024 |
Description | Computer Assisted Screening for Cortical Alterations in Development (CASCADE) |
Amount | £1,161,504 (GBP) |
Funding ID | APP35430/ UKRI534 |
Organisation | Medical Research Council (MRC) |
Sector | Public |
Country | United Kingdom |
Start | 03/2025 |
End | 03/2028 |
Description | Deep Generative Models of Fetal Brain Development: forward modelling of the mechanisms of neurodevelopmental impairment |
Amount | |
Funding ID | 2741200 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 08/2022 |
End | 09/2026 |
Description | Reading minds with Deep Learning: predicting behavioural states from functional imaging data |
Amount | |
Funding ID | 2442178 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 08/2020 |
End | 09/2024 |
Title | Developing Human Connectome Project (dHCP) |
Description | Few advances in neuroscience could have as much impact as a precise global description of human brain connectivity (connectome) and its variability. Understanding this connectome in detail will provide insights into fundamental neural processes and intractable neuropsychiatric diseases. Currently, the connectome of the mature adult brain is in progress. The Developing Human Connectome Project (dHCP), led by King's College London, Imperial College London and Oxford University, aims to make major scientific progress by creating the first 4-dimensional connectome of early life. Our goal is to create a dynamic map of human brain connectivity from 20 to 44 weeks post-conceptional age, which will link together imaging, clinical, behavioural, and genetic information. This unique setting, with imaging and collateral data in an expandable open-source informatics structure, will permit wide use by the scientific community, and to undertake pioneer studies into normal and abnormal development by studying well-phenotyped and genotyped group of infants with specific genetic and environmental risks that could lead to Autistic Spectrum Disorder or Cerebral Palsy. This is publicly available from the NDA - most recent release 2023 |
Type Of Material | Database/Collection of data |
Year Produced | 2021 |
Provided To Others? | Yes |
Impact | Google scholar counts 732 citations that mention the Developing Human Connectome Project (dHCP) |
URL | https://nda.nih.gov/edit_collection.html?id=3955 |
Title | Developing Human Connectome Project spatio-temporal surface atlas of the fetal brain |
Description | This repository contains spatio-temporal surface atlas, spanning 21-36 weeks of gestation, generated by adapting the procedure developed for the neonatal surface atlas in Bozek et al., 2018, which iteratively refines templates through a repeated alignment of individuals to a common space using MSM algorithm to the fetal data. At each iteration, the age-specific templates are obtained through weighted averaging of co-registered surfaces, whereby weights are defined by the Gaussians centred on the gestational weeks for which templates are calculated, and are subsequently used as a target space for the following iteration. Adaptive kernel regression, compensating for a difference in the number of scans available for different ages, was used to parameterise the width of the Gaussians. The atlas was generated in three stages: first, a common reference space was initialised via affine sulcal-depth-based registration to the dHCP neonatal GW36 template. At the next iteration, the template was refined using sulcal-depth-based nonlinear alignment, followed by 4 iterations of curvature-based alignment (a more fine-grained feature than the sulcal depth). |
Type Of Material | Database/Collection of data |
Year Produced | 2023 |
Provided To Others? | Yes |
Impact | Almost any paper that uses dHCP fetal cortical surface data will need to use this atlas |
URL | https://doi.gin.g-node.org/10.12751/g-node.qj5hs7 |
Title | Generative model of cortical neurodevelopment |
Description | This is an AI model of healthy cortical neurodevelopment, trained on cortical surface data. It can be used to simulate how an preterm individual's brain should develop if it was healthy. A derived measure of deviation between simulated healthy scans and ground truth follow up scans improves the precision with which it is possible to predict cognitive outcomes of these individuals at 18 months. |
Type Of Material | Computer model/algorithm |
Year Produced | 2023 |
Provided To Others? | Yes |
Impact | The paper describing this method is under revision for the journal Imaging Neuroscience An early version of this method was presented as an oral at the Medical Image Understanding and Analysis Conference (2022) |
URL | https://github.com/Abdulah-Fawaz/continuous_cGAN |
Title | Multi-channel spatio-temporal MRI atlas of the normal fetal brain development from the developing Human Connectome Project |
Description | This repository contains multi-channel spatio-temporal MRI atlas of the normal fetal brain development during 21-36 weeks GA cretated as a part of the Developing Human Connectome Project (dHCP). |
Type Of Material | Database/Collection of data |
Year Produced | 2023 |
Provided To Others? | Yes |
Impact | Paper https://elifesciences.org/reviewed-preprints/88818 |
URL | https://doi.gin.g-node.org/10.12751/g-node.ysgsy1 |
Title | SIM: Surface-based fMRI Analysis for Inter-Subject Multimodal Decoding from Movie-Watching Experiments |
Description | Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for cognitive training (neurofeedback) for which it would be useful to pool experiences across individuals to better simulate stimuli not sampled during training. A key obstacle to model generalisation is the degree of variability of inter-subject cortical organisation, which makes it difficult to align or compare cortical signals across participants. In this paper we address this through use of surface vision transformers, which build a generalisable model of cortical functional dynamics, through encoding the topography of cortical networks and their interactions as a moving image across a surface. This is then combined with tri-modal self-supervised contrastive (CLIP) alignment of audio, video, and fMRI modalities to enable the retrieval of visual and auditory stimuli from patterns of cortical activity (and vice-versa). We validate our approach on 7T task-fMRI data from 174 healthy participants engaged in the movie-watching experiment from the Human Connectome Project (HCP). Results show that it is possible to detect which movie clips an individual is watching purely from their brain activity, even for individuals and movies not seen during training. Further analysis of attention maps reveals that our model captures individual patterns of brain activity that reflect semantic and visual systems. This opens the door to future personalised simulations of brain function. Code & pre-trained models will be made available at https://github.com/metrics-lab/sim. |
Type Of Material | Computer model/algorithm |
Year Produced | 2025 |
Provided To Others? | Yes |
Impact | ICLR 2025 paper |
URL | https://github.com/metrics-lab/sim |
Title | dHCP Deep Learning-based Neonatal Pipeline |
Description | The dHCP deep learning (DL)-based neonatal cortical surface reconstruction pipeline integrates fast and robust DL-based approaches. The pipeline provides MRI preprocessing Cortical surface reconstruction Cortical surface inflation Cortical feature estimation Spherical projection for neonatal structural brain MRI processing. The pipeline is accelerated by GPU and only requires ~30 seconds to process a single subject. |
Type Of Material | Computer model/algorithm |
Year Produced | 2024 |
Provided To Others? | Yes |
Impact | Medical Image Analysis paper |
URL | https://github.com/m-qiang/dhcp-dl-neonatal |
Description | Collaboration with Multicentre Epilepsy Detection (MELD) project |
Organisation | King's College London |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | The research conducted on this project contributed to development of a pre-surgical planning tool for focal epilppesy detection. This is to be spun out |
Collaborator Contribution | Methods |
Impact | https://jamanetwork.com/journals/jamaneurology/fullarticle/2830410?guestAccessKey=9e566ccc-ad0f-4119-a96b-9719f0a83ec5&utm_source=jps&utm_medium=email&utm_campaign=author_alert-jamanetwork&utm_content=author-author_engagement&utm_term=1m |
Start Year | 2022 |
Description | Collaboration with Wash University St Louis (WashU) |
Organisation | Washington University in St Louis |
Country | United States |
Sector | Academic/University |
PI Contribution | This is an intellectual collaboration involving our sharing of the software that is being developed |
Collaborator Contribution | WashU are sharing data and expertise. |
Impact | OHBM abstracts 2023: https://github.com/metrics-lab/Posters/blob/main/2023/OHBM/Guo_Uncovering-Folding-Hierarchical-Registration.pdf OHBM 2024 abstracts: Rosen Burke et al. Mapping evolutionary cortical expansion with anatomical MSM Yourong Guo et al. Uncovering the asymmetry of common temporal lobe folding variants |
Start Year | 2022 |
Title | Geomorph |
Description | An AI tool for learning spatial mappings between cortical surface feature sets |
Type Of Technology | Software |
Year Produced | 2023 |
Open Source License? | Yes |
Impact | The resulting paper is under revision for Medical Image Analysis (IF 10.9) |
URL | https://github.com/mohamedasuliman/GeoMorph |
Title | Hierarchical-surface-registration |
Description | This repository contains Python scripts and SLURM bash code to perform hierarchical surface registration and template concatenation for brain imaging analysis. The downstream analysis codes are also provided. |
Type Of Technology | Software |
Year Produced | 2024 |
Open Source License? | Yes |
Impact | A paper is being submitted to Nature Neuroscience this month |
URL | https://github.com/Yrong-Guo/Hierarchical-surface-registration |
Title | New MSM |
Description | New MSM is a reimplementation of Multimodal Surface Matching (MSM) (Robinson et al. Neuroimage 2014,2018) a tool used for mapping cortical surface imaging feature sets into a common reference space such that features of cortical organisation may be directly compared across populations. MSM was fundamental to the HCP Multimodal parcellation (Glasser Nature 2016). However, the original implementation was extremely slow (90 mins). The new version of MSM runs in 2 mins. This is forming the basis of the groupwise registration framework which is central to the grant. |
Type Of Technology | Software |
Year Produced | 2023 |
Open Source License? | Yes |
Impact | newMSM is yet to be fully rolled out but is being used by collaborators in Washu, Barcelona, Indiana and internally to speed up computation of big data analyses of brain imaging data. |
URL | https://github.com/rbesenczi/newMSM |
Title | continuous_cGAN |
Description | Builds generative models of cortical development and ageing from cortical imaging feature sets |
Type Of Technology | Software |
Year Produced | 2023 |
Open Source License? | Yes |
Impact | Paper under revision for Imaging Neuroscience |
URL | https://github.com/Abdulah-Fawaz/continuous_cGAN/blob/main/LICENSE |
Title | dHCP Deep Learning-based Neonatal Pipeline |
Description | The dHCP deep learning (DL)-based neonatal cortical surface reconstruction pipeline integrates fast and robust DL-based approaches. The pipeline provides MRI preprocessing Cortical surface reconstruction Cortical surface inflation Cortical feature estimation Spherical projection for neonatal structural brain MRI processing. The pipeline is accelerated by GPU and only requires ~30 seconds to process a single subject. |
Type Of Technology | Software |
Year Produced | 2024 |
Open Source License? | Yes |
Impact | Medical Image Analysis paper TBC - new release of dHCP data |
URL | https://github.com/m-qiang/dhcp-dl-neonatal |