Magnetic resonance Imaging abnormality Deep learning Identification (MIDI)

Lead Research Organisation: King's College London
Department Name: Imaging & Biomedical Engineering

Abstract

Radiology workloads soared over the past decade due to changing demographics, increased screening and updated clinical guidelines specifying imaging in the clinical pathway. However, only 2% of NHS trusts met their 2019 reporting requirements. Before COVID, at any one time, 330,000 patients wait >30 days for their MRI reports - and there were forecasts that this would increase due to more demand than radiologist availability.
Following COVID there has been a 210% increase in the imaging backlog.

Reporting delays cause poorer short- and long-term clinical outcomes with late detection of illness inflating healthcare costs in accordance with World Health Organisation findings. This is exacerbated by radiologists routinely reporting from the back of report queues, introducing systemic delay in identifying abnormalities.

Our project makes a tool that will immediately flag brain MRI abnormalities allowing radiology departments to prioritise limited resources into reporting abnormal scans, thereby expediting early intervention from the referring clinical team, improving clinical outcomes and lowering healthcare costs. Furthermore, there will likely be reductions in mean-scan-reporting-time, through accurate and reliable clinical decision support, and reporting backlogs. Specific examples relate to cancer, stroke or infection where an early diagnosis can allow early treatment.

To achieve this we propose a deep learning decision-making tool for brain MRI scans that is both accurate and usable across the UK.

Technical Summary

A clinically validated decision-making tool to identify abnormalities on brain MRI scans does not exist. This project meets this clinical need by developing such an abnormality detection tool using deep learning, enabling immediate automated triage of abnormalities with target product profile diagnostic performance matching that of a consultant neuroradiologist. This is important as 330,000 patients wait >30 days for their MRI reports in the UK. The number is forecast to increase, due to more demand for MRI than the availability of radiologists to report these scans. UK-specific workforce shortages in radiology are negatively impacting patient care by delaying diagnosis; a similar picture is seen globally.
Immediate triage of a brain MRI into normal/abnormal allows early intervention to improve short- & long-term clinical outcomes. Furthermore, detecting illnesses early would result in lower costs for the healthcare system given less specialised medicine & fewer hours of treatment are needed for patient recovery.
The proposal is enabled by another deep learning labelling tool, allowing MRI scans to be labelled at scale. Our publications confirm that the core approach is not only feasible & effective but also allows subcategorization into relevant groups as secondary objectives.
However, there is a technology gap that must be filled to provide a capability ready for a clinical trial.
A key objective is to complete analytical validation by 30 months in multiple prospective external test sets.
Preparation for Class 2a Medical Device regulatory approval of software & phase III trial design, including a health economic evaluation, will be achieved within 36 months. A trial, beyond the current Award, will complete clinical validation.
The commercial exploitation pathway will be developed during the Award prior to the trial where a 3rd party (i.e. commercial partner) will be responsible. IP relates to the software we will generate for the triage tool in the proposal.

Publications

10 25 50
 
Description 2022 Expert external grant reviewer including UK (e.g., Royal College of Radiologists) and European organisations (e.g., Austrian and Belgian governments).
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
 
Description 2022-current. NIHR RfPB committee
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description 2022-current. RANO AI group (Representing UK in neuro-oncology AI; international)
Geographic Reach Multiple continents/international 
Policy Influence Type Participation in a guidance/advisory committee
 
Description 2022-current. UKNG research lead
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
URL https://ukng.org.uk
 
Description 2023 Expert external assessor for Medicines and Healthcare Products Regulatory Agency (MHRA)
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
Impact 2023 Expert external assessor for Medicines and Healthcare Products Regulatory Agency (MHRA)
 
Description 2023-current. NIHR Imaging Group member
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Advanced MR techniques for preoperative glioma characterization: Part 2. Hangel G, Booth TEmblem KE.J Magn Reson Imaging. 2023 Jun;57(6):1676-1695. doi: 10.1002/jmri.28663.
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in clinical reviews
 
Description Detection of cerebral aneurysms using artificial intelligence: a systematic review and meta-analysis. Din M, Agarwal S, Grzeda M, Wood DA, Modat M, Booth T.C. J Neurointerv Surg. 2023 Mar;15(3):262-271. doi: 10.1136/jnis-2022-019456.
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in systematic reviews
 
Description Systematic Review of Artificial Intelligence for Abnormality Detection in High-volume Neuroimaging and Subgroup Meta-analysis for Intracranial Hemorrhage Detection. Agarwal S, Wood D, Grzeda M, Suresh C, Din M, Cole J, Modat M, Booth T.C. Clin Neuroradiol. 2023 Dec;33(4):943-956. doi: 10.1007/s00062-023-01291-1.
Geographic Reach Multiple continents/international 
Policy Influence Type Citation in systematic reviews
 
Description AI-powered portable MRI abnormality detection (APPMAD)
Amount £299,498 (GBP)
Funding ID APP22377 
Organisation Medical Research Council (MRC) 
Sector Public
Country United Kingdom
Start 06/2024 
End 01/2026
 
Description Automated brain tumour segmentation: building a platform to allow accurate longitudinal comparisons
Amount £59,500 (GBP)
Organisation King's College London 
Sector Academic/University
Country United Kingdom
Start 09/2022 
End 03/2026
 
Description Development of a panel of predictive biomarkers using MRI-based radiogenomics analysis of glioblastomas
Amount £59,500 (GBP)
Organisation King's College London 
Sector Academic/University
Country United Kingdom
Start 09/2022 
End 03/2026
 
Description King's College London Commercial Development Fund
Amount £48,047 (GBP)
Organisation King's College London 
Sector Academic/University
Country United Kingdom
Start 03/2023 
End 10/2023
 
Title A suite of pre-trained foundation models for brain age 
Description Model available here: Optimising brain age estimation through transfer learning: A suite of pre-trained foundation models for improved performance and generalisability in a clinical setting. Wood DA, Townend M, Guilhem E, Kafiabadi S, Hammam A, Wei Y, Al Busaidi A, Mazumder A, Sasieni P, Barker GJ, Ourselin S, Cole JH, Booth T.C. Hum Brain Mapp. 2024 Mar;45(4):e26625. doi: 10.1002/hbm.26625. 
Type Of Material Computer model/algorithm 
Year Produced 2024 
Provided To Others? Yes  
Impact Model available here: Optimising brain age estimation through transfer learning: A suite of pre-trained foundation models for improved performance and generalisability in a clinical setting. Wood DA, Townend M, Guilhem E, Kafiabadi S, Hammam A, Wei Y, Al Busaidi A, Mazumder A, Sasieni P, Barker GJ, Ourselin S, Cole JH, Booth T.C. Hum Brain Mapp. 2024 Mar;45(4):e26625. doi: 10.1002/hbm.26625. 
 
Title Brain-age model 
Description Model available here: Accurate brain-age models for routine clinical MRI examinations. Wood DA, Kafiabadi S, Busaidi AA, Guilhem E, Montvila A, Lynch J, Townend M, Agarwal S, Mazumder A, Barker GJ, Ourselin S, Cole JH, Booth T.C. Neuroimage. 2022 Apr 1;249:118871. doi: 10.1016/j.neuroimage.2022.118871. 
Type Of Material Computer model/algorithm 
Year Produced 2022 
Provided To Others? Yes  
Impact Model available here: Accurate brain-age models for routine clinical MRI examinations. Wood DA, Kafiabadi S, Busaidi AA, Guilhem E, Montvila A, Lynch J, Townend M, Agarwal S, Mazumder A, Barker GJ, Ourselin S, Cole JH, Booth T.C. Neuroimage. 2022 Apr 1;249:118871. doi: 10.1016/j.neuroimage.2022.118871. 
 
Title Foundation model reduction of scans required for fine tuning 
Description Our study has shown community that 150 scans can be used with our foundation model to generate improved accuracy in a different prediction task. Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study). Chelliah A, Wood DA, Canas LS, Shuaib H, Currie S, Fatania K, Frood R, Rowland-Hill C, Thust S, Wastling SJ, Tenant S, Foweraker K, Williams M, Wang Q, Roman A, Dragos C, MacDonald M, Lau YH, Linares CA, Bassiouny A, Luis A, Young T, Brock J, Chandy E, Beaumont E, Lam TC, Welsh L, Lewis J, Mathew R, Kerfoot E, Brown R, Beasley D, Glendenning J, Brazil L, Swampillai A, Ashkan K, Ourselin S, Modat M, Booth T.C. Neuro Oncol. 2024 Jan 29:noae017. doi: 10.1093/neuonc/noae017. 
Type Of Material Data analysis technique 
Year Produced 2024 
Provided To Others? Yes  
Impact Our study has shown community that as little as 25 scans can be used with our foundation model to generate improved accuracy. Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study). Chelliah A, Wood DA, Canas LS, Shuaib H, Currie S, Fatania K, Frood R, Rowland-Hill C, Thust S, Wastling SJ, Tenant S, Foweraker K, Williams M, Wang Q, Roman A, Dragos C, MacDonald M, Lau YH, Linares CA, Bassiouny A, Luis A, Young T, Brock J, Chandy E, Beaumont E, Lam TC, Welsh L, Lewis J, Mathew R, Kerfoot E, Brown R, Beasley D, Glendenning J, Brazil L, Swampillai A, Ashkan K, Ourselin S, Modat M, Booth T.C. Neuro Oncol. 2024 Jan 29:noae017. doi: 10.1093/neuonc/noae017. 
 
Title Foundation model reduction of scans required for fine tuning 
Description Our study has shown community that as little as 25 scans can be used with our foundation model to generate improved accuracy. Optimising brain age estimation through transfer learning: A suite of pre-trained foundation models for improved performance and generalisability in a clinical setting. Wood DA, Townend M, Guilhem E, Kafiabadi S, Hammam A, Wei Y, Al Busaidi A, Mazumder A, Sasieni P, Barker GJ, Ourselin S, Cole JH, Booth T.C. Hum Brain Mapp. 2024 Mar;45(4):e26625. doi: 10.1002/hbm.26625. 
Type Of Material Data analysis technique 
Year Produced 2024 
Provided To Others? Yes  
Impact Our study has shown community that as little as 25 scans can be used with our foundation model to generate improved accuracy. Optimising brain age estimation through transfer learning: A suite of pre-trained foundation models for improved performance and generalisability in a clinical setting. Wood DA, Townend M, Guilhem E, Kafiabadi S, Hammam A, Wei Y, Al Busaidi A, Mazumder A, Sasieni P, Barker GJ, Ourselin S, Cole JH, Booth T.C. Hum Brain Mapp. 2024 Mar;45(4):e26625. doi: 10.1002/hbm.26625. 
 
Title GRASP 
Description Model available here: Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study). Chelliah A, Wood DA, Canas LS, Shuaib H, Currie S, Fatania K, Frood R, Rowland-Hill C, Thust S, Wastling SJ, Tenant S, Foweraker K, Williams M, Wang Q, Roman A, Dragos C, MacDonald M, Lau YH, Linares CA, Bassiouny A, Luis A, Young T, Brock J, Chandy E, Beaumont E, Lam TC, Welsh L, Lewis J, Mathew R, Kerfoot E, Brown R, Beasley D, Glendenning J, Brazil L, Swampillai A, Ashkan K, Ourselin S, Modat M, Booth T.C. Neuro Oncol. 2024 Jan 29:noae017. doi: 10.1093/neuonc/noae017. 
Type Of Material Computer model/algorithm 
Year Produced 2024 
Provided To Others? Yes  
Impact Model available here: Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study). Chelliah A, Wood DA, Canas LS, Shuaib H, Currie S, Fatania K, Frood R, Rowland-Hill C, Thust S, Wastling SJ, Tenant S, Foweraker K, Williams M, Wang Q, Roman A, Dragos C, MacDonald M, Lau YH, Linares CA, Bassiouny A, Luis A, Young T, Brock J, Chandy E, Beaumont E, Lam TC, Welsh L, Lewis J, Mathew R, Kerfoot E, Brown R, Beasley D, Glendenning J, Brazil L, Swampillai A, Ashkan K, Ourselin S, Modat M, Booth T.C. Neuro Oncol. 2024 Jan 29:noae017. doi: 10.1093/neuonc/noae017. 
 
Title Leeds retrospective brain MRI data 
Description Leeds retrospective brain MRI data ( brain MRI scans) 
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? No  
Impact Leeds retrospective brain MRI data ( brain MRI scans) - will allow more training at scale 
 
Title MIDI 
Description Model available here: Deep learning models for triaging hospital head MRI examinations. Wood DA, Kafiabadi S, Busaidi AA, Guilhem E, Montvila A, Lynch J, Townend M, Agarwal S, Mazumder A, Barker GJ, Ourselin S, Cole JH, Booth T.C. Med Image Anal. 2022 May;78:102391. doi: 10.1016/j.media.2022.102391. 
Type Of Material Computer model/algorithm 
Year Produced 2022 
Provided To Others? Yes  
Impact Model available here: Deep learning models for triaging hospital head MRI examinations. Wood DA, Kafiabadi S, Busaidi AA, Guilhem E, Montvila A, Lynch J, Townend M, Agarwal S, Mazumder A, Barker GJ, Ourselin S, Cole JH, Booth T.C. Med Image Anal. 2022 May;78:102391. doi: 10.1016/j.media.2022.102391. 
 
Title MIDI prospective dataset 
Description 30,000 brain MRI scans from 42 UK sites 
Type Of Material Database/Collection of data 
Year Produced 2024 
Provided To Others? No  
Impact 30,000 brain MRI scans from 42 UK sites - largest CRN portfolio adopted Neurology study in UK 
URL https://clinicaltrials.gov/ct2/show/NCT04368481
 
Title Transfer App for MIDI study 
Description App allows data to be transferred from sites to KCL repository 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? No  
Impact App allows data to be transferred from sites to KCL repository - image transfer efficiency and speed improved 
 
Description Brain neuroimaging diagnosis using AI 
Organisation Leeds Teaching Hospitals NHS Trust
Country United Kingdom 
Sector Public 
PI Contribution Wrote application. Will analyse data transferred to KCL.
Collaborator Contribution Obtained data. Deidentify and transfer data.
Impact Publication: Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study). Chelliah A, Wood DA, Canas LS, Shuaib H, Currie S, Fatania K, Frood R, Rowland-Hill C, Thust S, Wastling SJ, Tenant S, Foweraker K, Williams M, Wang Q, Roman A, Dragos C, MacDonald M, Lau YH, Linares CA, Bassiouny A, Luis A, Young T, Brock J, Chandy E, Beaumont E, Lam TC, Welsh L, Lewis J, Mathew R, Kerfoot E, Brown R, Beasley D, Glendenning J, Brazil L, Swampillai A, Ashkan K, Ourselin S, Modat M, Booth T.C. Neuro Oncol. 2024 Jan 29:noae017. doi: 10.1093/neuonc/noae017.
Start Year 2023
 
Description RESPOND AI consortium 
Organisation University of Pennsylvania
Country United States 
Sector Academic/University 
PI Contribution local PI supply data and review research
Collaborator Contribution Other partners local PIs They also supply data and review research
Impact Award: 2022 NIH (NIH Call Type R01 (NIH Research Project Grant Programme)) Generalizable quantitative imaging and machine learning signatures in glioblastoma, for precision diagnostics and personalized treatment: the ReSPOND consortium Publication: Association of partial T2-FLAIR mismatch sign and isocitrate dehydrogenase mutation in WHO grade 4 gliomas: results from the ReSPOND consortium. Lee MD, Booth T.C., Jain R; ReSPOND Consortium. Neuroradiology. 2023 Sep;65(9):1343-1352. doi: 10.1007/s00234-023-03196-9. Publication: Federated learning enables big data for rare cancer boundary detection Bakas S Booth T.C.,Martin J Nat Commun. 2022 Dec 5;13(1):7346. doi: 10.1038/s41467-022-33407-5. Conference proceeding: EPID-15. Sex-specific differences in glioblastoma in the respond consortium Gongala S, Booth T.C.,Badve C Neuro-Oncology 25 (Supplement_5), v118-v118 2023 Conference proceeding: NIMG-13. Robustness of prognostic stratification in de novo glioblastoma patients across 22 geographically distinct institutions: insights from the respond consortium Akbari H, Booth T.C.,.Davatzikos C Neuro-Oncology 25 (Supplement_5), v187-v187 2023 Conference proceeding: NIMG-67. Multi-parametric-based machine learning analysis for prediction of neoplastic infiltration and recurrence in patients with glioblastoma: updates from the multi -institutional respond consortium Akbari H, Booth T.C.,Davatzikos C Neuro-Oncology 24 (Supplement_7), vii179-vii180 2022 Conference proceeding: NIMG-29. association of partial T2-FLAIR mismatch sign and isocitrate dehydrogenase mutation in WHO grade 4 glioma/glioblastoma: results from the respond consortium Lee MBooth T.C.,Jain R Neuro-Oncology 24 (Supplement_7), vii168-vii169 2022 Conference proceeding: NIMG-29. association of partial T2-FLAIR mismatch sign and isocitrate dehydrogenase mutation in WHO grade 4 glioma/glioblastoma: results from the respond consortium Lee MBooth T.C.,Jain R RSNA Book of Abstracts 2022 Conference proceeding: NIMG-33. Prognostic stratification of de novo glioblastoma patients across 22 geographically distinct institutions: updates from the respond consortium Akbari H, Booth T.C.,.Davatzikos C Neuro-Oncology 24 (Supplement_7), vii170-vii170 2022
Start Year 2022
 
Title DETERMINING BRAIN AGE FROM CROSS-SECTIONAL IMAGING 
Description Stage of UK Patent Application No. 2310881.4 currently 
IP Reference UK Patent Application No. 2310881.4 
Protection Patent / Patent application
Year Protection Granted 2023
Licensed No
Impact Stage of UK Patent Application currently
 
Title MIDI application (abnormality triage tool for Brain MRI) 
Description MIDI application (abnormality triage tool for Brain MRI) Testing on double labelled prospective data 
Type Diagnostic Tool - Imaging
Current Stage Of Development Initial development
Year Development Stage Completed 2024
Development Status Under active development/distribution
Impact Early phase of development But modelling shown here shows reports to report abnormal scans: Deep learning models for triaging hospital head MRI examinations. Wood DA, Kafiabadi S, Busaidi AA, Guilhem E, Montvila A, Lynch J, Townend M, Agarwal S, Mazumder A, Barker GJ, Ourselin S, Cole JH, Booth T.C. Med Image Anal. 2022 May;78:102391. doi: 10.1016/j.media.2022.102391. 
 
Title MIDI tool 
Description MIDI tool in progress 
Type Of Technology Software 
Year Produced 2023 
Impact MIDI tool in progress 
 
Description 2022 invited industry-sponsored conference speaker: British Institute of Radiology. Annual Congress. London, UK. Understanding the black box. Interpretability and Explainability of AI 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 2022 industry-sponsored conference speaker: British Institute of Radiology. Annual Congress. London, UK. Understanding the black box. Interpretability and Explainability of AI
Questions and discussion
Year(s) Of Engagement Activity 2022
 
Description 2023 invited conference keynote speaker: Congress of the Portuguese Society of Neurology. Artificial Intelligence in Neurointerventional Surgery. Porto, Portugal. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 2023 conference keynote speaker: Congress of the Portuguese Society of Neurology. Artificial Intelligence in Neurointerventional Surgery. Porto, Portugal.
Questions and discussion.
Year(s) Of Engagement Activity 2023
 
Description 2023 invited lecturer for European Course on Advanced Imaging Techniques in Neuroradiology 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 2023 European Course on Advanced Imaging Techniques in Neuroradiology - 1st Cycle Module 4 on Volumetry & AI. jointly organized by the European Society of Neuroradiology (ESNR) and the European Society for Magnetic Resonance in Medicine and Biology (ESMRMB). Brain Tumours and AI. Lecture and workshop. Malta.
Year(s) Of Engagement Activity 2023
 
Description 2023 invited speaker and moderator UKNG/BNVG. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Moderated event and also gave lecture about future developments and study outcomes - questions and discussions after
Year(s) Of Engagement Activity 2023
URL https://ukng.org.uk
 
Description 2024 invited speaker: American Society of Neuroradiology 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 2024 invited speaker: American Society of Neuroradiology ASM, USA. "British Neuroradiology: Celebrating the Legacy and Navigating the Future. Responsible and Meaningful AI: Neuroradiologist's Personal Assistant."
Year(s) Of Engagement Activity 2024
URL https://www.asnr.org/asnr-2024-annual-meeting/
 
Description BBC Worcestershire interview 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Interview on AI - included the AI GRASP study
Year(s) Of Engagement Activity 2024
URL https://www.bbc.co.uk/sounds/play/p0hdf9wd
 
Description Live interactive discussion: Science Gallery London - AI's Brain Scan Breakthroughs 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact https://london.sciencegallery.com/sgl-events/ai-forum-self-care-and-ai-whos-in-control-b6f3b
was an interactive discussion which was part of the AI season at Science Gallery London:
https://london.sciencegallery.com/ai-season
"Named as one of the best exhibitions in London by Evening Standard, Condé Nast Traveller and Visit London, the new season at Science Gallery London takes a questioning and playful look at the ways artificial intelligence is already shaping so many areas of our lives - from our healthcare and justice systems to how we look after our pets."
Year(s) Of Engagement Activity 2023
URL https://london.sciencegallery.com/sgl-events/ai-forum-self-care-and-ai-whos-in-control-b6f3b
 
Description Live interview for BBC World Service (81 million daily reach) 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Discussed this paper: Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study)
Year(s) Of Engagement Activity 2024
URL https://www.bbc.co.uk/sounds/play/live:bbc_world_service
 
Description Press release published in Daily Mail (reach of 4 million per day) 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Discussed this paper: Glioblastoma and Radiotherapy: a multi-center AI study for Survival Predictions from MRI (GRASP study)
Year(s) Of Engagement Activity 2024
URL https://www.dailymail.co.uk/sciencetech/article-13034415/AI-predict-brain-cancer-survival-rate.html