QuantifyTBI: A Machine Learning Approach to Automatic Segmentation and Quantification of Lesions in Traumatic Brain Injury Imaging

Lead Research Organisation: Imperial College London
Department Name: Computing

Abstract

Traumatic brain injury (TBI) has been characterised as the most complex disease in the most complex organ of our body. TBI is defined as a pathological change in brain function caused by strong external force, commonly induced by falls, assaults, car traffic accidents, sport injuries, or the blast of an explosion in military combat. TBI has been estimated to affect over 6.8 million people per year worldwide and is the leading cause of disability and death of young adults in developed countries. The high number of incidences puts a major socio-economical burden on public health. A recent estimate of the total costs of TBI in Europe, excluding non-hospitalised patients, produces a figure of 33 billion Euros. The biggest cost, of course, is paid by the millions of patients and their families, who live for years with long-term consequences of TBI. Medical imaging combined with advanced computational methods have the potential to improve TBI care by supporting the critical tasks of early diagnosis, prognosis, and treatment. Imaging has been established as the primary tool for visual, non-invasive assessment of TBI both in critical care, and short- and long-term follow-up. However, the current use of imaging for TBI assessment is limited to manual, qualitative and often subjective inspection of the images. This motivates the main objective of this project which is the development of software tools that enable the automatic extraction of clinically useful information to improve care for patients with TBI.

The project QuantifyTBI explores computational methods, in particular machine learning approaches, to analyse and quantify brain scans of patients with TBI. Specific algorithms and software tools are developed that allow doctors to more objectively and accurately assess the severity of head injuries and monitor the progression during treatment. The main focus is to develop software that allows to automatically derive quantitative measures about TBI lesions from the patient's brain scans. Such measures include the number of lesions, the type of lesions, their size, the location, and the ratio of affected brain tissue. An accurate and comprehensive image-based quantification is essential for developing personalised treatment strategies, supporting diagnosis and monitoring disease progression. It also helps to better understand TBI from a clinical perspective, and will eventually lead to better treatment and improved outcome of TBI patients.

Planned Impact

The following beneficiaries will benefit from the research that is carried out in the QuantifyTBI project.

Public healthcare/NHS
Public healthcare, such as the NHS, benefits from the development of effective tools that support a better understanding of diseases and have the potential to help to develop better treatment strategies. Our research on TBI image analysis has the potential to have a significant impact on TBI related healthcare. The analysis tools will help to inform patient management, monitor injury progression, and improve prediction of outcome. Early and accurate prognostication would allow informed decisions regarding life sustaining treatment in the acute phase, and will help to manage treatment costs.

Clinicians
Clinicians will benefit from software tools that will support diagnosis, monitoring and treatment of TBI. The software has the potential to make decisions more informed and less subjective and dependent on experience. Less trained clinicians will benefit the most from a decision support system that could be built around our analysis software.

Patients
Patients suffering from TBI will benefit from improved care. In particular, new personalised treatment strategies that can be developed using our analysis tools have the potential to improve patient outcome.

General public
TBI can affect everyone, and one of the most frequent causes are road traffic collisions. Our research has potential to raise the awareness for TBI in the general public. Informing the public about consequences of TBI, and emphasise the importance of precautions (e.g. wearing bike helmets) could eventually lead to fewer cases of TBI. As part of this research, we will engage with the public and disseminate TBI related information material.

Industry/Pharmaceutical Companies
The analysis tools have commercial value, and medical imaging companies have strong interests in the possibility of using such tools to derive imaging biomarkers that enable patient stratification in clinical trials as well as new ways for diagnostics. Patient stratification is also of great interest to pharmaceutical companies, in particular in phase 2 and 3 of clinical trials, which can reduce costs by optimising patient selection and reduce the number of individuals needed in a particular trial.
 
Description We have shown that machine learning, and in particular, deep neural networks, can be successfully applied to quantify lesions in brain images. This has recently been further confirmed by using the developed technology from the project in new research on lesion segmentation in head CT.
Exploitation Route We have released an open source implementation of our software for detecting brain lesions. Other researchers will be able to build upon our results and further improve automatic systems for brain image analysis. The software has already been used by others on similar problems.
Sectors Healthcare

URL http://www.smh.com.au/national/health/dr-google-will-see-you-now-20161212-gt9dr1.html
 
Description This award has significantly contributed to our research in using artificial intelligence and machine learning for the analysis of medical images in radiology applications. In particular, we could demonstrate that the accurate analysis of brain scans and the automatic quantification of brain lesions is possible with automated, machine-learning based algorithms. The findings of this research have been published in scientific papers which have been very well received by the research community. One of the resulting articles in the journal of Medical Image Analysis remains one of the journal's highest cited papers over the last five years. Our publicly available source code has been downloaded, used and extended by many researchers from the biomedical imaging community. Our research has also received notable attention in the public media. Researchers from our team have been interviewed by several newspapers and we have delivered presentations and exhitbitions about our work to the general public, for example, at the World Economic Forum's Annual Meeting of the New Champions 2016 and at the annual science fair, Imperial Festival. Additionally, we informed policy makers and government officials about the potential of AI technologies in healthcare in several national and international policy events, for example, at an expert panel meeting organised by the European Commission. Our research has also influenced the health-tech industry. We have evidence from two companies, including a global player in medical imaging, that our technology has been tested and evaluated in clinical trials and our findings may thus have a direct impact on future products. We have also been successful in acquiring further funding through an EPSRC Impact Acceleration Award to further develop our technology to improve its usability by non-technical experts in the clinical research community. If successful, the developed proof-of-concept could be considered for commercialisation.
First Year Of Impact 2017
Sector Healthcare
Impact Types Societal,Economic,Policy & public services

 
Description European Commission Expert Group on Liability and New Technologies
Geographic Reach Europe 
Policy Influence Type Contribution to a national consultation/review
Impact The expert consultation has directly influenced the report of the working group on liability of new technologies in healthcare.
URL https://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.groupDetail&groupID=3592&news=1
 
Description EPSRC Healthcare Impact Partnerships
Amount £950,000 (GBP)
Funding ID EP/P023509/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 10/2017 
End 09/2020
 
Description EPSRC Impact Acceleration Award
Amount £68,193 (GBP)
Funding ID EP/R511547/1 
Organisation Imperial College London 
Sector Academic/University
Country United Kingdom
Start 04/2019 
End 03/2020
 
Description EPSRC Research Grant
Amount £707,983 (GBP)
Funding ID EP/R005982/1, EP/R005516/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 02/2018 
End 01/2021
 
Description ERC Starting Grant
Amount € 1,500,000 (EUR)
Organisation European Commission H2020 
Sector Public
Country Belgium
Start 02/2018 
End 01/2023
 
Description Clinical collaboration 
Organisation Addenbrooke's Hospital
Department Kidney Transplant Team
Country United Kingdom 
Sector Hospitals 
PI Contribution We have been developing software for brain lesion quantification used in clinical research by our collaborator.
Collaborator Contribution Our collaborator has provided research and clinical data for method development and evalaution.
Impact See publication output.
Start Year 2016
 
Title DeepMedic - Brain Lesion Segmentation Tool 
Description DeepMedic is our software for brain lesion segmentation based on a multi-scale 3D Deep Convolutional Neural Network coupled with a 3D fully connected Conditional Random Field. The system has been shown to yield excellent performance (winner of the ISLES 2015 competition) on challenging lesion segmentation tasks, including traumatic brain injuries, brain tumors, and ischemic stroke lesions. 
Type Of Technology Software 
Year Produced 2016 
Open Source License? Yes  
Impact Wide spread use in the medical image analysis community. 
URL https://biomedia.doc.ic.ac.uk/software/deepmedic/
 
Description European Commission Expert Group on Liability and New Technologies 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Provide the European Commission with expertise on the applicability of the Product Liability Directive to traditional products, new technologies and new societal challenges (Product Liability Directive formation) and assist the Commission in developing principles that can serve as guidelines for possible adaptations of applicable laws at EU and national level relating to new technologies (New Technologies formation).
Year(s) Of Engagement Activity 2018
URL http://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.groupMeeting&meetingId=9390
 
Description Imperial Global Science Policy Forum 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact The Imperial Global Science Policy Forum is a high-profile network connecting Imperial academics with senior international science and technology advisers and diplomats, UK government policymakers, industry experts and other relevant stakeholders.
Year(s) Of Engagement Activity 2018
URL https://www.imperial.ac.uk/news/188848/diplomats-industry-leaders-discuss-future-ai/
 
Description Tutorial on Deep Learning for Medical Imaging at MICCAI 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This half-day tutorial covered important aspects of deep learning with a particular focus on medical imaging applications. The tutorial aimed to provide an introduction to the basics and fundamental concepts of deep learning, practical advice for the use of deep learning for medical imaging tasks, and gave an overview of latest developments and opportunities for future research. The tutorial was targeted at all levels and for any researcher interested in deep learning. The first lectures were tailored for people new to the field (e.g., first year PhD students), while later lectures covered more advanced topics and latest developments which should be of interest to anyone already working with deep learning methods.
Year(s) Of Engagement Activity 2018
URL https://sites.google.com/view/miccai-dl-tutorial
 
Description World Economic Forum Ideas Lab Presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact The talk was intended to present advances in research on medical imaging using machine learning and artificial intelligence.
Year(s) Of Engagement Activity 2016
URL https://youtu.be/IFFntbEqxco