Development of 2D and 3D Ultrasound Super-Resolution (US-SR) Imaging for the Clinic

Lead Research Organisation: King's College London
Department Name: Imaging & Biomedical Engineering

Abstract

Cancer is among the leading causes of death worldwide. Cancers generate their own network of blood vessels to provide nutrients and oxygen to grow and spread. Detecting these developments early and treating them increases the chances of survival. However, current imaging methods are unable to detect these microscopic structures deep within the body. Therefore there is a crucial need to develop new imaging techniques that can fill this requirement. Additionally, imaging techniques which can look at the full 3D region of disease are urgently needed to reliably assess these.

The research in this proposal is designed to develop and demonstrate an ultrasound imaging technique known as ultrasound super-resolution (US-SR) in 2D and 3D in the clinic. US-SR is able to image extremely fine details of the blood vessel network, previously unseen with standard ultrasound imaging. This technique involves adding small amounts of microbubbles into the blood stream, which show up on the ultrasound images because the sound is more strongly reflected from the bubbles than other tissues. These bubbles circulate harmlessly within the vessels until they dissolve after a few minutes. By pinpointing the location of these travelling bubbles over time, we can build up an image which 'paints out' the vessel structures containing those microbubbles. The ability to see these small vessels using ultrasound, which is able to image at depth (>10 cm) in humans, has the potential to identify these important changes in the vascular network

Currently, however, US-SR has only been demonstrated in a small number of patients, it requires long scan times (in the range of 10s of minutes depending on the target) and ultrasound use in hospitals is generally limited to 2D. Within this proposed fellowship, it is my aim to firstly, develop faster ways to acquire the data needed to create these images. Secondly, to demonstrate the use of 2D US-SR in a large number of patients. And lastly, to use these developments to move 3D US-SR into the clinic.

Successful 3D clinical US-SR demonstration could propel this technique into clinical practice. Its use could provide safe, low-cost microscopic assessment of blood vessels associated with disease. This could be crucial to patients with a wide range of micro-vascular related diseases including cancer due to early diagnosis and treatment. Given that US is an affordable imaging technique compared to for example x-ray CT and MRI, this could also provide significant cost-savings for the NHS.

Technical Summary

Non-invasive imaging of the microvasculature is crucial for the early detection and intervention of diseases such as cancer and other microvascular related diseases. This proposal addresses a crucial clinical challenge: the lack of a sensitive, safe, repeatable method for detecting, characterising and monitoring such diseases. Recently developed ultrasound super-resolution (US-SR) is able to resolve microvascular details far beyond the diffraction limit at depth (>10 cm) in vivo. To transfer this technology into society, clinical translation and 3D US-SR development is urgently needed.
Aims:. This research is designed to provide advances in areas of maximal clinical relevance through systematically designed experiments, recent technological advances, and clinical guidance and support. The results will provide both validation, and a solid grounding in basic science for the fast developing field of US-SR. The core objectives are:
1)To develop novel advanced, acquisition strategies and real-time software using deep learning, advanced signal processing methods, and the activation of sparse contrast agent to provide improved detection accuracy, localisation rates, and automation.
2)To design, develop and test (in vitro and in vivo) the accuracy and clinical relevance of structural and functional parameters for disease characterisation.
3)To formalise clinical 2D US-SR and establish clinical acceptance. This involves the demonstration of the diagnostic power of US-SR parameters over large clinical datasets from existing studies.
4)To develop and implement clinical 3D US-SR with the aid of advances made in 1)-3), a healthy volunteer pilot study and existing patient studies.
By making maximal use of planned or existing trials, I will avoid the need for significant additional human involvement. Throughout this translational project, methods will be evaluated by an extensive network of clinicians and researchers, allowing continuous feedback and ongoing knowledge

Planned Impact

Patients, the NHS, clinicians, the education sector, researchers and industries will benefit from this research. The proposed research could propel ultrasound super-resolution (US-SR) into the clinical world. Clinical 2D US-SR will be implemented within the time-frame of the Fellowship. Its real-world deployment could provide repeatable, safe, low-cost microscopic assessment of vasculature. This could aid clinicians with early disease detection, diagnosis, intervention and treatment monitoring in cancer, as well as a wide range of microvascular related diseases, e.g. those associated with diabetes and ischemia. Early detection and clinical intervention can significantly increase the chances of survival for almost all cancer patients. The work has the potential therefore to enhance the quality of life for many people, and in turn contribute to the nation's improved health. Clinicians and the patient population could thus be a beneficiary of this research within the next 5-10 years. In the future, US-SR may also be able to inform a personalised treatment plan based on characterisation of the vascular network and behaviour. More sensitive, personalised diagnostic modalities would have huge worldwide benefits to the future of cancer treatment and monitoring. This could potentially occur within the next 15 years.

Given that US is an affordable technology compared to e.g. x-ray CT and MRI, this technology could also provide significant cost-savings for the NHS. In addition, real-time US-SR could aid in assessing disease conditions in a fraction of the time required for the aforementioned imaging modalities, improving clinical efficiency and reducing clinical time requirements. Furthermore, improved resolution of microvascular structure and flow may introduce new indicators to aid diagnosis and could further expand the use of contrast enhanced US in primary care. This, as well as promoting the use of 3D clinical probes, and microbubble (MB) contrast agents in both a clinical and research setting would benefit companies and industries active in US medical diagnostics and MB manufacturers, e.g. Bracco, as well as clinicians and researchers, during the time-frame of the project. This could avoid more expensive clinical examinations and hence reduce healthcare costs. Further cost-savings gained through early cancer detection and intervention would result from increased chances of successful treatment, improved survival rates, and reducing the need for costly late-stage cancer treatments. Furthermore, newly developed acquisition protocols and software offers opportunity for commercialisation and industrial development. Researchers and the education sector will also benefit during and after the project finishes through dissemination and communication about the research in the academic environment, summer schools, and through public engagement activities.

Widespread implementation of 3D US-SR will likely be slower then 2D due to the current limited availability of 3D clinical probes, however this is predicted to drastically increase in the next few years due to recent advances in ultrasound (US) hardware and software. Successful demonstration of 3D US-SR could help to expedite translation of 3D equipment to the clinic, thus benefiting both clinicians and medical diagnostic companies e.g. Phillips and GE.

Both the Fellow and Research assistant will develop investigative research skills, interpersonal and communication skills across different audiences, e.g. academics, clinicians and the public. Furthermore, skills involved in working in an interdisciplinary environment, with clinicians, patients and researchers in different areas of expertise will be hugely valuable. The fellow will also develop project management and leadership skills needed to effectively deliver this ambitious project. This will aid in providing skilled people to the workforce.

Publications

10 25 50
 
Description Centre of Medical Engineering Public Engagement Grant scheme
Amount £3,000 (GBP)
Organisation King's College London 
Sector Academic/University
Country United Kingdom
Start 07/2022 
End 07/2023
 
Description EPSRC DTP Studentship
Amount £83,934 (GBP)
Funding ID EP/W524475/1 
Organisation King's College London 
Sector Academic/University
Country United Kingdom
Start 02/2023 
End 07/2026
 
Title Aberration simulation model 
Description This simulation combines the established K-Wave model which the marmottant microbubble model into a single simulation model with realistic aberration masks in order to investigate the effects of aberration on ultrasound super-resolution imaging. This is a way of establishing its effects through realistic in vivo tissue without the use of real subjects/animals, and with the benefit of having ground truth for validation purposes. 
Type Of Material Computer model/algorithm 
Year Produced 2020 
Provided To Others? No  
Impact This has resulted in an improved understanding of the effect of aberration on deep ultrasound signals in the body and has produced a publication listed in the outcomes sections for publications including (DOI: 10.1109/IUS52206.2021.9593820) 
 
Description Collaboration with Antonios Pouliopoulos 
Organisation King's College London
Country United Kingdom 
Sector Academic/University 
PI Contribution We will be sharing our expertise and intellectual input in microbubbles and contrast enhanced ultrasound imaging since we have a shared interest in the use of microbubbles in ultrasound. I will also provide training of his students/staff on our research systems and equipment in the lab. We will offer the shared use of our lab space and lab equipment, and therefore will also provide training for the required equipment.
Collaborator Contribution Antonios is an expert in the use of ultrasound and microbubbles to treat brain diseases and so his intellectual input, expertise and shared knowledge will be very valuable. We will be sharing lab space, and therefore will be able to share and have access to shared equipment. We will also have access to experts in performing interventional ultrasound in vivo experiments which may be beneficial.
Impact We have put forward a number of project proposals with co-supervision to supervise prospective students with our combined expertise.
Start Year 2021
 
Description Collaboration with Cardiac Modelling and Imaging Biomarker Team 
Organisation King's College London
Country United Kingdom 
Sector Academic/University 
PI Contribution This collaboration involves access to equipment and facilities, including high frame rate ultrasound imaging research systems (ULA-OP systems) and ultrasound imaging lab, as well as ultrasound imaging and contrast expertise and intellectual input.
Collaborator Contribution The partners contribute their expertise within the field of cardiac imaging and cardiac pressure estimations, and perform the experimental research.
Impact 10.1109/TUFFC.2019.2948759 10.1109/IUS52206.2021.9593833
Start Year 2019
 
Description Collaboration with Dr Jim Watchorn 
Organisation Royal Berkshire Hospital
Country United Kingdom 
Sector Hospitals 
PI Contribution Intellectual input and expertise in terms of contrast enhanced ultrasound imaging of the vasculature and in particular using super-resolution imaging. Providing guidance on the imaging protocol for research data collection for a study on ICU patients. Data analysis of subsequent data.
Collaborator Contribution Access to data. Clinical expertise in Intensive Care and Nephrology, in particular Sepsis and the vascular presentation of patients with septic shock. Intellectual input in nephrology and complex vascular function.
Impact Research dataset from ICU patients
Start Year 2021
 
Description Collaboration with Dr Peralta 
Organisation King's College London
Department Division of Imaging Sciences and Biomedical Engineering
Country United Kingdom 
Sector Academic/University 
PI Contribution My contribution to this collaboration is my expertise in super-resolution ultrasound imaging and bubble physics, as well as shared lab equipment and training.
Collaborator Contribution Dr Peralta has expertise using the K-wave simulation platform, and has already performed investigations into the effects of aberration on ultrasound imaging. Together with my expertise in super-resolution imaging and bubble physics, this allows us to form a collaboration to investigate this important topic.
Impact DOI: 10.1121/1.5146890 DOI: 10.1109/IUS52206.2021.9593820 DOI: 10.1109/IUS52206.2021.9593571 DOI: 10.1109/IUS46767.2020.9251837 DOI: 10.1109/IUS46767.2020.9251331 DOI: 10.1109/ULTSYM.2019.8926265
Start Year 2019
 
Description Collaboration with Imperial College London 
Organisation Imperial College London
Department Department of Bioengineering
Country United Kingdom 
Sector Academic/University 
PI Contribution My contribution involves intellectual input and expertise in super-resolution ultrasound imaging and contrast enhanced ultrasound imaging. Furthermore access to data, equipment and facilities when needed.
Collaborator Contribution My partners contribution involves intellectual input and expertise in a wide range of ultrasound, signal processing, engineering, and imaging. Furthermore access to data, equipment and facilities when needed.
Impact 10.1109/IUS46767.2020.9251478 10.1109/IUS46767.2020.9251336 10.1109/IUS52206.2021.9593820 10.1121/10.0004529 10.1109/TUFFC.2019.2943646 10.1055/a-1917-0016 10.1109/IUS54386.2022.9958903
Start Year 2019
 
Description Collaboration with James Choi 
Organisation Imperial College London
Department Department of Bioengineering
Country United Kingdom 
Sector Academic/University 
PI Contribution I am contributing expertise and intellectual input, as well as the use of our imaging equipment and facilities. This includes training and imparting knowledge on imaging, microbubble imaging and super-resolution to his team. They also have access to our lab, equipment e.g. high frame rate ultrasound system, data and training. We are also collaborating on developing new complimentary ideas, sharing phantom knowledge and sharing microbubble based knowledge. Group members have also attended our group meetings to get feedback and advice.
Collaborator Contribution James is an expert in the use of ultrasound and microbubbles to treat brain diseases and so his intellectual input, expertise and shared knowledge will be very valuable. We will be meeting regularly, and sharing a PhD project student. This will mean having access to his lab space, valued equipment, expertise and his teams extensive knowledge on many aspects e.g. phantoms, microbubble dynamics and therapy.
Impact 10.1121/10.0010944. Another output is a 'Centre of Doctoral Training in Smart Medical Imaging' PhD project due to commence Sep 2023 entitiled: 'Bubble Brilliance - - how microbubbles provide contrast in ultrasound imaging'. This project will be co-supervised by James and I, with multi-disciplinary research involving biology, chemisty, physics, engineering for the application of non-invasive surgery. The proposed work is a study in physics and engineering; and in the development of a new microvascular imaging algorithm. The student will be investigating the physics of bubbles and ultrasound while analysing data using signal and image processing. We will also be engineering a new medical imaging technology that will be able to image the microvasculature. As a result, this work is within the remit of the EPSRC and the CDT in Smart Medical Imaging.
Start Year 2020
 
Description Collaboration with London South Bank University 
Organisation London South Bank University
Country United Kingdom 
Sector Academic/University 
PI Contribution My contribution included access to lab facilities, intellectual input, and use of research equipment, including high frame rate programmable research ultrasound systems (ULA-OP 256 systems).
Collaborator Contribution Contributions made by the partners included expertise in the area of mechanical engineering and bone characterisation. Collaborators performed experimental studies with phantoms and resulted in a conference publication.
Impact 10.1109/IUS46767.2020.9251566 10.1109/IUS46767.2020.9251336 10.1109/IUS52206.2021.9593571 10.1109/TUFFC.2019.2943646
Start Year 2020
 
Description Collaboration with Maria Thanou 
Organisation King's College London
Country United Kingdom 
Sector Academic/University 
PI Contribution I am contributing expertise and intellectual input, as well as the use of our imaging equipment and facilities. This includes training and imparting knowledge on microbubble and nanodroplet imaging to her students. They also have access to our lab, equipment, data and training. We have been performing calibration experiments as well as exploratory experiments to characterise their new nanodroplets. Group members have also attended our group meetings to get feedback and advice.
Collaborator Contribution Maya and her team have expertise in nanomedicine. They have contributed their expertise and intellectual input, and have been performing experiments in our lab. We have submitted two CDT PhD projects to co-supervise, and equipment funds to buy shared equipment. One of these projects was chosen by a student and will begin Sep 2023.
Impact CDT PhD Project Student who will start on the project: 'Nanodroplets for brain tumour imaging and therapy' in Sep 2023. This is a multi-disiplinary project involving biology, chemistry. engineering and physics. It will involve the development of nanodroplets for super-resolution ultrasound imaging.
Start Year 2021
 
Description Collaboration with University of Florence 
Organisation University of Florence
Country Italy 
Sector Academic/University 
PI Contribution I have been using research systems developed by the team at University of Florence to perform my research and have a close working relationship with their team regarding its use within super-resolution ultrasound imaging and publish my work on this topic in collaboration and dialogue with them. Therefore there is exchange of expertise and intellectual input. This year, a student of theirs will visit our lab for 3 months to work on a project with our equipment which has compatibility with their system. This will enable valuable knowledge exchange, and in addition we will train the student in the use of our additional equipment, and the student will be able to train us in the recent developments of their research system.
Collaborator Contribution These collaborators have provided us with research equipment, ongoing equipment and software support and guidance, as well as lab visits. They train us with the use of this system and any updates and problems we meet. They are always available to provide product support and developments. This year, a student of theirs will visit our lab for 3 months to work on a project with our equipment which has compatibility with their system. This will enable valuable knowledge exchange, and in addition we will train the student in the use of our additional equipment, and the student will be able to train us in the recent developments of their research system.
Impact 10.1109/IUS46767.2020.9251336 10.1109/IUS52206.2021.9593571 10.1109/IUS46767.2020.9251837 10.1109/TUFFC.2019.2943646 10.1109/IUS46767.2020.9251331
Start Year 2019
 
Description Collaboration with Wenfeng Xia 
Organisation King's College London
Country United Kingdom 
Sector Academic/University 
PI Contribution We are using my expertise and intellectual input into collaborative work with photoacoustics. This will also involve the training of staff by my team. It has also included access to equipment and lab facilities.
Collaborator Contribution We are using Wenfeng's expertise and intellectual input of photoacoustics into collaborative work with super-resolution and microbubbles. This will also involve the training of my team by Wenfeng's team. It may also included access to photoacoustic equipment and lab facilities.
Impact This is new research that will be conducted by our teams combining Photoacoustic technology with our team's work on super-resolution/microbubbles
Start Year 2023
 
Description Conference Challenge Organising and Advisory Committee 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Although the challenge has been organised over the past year, the submission has not happened, so the impact is difficult to ascertain as yet. It is intended to spark collaboration, discussion, shared knowledge and shared data and image processing capabilities between the wider participants (which will be in the 100s). These impacts/outcomes have already happened between the members on the organising committee, for example organising this challenge has sparked debate, discussion and collaborative work on how best to formulate this challenge and create and distribute the challenge data, as well as on the wider subject of super-resolution itself. Further impacts and outcomes are expected once the challenge has been completed at the upcoming conference.
Year(s) Of Engagement Activity 2022
URL https://2022.ieee-ius.org/ultra-sr-challenge/
 
Description Hosting a School Lab visit for 'I Can Be' Charity 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact I Can Be is a charity which pairs up socially disadvantaged school girls with inspiring women in the work place. I hosted a group of 7 and 8 year old girls from disadvantaged backgrounds selected from London schools at my institution (St Thomas's Hospital). I organised activities for them to do related to my work, answered questions about my career, work, role, and took them on a tour. It is hoped that this would inspire young girls from disadvantaged backgrounds into the possibility of careers in STEM subjects.
Year(s) Of Engagement Activity 2020
URL https://www.icanbe.org.uk/
 
Description I'm a Scientist, Get me out of here 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact 'I'm a Scientist, Get me out of here' connects school students with scientists working in the profession/research from across the UK. This sparks questions and discussions about what it means to be a scientist, what it is like working as a scientist, and encourages children to think about science professions as an option for their future career.
Year(s) Of Engagement Activity 2022
 
Description Institute of Physics Summer Reading Challenge 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The annual Summer Reading Challenge was held in libraries across Islington. This year's theme, 'Gadgeteers', was designed to spark children's curiosity about the world around them. With resources and activities from the Science Museum, the challenge focuses on inspiring children to see the science and innovation behind everyday objects, showing that reading and science are for everyone. The aim was to read six books over the summer, for a chance to win prizes. All completers will receive a certificate and medal. We also provided science based interactive activities for them to take part in. Parents and children provided great feedback, questions, discussion about careers in science, including some particular interest in pursuing physics in the future.
Year(s) Of Engagement Activity 2022
URL https://www.iop.org/events/iop-summer-reading-challenge-islington-libraries-0
 
Description Institute of Physics Summer Superhero Open Days 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact The IOP limitless campaign and Superheroes Unlimited summer exhibition engaged audiences with physics with numerous exhibitions and events. In total, the campaign reached over 2,800 people who were inspired to support and potentially become the science superheroes of the future. Children and adults were excited to take part in interactive activities, discuss potential future roles in science, and promoted lots of discussion about physics and role models/career aspirations. Feedback from children and adults were brilliant. Following the success, there are now future events being organised (e.g. Summer Festival in Bristol), School workshops organised from to being noticed and approached at the events, indication of increased interest in science by the attendees, a request to do a school assembly about a science career, and an internal grant funding for future Public Engagement events at local schools.

Testimonial from organiser - 'In the Superheroes Unlimited exhibition, we were delighted to work with Kirsten to reimagine her work at the KCL School of Biomedical Engineering & Imaging Sciences and create the science superhero UltraSonic. Young people, their families and their teachers were inspired by the character's powers to create special bubbles and control them with unltrasound. The exhibits and accompanying experiments sparked the imagination to think about the role of physics in medicine and its application to the challenges that we all face. At family events - young people were excited to meet our "real life superhero" and the activities she brought with her were a huge hit with visitors young and old alike! Visitors loved using a real-life ultrasound tool to solve puzzles and have a scan to take home as a souvenir. Our campaign, Limit Less, wants to demonstrate the societal impact of physics on the global issues that young people care about so we were thrilled to work with Kirsten to share her work and give young people a positive role model working in such an exciting application of physics."
Year(s) Of Engagement Activity 2022
URL https://www.iop.org/explore-physics/superheroes-unlimited
 
Description School Visit (St Mary's of the Angels School, London) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Visited a school to host a workshop with approximately 30 pupils. We demonstrated the power of sound/ultrasound and illustrated bubble oscillations to young children through interactive activities, with the hope to inspire them follow a STEM career. This sparked questions and discussion afterwards, and the school reported continued excitement about the workshop afterwards.
Year(s) Of Engagement Activity 2023
 
Description Twitter Outreach during British Science Week 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I took part in posting #MIStories (medical imaging stories) on Twitter via the School account which involved showing examples of our research and research images in occasion of the British Science Week (6th-15th March 2020 https://www.britishscienceweek.org/) for further public engagement of our work beyond the normal peer group, and enabled engagement via social media (Twitter, LinkedIn). The images may further be used on the School/CDT website, and in printed form for public engagement events in the future.
Year(s) Of Engagement Activity 2020
URL https://twitter.com/KingsImaging/status/1239853988507340801?s=20