📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

Ultrathin fluorescence microscope in a needle

Lead Research Organisation: University of Kent
Department Name: Sch of Physical Sciences

Abstract

Optical biopsy techniques allow high-resolution images of human tissue to be obtained in real time, without the need for invasive biopsy and histology. A common approach to optical biopsy is fluorescence endomicroscopy, whereby a flexible probe containing a fibre imaging bundle obtains video-rate images from fluorescently-labelled tissue. However, these probes only allow the most superficial tissue layers to be imaged. More recently, there has been interest in incorporating fluorescence microscopy probes into needles which could penetrate below the surface of organs, thus allowing deep-tissue imaging. However, there is currently a severe trade-off between the quality of the images (in terms of image size and resolution) and the diameter of the needle probe.

In this project, a new approach for incorporating a microscope into a needle will be developed. Like conventional endomicroscopes, the needle will use a fibre imaging bundle to transmit images. However, in order to obtain higher quality images, the resolution limits of these bundles will be overcome. Conventionally, each fibre in a fibre bundle transmits only one 'pixel' of information. The new imaging system will exploit the fact that additional information can be encoded within the multiple modes of light propagation which each fibre core supports. Unlike most previous approaches which have sought to exploit fibre modes as information channels, no complex holographic reconstructions or wave-shaping using spatial light modulators will be required. Instead, an approach similar to single-pixel imaging will allow high-speed reconstruction of wide-field or optically-sectioned fluorescence images following a simple calibration procedure.

Planned Impact

This project will demonstrate new technology for high resolution imaging through ultra-thin needle probes, offering a route to minimally-invasive deep tissue imaging for use in pre-clinical animal studies, clinical diagnostics and image-guided intervention. The expected impacts are:

> Technology Development and Transfer - All technology developed during the project will be considered for intellectual property protection, with the aim of increasing the likelihood of commercial interest and adoption. Results will then be rapidly disseminated in leading journals with gold (preferably) or green open access.

> Patient and Societal Benefit - In the longer-term, if adopted in the clinic, the technology would allow real-time imaging to support or even supplant histology in certain procedures. Real-time information would support more effective decision making, particularly during interventional procedures, where conventional histology, and even techniques such as frozen section, are too slow. For example, real-time evaluation of tumour margins could help reduce incomplete excision, reducing the number of returns for reoperation and hence saving patients from additional risk and discomfort, as well as providing financial savings for health services.

> Open Data - To ensure the benefits of the project are shared widely, following IP and publication embargo considerations, all data, designs and software will be made publicly available for use by the research community. This will allow more rapid replication of results and faster developments in the field, as well as the generation of, for example, new reconstruction algorithms.

> Staff Development - The project will support the establishment of the PI's long-term research programme, seeding the development of a new group which will conduct internationally-leading research into point-of-care and in vivo microscopy and train the next generation of students in the field. The research associate employed on the project will be encouraged to take ownership of the research, and particularly the generation of new research directions. They will receive training in transferable skills from the University of Kent's staff development programme and have the opportunity to build contacts at an international conference and other networking events, preparing them for a future career in academia or industry, and hence contributing to the skilled workforce.

> Public Engagement - The project will be used as an entry point for engagement with the public around the role of imaging technology and physical sciences research in healthcare, and the complex balance between cost, invasiveness and clinical outcome. The project will also support the development of a very low-cost flexible microscope as an educational tool for use in public outreach activities.
 
Title Inline holographic microscopy of pond water through a fiber imaging bundle 
Description Demonstration of inline holographic microscopy of pond water through a fiber imaging bundle. A moving object is tracked and each frame is focused on the object as it moves in 3D. 
Type Of Art Film/Video/Animation 
Year Produced 2020 
URL https://opticapublishing.figshare.com/articles/media/Inline_holographic_microscopy_of_pond_water_thr...
 
Title Inline holographic microscopy of pond water through a fiber imaging bundle 
Description Demonstration of inline holographic microscopy of pond water through a fiber imaging bundle. A moving object is tracked and each frame is focused on the object as it moves in 3D. 
Type Of Art Film/Video/Animation 
Year Produced 2020 
URL https://opticapublishing.figshare.com/articles/media/Inline_holographic_microscopy_of_pond_water_thr...
 
Description ptical biopsy techniques allow high resolution images of human tissue to be obtained in real time, without the need for invasive biopsy and histology. A common approach to optical biopsy is fluorescence endomicroscopy, whereby a flexible probe containing a fibre imaging bundle obtains video-rate images from fluorescently-labelled tissue. However, these probes only allow the most superficial tissue layers to be imaged. More recently, there has been interest in incorporating fluorescence microscopy probes into needles which could penetrate below the surface of organs, thus allowing deep-tissue imaging. However, there is currently a severe trade-off between the quality of the images (in terms of image size and resolution) and the diameter of the needle probe.

In this project, we developed a new approach for incorporating a microscope into a needle. We showed that it is possible to send microscopy images through a conduit that is under 0.1 mm in diameter. The conduit contains a multimode fibre, consisting of in inner core and an outer cladding. Multimode fibres do not normally transmit images, the light is scrambled as it travels through the fibre. We showed that by projecting random patterns through the fibre, we could build up an image from a large number of measurements using a concept called single pixel imaging. We were able to show that we could achieve a frame rate of 1 image per second, with a resolution better than a fibre bundle. We evaluated two different methods of generating the random patterns: a digital micromirror device (similar to that used in a digital projector) and a pair of scanning mirror behind a diffuser plate.
Exploitation Route These results will be of interest to teams working to develop ultrathin needle microscopes for medical or biomedical applications.
Sectors Healthcare

Pharmaceuticals and Medical Biotechnology

 
Description Ultrathin Inline Holographic Microscopy
Amount £19,500 (GBP)
Funding ID RGS\R2\202225 
Organisation The Royal Society 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2021 
End 07/2022
 
Title Real-timing processing of fiber bundle endomicroscopy images in Python using PyFibreBundle: data and code 
Description This dataset contains raw images and python scripts used to generate figures from the paper:"Real-timing processing of fiber bundle endomicroscopy images in Python using PyFibreBundle".This paper describes and evaluates the Python package PyFibreBundle which provides a toolkit for working with images captured through fibre imaging bundles. An archived copy of PyFibreBundle Release 1.3.4 is included here to allow for exact replication of the results in the paper. However, if you are intending to use PyFibreBundle for other purposes, please download the most up-to-date version from: https://github.com/MikeHughesKent/PyFibreBundle. Here you will also find examples, tests and installation instructions.Within the repository, scripts and data used to generate the figures and timings from the paper are in the 'paper' folder. The 'src' folder contains the archived copy of PyFiberBundle Release 1.3.4. A copy of the documentation for this release of PyFibreBundle is in the 'docs' folder; to read this open 'docs\build\html\index.html' in a web browser. The up-to-date documentation can also be found at: https://pyfibrebundle.readthedocs.io/If making use of the code, please (1) reference the paper and (2) provide a link to the the latest version of PyFibreBundle. If you would like to collaborate on using this code, please get in touch. 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? Yes  
URL https://figshare.com/articles/dataset/Real-timing_processing_of_fiber_bundle_endomicroscopy_images_i...
 
Title PyFibreBundle 
Description PyFibreBundle is a Python package for processing images captured through optical fibre bundles. PyFibreBundle is fast enough for live imaging as well as for offline research; frame rates of over 100 fps can be achieved on mid-level hardware, including core removal and mosaicing. The Numba just-in-time compiler is used to accelerate key portions of code (particularly triangular linear interpolation) and OpenCV is used for fast mosaicing. If the Numba package is not installed then PyFibreBundle falls back on Python interpreted code. 
Type Of Technology Software 
Year Produced 2023 
Open Source License? Yes  
Impact As the code is freely available on Github it is not possible to track usage. I have been informed by several research groups that they are making use of the code to support their research into fibre bundle imaging techniques. 
URL https://pyfibrebundle.readthedocs.io/en/latest/
 
Description Community Outreach Day in Ramsgate Market 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact In collaboration with Discovery Planet, a one-day pop-up event was held in Ramsgate Market. The key message of the event was to illustrate via simple experiments many different aspects of light technologies and their value to society. The science was explained through a series of games (some participants playing them twice!), while there was more detailed information available for those who wanted to find out more.

The first two experiments in the 'Light Loops' tent demonstrated how light travels through tubes of perspex and water by total internal reflection. While it's universally accepted that 'light travels in straight lines', these demonstrations showed how light can be 'bent' using optical fibres, getting it to where we need it. These fibres now play a key role in our society, from the fibre broadband in our homes to medical devices in our hospitals.

Next, a maze of 'security' light rays challenged participants to reach a crystal placed in the middle of the maze. Finally in this tent, an ultraviolet torch was used to find four hidden letters written using fluorescent materials, introducing the idea of using fluorescence in medical imaging and document security (as taught to our forensic science students).

Finding the remaining three letters to complete an anagram then took participants over to the 'Light Botic' tent. Here, the participant had to try their skills as a medic, hunting for the remaining letters inside a 'patient' using a flexible endoscope, and giving them an insight into how difficult medical diagnostics can be. This tent also showcased some of our latest work in miniaturised medical imaging devices for the lung.
Year(s) Of Engagement Activity 2019
URL https://research.kent.ac.uk/applied-optics/2019/10/10/community-outreach-at-ramsgate-market/
 
Description Presentations and demo endomicroscope at University of the Third Age research day 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact A talk was given to around 100 people on "Where No Microscope Has Gone Before", explaining how ultrathin microscopes can be built. A demo of a simple fluorescence endomicroscope was then available to give participants the opportunity to see for themselves how it worked.
Year(s) Of Engagement Activity 2019
URL https://research.kent.ac.uk/applied-optics/2019/05/31/2019-u3a-event/
 
Description Taster day for sixth formers 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact A 1.5 session with sixth formers, part of a one day helping them to understand university activities and life. An outreach/demonstration endomicroscope, part funded by EPSRC and the University of Kent, was used to introduce ideas related to optics, fluorescence and medical imaging,
Year(s) Of Engagement Activity 2019
 
Description Visit of schoolchildren 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Schools
Results and Impact Twenty schoolchildren visited the lab in small groups and some demonstration of endoscopic and needle imaging systems. Michael Hughes then gave a 15 minute talk to discuss career opportunities in physics and optics.
Year(s) Of Engagement Activity 2018