Dynamic Dichroic Mirrors and Single-Shot Spectroscopy

Lead Research Organisation: Imperial College London
Department Name: Bioengineering

Abstract

Optical spectroscopy involves splitting light up into its component wavelengths, exactly like how a glass prism splits sunlight up into a rainbow (or 'spectrum') of colours. While this may, at first, just appear to be aesthetically pleasing, the rainbow of colours does include some very useful information about the light it came from. For example, if one were to look very carefully at the orange part of the spectrum of the sun (roughly around the colour corresponding to old orange street lights), one would find a pair of dark lines where the light appears to be missing. This corresponds to absorption due to sodium, which tells us that there is sodium in the upper atmosphere (or 'chromosphere') of the sun; we have, in effect, learned part of what the sun is made of, from 93 million miles away, using nothing more than a glass prism. This is the power of optical spectroscopy.

Optical spectroscopy has many other uses; it can investigate the chemical composition of forensic samples, help locate a tumour, identify chemical weapons from a distance, monitor deforestation from orbit, authenticate artwork, and many more besides. Nevertheless, if we try to take pictures like we would do with a camera, there's a problem; a camera can only capture 2D information, and if we have a spectrum at each pixel, we either need to illuminate one line at a time (and use the other axis of the camera to measure the spectrum) or use a sequence of filters to get the data one wavelength at a time. In fact, if we know what spectrum we're looking for, the filter approach is much faster, but that requires carrying a stack of filters for each thing you might want to measure. That might be OK for a few things, but for portable or space-based applications, or if there are a lot of potential analytes, that can become infeasible. The alternative is to make a new filter each time, using a photorefractive polymer.

This new system can create any filter that the user might want, writing it into a material similar to that used to make holograms. This is unlike normal tunable filters, which are typically only capable of tuning a single transmission band's width and center wavelength. This new approach can create any filter profile the user might want, including multiple independent bands and different band shapes. It works by recording an interference pattern in a holographic plate, using two laser beams. The angle between the laser beams is changed, and another interference pattern is recorded. After doing this many times, the filter profile is recorded in the hologram; this entire process takes less than a second. Once the filter isn't needed any more, it can be rewritten, and a new pattern created; any number of analytes can be searched for, including those which the system has never seen before; they need only be programmed in by the control computer.

The holographic material is a new type known as a photorefractive polymer. Unlike normal holograms, this material is rewritable; it can be erased, and a new pattern written into it. While this has been used to create rewritable holographic displays before, this is the first example where the material will be used to create a holographic filter. Nevertheless, synthesizing it is not difficult; it requires just two components to be made from scratch, and these are both easy synthetic procedures with high yields.

Overall, this project offers to create a kind of 'Instagram for spectroscopy'; rather than being limited to a small selection of physical camera filters, a user can digitally apply any one that might be needed, including programming a new one from scratch if necessary. This makes the spectroscopic imaging process faster, and more efficient, allowing the user to gather data over larger areas, and with more precision, than ever before.

Planned Impact

Aside from the academic impact, this technology has the potential to benefit a large number of other stakeholders. As noted elsewhere, while this is intended purely as a prototype instrument, once it is constructed and characterized, altering it for other applications is trivial. The Rowlands Lab research program will be pursuing some of these applications, but the designs and characterization data will be disseminated freely to encourage users to adapt the design for other purposes. Some example stakeholders include:

1) Soldiers and homeland security (standoff threat detection). The ability to detect and monitor small molecules in the environment is important when these molecules may be hazardous. Chemical warfare agents such as chlorine and mustard gas can be identified by their vibrational spectra and hence avoided; some toxins even have a pronounced colour, hence can be detected by their UV/Vis spectra alone.

2) Environmental monitoring. By enabling earth scientists to study larger areas in more detail, the resulting information directly informs political decisionmaking, commercial development and pollution control. The population as a whole all benefit from these efforts, since it enables natural resources to be preserved, and the population's exposure to toxic chemicals to be minimized. Similarly, monitoring of emissions from power stations, factories and other potential polluters can be done over a larger area and at lower cost, further protecting the population from potentially harmful contaminants.

3) Forensic investigators. The ability to rapidly sweep a crime scene for signs of blood, semen or other forensic samples is clearly of interest in criminal investigations. Investigators could tune the filter to that of a vibrational spectrum corresponding to an analyte (such as blood) and allow a computer to analyse the image to determine when there are stains that might be worth further study. The ability to rapidly switch between different filters, and to process the entire scene as an image rather than having to take spectra one line at a time, minimizes the possibility that a sample is missed, or isn't classified correctly.

4) Doctors / surgeons. A great deal of ongoing research is focussed on the use of hyperspectral imaging in medicine. For example, Raman microscopy is under investigation as a means of locating tumour cells, and image-guided fluorescence surgery is being trialed in order to locate a tumour margin. Bacteria and other toxins can be identified by their optical spectra as well. By developing a high-speed hyperspectral imaging system, these techniques could be sped up in order to make them of practical use in the clinic, rather than just curiosities to be investigated in the laboratory.

5) Manufacturing. As noted elsewhere, one potential application of dynamic hyperspectral imaging would be quality control. Being able to monitor a reaction, assess the composition of a polymer, or determine the contents of a dye sample are of widespread interest throughout the manufacturing sector, and by increasing hyperspectral image throughput to match the rate of production of a modern industrial process, these applications can be pursued, rather than being avoided because of a lack of speed.

6) Robotics. Robots use many different types of hyperspectral imaging to sense the environment, from near-infrared LIDAR to multiple cameras operating in the visible, to long-wave infrared thermal imaging. Being able to rapidly filter the light to, for example, image at wavelengths which easily penetrate foliage, or reject interference from lasers and other bright sources would enable the robot to be more robust and to cope with a larger number of environmental conditions.

Along with the benefits highlighted above, the project has a number of opportunities for training researchers in precision optical engineering and high-tech manufacturing, and these will be a source of additional impact.

Publications

10 25 50
 
Description [2021]
Though this work is still ongoing, the interferometer design (which creates the interference patterns that form the filter) has been built and tested. The laser modulation bandwidth is not sufficient for the proposed instrument, so a modification was made to incorporate an electro-optic modulator - this appears to be able to achieve the necessary speed and modulation depth. Further to this, the electronic design has been validated, and is able to sustain the data throughput at the required precision in order to keep up with the moving components of the system.

The interferometer design was reworked after it was discovered that the original design was insufficiently stable. As a fortunate consequence, the new design was quite unique, in the sense that it could be used for several novel new applications including Structured Illumination Microscopy. This work is being developed by a PhD student, who is hopefully going to publish it as a significantly improved method for creating complex arbitrary interferometric patterns.

[UPDATE MARCH 2022]: The new interferometer design has been significantly better characterized and has been implemented into a SIM system. Fringe stability, while not perfect, appears good. Reconstructed super-resolution images still have not been obtained, but the performance characteristics are promising - interference modulation contrast is good, integration issues have largely been overcome, and the system speed is world-class.
Exploitation Route If this project goals are ultimately met, the result will be a reprogrammable optical filter that can be used by optical scientists and engineers to create hyperspectral imaging instruments which operate at unprecedented speeds. This will be useful for defence, security and aerospace (for space-based monitoring, chemical weapon detection, decontamination efforts, penetrating camouflage, and so on), as well as manufacturing (defect monitoring, quality control). This project has also involved creation of a Raman microscope which is being used in the lab for cancer detection, and is also being taken forwards as a high-throughput Raman mapping tool.

The new interferometer design is being explored both for patent protection, as well as for use in optical microscopy, photolithography, 3D printing and other potential applications. The design is expected to form the basis of future optical interferometers requiring stable fringes but the ability to rapidly control the phase and configuration of the interfering beams.

[UPDATE MARCH 2022] Patenting has been delayed until we can generate proper superresolution microscopy images. Initial (confidential) discussions with microscopy companies appear very positive, and there is a good chance of a licensing agreement once performance has been proven.
Sectors Aerospace, Defence and Marine,Education,Manufacturing, including Industrial Biotechology,Pharmaceuticals and Medical Biotechnology,Security and Diplomacy,Other

 
Description During this work we were forced to pioneer a new type of interferometer with a wide variety of applications, but in particular it was suitable for Structured Illumination Microscopy (SIM). We coupled the interferometer to the microscope and found it performed as predicted, providing several performance advantages (field of view, achromaticity, speed, photon efficiency). The interferometer design has been chosen by the Technology Transfer office at Imperial College to be patented, and the filing will occur within the month. NDAs have been arranged with the microscope manufacturers Nikon and Olympus; both have expressed an interest in licensing the technology. Zeiss is in the process of approving an NDA as well. The SIM implementation has attracted funding from the Royal Society to purchase a high-speed camera in order to exploit the speed of the design; this work will be prepared for publication after the patent is filed. Finally the SIM microscope was the focus of a PhD student's thesis (after his original project was scooped) and he successfully defended in October.
First Year Of Impact 2022
Sector Healthcare,Manufacturing, including Industrial Biotechology,Other
Impact Types Societal,Economic

 
Description DORMOUSE: Detection Of Reflected Microscopic Optical UltraSound Emission
Amount £60,000 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 10/2021 
End 09/2025
 
Description Deep Tissue Short-Wave Infrared Multiphoton Microscopy
Amount $1,000,000 (USD)
Organisation Chan Zuckerberg Initiative 
Sector Private
Country United States
Start 01/2021 
End 06/2023
 
Description Megapixel Ultrasound Scanners for Deep Tissue Cellular Imaging
Amount $1,000,000 (USD)
Organisation Chan Zuckerberg Initiative 
Sector Private
Country United States
Start 01/2021 
End 06/2023
 
Description Primed Conversion Oblique Plane Microscopy
Amount £149,999 (GBP)
Funding ID BB/T011947/1 
Organisation Biotechnology and Biological Sciences Research Council (BBSRC) 
Sector Public
Country United Kingdom
Start 03/2020 
End 09/2020
 
Description Projected Arbitrary Spot Structured Illumination Microscopy
Amount £19,950 (GBP)
Funding ID RGS\R2\212305 
Organisation The Royal Society 
Sector Charity/Non Profit
Country United Kingdom
Start 02/2022 
End 01/2023
 
Description The Computerized Chemist
Amount £60,000 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 10/2021 
End 09/2025
 
Description Towards High-Throughput Detection of Ovarian Cancer Cells from Liquid Biopsy using Stimulated Raman Scattering
Amount £98,622 (GBP)
Funding ID C68270/A29694 
Organisation Cancer Research UK 
Sector Charity/Non Profit
Country United Kingdom
Start 09/2020 
End 08/2021
 
Title Common path interferometer design 
Description As part of the redesign process we pioneered a new common-path interferometer design with impressive degrees of flexibility to project arbitrary patterns. We are in the process of patenting this idea, but are also using it to develop a new structured illumination microscope which is simpler, faster and cheaper than anything that came before. 
Type Of Material Improvements to research infrastructure 
Year Produced 2020 
Provided To Others? No  
Impact This work has lead to a new research direction for a PhD student, and is forming the basis of a number of grant applications in the short term. We are also pursuing IP protection, but this is currently in the internal sifting stage and we are hoping to take the application forward if it is approved. Because of this IP protection issue we have not made it accessible to other researchers at this time, but all of the optical and mechanical designs are prepared ready for release. 
 
Title Hyperspectral imaging microscope 
Description This grant has funded a hyperspectral imaging microscope that can not only operate as a point-scanning Raman spectrometer, but can assess the transmission spectrum of a sample with close-to diffraction-limited spatial resolution, for use in developing optical filters. It is being used in this project to assess how spatially inform the filters that are produced are, but is also supporting the development of novel Raman instrumentation for cancer diagnosis and treatment. 
Type Of Material Improvements to research infrastructure 
Year Produced 2020 
Provided To Others? Yes  
Impact The tool was used by a spinout company from Imperial College London to measure the transmission spectrum through a plastic sample, for use in their development of a diagnostic test. The use of the system was offered at no charge. 
 
Title Temporal analysis for super-resolution imaging 
Description A method for analysing the temporal resolution of an imaging technique, particularly a super-resolution imaging technique such as Structured Illumination Microscopy. The method effectively performs a Fourier analysis in the time domain, modulating the average intensity of the image at a certain rate and assessing whether the imaging system is able to resolve it. In this way, it is possible to assess whether an imaging technique can actually resolve the temporal frequencies claimed, as opposed to crude extrapolation based on factors like camera frame rate. 
Type Of Material Data analysis technique 
Year Produced 2020 
Provided To Others? Yes  
Impact Publication of a paper describing the technique 
URL https://www.imperial.ac.uk/rowlands-lab/resources/
 
Description High-speed fluorescence voltage sensors 
Organisation Imperial College London
Department Faculty of Medicine
Country United Kingdom 
Sector Academic/University 
PI Contribution Development of a novel high-speed microscope for recording high-speed information from a live mouse brain
Collaborator Contribution Biological support - provision of GEVI-labelled mice, neurobiology advice, brain slicing expertise
Impact Invited talk given by my PhD student
Start Year 2020
 
Description Ovarian cancer partnership 
Organisation Hammersmith Hospital
Country United Kingdom 
Sector Hospitals 
PI Contribution This collaboration means to develop novel Raman microscopy instrumentation for the detection of cancer biomarkers. My research team is developing the instrumentation, starting with a simple point-scanning Raman microscope, but hopefully later encompassing light-sheet illumination and stimulated Raman microscopy methods
Collaborator Contribution Prof Iain McNeish is providing ovarian cancer cells taken from ascites fluid in clinical patients. These are then scanned using the Raman system to assess whether they can be distinguished from other cells.
Impact This collaboration has lead to a successful application for funding from CRUK (detailed separately) to rapidly screen for tumour cells. This collaboration is multidisciplinary, covering microscopy development and cancer biology.
Start Year 2019
 
Title Common-Path Interferometer 
Description The invention is a common-path interferometer which can be reconfigured (into multiple different interference patterns and phases) using a single galvanometric mirror. The design is photon-efficient, achromatic and able to be reconfigured within a millisecond. 
IP Reference Not yet assigned 
Protection Patent / Patent application
Year Protection Granted
Licensed No
Impact NDAs have been signed with Nikon and Olympus, and Zeiss is in progress. Olympus has expressed an informal interest in licensing the technology.