Next Generation Imaging using Sparse Single-Photon Data
Lead Research Organisation:
Heriot-Watt University
Department Name: Sch of Engineering and Physical Science
Abstract
Over the last three decades, our lives have been revolutionized by the availability of inexpensive CMOS-based CCD cameras whose ubiquitous nature has changed key aspects of security, communications, data handling, healthcare, commerce and leisure for almost all sections of society, regardless of wealth or geographical location. For example, it is estimated that over one half of all adults in the UK own a smartphone with imaging/video capability - a statistic considered unthinkable less than 10 years ago. The next revolution in imaging will almost certainly be spearheaded by sparse photon and three dimensional imaging, ultimately using the effects of quantum entanglement. Such a revolution will necessarily require fast timing of the single-photon detection, in the form of arrayed detectors or single-pixel cameras. The use of fast timing will permit effective time-of-flight based depth profiling at remote distances, and the effects of quantum entanglement could be utilised effectively in critical niche examples, such as imaging below the diffraction limit, wavelength transmutation or quantum secure imaging. These revolutionary changes represent a paradigm shift in terms of functionality, but present significant challenges in algorithm development and data processing, as well as data fusion with other imaging platforms, for example multispectral and regular video. This Fellowship will allow me to bridge the gap between the enabling quantum technology and the image processing community in order to improve the scope and overall performance of next generation imaging systems based on quantum technology.
Planned Impact
This Fellowship will allow me to forge a strong link between the quantum technology and signal and image processing academic communities to develop a strong and sustained partnership in order to improve our understanding and develop optimised algorithms and hardware approaches for the sparse single-photon image regime. My research will extend these approaches to more novel entangled photon pair applications in microscopy and image security. With immediate benefits to the growing field of sparse photon imaging, both in academia and industry, allowing, for example, depth profiles to be formed with a minimum of frame time, opening up possibilities for video rate cm-resolution depth information even for targets at very remote distances. Also, the approach can be used for image formation in other environments, such as highly scattering underwater conditions, where the photon return from the target is necessarily very low. Later parts of my research will be concerned with laboratory demonstrations of high-resolution microscopy using entangled photons, of clear potential benefit to the microscopy community, particularly in biophotonics. It is clear that this research has the potential to impact several fields, both academic and industrial. In the second year, I will have a workshop for industrial partners, collaborators and other potential users who will be invited through my various networks, formal collaborations, quantum Technology Hubs, etc.. The workshop will examine all issues associated with the deployment of sparse photon depth imagers, and their reach into new application areas. This workshop will help cement links between quantum technology and image processing communities which will be enhanced by targeted follow-up events.
Users of Free-space Depth Imaging Systems
I have formal connections with SELEX ES, through my involvement as a member of the Management Board of the Strategic Alliance with HWU and via my co-supervision of a EngD student based at the company. The company have a research programme on long-range, single-photon imaging in free-space. Throughout the Fellowship, SELEX will be fully briefed regarding developments and discuss future requirements for future depth imaging in their sector. As an example of more detailed involvement, I will process the company's own depth image data and use these results to discuss future strategy.
Users of Underwater Imaging Systems
My research in underwater measurements in this field has been confined to laboratory demonstrations to date, these laboratory experiments and associated modelling have provided strong evidence of high-resolution imaging (ie sub-millimetre) being possible at distances of 10 metres and beyond even in typical (ie highly scattering) coastal water. This initial work has been funded by DSTL, in collaboration with Prof Yvan Petillot, an academic leader in underwater sensing and a co-founder of Seebyte, a HWU spinout company. Here, the use of optical depth imaging technology can be used in conjunction with autonomous vehicles to provide inspection tasks currently performed by manned exploration. Remote depth imaging can provide a more safe, and overall less expensive alternative. I will work with DSTL and Seebyte to seek impact opportunities and benchmark my technology against known industry standards, and to engage the oil and gas, and defence industries.
Users of microscopy
The super-resolution microscope proposed with the use of entangled photons has potential uses in a number of areas, with biophotonics being one of the obvious exploitation paths. I will work with the MRC-funded, HWU led Edinburgh Super-resolution Imaging Consortium, which attracts collaborative users from all over Europe. This engagement will allow interaction on a number of critical sub-diffraction limit imaging challenges, especially where photo-damage is evident. ESRIC also offers a gateway to the major microscopy vendors.
Users of Free-space Depth Imaging Systems
I have formal connections with SELEX ES, through my involvement as a member of the Management Board of the Strategic Alliance with HWU and via my co-supervision of a EngD student based at the company. The company have a research programme on long-range, single-photon imaging in free-space. Throughout the Fellowship, SELEX will be fully briefed regarding developments and discuss future requirements for future depth imaging in their sector. As an example of more detailed involvement, I will process the company's own depth image data and use these results to discuss future strategy.
Users of Underwater Imaging Systems
My research in underwater measurements in this field has been confined to laboratory demonstrations to date, these laboratory experiments and associated modelling have provided strong evidence of high-resolution imaging (ie sub-millimetre) being possible at distances of 10 metres and beyond even in typical (ie highly scattering) coastal water. This initial work has been funded by DSTL, in collaboration with Prof Yvan Petillot, an academic leader in underwater sensing and a co-founder of Seebyte, a HWU spinout company. Here, the use of optical depth imaging technology can be used in conjunction with autonomous vehicles to provide inspection tasks currently performed by manned exploration. Remote depth imaging can provide a more safe, and overall less expensive alternative. I will work with DSTL and Seebyte to seek impact opportunities and benchmark my technology against known industry standards, and to engage the oil and gas, and defence industries.
Users of microscopy
The super-resolution microscope proposed with the use of entangled photons has potential uses in a number of areas, with biophotonics being one of the obvious exploitation paths. I will work with the MRC-funded, HWU led Edinburgh Super-resolution Imaging Consortium, which attracts collaborative users from all over Europe. This engagement will allow interaction on a number of critical sub-diffraction limit imaging challenges, especially where photo-damage is evident. ESRIC also offers a gateway to the major microscopy vendors.
Publications
Kuzmenko K
(2020)
3D LIDAR imaging using Ge-on-Si single-photon avalanche diode detectors.
in Optics express
Wang K
(2021)
40Gbits -1 Data Transmission in an Installed Optical Link Encrypted Using Physical Layer Security Seeded by Quantum Key Distribution
in Journal of Lightwave Technology
Gemmell NR
(2017)
A compact fiber-optic probe-based singlet oxygen luminescence detection system.
in Journal of biophotonics
Kim MM
(2016)
A feasibility study of singlet oxygen explicit dosmietry (SOED) of PDT by intercomparison with a singlet oxygen luminescence dosimetry (SOLD) system.
in Proceedings of SPIE--the International Society for Optical Engineering
Yi X
(2023)
Afterpulsing in Ge-on-Si Single-Photon Avalanche Diodes
in IEEE Photonics Technology Letters
Tachella J
(2019)
Bayesian 3D Reconstruction of Complex Scenes from Single-Photon Lidar Data
in SIAM Journal on Imaging Sciences
Halimi A
(2016)
Bayesian Filtering of Smooth Signals: Application to Altimetry
Sidqi N
(2019)
Comparative study of dielectric coating materials for micro-cavity applications
in Optical Materials Express
Title | Visualization 1.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 1.2 AL in water. The average optical power entering the water tank was approximately 1 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_1_avi/8798072/1 |
Title | Visualization 1.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 1.2 AL in water. The average optical power entering the water tank was approximately 1 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_1_avi/8798072 |
Title | Visualization 2.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 1.2 AL in water. The average optical power entering the water tank was approximately 1 mW and the acquisition time per frame was 0.01 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_2_avi/8798093/1 |
Title | Visualization 2.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 1.2 AL in water. The average optical power entering the water tank was approximately 1 mW and the acquisition time per frame was 0.01 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_2_avi/8798093 |
Title | Visualization 3.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 1.2 AL in water. The average optical power entering the water tank was approximately 1 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data from individual binary frames. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_3_avi/8798102/1 |
Title | Visualization 3.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 1.2 AL in water. The average optical power entering the water tank was approximately 1 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data from individual binary frames. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_3_avi/8798102 |
Title | Visualization 4.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 4.8 AL. The average optical power entering the water tank was approximately 8 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. Each frame was then improved using the median filter model and the PA. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_4_avi/8798105 |
Title | Visualization 4.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 4.8 AL. The average optical power entering the water tank was approximately 8 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. Each frame was then improved using the median filter model and the PA. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_4_avi/8798105/1 |
Title | Visualization 5.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 6.7 AL. The average optical power entering the water tank was approximately 8 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. Each frame was then improved using the median filter model and the PA. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_5_avi/8798108 |
Title | Visualization 5.avi |
Description | Depth and intensity profiles of flange target spinning about a vertical axis at 6.7 AL. The average optical power entering the water tank was approximately 8 mW and the acquisition time per frame was 1 ms. The intensity and the depth with respect to the reference signal were obtained performing the cross correlation approach with data obtained aggregating 50 binary frames. Each frame was then improved using the median filter model and the PA. |
Type Of Art | Film/Video/Animation |
Year Produced | 2019 |
URL | https://opticapublishing.figshare.com/articles/media/Visualization_5_avi/8798108/1 |
Description | This Fellowship award was responsible for significant research outcomes which included: • first demonstration of multi-kilometre range single-photon imaging (2017) • first single-photon underwater 3D imaging demonstartion (2015) • first deminstartion of long range single-photon imaging through camouflage (2017) • first demonstration real-time reconstruction of complex, moving scenes (2019) • first demonstration of planar geometry Ge-on-Si single-photon avalanche diode detectors (2019). • first single-photon underwater iamgign usign arrayed detectors; first demonstration of single-photon imaging through atmospheric obscurants(2019) • first single photon imaging using new Ge-on-Si detectors in the shortwave infrared (2020) • first demonstration of colour reconstruction with SPAD detectors using metasurface filters (2020) • first demonstration of single-photon imaging through obscurants using real-time reconstruction (2021) |
Exploitation Route | The outcomes of this project were subsequently investigate by the EPSRC Quantum Technology Hubs in Quantum-Enhanced Imaging and Quantum Communications. Some of the outcomes were adopted by the industrially led Innovate UK collaborations "AQUASeC" and "SPIDAR", both led by Toshiba. The long range single-photon imaging work continues to be a theme developed by DSTL. |
Sectors | Aerospace Defence and Marine Digital/Communication/Information Technologies (including Software) Electronics Environment Manufacturing including Industrial Biotechology Security and Diplomacy Transport |
Description | The outcomes of this project were subsequently investigated by the EPSRC Quantum Technology Hubs in Quantum-Enhanced Imaging and Quantum Communications. Some of the outcomes were adopted by the industrially led Innovate UK collaborations "AQUASeC" and "SPIDAR", both led by Toshiba. The long range single-photon imaging work continues to be a theme developed by DSTL. The outcomes of this project were used in NATO field trials in imaging held in the USA in 2016 and Porton Down in 2023 alongside teams from other NATO countries, including USA, Canada, France, Germany and Sweden. |
First Year Of Impact | 2016 |
Sector | Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Electronics,Manufacturing, including Industrial Biotechology,Security and Diplomacy,Transport |
Impact Types | Societal Economic |
Description | DSTL Advanced Vision |
Amount | £396,595 (GBP) |
Funding ID | ACC6012970 |
Organisation | Defence Science & Technology Laboratory (DSTL) |
Sector | Public |
Country | United Kingdom |
Start | 03/2020 |
End | 03/2022 |
Description | High Resolution 3D Imaging Through Obscurants Using Single Photons |
Amount | £138,380 (GBP) |
Funding ID | DSTLX1000141221 |
Organisation | Defence Science & Technology Laboratory (DSTL) |
Sector | Public |
Country | United Kingdom |
Start | 09/2019 |
End | 09/2023 |
Description | MoD Seeing Through Clouds |
Amount | £412,232 (GBP) |
Funding ID | DSTLX1000108233 |
Organisation | Defence Science & Technology Laboratory (DSTL) |
Sector | Public |
Country | United Kingdom |
Start | 05/2016 |
End | 06/2018 |
Description | Single Photon Infrared Imaging, Detection and Ranging (SPIDAR) |
Amount | £5,700,000 (GBP) |
Funding ID | Application ref 44835 |
Organisation | Innovate UK |
Sector | Public |
Country | United Kingdom |
Start | 09/2020 |
End | 09/2023 |
Description | Ultrafast Single-photon Detection for Quantum Applications |
Amount | £1,353,048 (GBP) |
Funding ID | EP/W003252/1 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 03/2022 |
End | 03/2027 |
Title | SINGLE PHOTON AVALANCHE DETECTOR, METHOD FOR USE THEREFORE AND METHOD FOR ITS MANUFACTURE. |
Description | A single photon avalanche diode (SPAD) device is presented. The SPAD device comprising: a Si-based avalanche layer formed over an n-type semiconductor contact layer; a p-type charge sheet layer formed in or on the avalanche layer, the p-type charge sheet layer having an in-plane width; a Ge-based absorber layer, formed over the charge sheet layer and/or the avalanche layer, and overlapping the charge sheet layer, the Ge-based absorber layer having an in-plane width; wherein, at least in one in-plane direction, the in-plane width of the Ge-based absorber layer is greater than the in-plane width of the p-type charge sheet layer. |
IP Reference | WO 2020/053564 A1 |
Protection | Patent application published |
Year Protection Granted | 2020 |
Licensed | No |
Impact | Patent currently being pursued in a number of jurisdictions. |