An optically sectioning microscope designed for high speed high resolution random access multi-point scanning of single cells and microcircuits.

Lead Research Organisation: University of Leicester
Department Name: Cell Physiology and Pharmacology

Abstract

Fluorescent molecules absorb light energy at one wavelength and emit light at a longer wavelength. This property is harnessed in fluorescence microscopy; because the excitation and emission wavelengths of light can be optically separated, structures labelled with a fluorophore can be selectively visualised. However, illumination reveals not only parts of the labelled specimen that are in focus, it reveals areas above or below the focal plane, obscuring detail and reducing resolution. Confocal microscopes circumvent this problem by optically sectioning the specimen by removing unwanted light originating above and below the focal plane. In standard confocal systems, a small point of light, usually supplied by a laser, is focussed onto the specimen and scanned point by point across the entire field of view. Emitted light is directed towards a pin hole positioned in the conjugate primary focal plane of the specimen. An image with a finite optical thickness is produced because light originating above or below the plane of focus misses the pinhole and is rejected. Standard scanning methods use two oscillating mirrors to move the laser in x and y directions. These systems can operate at relatively high frequencies that can generate two dimensional images at near video rates (~30 frames per second). However, because the laser is moved contiguously across the whole field of view, the amount of time that the laser dwells in any one position is extremely short. This limits the amount of light collected and so increases the signal to noise ratio. Thus speed is gained at the expense of image quality. Whereas these speeds may be useful for measuring fluorescence changes associated with some biological signals, measurements of action potentials, indicators of neuronal activity, with voltage sensitive dyes for example requires sampling rates of at least 1 KHz. This is clearly not feasible with standard scanning techniques. In this proposal, we will develop two different configurations of optically sectioning microscope that are each capable of very fast scanning (up to 25 KHz) but from a limited number of selected points of interest. This will be achieved by using non scanning methods that allow rapid laser positioning to any point in the field of view in under 20 micro seconds. Increased measurement speeds are achieved by taking measurements from a limited number of non-contiguous regions of a single cell or from distantly separated neurones that comprise a functioning network. This approach is termed random access scanning. The first configuration will be implemented with a programmable digital micromirror device (DMD). This represents an array of miniature mirrors that can be independently controlled at high speed. These will be used to define patterns of non-contiguous laser illumination on the specimen. Optical sectioning can be achieved because only light emitted from the focal plane of the specimen will be reflected back along the same optical path to the mirror and reflected onto a CCD camera. Mirrors will be switched rapidly to cover the whole field of view to generate an optically sectioned image. A small number of selected sites of interest of variable size can then be defined from the field of view and scanned at very high speeds, theoretically approaching 10-15 KHz. In the second configuration, speed will be increased further by positioning the laser beam with an acousto optical device (AOD). These devices use radio frequency sound waves to deflect light An AOD that is capable of deflecting light in x and y planes will be used to direct laser light to the specimen. Optical sectioning will be achieved with a DMD synchronised to the AOD positioned in the conjugate primary image plane. This system should produce maximum scan rates of 25 KHz. Successful implementation will lead towards the development of a low cost, 'solid state', high speed confocal imaging system capable of operating at very high speeds.

Technical Summary

With the rapid development of fluorophores that can detect changes in voltage or alterations in ion or second messenger concentrations, modern optical recording techniques permit the generation of spatio-temporal maps of a wide range of intra- or inter-cellular signalling events. These methods provide an enormous potential for rapid, high throughput analysis of large number of structures or points of interest. However, imaging systems that are capable of high spatial resolution generally suffer form poor temporal resolution, and vice verse. Very few systems are capable of sampling at speeds necessary to resolve the voltage changes accompanying a single action potential from more than one point while maintaining sub-cellular spatial resolution. Standard, inertia-limited, optically sectioning microscopes use mirrors to position a light source across an entire field of interest. Much of the scanning time is wasted because it is recording information from the gaps between complex, non-contiguous morphologies of dendritic structures or neuronal networks. We aim to develop two configurations of optically sectioning microscope implementing more efficient, non-scanning techniques that allow standard full frame scanning but also high speed (>1 KHz) scanning from up to 25 user selected, non-contiguous points of interest. Two designs will be developed and evaluated. The first configuration will use an array of digital micromirrors for both programmable, random access point illumination of the specimen and for spatial filtering allowing optical sectioning. In the second system, higher laser positioning speeds will be obtained using a novel acousto optical device that is specifically designed to work in both x and y planes and which provides uniform beam intensity. Successful implementation will lead towards the development of a low cost, 'solid state', high speed confocal imaging system capable of operating at very high speeds.

Publications

10 25 50
 
Description The purpose of this research was to develop a digital confocal microscope. We have achieved all of the original objectives leading to the filing of one patent that protects the IP behind the project and the publication of a paper that describes the work. This project led to the award of a follow on fund project (BB/J019046/1 ) where we worked with a commercial partner to develop licencing opportunities. This is ongoing.
The project has also initiated an entirely new line of research into multiphoton, super-resolution microscopy that has been enormously successful, leading to the award of several new BBSRC grants including BB/L00691X/1 ; BB/L024284/1 and a recent ALERT 14 award of > £630k to develop a new super-resolution facility.
Exploitation Route We are in the process of trying to commercialise this and other microscopes that we have developed. This has been succesful in that we have been awarded several grants including a recent ALERT 14 grant to use the technology to develop a user facility for fast, functional super-resolution microscopy at Leicester and within the wider scientific community
Sectors Construction,Digital/Communication/Information Technologies (including Software),Education,Manufacturing, including Industrial Biotechology,Pharmaceuticals and Medical Biotechnology

 
Description The succesful development of this microscope has led to a follow on fund award to work with a commercial partner (BB/J019046/1 ). Indirectly, this project has led to the development of further microscope technology that has led to further developments and awards (BB/L00691X/1 ; BB/L024284/1 ; ALERT 14 -Hartell).
First Year Of Impact 2012
Sector Digital/Communication/Information Technologies (including Software),Education,Healthcare,Pharmaceuticals and Medical Biotechnology
Impact Types Economic

 
Description ALERT 14
Amount £638,019 (GBP)
Funding ID BB/M012034/1 
Organisation Biotechnology and Biological Sciences Research Council (BBSRC) 
Sector Public
Country United Kingdom
Start 11/2014 
End 11/2015
 
Title IMPROVED OPTICAL ARRANGEMENT 
Description The present disclosure relates to an improved optical arrangement for an optical imaging system or the like, comprising: an optical device; a digital micromirror device having a plurality of individually addressable micromirrors; a convex mirror; and a concave mirror concentric to the convex mirror. The convex mirror and the concave mirror define an optical triplet which is located in an optical path with the digital micromirror device and the optical device. The concave mirror comprises two concave mirror sections, one or both concave mirror sections being moveable relative to the convex mirror so as to control an image mapping between the digital micromirror device and the optical device. 
IP Reference WO2012063075 
Protection Patent application published
Year Protection Granted 2012
Licensed Commercial In Confidence
Impact This work has led to the development of a new but related microscope that has produced two more patents and signficant further funding via normal BBSRC responsive mode routes, follow on funding and the ALERT 14 infrastructure theme
 
Title IMPROVEMENTS IN OR RELATING TO SUPER-RESOLUTION MICROSCOPY 
Description This invention relates to a method of processing images captured following structured illumination of a sample through which significant improvements in lateral and axial resolution can be achieved. 
IP Reference EP3060953 
Protection Patent application published
Year Protection Granted 2016
Licensed No
Impact This method forms the basis for the development of a new form of microscopy called SuperRAMP which is a super-resolution form of multiphoton microscopy. It is currently in use at Leicester University as part of a Super-resolution facility
 
Title Improvements in or relating to structured illumination microscopy utilising acousto-optic deflectors. 
Description A new method to improve on the transmission properties of acousto-optic devices for their use in microscopy 
IP Reference GB1406150.1 
Protection Patent application published
Year Protection Granted 2014
Licensed No
Impact This work has contributed to the acquisition of further funding via the BBSRC responsive mode, follow on funding and ALERT 14 programs
 
Title Improvements in or relating to super-resolution microscopy 
Description A new method using structured illumination in combination with localization software methods to produce super-resolution imaging 
IP Reference GB1318598.8 
Protection Patent application published
Year Protection Granted 2013
Licensed No
Impact This work has led to the application of a second patent and has stimulated significant further funding via BBSRC responsive mode and follow on funding, and more recently ALERT 14 funding for the formation of a dynamic superresolution facility at Leicester to use the technology.
 
Title OPTICAL ARRANGEMENT 
Description The present disclosure relates to an improved optical arrangement for an optical imaging system or the like, comprising: an optical device; a digital micromirror device having a plurality of individually addressable micromirrors; a convex mirror; and a concave mirror concentric to the convex mirror. The convex mirror and the concave mirror define an optical triplet which is located in an optical path with the digital micromirror device and the optical device. The concave mirror comprises two concave mirror sections, one or both concave mirror sections being moveable relative to the convex mirror so as to control an image mapping between the digital micromirror device and the optical device. 
IP Reference US2014043460 
Protection Patent granted
Year Protection Granted 2014
Licensed No
Impact The device is currently in use within my lab and we are currently in discussions regarding licensing the technology
 
Title Digital Micromirror External Operation (XOP) Driver 
Description A driver for a texas instruments digital micromirror for use with igor Pro software. 
Type Of Technology Software 
Year Produced 2012 
Impact This is used to control a novel DMD based confocal microscope that we are currently seeking to licence. It allows simple control of a digital micromirror for digital imaging and spatial control of light 
 
Title NiMan 
Description A suite of software that allows time resolved analysis of large stacks of images but also including a novel method for creating and analysing super-resolution images from structured illumination microscopy 
Type Of Technology Software 
Year Produced 2015 
Impact The software has been developed over many years and is used by members of my laboratory and collaborators to analyse data collected from the various research projects we have undertaken over the last 10 years 
 
Title NiMaq 
Description A suite of software that allows the control of imaging equipment including cameras, light sources, digital RF synthesisers, microscopes and scanning devices 
Type Of Technology Software 
Year Produced 2016 
Impact This software has been developed over many years and is the basis for most of the technical developments my lab has made over many years. We hope that it will either be released as an open source tool or form part of a spin out product that we can licence or sell 
 
Title Visible wavelength acousto-optical based super-resolution microscope 
Description A novel super-resolution microscope that produced improvements in lateral and axial resolution through a combination of patterned illumination and mathematical processing of images. 
Type Of Technology New/Improved Technique/Technology 
Year Produced 2018 
Impact Ongoing