MEMS-enabled miniaturised multimodal microscopy through pulsed structured illumination

Lead Research Organisation: University of Strathclyde
Department Name: Electronic and Electrical Engineering

Abstract

The build-up of antimicrobial resistance is developing to become one of the biggest modern health challenges, one that has emerged over the last decade and places a significant threat on modern day medical treatments. While fantastic research in deciphering build-up and interaction mechanisms between cells and micro-organisms that lead to drug resistance are ongoing, tool-kits to evaluate, image and visualise these interactions in real-time 3D environments and with subcellular resolution are limited to very well-funded research labs and central facilities. While access to these is enabled in the UK through time requests in grant applications, the possibility to have systems in situ and in an environment that fosters biological development would present a significant potential to leverage further research momentum and invention to tackle this wide ranging significant health challenge.

In this proposal, miniaturised 3D imaging systems with super-resolution capability will be developed, allowing to resolve samples beyond the physical diffraction limit based on active optical microsystems and 3D-printing. This will allow the creation of small scale and portable systems which could drastically alter the access gap and costs currently present in state-of-the art subcellular biomedical imaging systems, both in research as well as in pre-clinical settings. We seek to address this by combining fluorescence and acoustic based imaging modalities, enabling high-throughput investigations through multi-modal parallel systems which can show new insights in the behaviour of microbial-cell interactions and antimicrobial resistance development.

By creating fluorescence and acoustic super-resolution imaging systems in a combined small-scale form factor, the complimentary information content from both imaging techniques will be characterised and evaluated. From initial system designs an iterative improvement process with feedback from biomedical researchers will be followed to have multiple cycles of development, design, fabrication and test to create a targeted miniaturised super-resolution system that can significantly help solving problems of antimicrobial resistance build-up.

The primary objective is a centimetre scale 3D super-resolution system with active micro-optics for full digital control of the imaging content, with the research also looking at novel resolution and information fusion potentials of the complementary imaging modalities, generating real-time process information for end-users. The outcome of this research project will advance significantly the availability of state-of-the-art biomedical imaging systems in environments on national and international level, specifically for large scale parallel investigations and lower funded labs, as present in many developing countries.

Planned Impact

The proposed research will develop miniaturised multimodal 3D super-resolution biomedical imaging systems utilising 3D-printing and active micro-optics, which will significantly increase the functionality and capability of light-sheet based biomedical imaging techniques through complimentary signal contrast detection and drastically reduce the costs of state-of-the-art techniques through the mentioned cost-effective micro-optics and 3D-printing.

The usefulness of the developed systems will be demonstrated with trials including Leishmaniasis parasite-host interaction pathways investigations and further antimicrobial resistance scenario investigations, creating multiple impacts by leveraging the use of a portable, cost-effective, dual modality imaging system that is tailored for the envisaged investigations and can be used with commonly used sample preparation techniques in biomedical sciences. Anticipated results will directly benefit the international academic community in biomedical imaging research, end-users who are investigating cell-scale dynamics with long-term interaction processes, and have a potential for industry benefit through leveraging the industrial exploitation of the novel approach to super-resolution small-package system design.

The project goal of generating an imaging system with subcellular resolution and multiple contrast mechanisms has direct application potential across a wide range of biomedical science, plant science and developmental biology research areas, harnessing access to the technology for insight into subcellular dynamics/interactions, which leverages impact on the UK society through addressing healthcare challenges. It also raises the development potential into applying the systems for research questions looking into neglected infectious diseases which disproportionally affect developing countries.

Further beneficiaries on the academic side are anticipated through the multidisciplinary approach to benefit both engineering and biomedical research communities in the form of the development of a super-resolution concept with simultaneous feature evaluation and adaptable sample excitation through the use of active micro-optics, allowing for a significant reduction of data storage requirements by automatically classifying and recording of only sample areas of interest. This has the potential to further cross-fertilise the associated disciplines, raising the potential to use the developed systems in new environments through the miniaturisation, with future potential for pre-clinical and clinical applications.

All staff involved (PI, post-doc, students, and collaborators) will gain knowledge and a significant skills improvement on aspects ranging from microscope system design and miniaturisation, miniaturised optics integration, image processing techniques, and 3D-printed hardware design, all the way to system application tests. By engaging with collaborators in developing countries through this proposal and the PI's framework of a RAEng Engineering for Development Research Fellowship, the system deployment and exposure in an international context will be addressed with an additional significant impact on the developing partners research landscape.
 
Description During the award we have created a low-cost and small-scale version of a structured illumination microscope, which is a microscope technique that allows super-resolution imaging to visualise internal structures of cells or other fluorescence labelled samples. The size and cost-reduction is enabled by using custom Microelectromechanical System (MEMS) mirrors that can be positioned in 3 dimensions using electrical control signals. By using these small active mirrors we have also created a system that can flexibly adapted to different image magnification settings, illumination colours, or resolution requirements, therefore creating a flexible system that can see wide applications in many biomedical imaging questions where smallest scale interactions and structural questions are to be answered.
Exploitation Route We are currently testing the developed system with partners from the biological sciences and are anticipating to be able to provide an imaging setup for access by local collaborators. We will also make system designs and assembly instructions openly available, which will allow researchers to replicate the system and take forward in their own application areas. Further steps to improve the performance, flexibility and reduce the system size are currently undertaken.
Sectors Healthcare,Pharmaceuticals and Medical Biotechnology

 
Description Miniaturised 3D biomedical imaging: super-resolution microscopy development using 3D-printing and structured illumination
Amount £39,828 (GBP)
Funding ID 2431319 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2020 
End 03/2024
 
Title Data for: "Cold-atom shaping with MEMS scanning mirrors" 
Description 2D images as .txt files . 1D plot as Origin source file 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
Impact This dataset was the basis of a journal publication, DOI: 10.1364/OL.475353 
URL https://pureportal.strath.ac.uk/en/datasets/4f23fe3b-e52c-43fd-8206-edc5806b2e50
 
Title Data for: "Miniaturised structured illumination microscopy using two 3-axis MEMS micromirrors " 
Description This dataset contains component characterisation and calibration data next to fluorescence microbead and cell images taken with a custom Microelectromechanical Systems (MEMS) structured illumination microscopy (SIM) system, providing underlying data for a manuscript titled "Miniaturised structured illumination microscopy using two 3-axis MEMS micromirrors". The dataset has 8 csv files containing the raw data of measurements taken on the MEMS device as well as on the overall imaging system. Additionally, all raw and super-resolution processed bead images and cell images used in the above mentioned are provided in .tiff format in sub folders. An overarching jupyter notebook in the main folder has details on data processing and the embedded data visualisation used in the manuscript. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
Impact This dataset was the basis of a journal publication, DOI: 10.1364/BOE.475811 
URL https://pureportal.strath.ac.uk/en/datasets/fb83f3fa-4e7f-4049-854a-9e3325cd9779
 
Title Data for: "On-chip frequency tuning of fast resonant MEMS scanner" 
Description This dataset contains the underlying data for the above mentioned manuscript. The raw data, measured by a vibrometer and microscope, is present in the .zip files. Processed data is saved in .csv files, with a description of the processed files and the data extraction for plotting presented in the jupyter notebook file. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
Impact This dataset was the basis of a journal publication, DOI: 10.1109/JMEMS.2022.3201381 
URL https://pureportal.strath.ac.uk/en/datasets/c589d644-e614-4c0c-80b6-5af7fe786492
 
Title Data for: "Tuneable wide-field illumination and single-molecule photoswitching with a single MEMS mirror" 
Description This dataset supports the publication "Tuneable wide-field illumination and single-molecule photoswitching with a single MEMS mirror" in ACS Photonics (2021). The dataset is composed of tif image files acquired with an emCCD camera (iXon Life 888, Andor) using the manufacturer software (Andor Solis). Each sample dataset is divided into three files of no more than 2Gb, i.e. "name1_X1.tif", "name1_X2".tif, name1_X3 consist of a single acquisition. The first frame of name1_X2 follows the last frame of name1_X2.tif. The data was acquired on 12 February 2021. Data embargo until 31/08/21 or until the related publication is published. 
Type Of Material Database/Collection of data 
Year Produced 2021 
Provided To Others? Yes  
Impact This dataset was the basis of a journal publication, DOI: 10.1021/acsphotonics.1c00843 
URL https://pureportal.strath.ac.uk/en/datasets/4bbe9c0a-270d-4637-9d88-060c77e91233
 
Title MEMS enabled miniaturised light-sheet microscope characterisation data 
Description This dataset contains characterisation data for a new microscope system. The data is presented in Excel format (MEMS and lens electromechanical performance), Autodesk Inventor format (3D assembly of system), .opd format (surface profile of 3D-printed element) and .tiff format (all imaging data) 
Type Of Material Database/Collection of data 
Year Produced 2021 
Provided To Others? Yes  
Impact The dataset formed the basis of a journal publication, DOI: 10.1038/s41598-021-93454-8 
URL https://pureportal.strath.ac.uk/en/datasets/96b96f33-0956-4621-a203-282fa799e7ed
 
Description Collaboration with IIT Gandhinagar 
Organisation Indian Institute of Technology Gandhinagar
Country India 
Sector Academic/University 
PI Contribution We have supplied equipment for a light-sheet microscopy system (a copy of a system under development at Strathclyde) and had multiple visits with training sessions on alignment, build and use of the system. Additionally, support for improving the system to include structured illumination parts is ongoing.
Collaborator Contribution The collaborator at IIT Gandhinagar has supplied infrastructure to test the so far developed system in a developing country setting and is further engaging with further partners to look at applications of the developed technology that feed into system designs and use cases.
Impact Main outcome has been a collaborative workshop on applied photonics in January 2020, hosted at IIT Gandhinagar.
Start Year 2017
 
Description Collaboration with University of Tokyo 
Organisation University of Tokyo
Country Japan 
Sector Academic/University 
PI Contribution Testing of optical Microelectromechanical System (MEMS) scanner in the context of biomedical imaging system, and implementation in microscopy prototypes.
Collaborator Contribution Development and supply of MEMS scanner to be implemented in biomedical imaging systems.
Impact Pre-award conference paper: DOI: 10.1109/OMN.2019.8925053
Start Year 2017
 
Description Hosting of workshop with collaborator in India 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact A workshop on applied photonics for was hosted at IIT Gandhinagar, India, with collaborators from the IIT and City University London. About 40 participants from India and the UK, attended the five-day workshop and gained knowledge about the cutting edge research on optical sensing, biomedical sensing and biomedical imaging, including hands-on experimental sessions with miniaturised 3D-printed microscopes. Participants included post-graduate and under-graduate students as well as industry representatives.
Year(s) Of Engagement Activity 2020
URL https://news.iitgn.ac.in/2020/01/15/phase-2020-indo-uk-workshop-on-applied-photonics-concludes-at-ii...
 
Description Organisation of PHASE 2022 workshop with partners in India 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Organisation and hosting of a hybrid workshop on Optical Imaging and Sensing, arranged with support by collaborators at IIT Gandhinagar, India. The 2 day event was planned to have virtual talks by experts in optical sensing and imaging, combined with practical imaging experiments specifically targeted to students at UEM Kolkata and University of Calcutta. Equipment for running practical sessions at both Universities in India was shipped, with the practical session ultimately having to be delayed due to Covid shutdowns in India at the start of 2022.
Over 60 participants were registered, with attendance at talks at any given time over 40 and in-depth discussions at virtual coffee breaks after the events. The event also lead to combined final year project supervision between students in India and the UK organiser.
Year(s) Of Engagement Activity 2022
URL https://bauer-ralf.wixsite.com/phase2022