Small cell imaging using smartphones and single-board computing: analysing platelet function and microbial pathogens using consumer optoelectronics

Lead Research Organisation: University of Reading
Department Name: Pharmacy

Abstract

Microscopes are used in clinical diagnostics to analyse tissue, to examine blood cells, and to identify or analyse disease-causing micro-organisms. Whilst cell measurement instruments called "flow cytometers" are also often used, for many clinical areas analysis of cells and tissue such as red and white blood cells still relies on expert lab workers, who use traditional microscopes based on complex optics, designed for visual examination by eye.
Likewise, clinical and diagnostic microbiology still relies heavily on 40- to 135-year old tools such as agar plates. Antibiotic resistance testing uses paper discs soaked in antibiotic to perform 'disc diffusion' assays that have barely changed since Fleming first discovered penicillin. There are many reasons that that old technology (optical microscope) and techniques (agar plates) are still used. Often experts are already trained and it can be hard to replace experts with automated or electronic systems. Another major barrier to rapid change is that the materials needed to run current conventional tests are often extremely cheap (petri dishes, glass slides, agar and broth media, microwell plates) and labs are already equipped (optical microscope, incubator, pipettes, autoclave, spectrometer).
The biggest revolutions in clinical diagnostics can therefore only occur when we develop truly low-cost ways to replicate traditional human methods such as microscopic analysis or microbiology lab tests.
An excellent example where consumer electronics have made centuries-old technology redundant is in digital microscopy. Miniature CMOS sensors - only cheap because consumers buy millions of smartphones - combined with cheap plastic lenses - developed for mass market products such as DVD players - can magnify bacteria without microscope objectives and tubes. This technology revolution can be demonstrated dramatically using "smartphone microscopes" which can be made either from 3D printed parts, or even simpler laser-cut Perspex or plywood frames. Similarly, the £30 Raspberry Pi single-board computer can be transformed into a high power digital microscope.
Over the next decade, low cost digital microscopy promises to revolutionise various clinical diagnostics.
Purpose of Travel
This Overseas Travel Grant will fund a visit to the BIGHEART biomedical technology institute at the prestigious Department of Biomedical Engineering at the National University of Singapore, to learn from leading researchers and gain new expertise in optical, electronic and software development. This will complement applicant Edwards' prior expertise in fundamental biomedical science, microfluidic clinical diagnostics, and healthcare innovation.
Target clinical applications: Leptospirosis bacteria and blood platelets
The new digital microscopy devices will be targeted to two clinical applications linked to recent and ongoing research by the applicant. Edwards' group recently demonstrated bacterial detection, identification and antibiotic resistance testing in very low cost microfluidic devices, with smartphone detection; this research continues funded by another EPSRC grant awarded early in 2018. Edwards also works closely with cardiovascular disease experts within Reading's Institute of Cardiovascular and Metabolic Research (ICMR), studying new methods to measure platelet function. The first target is Leptospirosis - which causes Weil's disease - was selected as it illustrates many of the common characteristic challenges faced by clinical microbiologists across the globe. The second target is measurement of platelets - linking with ICMR research - is important because blood clotting is a critical process behind the majority of cardiovascular disease. Novel applications of advanced low-cost digital microscopy technology will be developed that address clinical challenges faced across the SE Asia region, the UK, and worldwide.

Planned Impact

1 Capacity building in strategically vital interface between digital technology and biomedical science
Whilst many engineers focus on biomedical technology as a vital target application for their research, it is relatively less common for biomedical scientists to move into engineering. Worldwide, there are more engineering and chemical engineering departments with biomedical research strength, than biomedical departments with engineering skills. Applicant Edwards is part of a smaller group of biologists with strong interest and active research in engineering science. To build new long-term research programs at this life science-engineering interface, this OTG will permit the PI to gain new expertise in the areas of optoelectronic and image analysis software engineering, through a long visit to a leading Biomedical Engineering hub.
This new expertise will be brought back to the UK within an appropriate applied science institution and allow PI to continue to bridge the University of Reading's Pharmacy department with the recently founded Bioengineering division. Our capability at the life science - engineering interface must continue to maintain it's world-leading reputation, and a significant proportion of our economy relies on this capacity for interdisciplinary research especially in healthcare.

2 The initial near-term economic impact is most likely to be expanding research capacity supporting R&D investment in the UK research base
Life science research remains one of the UK's greatest assets, with world-leading expertise in fundamental bioscience allied to as much as 20% of GDP in life science industries such as pharma, biotech and medical technology. We have complementary expertise in software, including world-leading reputation in AI. Digital healthcare technology is therefore rightly recognised as a major growth area and a significant focus of strategic research funding. This project will help secure further R&D investment in digital microscopy, a vital interface between cell and microbial biology and digital analysis. Our understanding of the difficult process innovation in healthcare is also vital to deliver disruptive technology into the clinic- many regulatory and health systems barriers to application of digital technology to healthcare remain, but the UK leads the way in understanding these barriers (e.g. through Academic Health Science Networks and Diagnostics Evidence Centres).
Investment in research and innovation in biomedical science is equally important for the UK to build upon its strong life science research base and deliver economic growth. There is great potential for this initial research project to lead to new inventions in hardware, software and in identifying novel application of existing technology. Ultimately this should lead to securing further R&D investment into UK healthcare technology, helping to prove the value of UK research base as a leading biomedical technology development base, and move towards future economic returns from new products.

3 Public and patient benefit
Ultimately, the purpose of this research is to develop new technology that automates clinical diagnostic processes that are currently laborious and manual, specifically in the areas of cardiovascular disease (blood cell measurements) and clinical microbiology (e.g. functional serology or pathogenic bacteria identification). However, this OTG is a new research project and benefits to patients will follow many years later through downstream R&D programs, and are thus hard to quantify directly. Whilst patient benefits are long-term, the pathway to this outcome will generate economic impact (see 2).

4 Public understanding of EPSRC funding
The application of smartphone camera technology to clinical diagnostics is expected to generate significant public interest both in the UK and in SE Asia, especially when coupled to public health problems such as neglected tropical disease or heart attacks.

Publications

10 25 50
publication icon
Diep T.T. (2019) 3D printed raspberry PI microscopy for low cost microfluidic bacterial motility analysis in 23rd International Conference on Miniaturized Systems for Chemistry and Life Sciences, MicroTAS 2019

publication icon
Dönmez S.I. (2021) AGAR-FREE, FAST AND CHEAP BACTERIOPHAGE COUNTING ASSAY USING MICROFLUIDIC DEVICE IN DARKFIELD IMAGING SYSTEM in MicroTAS 2021 - 25th International Conference on Miniaturized Systems for Chemistry and Life Sciences

publication icon
Jégouic S.M. (2019) Development of an affordable and sensitive diagnostic test for dengue disease using microfluidics and smartphones in 23rd International Conference on Miniaturized Systems for Chemistry and Life Sciences, MicroTAS 2019

 
Description The investigator was able to design and develop a 3D printed darkfield illuminated imaging system for detecting and measuring bacterial cell suspensions, that led to postgraduate research using this imaging rig published as a new concept article in "Sensors and Actuators B". The travel award enabled the researcher to design and build the prototype imaging system used in this new research study, by gaining optical and electronic engineering skills, and through discussions with biomedical engineers, in several overseas locations. The investigator was also able to complete a systematic analysis of digital cameras for portable diagnostic testing, including a publication in "Wellcome Open Research". The investigator also used expertise gained in digital imaging especially of diagnostic tests to publish a research method paper describing video-assisted field testing of COVID-19 diagnostic tests. This expertise also contributed to co-authoring an article about portable microbiology testing to tackle antimicrobial resistance (AMR).

During this travel award, the investigator gained a detailed understanding of three topical and important areas:
1) Digital imaging technology
With a background in biology, but a research focus on technology development, the investigator has through this travel award been able to develop a much more detailed and sophisticated understanding of digital imaging technology by visiting engineering experts/departments overseas. This new expertise includes more detailed understanding of imaging hardware (electronics and digital cameras) and also associated software (e.g. image analysis software, control software).

2) Need for digital microscopy and digital imaging for diagnostics
This travel award allowed visits to a wide range of end-users who might benefit from digital microscopy, including both healthcare microbiologists but also veterinary and agricultural stakeholders. This allowed a clearer definition of the possible users of advanced digital imaging technology in a number of countries across South and SE Asia. The investigator also built an improved understanding of how digital microscopy and digital cameras can be used more broadly for clinical diagnostics.

3) Open source hardware
During the travel award the investigator met with many engineers and researchers who are actively involved in open source hardware development, where instruments, electronics and devices are designed and published so anyone can make their own or contribute to the design. This movement complements open source software which has become increasingly important and ubiquitous. The investigator is therefore exploring ways to publish more details of hardware developed, to share details of experimental methods and instruments more transparently. This has led to a community project back in the host institution, such that as an outcome from this award, there is a new and growing Open Source Hardware community at the University of Reading, using low-cost digital imaging and digital microscopy for a wide range of research applications.
Exploitation Route One unexpected but important outcome of this funding - the development of a robotic laboratory imaging system - we believe has many possible end-users, and possible commercial value that we evaluated through a further ICURe commercialisation award. This led to spinout of a new open source laboratory hardware business, Object Bio, the business developent activities of which are also supported by a Royal Society Entrepreneur in Residence at Reading.
A second important outcome is that expertise in digital capture of diagnsotic test results has been applied to covid-19 rapid testing, in part through collaboration with an AHRC funded project focussed on design of diagnostic tests.
A third outcome is that the robotic laboratory imaging system has been extensively used to develop microfluidic microbiology technology. Without the digital imaging tools - developed using expertise gained during this award - we would not be able to capture detailed bacterial growth data from our systems. Using this open source hardware instrumentation we have performed 10s of thousands of microfluidic assays, leading to a major clinical evaluation of the technology for use in the NHS, starting in 2022, and funded by the NIHR. This should lead to clinical benefits in the UK and worldwide.
Further uptake of the outcomes might be expected in the future however it's currently too early to say.
Sectors Agriculture, Food and Drink,Healthcare,Pharmaceuticals and Medical Biotechnology

 
Description We have worked with one existing UK SME, and explored incorporation of a new spinout, to explore commercial opportunities exploiting a new robotic digital imaging product partly developed through this award. At this point it is still too early to expect significant impact, but we expect this to develop further over the next few years.
Sector Agriculture, Food and Drink,Healthcare,Pharmaceuticals and Medical Biotechnology
Impact Types Economic

 
Description ICURe EXFEB23
Amount £35,000 (GBP)
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 03/2023 
End 05/2023
 
Description Institutional Research Infrastructure Grant- One Image
Amount £45,000 (GBP)
Organisation University of Reading 
Sector Academic/University
Country United Kingdom
Start 02/2022 
End 01/2023
 
Description Institutional Sponsorship-International Partnerships-University of Reading
Amount £181,926 (GBP)
Funding ID EP/W524268/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 01/2022 
End 03/2022
 
Description Point-of-care antibiotic susceptibility testing to aid urinary tract infection treatment using dip-and test microcapillary devices
Amount £1,027,344 (GBP)
Funding ID NIHR203362 
Organisation National Institute for Health Research 
Sector Public
Country United Kingdom
Start 04/2022 
End 03/2025
 
Title Data associated with the article 'Remote videolink observation of model home sampling and home testing devices to simplify usability studies for point-of-care diagnostics' 
Description This dataset contains the video instruction resource used for remote testing of model home testing devices. The questionnaire given to participants along with a summary table of responses to the rating questions. This dataset contains images of model tests returned by participants during the study 'Remotely evaluating user experience of Covid-19 lateral flow devices'. A spreadsheet summary of the analysis of the returned images is also included. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
URL https://researchdata.reading.ac.uk/id/eprint/254
 
Description Clincial microbiology- NHS clinical research partnership 
Organisation Hampshire Hospitals NHS Foundation Trust
Country United Kingdom 
Sector Public 
PI Contribution We were able to outline the technology developed over the past 5 years to our partner, including our extensive laboratory validation data sets alongside summaries of the features of this technology. We also shared prototypes and target product profiles to outline the possible NHS applications of our technology. We then could plan a detailed clincal evaluation plan, which we shared In future, we will produce and optimise prototype products for evaluation using clinical samples collected in our partner NHS sites, and analyse the data generated.
Collaborator Contribution Our partners were able to bring their insight into current: -best practice analytical microbiology -clinical needs and gaps in current testing regime -UK policy and strategy for improving microbiology testing -UK policy and strategy for tackling antimicrobial resistance Our partners are also very experienced in planning and executing clinical trials of novel in vitro diagnostic devices and technologies. Building on this expertise, we were able to develop a joint validation and clinical trial plan, leading to success in securing NIHR funding for this multi-trial study.
Impact The most significant outcome so far is the award of a major NIHR grant that will support full evaluation of our technology in the NHS for antibiotic susceptibility testing. The new NIHR i4i Product Development Award starting in April 2022 is awarded to a partnership between the University of Reading and Hampshire Hospitals NHS Foundation Trust. This is a new joint research program, built around initial discussions and planning during 2021.
Start Year 2021
 
Description Clinical laboratory microbiology- evaluating microcapillary antibiotic susceptibility tests in Spain 
Organisation Central University Hospital of Asturias
Country Spain 
Sector Hospitals 
PI Contribution We made several batches of prototype antibiotic susceptibilty tests tailored to the requirements of the clinical microbiology team at Oviedo, at the Central University Hospital of Asturias in Northern Spain. We also created tailored instructions and SOP for them to use these tests. We shipped these batches
Collaborator Contribution Our partners have extensive expertise in evaluating antibiotic susceptibility tests and are familar with the latest developments in tackling antimicrobial resistance through laboratory microbiology. They were able to take our prototype test devices and run them with prospective sets of clinical isolates, and compare the results of our novel devices to current clinical reference standard or commercial regulatory approved laboratory tests. They recorded test results using smartphone, to demonstrate the portability and ease of use. They were able to gather feedback on usability and device design, that will help improve and optimise the prototypes. The validation data will be suitable for a joint publication in a clinical microbiology journal.
Impact Most important outputs will be a small but important data set showing independent evaluation of our technology in a clinical microbiology laboratory.
Start Year 2021
 
Description Evaluating microcapillary microbiology for antibiotic resistance testing of neglected tropical pathogens 
Organisation Mahidol University
Country Thailand 
Sector Academic/University 
PI Contribution We have made and supplied batches of microcapillary antibiotic susceptibility tests. We discussed possible applications to the local clinical microbiology system in Thailand and wider in SE Asia. We planned preliminary experiments that will establish a pilot data set that will help us to better plan longer-term evaluations and adoption studies. We also visited to test out the technology in March 2022, allowing us to better understand their needs as well as showing them how our technology works and what it offers.
Collaborator Contribution Our partners, including our lead co-I Dr Narisara Chantratita at Department of Microbiology and Immunology, are leading experts in bacterial infections, especially those causing neglected tropical diseases such as meloidosis. They have studied the antibiotic resistance of such microbes and are involved in important survillance for drug-resistant infection. Their contribution is to assess if our technology might be useful to tackle antimicrobial resistance (AMR) in a global health setting- one of the real Grand Challenges for public health in the next decades.
Impact To date, the main outcome is the evaluation of our novel microcapillary microbiology testing system in an external microbiology unit. This has taken the form of two pilot experimental evaluations: firstly, checking the technology works in an external microbiology lab in Bangkok with similar microbes to those already tested previously in Reading; secondly, the technology will be evaluated using important neglected tropical pathogens.
Start Year 2022
 
Title Design for laboratory robotic analysis instrument 
Description We published an open source design for a laboratory imaging robot, using open source hardware designs. These designs were published under an open source license. 
IP Reference  
Protection Protection not required
Year Protection Granted 2019
Licensed No
Impact Too early to state.
 
Title Darkfield smartphone bacterial measurement rig 
Description We developed a simple method for quantifying a suspension of bacterial cells in a microfluidic device that only requires a single LED light source, plus a smartphone or digital camera. By imaging light scatter on a dark background, the concentration of bacterial cell suspension can be measured. The analytical performance of this system is similar to absorbance measurement by conventional spectrometer or turbidity meter routinely used in all microbiology labs. However, it has the advantage of simpler hardware requirements. We demonstrate this system is useful to measure bacterial cell lysis by bacteriophage, an important class of biological antimicrobial agents. 
Type Of Technology Physical Model/Kit 
Year Produced 2020 
Impact Too early for impact, further refinement is required to make use of this product. The design has been briefly described in our first concept publication (Donmez 2020) but we have not yet fully published the refined design. We are considering publishing the design as an open source hardware project, but the design needs 
 
Title POLIR 
Description To allow us to analyse large numbers of microfluidic devices in the laboratory, we designed and built a high-throughput robotic lab instrument capable of imaging and making optical measurements of a wide range of samples. This product was published as a open source hardware design and is built using a range of open source tools, designs and hardware. We believe this flexible and powerful instrument will be very useful for a wide range of applications in the life sciences and beyond, and we are actively pursuing ways to make this new design and product available. 
Type Of Technology Systems, Materials & Instrumental Engineering 
Year Produced 2019 
Impact We expect many lab researchers will find this new analysis product useful, and are actively developing a plan to make it as widely available as possible. At this early stage there are no external users and we expect impact to develop over the next few years. 
URL https://gitlab.com/AlEdwards/polir
 
Company Name OBJECT BIO LTD 
Description Object Bio is a new company founded in 2020 to develop flexible analytical instrumentation designed to study microfluidic devices such as microfluidic microbiology. As a new startup, only incorporated in 2020, Object Bio has yet to publish a web page and it is too early to include further details. 
Year Established 2020 
Impact Object Bio was incorporated in 2020 and it is therefore too early to describe any impacts.
 
Description Maker and open source activities 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact We publicized our work on new technology for accelerating microbiological testing through high-profile blogs targetting the hardware/software development community. Blog posts at two very popular and influential sites- Hackaday and Raspberrypi.org blog featured in great detail our open source robotic system for analyzing microfluidic microbiology.

The purpose of this activity was to highlight the power of technology that is rapidly developing for other purposes (e.g. consumer electronics) to solve healthcare problems. This is important to cross disciplines and share how robotics and optoelectronics can be utilised in healthcare to solve major global health problems.
Year(s) Of Engagement Activity 2019,2020
URL https://www.raspberrypi.org/blog/raspberry-pi-vs-antibiotic-resistance-microbiology-imaging-with-ope...
 
Description Open Image- cross-campus, interdisciplinary open source digital imaging initiative 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Building on success in using open source hardware to image laboratory experiments, we built a local community involved in open source hardware for digital imaging for a broad range of research and teaching activities. This is currently a local community, across the campus at the University of Reading, with engagement across many diverese schools and departmenst from biomedical science to typography and architecture.
As part of our Open Research programme, this has already succeeded in making a broad range of researchers aware of the benefits of publishing details, data, designs and methodology beyond traditional academic research outputs.
Year(s) Of Engagement Activity 2021,2022