Computer Vision for Analytical Chemistry (CVAC): Scalable Productivity for Chemical Manufacturing
Lead Research Organisation:
University of Strathclyde
Department Name: Pure and Applied Chemistry
Abstract
KEYWORDS: chemistry, catalysis, image processing, manufacturing, productivity, EPSRC.
The digital eyes of cameras paint the colourful worlds we can and cannot see by numbers. These numbers have the power to help us make life-changing medicines on timescales that, at the present time, we cannot imagine.
This research and leadership programme focusses on developing the analytical power of digital cameras to improve the productivity and safety of chemical manufacturing.
The Pharmaceutical sector is the UK's second largest in terms of income, but it is an extremely costly business to run. This cost burden hits at the heart of one of the UK's biggest challenges: our lack of productive output versus hours worked compared with other nations. To this point, 'Big Pharma' stands to realise a >£1bn reduction in R&D cost by 2030, but only if the efficiency with which it can discover new medicines can be improved by a third beyond the current state of the art. How can we make new medicines more productively? Fast adoption of digital technologies is vital. As linked to the core of the proposed research, digital technology adoption should include the amazing ability of cameras to tell the story of the world, not in words, but in useful numbers.
In Big Pharma, to understand whether or not the chemical process of making a medicine is safe to use on the manufacturing scale, we need to be able to analyse the chemical process in real time. The better we analyse a process on the small scale, the better its chances of being used productively to make medicines on the large scale. However, many useful reactions are never applied in industry because they do not meet the strict criteria for safe application on the manufacturing scale. This is an unsolved problem, and no current chemical monitoring technologies can seamlessly analyse chemical processes on small lab scale, large plant scale, and in dangerous environments. If such a monitoring technology were available, it has the potential to lead to an up-to 9:1 return on investment, moving us closer to the ultimate goal of improving research productivity by a full third.
Computer Vision is the science of digitally quantifying real-world objects using cameras. It is a vibrant area of research with a rich history in astronomy, land surveys, autonomous systems, food safety, defence and security, and art forensics, among other areas. Whilst 'photo-style' camera analysis has been used over the past decade, new and unique methods of using real-time camera-based chemical monitoring is still hugely underdeveloped across chemical manufacturing, despite the wealth of emerging knowledge from seemingly unrelated scientific disciplines. The untapped technology of camera-enabled reaction monitoring thus holds remarkable fundamental research potential. A new research programme in this area would contribute strongly to UK chemical manufacturing, realising significant and digitally-adoptive increases in productivity 2-3 years ahead of current 2030 targets.
This ambitious research programme will deliver a world-leading suite of new camera-enabled analytics for understanding a wide range of valuable chemical processes to make them safer and more productive on scale. The research leader has an emerging track record which has already directed step-changes in homogeneous catalyst design, reaction kinetics platforms, safety software systems, and industrial technology translation. Bordering chemistry and computer Science, this programme will deliver research excellence in video analysis methods for visible and invisible chemical processes, across all scales of chemical development, and in a wide range of chemistries beyond the core focus of improving productivity in Pharmaceutical development.
The digital eyes of cameras paint the colourful worlds we can and cannot see by numbers. These numbers have the power to help us make life-changing medicines on timescales that, at the present time, we cannot imagine.
This research and leadership programme focusses on developing the analytical power of digital cameras to improve the productivity and safety of chemical manufacturing.
The Pharmaceutical sector is the UK's second largest in terms of income, but it is an extremely costly business to run. This cost burden hits at the heart of one of the UK's biggest challenges: our lack of productive output versus hours worked compared with other nations. To this point, 'Big Pharma' stands to realise a >£1bn reduction in R&D cost by 2030, but only if the efficiency with which it can discover new medicines can be improved by a third beyond the current state of the art. How can we make new medicines more productively? Fast adoption of digital technologies is vital. As linked to the core of the proposed research, digital technology adoption should include the amazing ability of cameras to tell the story of the world, not in words, but in useful numbers.
In Big Pharma, to understand whether or not the chemical process of making a medicine is safe to use on the manufacturing scale, we need to be able to analyse the chemical process in real time. The better we analyse a process on the small scale, the better its chances of being used productively to make medicines on the large scale. However, many useful reactions are never applied in industry because they do not meet the strict criteria for safe application on the manufacturing scale. This is an unsolved problem, and no current chemical monitoring technologies can seamlessly analyse chemical processes on small lab scale, large plant scale, and in dangerous environments. If such a monitoring technology were available, it has the potential to lead to an up-to 9:1 return on investment, moving us closer to the ultimate goal of improving research productivity by a full third.
Computer Vision is the science of digitally quantifying real-world objects using cameras. It is a vibrant area of research with a rich history in astronomy, land surveys, autonomous systems, food safety, defence and security, and art forensics, among other areas. Whilst 'photo-style' camera analysis has been used over the past decade, new and unique methods of using real-time camera-based chemical monitoring is still hugely underdeveloped across chemical manufacturing, despite the wealth of emerging knowledge from seemingly unrelated scientific disciplines. The untapped technology of camera-enabled reaction monitoring thus holds remarkable fundamental research potential. A new research programme in this area would contribute strongly to UK chemical manufacturing, realising significant and digitally-adoptive increases in productivity 2-3 years ahead of current 2030 targets.
This ambitious research programme will deliver a world-leading suite of new camera-enabled analytics for understanding a wide range of valuable chemical processes to make them safer and more productive on scale. The research leader has an emerging track record which has already directed step-changes in homogeneous catalyst design, reaction kinetics platforms, safety software systems, and industrial technology translation. Bordering chemistry and computer Science, this programme will deliver research excellence in video analysis methods for visible and invisible chemical processes, across all scales of chemical development, and in a wide range of chemistries beyond the core focus of improving productivity in Pharmaceutical development.
Planned Impact
The economic and societal impact of this research in the longer-term will contribute to a 30% increase in Pharmaceutical R&D productivity, £1.3bn savings, and 1,555 fewer accidents associated with Pharmaceutical Manufacturing per year. The impact activities below aim to fully exploit the ability of the CVAC research programme to contribute to these productivity-focussed targets, serving stakeholders at the school-, academic-, industrial, and policy-making levels.
KEY BENEFICIARIES: As outlined in significant detail in the Beneficiaries section, it is envisaged that the proposed programme will serve:
- academic collaborators: colleagues working in electrochemistry, biochemistry, and materials design will benefit from access to new methods of monitoring changes in their systems that were previously difficult or impossible to measure.
- industrial process chemists: gaining unmet access to new high throughput reaction discovery methods that are, unprecedentedly, also applicable to scaled-up processes
- software engineering job seekers: ambitious computer scientists will gain opportunities to design and maintain commercial software emerging from the research.
- school children and coding enthusiasts: outputs from applying computer science to chemistry will be redressed in fun, accessible classes for the next generation of scientific talent.
- popular science content consumers: public lectures and massive open online courses will be created to engage a worldwide audience on the importance of cameras in chemical science.
- international chemistry policy makers: case studies from the research will inform new analytical chemical nomenclature and provide evidence for accelerating digital technology adoption.
TIMING: Chemical Manufacturing is increasing digitalisation, investing $3.2billion by 2022. Emerging 5G internet and increasing accessibility of camera technology are providing infrastructure to deliver connected, data-rich services to Chemical and related sectors. Development of computer vision for analytical chemistry (CVAC) methods for understanding high-value chemical reactions is thus extremely well-timed.
WIDER INFLUENCE: Adoption of digital innovations can reduce R&D spend by £1.3bn (~25%). Productivity improvements of 30% are targeted by 2030. Even if this programme positively influences only 1 of 5 project partners, from over 3,000 companies operating in the UK, a contribution to R&D costing-saving of over £43m could be realised. Non-invasive CVAC kinetic methods developed herein will improve high-throughput experimentation and support more efficient large-scale manufacturing. This helps improve quality control and process safety measures. Overall, this programme will benefit practitioners in catalysis research, materials development, and drug discovery. This is evidenced by the broad academic and industrial collaborations to develop computer vision kinetics beyond the core programme.
MAXIMISING IMPACT: The core research milestones (Y1-4, Work Plan) show escalating dissemination activity for the envisaged reach of the research. After review, Y5-7 will broaden research capabilities towards understanding metal-based carbonyl releasing therapeutics, a vibrant area of drug discovery and natural progression from initial research developments in metal catalysis. Later years will involve additional secondments to each partner company to streamline deployment of the new computer vision kinetics capabilities in-house for company-specific research projects. In relation, technology transfer via software licensing will escalate after the 4-year review. Finally, teaching material development will tackle the highlighted issue of a skills shortage in modern chemists via an increase in chemistry-specific computer programming abilities. Maximising research exposure will also demand a high-quality group website, strategic social media presence, YouTube research video summaries, podcast appearances, and press releases.
KEY BENEFICIARIES: As outlined in significant detail in the Beneficiaries section, it is envisaged that the proposed programme will serve:
- academic collaborators: colleagues working in electrochemistry, biochemistry, and materials design will benefit from access to new methods of monitoring changes in their systems that were previously difficult or impossible to measure.
- industrial process chemists: gaining unmet access to new high throughput reaction discovery methods that are, unprecedentedly, also applicable to scaled-up processes
- software engineering job seekers: ambitious computer scientists will gain opportunities to design and maintain commercial software emerging from the research.
- school children and coding enthusiasts: outputs from applying computer science to chemistry will be redressed in fun, accessible classes for the next generation of scientific talent.
- popular science content consumers: public lectures and massive open online courses will be created to engage a worldwide audience on the importance of cameras in chemical science.
- international chemistry policy makers: case studies from the research will inform new analytical chemical nomenclature and provide evidence for accelerating digital technology adoption.
TIMING: Chemical Manufacturing is increasing digitalisation, investing $3.2billion by 2022. Emerging 5G internet and increasing accessibility of camera technology are providing infrastructure to deliver connected, data-rich services to Chemical and related sectors. Development of computer vision for analytical chemistry (CVAC) methods for understanding high-value chemical reactions is thus extremely well-timed.
WIDER INFLUENCE: Adoption of digital innovations can reduce R&D spend by £1.3bn (~25%). Productivity improvements of 30% are targeted by 2030. Even if this programme positively influences only 1 of 5 project partners, from over 3,000 companies operating in the UK, a contribution to R&D costing-saving of over £43m could be realised. Non-invasive CVAC kinetic methods developed herein will improve high-throughput experimentation and support more efficient large-scale manufacturing. This helps improve quality control and process safety measures. Overall, this programme will benefit practitioners in catalysis research, materials development, and drug discovery. This is evidenced by the broad academic and industrial collaborations to develop computer vision kinetics beyond the core programme.
MAXIMISING IMPACT: The core research milestones (Y1-4, Work Plan) show escalating dissemination activity for the envisaged reach of the research. After review, Y5-7 will broaden research capabilities towards understanding metal-based carbonyl releasing therapeutics, a vibrant area of drug discovery and natural progression from initial research developments in metal catalysis. Later years will involve additional secondments to each partner company to streamline deployment of the new computer vision kinetics capabilities in-house for company-specific research projects. In relation, technology transfer via software licensing will escalate after the 4-year review. Finally, teaching material development will tackle the highlighted issue of a skills shortage in modern chemists via an increase in chemistry-specific computer programming abilities. Maximising research exposure will also demand a high-quality group website, strategic social media presence, YouTube research video summaries, podcast appearances, and press releases.
Organisations
- University of Strathclyde (Fellow, Lead Research Organisation)
- UNIVERSITY OF STRATHCLYDE (Collaboration)
- AstraZeneca (United Kingdom) (Project Partner)
- Terumo Aortic (Project Partner)
- Fujifilm (United Kingdom) (Project Partner)
- Imperial College London (Project Partner)
- GlaxoSmithKline (United Kingdom) (Project Partner)
- STEMMER IMAGING Ltd (UK) (Project Partner)
- Johnson Matthey (United Kingdom) (Project Partner)
People |
ORCID iD |
Marc Reid (Principal Investigator / Fellow) |
Publications
Barrington H
(2022)
Computer Vision for Kinetic Analysis of Lab- and Process-scale Mixing Phenomena
Barrington H
(2022)
Computer Vision for Kinetic Analysis of Lab- and Process-Scale Mixing Phenomena.
in Organic process research & development
Bugeja N
(2023)
Teaching old presumptive tests new digital tricks with computer vision for forensic applications
in Digital Discovery
Reid M
(2023)
Highlights from the 56th Bürgenstock Conference on Stereochemistry 2023.
in Chemical science
Yan C
(2023)
Computer vision as a new paradigm for monitoring of solution and solid phase peptide synthesis
in Chemical Science
Description | Development of Imaging Methods for Industrial Chemical Kinetics |
Amount | £3,741 (GBP) |
Funding ID | AI3SD-FundingCall3_014 |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 06/2021 |
End | 09/2021 |
Description | AstraZeneca - Kineticolor |
Organisation | University of Strathclyde |
Department | Department of Pure and Applied Chemistry |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | Sharing of concepts behind the video imaging software our team is developing, with a view of understanding how we could expand the current solution towards more high-throughput applications. |
Collaborator Contribution | Regular (minimum quarterly) meetings to help steer the priorities in the development of our analytical software. Specifically, AstraZeneca have provided in-depth detail on high throughput chemistry workflows that help embed this real-world relevance to the software solutions our team is trying to provide. |
Impact | Formalised in-kind support for UKRI Future Leaders Fellowship. |
Start Year | 2018 |
Description | Fujifilm - Kineticolor |
Organisation | University of Strathclyde |
Department | Department of Pure and Applied Chemistry |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | Education and concept sharing with regards video imaging software under development in our team. |
Collaborator Contribution | Biannual meetings to review process chemistry relevance of the technology under development in our team. Fujifilm have provided lab and plant tours to impress the relevance and possible applications of our technology. |
Impact | Mature proof of concept leading to Fujifilm being named a formal project partner on UKRI Future Leaders Fellowship. |
Start Year | 2018 |
Description | GSK - Kineticolor |
Organisation | University of Strathclyde |
Department | Department of Pure and Applied Chemistry |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | Demonstration and development of video imaging software to be applied in industrial metal-mediated reactions. |
Collaborator Contribution | Regular (minimum quarterly) meetings, with quantified time in-kind, to help steer the priorities of analysis being output by our software, and highlighting a list of additional application areas. |
Impact | The original collaboration led to formal project partnership status for GSK to be involved in my UKRI Future Leaders Fellowship. 2 mature proof-of-concept projects, evidencing the potential benefit of our analytical technology in compliment to the tools GSK already use, have been completed. We have formalised a non-disclosure agreement to more deliberately explore commercial solutions that will evolve from the software under development in our team. |
Start Year | 2018 |
Description | Johnson Matthey - Kineticolor |
Organisation | University of Strathclyde |
Department | Department of Pure and Applied Chemistry |
Country | United Kingdom |
Sector | Academic/University |
PI Contribution | Education and concept sharing around the analytical software our team is developing. |
Collaborator Contribution | Biannual meetings to help steer the priority areas for software development and analytical chemistry applications. |
Impact | Mature proof-of-concept study leading to Johnson Matthey being named a formal project partner on my UKRI Future Leaders Fellowship |
Start Year | 2019 |
Description | Podcast Series |
Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Postgraduate students |
Results and Impact | Through the lens of his daily dealings in leading an academic research fellowship, Dr Marc Reid shares with you his bite-sized thoughts on team management, motivation, public speaking, family balance, writing, mentoring, serial tasking, (not) multitasking, entrepreneurship, imposter phenomenon, and more. |
Year(s) Of Engagement Activity | 2021,2022 |
URL | https://www.dr-marc-reid.com/podcast |
Description | YouTube Lecture Series |
Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Media (as a channel to the public) |
Results and Impact | The Practice & Pitfalls of Studying Organic Reaction Mechanisms Outline: Mechanism matters. From small academic laboratories to industrial pilot plants, the study of reaction mechanisms is vital for controlling and predicting the outcome of a chemical process. In this class, we revisit concepts in kinetics introduced at undergraduate level, and consider how we can avoid the most common mistakes when trying to understand linear and catalytic reactions in more depth. Originally developed in 2018-19 as a postgraduate chemistry course, these lectures share (and perhaps remind you) of some fundamental building blocks needed to more deeply study chemical reaction mechanisms. |
Year(s) Of Engagement Activity | 2018,2020,2021,2022 |
URL | https://www.youtube.com/playlist?list=PL0iVmFi_gciI15Kvw_kM7-GpjY4npjVV_ |