Computer Vision for Analytical Chemistry (CVAC): Scalable Productivity for Chemical Manufacturing
Lead Research Organisation:
University of Strathclyde
Department Name: Pure and Applied Chemistry
Abstract
KEYWORDS: chemistry, catalysis, image processing, manufacturing, productivity, EPSRC.
The digital eyes of cameras paint the colourful worlds we can and cannot see by numbers. These numbers have the power to help us make life-changing medicines on timescales that, at the present time, we cannot imagine.
This research and leadership programme focusses on developing the analytical power of digital cameras to improve the productivity and safety of chemical manufacturing.
The Pharmaceutical sector is the UK's second largest in terms of income, but it is an extremely costly business to run. This cost burden hits at the heart of one of the UK's biggest challenges: our lack of productive output versus hours worked compared with other nations. To this point, 'Big Pharma' stands to realise a >£1bn reduction in R&D cost by 2030, but only if the efficiency with which it can discover new medicines can be improved by a third beyond the current state of the art. How can we make new medicines more productively? Fast adoption of digital technologies is vital. As linked to the core of the proposed research, digital technology adoption should include the amazing ability of cameras to tell the story of the world, not in words, but in useful numbers.
In Big Pharma, to understand whether or not the chemical process of making a medicine is safe to use on the manufacturing scale, we need to be able to analyse the chemical process in real time. The better we analyse a process on the small scale, the better its chances of being used productively to make medicines on the large scale. However, many useful reactions are never applied in industry because they do not meet the strict criteria for safe application on the manufacturing scale. This is an unsolved problem, and no current chemical monitoring technologies can seamlessly analyse chemical processes on small lab scale, large plant scale, and in dangerous environments. If such a monitoring technology were available, it has the potential to lead to an up-to 9:1 return on investment, moving us closer to the ultimate goal of improving research productivity by a full third.
Computer Vision is the science of digitally quantifying real-world objects using cameras. It is a vibrant area of research with a rich history in astronomy, land surveys, autonomous systems, food safety, defence and security, and art forensics, among other areas. Whilst 'photo-style' camera analysis has been used over the past decade, new and unique methods of using real-time camera-based chemical monitoring is still hugely underdeveloped across chemical manufacturing, despite the wealth of emerging knowledge from seemingly unrelated scientific disciplines. The untapped technology of camera-enabled reaction monitoring thus holds remarkable fundamental research potential. A new research programme in this area would contribute strongly to UK chemical manufacturing, realising significant and digitally-adoptive increases in productivity 2-3 years ahead of current 2030 targets.
This ambitious research programme will deliver a world-leading suite of new camera-enabled analytics for understanding a wide range of valuable chemical processes to make them safer and more productive on scale. The research leader has an emerging track record which has already directed step-changes in homogeneous catalyst design, reaction kinetics platforms, safety software systems, and industrial technology translation. Bordering chemistry and computer Science, this programme will deliver research excellence in video analysis methods for visible and invisible chemical processes, across all scales of chemical development, and in a wide range of chemistries beyond the core focus of improving productivity in Pharmaceutical development.
The digital eyes of cameras paint the colourful worlds we can and cannot see by numbers. These numbers have the power to help us make life-changing medicines on timescales that, at the present time, we cannot imagine.
This research and leadership programme focusses on developing the analytical power of digital cameras to improve the productivity and safety of chemical manufacturing.
The Pharmaceutical sector is the UK's second largest in terms of income, but it is an extremely costly business to run. This cost burden hits at the heart of one of the UK's biggest challenges: our lack of productive output versus hours worked compared with other nations. To this point, 'Big Pharma' stands to realise a >£1bn reduction in R&D cost by 2030, but only if the efficiency with which it can discover new medicines can be improved by a third beyond the current state of the art. How can we make new medicines more productively? Fast adoption of digital technologies is vital. As linked to the core of the proposed research, digital technology adoption should include the amazing ability of cameras to tell the story of the world, not in words, but in useful numbers.
In Big Pharma, to understand whether or not the chemical process of making a medicine is safe to use on the manufacturing scale, we need to be able to analyse the chemical process in real time. The better we analyse a process on the small scale, the better its chances of being used productively to make medicines on the large scale. However, many useful reactions are never applied in industry because they do not meet the strict criteria for safe application on the manufacturing scale. This is an unsolved problem, and no current chemical monitoring technologies can seamlessly analyse chemical processes on small lab scale, large plant scale, and in dangerous environments. If such a monitoring technology were available, it has the potential to lead to an up-to 9:1 return on investment, moving us closer to the ultimate goal of improving research productivity by a full third.
Computer Vision is the science of digitally quantifying real-world objects using cameras. It is a vibrant area of research with a rich history in astronomy, land surveys, autonomous systems, food safety, defence and security, and art forensics, among other areas. Whilst 'photo-style' camera analysis has been used over the past decade, new and unique methods of using real-time camera-based chemical monitoring is still hugely underdeveloped across chemical manufacturing, despite the wealth of emerging knowledge from seemingly unrelated scientific disciplines. The untapped technology of camera-enabled reaction monitoring thus holds remarkable fundamental research potential. A new research programme in this area would contribute strongly to UK chemical manufacturing, realising significant and digitally-adoptive increases in productivity 2-3 years ahead of current 2030 targets.
This ambitious research programme will deliver a world-leading suite of new camera-enabled analytics for understanding a wide range of valuable chemical processes to make them safer and more productive on scale. The research leader has an emerging track record which has already directed step-changes in homogeneous catalyst design, reaction kinetics platforms, safety software systems, and industrial technology translation. Bordering chemistry and computer Science, this programme will deliver research excellence in video analysis methods for visible and invisible chemical processes, across all scales of chemical development, and in a wide range of chemistries beyond the core focus of improving productivity in Pharmaceutical development.
Planned Impact
The economic and societal impact of this research in the longer-term will contribute to a 30% increase in Pharmaceutical R&D productivity, £1.3bn savings, and 1,555 fewer accidents associated with Pharmaceutical Manufacturing per year. The impact activities below aim to fully exploit the ability of the CVAC research programme to contribute to these productivity-focussed targets, serving stakeholders at the school-, academic-, industrial, and policy-making levels.
KEY BENEFICIARIES: As outlined in significant detail in the Beneficiaries section, it is envisaged that the proposed programme will serve:
- academic collaborators: colleagues working in electrochemistry, biochemistry, and materials design will benefit from access to new methods of monitoring changes in their systems that were previously difficult or impossible to measure.
- industrial process chemists: gaining unmet access to new high throughput reaction discovery methods that are, unprecedentedly, also applicable to scaled-up processes
- software engineering job seekers: ambitious computer scientists will gain opportunities to design and maintain commercial software emerging from the research.
- school children and coding enthusiasts: outputs from applying computer science to chemistry will be redressed in fun, accessible classes for the next generation of scientific talent.
- popular science content consumers: public lectures and massive open online courses will be created to engage a worldwide audience on the importance of cameras in chemical science.
- international chemistry policy makers: case studies from the research will inform new analytical chemical nomenclature and provide evidence for accelerating digital technology adoption.
TIMING: Chemical Manufacturing is increasing digitalisation, investing $3.2billion by 2022. Emerging 5G internet and increasing accessibility of camera technology are providing infrastructure to deliver connected, data-rich services to Chemical and related sectors. Development of computer vision for analytical chemistry (CVAC) methods for understanding high-value chemical reactions is thus extremely well-timed.
WIDER INFLUENCE: Adoption of digital innovations can reduce R&D spend by £1.3bn (~25%). Productivity improvements of 30% are targeted by 2030. Even if this programme positively influences only 1 of 5 project partners, from over 3,000 companies operating in the UK, a contribution to R&D costing-saving of over £43m could be realised. Non-invasive CVAC kinetic methods developed herein will improve high-throughput experimentation and support more efficient large-scale manufacturing. This helps improve quality control and process safety measures. Overall, this programme will benefit practitioners in catalysis research, materials development, and drug discovery. This is evidenced by the broad academic and industrial collaborations to develop computer vision kinetics beyond the core programme.
MAXIMISING IMPACT: The core research milestones (Y1-4, Work Plan) show escalating dissemination activity for the envisaged reach of the research. After review, Y5-7 will broaden research capabilities towards understanding metal-based carbonyl releasing therapeutics, a vibrant area of drug discovery and natural progression from initial research developments in metal catalysis. Later years will involve additional secondments to each partner company to streamline deployment of the new computer vision kinetics capabilities in-house for company-specific research projects. In relation, technology transfer via software licensing will escalate after the 4-year review. Finally, teaching material development will tackle the highlighted issue of a skills shortage in modern chemists via an increase in chemistry-specific computer programming abilities. Maximising research exposure will also demand a high-quality group website, strategic social media presence, YouTube research video summaries, podcast appearances, and press releases.
KEY BENEFICIARIES: As outlined in significant detail in the Beneficiaries section, it is envisaged that the proposed programme will serve:
- academic collaborators: colleagues working in electrochemistry, biochemistry, and materials design will benefit from access to new methods of monitoring changes in their systems that were previously difficult or impossible to measure.
- industrial process chemists: gaining unmet access to new high throughput reaction discovery methods that are, unprecedentedly, also applicable to scaled-up processes
- software engineering job seekers: ambitious computer scientists will gain opportunities to design and maintain commercial software emerging from the research.
- school children and coding enthusiasts: outputs from applying computer science to chemistry will be redressed in fun, accessible classes for the next generation of scientific talent.
- popular science content consumers: public lectures and massive open online courses will be created to engage a worldwide audience on the importance of cameras in chemical science.
- international chemistry policy makers: case studies from the research will inform new analytical chemical nomenclature and provide evidence for accelerating digital technology adoption.
TIMING: Chemical Manufacturing is increasing digitalisation, investing $3.2billion by 2022. Emerging 5G internet and increasing accessibility of camera technology are providing infrastructure to deliver connected, data-rich services to Chemical and related sectors. Development of computer vision for analytical chemistry (CVAC) methods for understanding high-value chemical reactions is thus extremely well-timed.
WIDER INFLUENCE: Adoption of digital innovations can reduce R&D spend by £1.3bn (~25%). Productivity improvements of 30% are targeted by 2030. Even if this programme positively influences only 1 of 5 project partners, from over 3,000 companies operating in the UK, a contribution to R&D costing-saving of over £43m could be realised. Non-invasive CVAC kinetic methods developed herein will improve high-throughput experimentation and support more efficient large-scale manufacturing. This helps improve quality control and process safety measures. Overall, this programme will benefit practitioners in catalysis research, materials development, and drug discovery. This is evidenced by the broad academic and industrial collaborations to develop computer vision kinetics beyond the core programme.
MAXIMISING IMPACT: The core research milestones (Y1-4, Work Plan) show escalating dissemination activity for the envisaged reach of the research. After review, Y5-7 will broaden research capabilities towards understanding metal-based carbonyl releasing therapeutics, a vibrant area of drug discovery and natural progression from initial research developments in metal catalysis. Later years will involve additional secondments to each partner company to streamline deployment of the new computer vision kinetics capabilities in-house for company-specific research projects. In relation, technology transfer via software licensing will escalate after the 4-year review. Finally, teaching material development will tackle the highlighted issue of a skills shortage in modern chemists via an increase in chemistry-specific computer programming abilities. Maximising research exposure will also demand a high-quality group website, strategic social media presence, YouTube research video summaries, podcast appearances, and press releases.
Organisations
- University of Strathclyde (Collaboration, Lead Research Organisation)
- Almac Group (Collaboration)
- AstraZeneca (Project Partner)
- Terumo Aortic (Project Partner)
- FUJIFILM Imaging colorants Limited (Project Partner)
- GSK (Project Partner)
- Imperial College London (Project Partner)
- STEMMER IMAGING Ltd (UK) (Project Partner)
- Johnson Matthey (United Kingdom) (Project Partner)
People |
ORCID iD |
| Marc Reid (Principal Investigator / Fellow) |
Publications
Barrington H
(2025)
Parallel and High Throughput Reaction Monitoring with Computer Vision.
in Angewandte Chemie (International ed. in English)
Barrington H
(2024)
Parallel and High Throughput Reaction Monitoring with Computer Vision
in Angewandte Chemie
Barrington H
(2022)
Computer Vision for Kinetic Analysis of Lab- and Process-scale Mixing Phenomena
Barrington H
(2022)
Computer Vision for Kinetic Analysis of Lab- and Process-Scale Mixing Phenomena
in Organic Process Research & Development
Barrington H
(2024)
High Throughput Parallel Reaction Monitoring with Computer Vision
Bugeja N
(2023)
Teaching old presumptive tests new digital tricks with computer vision for forensic applications.
in Digital discovery
Chang H
(2024)
Presumptive Tests for Xylazine - A Computer Vision Approach
Chang H
(2024)
Presumptive Tests for Xylazine - A Computer Vision Approach
| Description | The ambition to investigate computer vision in analytical chemistry has led to successful building of the Kineticolor software platform. Kineticolor takes video recordings as input and generates time-based trends as output. The software automates the process for extracting pixel-level data stored in the videos. The Kineticolor team, led by Reid, are now enabling industrial scientists and engineers to extract time- and space-resolved trends from their chemical processes, in a non-contact fashion, using any available camera. This is unlike any other process monitoring tool currently available to industrialists. The evolving technology stack offers a suite of analytics, including bulk average colour, mixing times, shape tracking, and parallel process monitoring, maximising the number of applications and stakeholders, from across the whole of chemical manufacturing. The research has thus far been validated by four peer-reviewed publications, two of which led to editorial spotlights from journals to maximise reach. Published applications of fellowship research include process-scale mixing analysis, catalyst deactivation, solid phase peptide synthesis, and forensic spot testing. These papers evidence progress on the initial targeted case studies as well as application opportunities that arose since the fellowship began. Additionally, the first iteration of the Kineticolor computer vision software has progressed to Gate 3 of 4 in the University of Strathclyde's stage-gated spinout process, pathing a way to the business-led impact envisioned for the fellowship. |
| Exploitation Route | This active renewal of this award is progressing efforts to spinout a software-as-a-service company in order to maximise the global reach of the new computer vision-enabled reaction monitoring technology developed during the award. The company is registered and a software branding trademark has been registered. Following support from InnovateUK's ICURe Explore programme, our team has trialled the software with 5 multinational companies in the chemical sector. Ongoing work aims to convert these relationships into commercial licence terms, ahead of formal spinout of our company (Kineticolor Ltd) from the university. |
| Sectors | Agriculture Food and Drink Chemicals Education Pharmaceuticals and Medical Biotechnology |
| URL | https://pubs.rsc.org/en/content/articlelanding/2023/sc/d3sc90145a |
| Description | Global investment for digitalisation of chemical manufacturing is expected to reach $31 billion by 2028, with an annual growth rate of 6% from the current $23.5 billion market.15 R&D managers are driving streamlined adoption of new process analytical technology to improve productivity, process safety, and ability to exploit artificial intelligence. On route to transforming pioneering research into business-led impact, a $400 million addressable market in the form of portable analytical instrumentation used for liquid and molecular-level analyses has been identified. In 2022, primary market research for Kineticolor was commissioned. From 32 interviews with research managers in the Pharma sector, the value-add of Kineticolor was identified in 3 parts: 1) It is operable on both small and large scales. This would enable scientists within distinct roles to use the same analytical technology as the making of a particular chemical is scaled up. 2) It is not one analytical tool monitoring one reaction but rather a technology that can help analyse many reactions simultaneously. This holds strong potential to alleviate pains around data throughput, accelerating discovery and optimisation of chemical processes. 3) It samples chemistry over multiple points in space as well as multiple places in time. This serves chemical engineers documenting mixing capabilities of vessels for regulatory approvals. Market exploration was expanded through the ICURe Explore programme in 2023. Through 107 conversations with industrialists, Kineticolor opportunities were identified across Food & Drink, Paints & Pigments, Fine Chemicals, Mining & Minerals, and cross-sector needs for digital product authentication. Since then, 24 proof-of-concept projects to analyse industry-supplied data, using Kineticolor, and 7 two-way NDAs have been established. The Kineticolor team are now in discussions with Lonza (a contract manufacturing organisation serving the pharmaceutical, biotech, and nutrients industries) for an evaluation license of the technology, with plans to negotiate a full licence, if the evaluation is positive, thus seeding business-led impact. |
| First Year Of Impact | 2022 |
| Sector | Agriculture, Food and Drink,Chemicals,Education |
| Impact Types | Societal Economic |
| Description | Development of Imaging Methods for Industrial Chemical Kinetics |
| Amount | £3,741 (GBP) |
| Funding ID | AI3SD-FundingCall3_014 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 05/2021 |
| End | 09/2021 |
| Description | AstraZeneca - Kineticolor |
| Organisation | University of Strathclyde |
| Department | Department of Pure and Applied Chemistry |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Sharing of concepts behind the video imaging software our team is developing, with a view of understanding how we could expand the current solution towards more high-throughput applications. |
| Collaborator Contribution | Regular (minimum quarterly) meetings to help steer the priorities in the development of our analytical software. Specifically, AstraZeneca have provided in-depth detail on high throughput chemistry workflows that help embed this real-world relevance to the software solutions our team is trying to provide. |
| Impact | Formalised in-kind support for UKRI Future Leaders Fellowship. |
| Start Year | 2018 |
| Description | Fujifilm - Kineticolor |
| Organisation | University of Strathclyde |
| Department | Department of Pure and Applied Chemistry |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Education and concept sharing with regards video imaging software under development in our team. |
| Collaborator Contribution | Biannual meetings to review process chemistry relevance of the technology under development in our team. Fujifilm have provided lab and plant tours to impress the relevance and possible applications of our technology. |
| Impact | Mature proof of concept leading to Fujifilm being named a formal project partner on UKRI Future Leaders Fellowship. |
| Start Year | 2018 |
| Description | GSK - Kineticolor |
| Organisation | University of Strathclyde |
| Department | Department of Pure and Applied Chemistry |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Demonstration and development of video imaging software to be applied in industrial metal-mediated reactions. |
| Collaborator Contribution | Regular (minimum quarterly) meetings, with quantified time in-kind, to help steer the priorities of analysis being output by our software, and highlighting a list of additional application areas. |
| Impact | The original collaboration led to formal project partnership status for GSK to be involved in my UKRI Future Leaders Fellowship. 2 mature proof-of-concept projects, evidencing the potential benefit of our analytical technology in compliment to the tools GSK already use, have been completed. We have formalised a non-disclosure agreement to more deliberately explore commercial solutions that will evolve from the software under development in our team. |
| Start Year | 2018 |
| Description | Johnson Matthey - Kineticolor |
| Organisation | University of Strathclyde |
| Department | Department of Pure and Applied Chemistry |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Education and concept sharing around the analytical software our team is developing. |
| Collaborator Contribution | Biannual meetings to help steer the priority areas for software development and analytical chemistry applications. |
| Impact | Mature proof-of-concept study leading to Johnson Matthey being named a formal project partner on my UKRI Future Leaders Fellowship |
| Start Year | 2019 |
| Description | Kineticolor software evaluation licence to test commercial viability |
| Organisation | Almac Group |
| Department | Almac Sciences |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | This organisation is one of several companies signed up to an software evaluation licence agreement, to review the commercial readiness of Kineticolor computer vision software, developed over the course of the fellowship. |
| Collaborator Contribution | The partner has conducted 15+ software trials across 2 company sites and multiple employees involved, both in training and testing. |
| Impact | The future aims of this collaboration is to convert Almac into a paying customer of the software. |
| Start Year | 2024 |
| Description | Podcast Series |
| Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Postgraduate students |
| Results and Impact | Through the lens of his daily dealings in leading an academic research fellowship, Dr Marc Reid shares with you his bite-sized thoughts on team management, motivation, public speaking, family balance, writing, mentoring, serial tasking, (not) multitasking, entrepreneurship, imposter phenomenon, and more. |
| Year(s) Of Engagement Activity | 2021,2022 |
| URL | https://www.dr-marc-reid.com/podcast |
| Description | YouTube Lecture Series |
| Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | The Practice & Pitfalls of Studying Organic Reaction Mechanisms Outline: Mechanism matters. From small academic laboratories to industrial pilot plants, the study of reaction mechanisms is vital for controlling and predicting the outcome of a chemical process. In this class, we revisit concepts in kinetics introduced at undergraduate level, and consider how we can avoid the most common mistakes when trying to understand linear and catalytic reactions in more depth. Originally developed in 2018-19 as a postgraduate chemistry course, these lectures share (and perhaps remind you) of some fundamental building blocks needed to more deeply study chemical reaction mechanisms. |
| Year(s) Of Engagement Activity | 2018,2020,2021,2022 |
| URL | https://www.youtube.com/playlist?list=PL0iVmFi_gciI15Kvw_kM7-GpjY4npjVV_ |