Uncertainty Quantification for Expensive COVID-19 Simulation Models (UQ4Covid)

Lead Research Organisation: University of Exeter
Department Name: Mathematics

Abstract

Accurate mathematical models of transmission are crucial for targeting successful interventions to combat the spread of SARS-Cov2. In the UK, established models are used to provide real time policy support to Government through the Scientific Pandemic Influenza group - Modelling (SPI-M). Modellers in SPI-M have a proven track record, and models are continually adapted to respond to the evolving pandemic. When using models to inform decision making, it is crucial that all sources of uncertainty are properly accounted for when calibrating and predicting. For 30 years the UK has been a world-leader in developing Uncertainty Quantification (UQ); delivering methods for formal treatments of uncertainty when using models to understand the world, allowing efficient and robust calibration and prediction. Despite this, these techniques are not currently in place for COVID-19 simulation models, leading to slower-than-necessary adaptive model development-UQ allows for fast re-calibration-and an under-representation of uncertainty in predictions delivered to policymakers.
This project will adapt and deliver UQ techniques, code and tutorials for models of COVID-19 in the UK, providing SPI-M modellers with tools to facilitate rapid re-calibration of their models when changes are made in response to the evolving pandemic, and to more accurately represent uncertainty in their predictions. We will work closely with MetaWards, a spatial meta-population transmission framework (Danon et al. 2009, 2020) that contributes to SPI-M, to develop and apply these tools as we move into the winter; enabling fast evaluation of interventions responding to localised outbreaks, efficacy of vaccine rollout strategies, duration of immunity and more.

Publications

10 25 50

publication icon
Brooks-Pollock E (2021) Modelling that shaped the early COVID-19 pandemic response in the UK. in Philosophical transactions of the Royal Society of London. Series B, Biological sciences

publication icon
Challen R (2023) Clinical decision-making and algorithmic inequality. in BMJ quality & safety

publication icon
Danon L (2021) A spatial model of COVID-19 transmission in England and Wales: early spread, peak timing and the impact of seasonality. in Philosophical transactions of the Royal Society of London. Series B, Biological sciences

 
Description That traditional UQ methods cannot work in real time for decision support in pandemics. We have developed and tested methodology based on a UQ-Data Assimilation hybrid that seems effective and would meet the need to real-time UQ in decision support scenarios.
Exploitation Route Once our papers are published, we want to work with specific infectious disease modelling groups to embed the UQ systems we have worked on into the models they develop. Such embedding will mean that the next pandemic can be faced with real time UQ already in place.
Sectors Aerospace, Defence and Marine,Healthcare,Government, Democracy and Justice

 
Description Our findings on variant spread were presented to SPI-M-O during the emergence of the Delta and Omicron variants, with models, uncertainties and figures we prepared being passed (along with similar from other groups) to SAGE to advise policy makers. The PI was recognised officially for these contributions by the government.
First Year Of Impact 2021
Sector Healthcare,Government, Democracy and Justice
Impact Types Policy & public services

 
Description Spatial tracking of Covid-19 variant spread during spring 2021 for Spi-M/SAGE during the emergence of the Delta variant
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Spatial tracking of spread of Omicron Variant of Covid-19, November 2021-January 2022
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Joint Biosecurity Centre, Department for Health and Social Care Secondment 118311
Amount £25,703 (GBP)
Organisation UK Health Security Agency 
Sector Public
Country United Kingdom
Start 11/2021 
End 09/2022
 
Title UQ4Covid Ensemble Data 
Description Data from multiple ensembles of the UQ4Covid spatial version of Metawards. Can be used for developing UQ or methods for plotting high-resolution outbreaks and their response to parameter perturbation. 
Type Of Material Database/Collection of data 
Year Produced 2021 
Provided To Others? Yes  
Impact Unknown, though multiple papers in preparation. 
URL https://gws-access.jasmin.ac.uk/public/covid19/
 
Title UQ4Covid Tutorials 
Description This is a set of methods, code, data and tutorials for fitting basic UQ methods to Covid-19 models. 
Type Of Material Computer model/algorithm 
Year Produced 2021 
Provided To Others? Yes  
Impact Unknown 
URL https://uq4covid.github.io
 
Description Stefan and UKHSA 
Organisation UK Health Security Agency
Country United Kingdom 
Sector Public 
PI Contribution Stefan Siegert, a project Co-I began consulting with them taking some of our methods and some of his own to help them with their covid prevalence model.
Collaborator Contribution Development of a Covid Prevalence model using waste water data.
Impact Paper in review in AIMS Mathematics
Start Year 2021
 
Description BBC News article 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact BBC News article on household bubbles
Year(s) Of Engagement Activity 2020
URL https://www.bbc.co.uk/news/uk-55372743
 
Description Podcast with +Plus Magazine 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact +Plus magazine podcast
Year(s) Of Engagement Activity 2021
URL https://plus.maths.org/content/mathematical-frontline-ellen-brooks-pollock-and-leon-danon