Uncertainty quantification and sensitivity analysis for resilient infrastructure systems
Lead Research Organisation:
University of Bristol
Department Name: Civil Engineering
Abstract
Computational modelling provides a vital tool to support infrastructure decisions, allowing to evaluate risks and benefits of different infrastructure options on a virtual system (or "digital twin") before committing to a particular design. Model outputs though are conditional on a range of uncertain assumptions and input data, due to our incomplete or imperfect knowledge of the drivers and the properties of the system being modelled. When models are used for long-term planning, the uncertainty about the current properties and drivers of the system is compounded with further uncertainty about how these will evolve in the future. For example, when planning water infrastructure for drought resilience, we need to make a set of uncertain assumptions about the way that future climate will affect water sources and how changes in the economy, society and lifestyle will affect future water demand. Another example is the energy sector, where the growing contribution of intermittent sources such as wind and solar introduces unprecedented levels of uncertainty to the quantification of energy production potential, both in the short and long term.
Overconfidence in model results and insufficient consideration of the breath of possible futures is a key obstacle to infrastructure resilience. If models are used to inform large investment decisions, they must be trustworthy and defensible. Decision-makers need to be made aware of the uncertainties affecting model output(s) and the critical assumptions that define the scope of validity of the model. Also, as uncertainty about the future is irreducible, modelling for resilience should aim at identifying designs that achieve an acceptable performance across a wide range of future scenarios, rather than designs that are optimal under any particular scenario.
Uncertainty Quantification and Sensitivity Analysis (UQ&SA) is a set of generic methods that can be used to analyse the propagation of uncertainties in model and thus improve the model's construction, validation, and use for decision-making under uncertainty. UQ&SA are "model-agnostic" methodologies, meaning that they are applicable to any mathematical model regardless of the specific application domain. The goal of this project is to set the foundations for integrating UQ&SA functionalities in the DAFNI platform. We believe this is very important for DAFNI to become a platform that not only enables users to share, combine and execute models, but also enables and promotes best practices for responsible modelling.
To achieve the project goal, we will develop DAFNI Workflows that use functionalities already existing in DAFNI for uncertainty propagation (the "Loop" functionality, which allows repeated executions of the same model against different input set-ups) and integrate them with existing open-source software packages for UQ&SA. In these Workflows, we will use two simple "proof-of-principle" models from the water and energy sector, so to ensure feasibility of the project within the limited timeframe, but also to produce training materials for current and future DAFNI users to learn "by example". Indeed throughout the project we will run a series of seminars and tutorial sessions on UQ&SA for early-career researchers, and develop recommendations for the DAFNI technical team on future developments needed in order to scale-up the applicability of UQ&SA to more complex models.
Overconfidence in model results and insufficient consideration of the breath of possible futures is a key obstacle to infrastructure resilience. If models are used to inform large investment decisions, they must be trustworthy and defensible. Decision-makers need to be made aware of the uncertainties affecting model output(s) and the critical assumptions that define the scope of validity of the model. Also, as uncertainty about the future is irreducible, modelling for resilience should aim at identifying designs that achieve an acceptable performance across a wide range of future scenarios, rather than designs that are optimal under any particular scenario.
Uncertainty Quantification and Sensitivity Analysis (UQ&SA) is a set of generic methods that can be used to analyse the propagation of uncertainties in model and thus improve the model's construction, validation, and use for decision-making under uncertainty. UQ&SA are "model-agnostic" methodologies, meaning that they are applicable to any mathematical model regardless of the specific application domain. The goal of this project is to set the foundations for integrating UQ&SA functionalities in the DAFNI platform. We believe this is very important for DAFNI to become a platform that not only enables users to share, combine and execute models, but also enables and promotes best practices for responsible modelling.
To achieve the project goal, we will develop DAFNI Workflows that use functionalities already existing in DAFNI for uncertainty propagation (the "Loop" functionality, which allows repeated executions of the same model against different input set-ups) and integrate them with existing open-source software packages for UQ&SA. In these Workflows, we will use two simple "proof-of-principle" models from the water and energy sector, so to ensure feasibility of the project within the limited timeframe, but also to produce training materials for current and future DAFNI users to learn "by example". Indeed throughout the project we will run a series of seminars and tutorial sessions on UQ&SA for early-career researchers, and develop recommendations for the DAFNI technical team on future developments needed in order to scale-up the applicability of UQ&SA to more complex models.
Organisations
| Description | DAFNI Annual Conference 2024 |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | We presented the motivation and state of progress of our project on integrating functionalities for uncertainty analysis into the DAFNI platform at the annual conference of the DAFNI community. |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.dafni.ac.uk/annual-conference-2024/ |
| Description | DAFNI Webinar Series 2024 on "Uncertainty in infrastructure systems modelling" |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Webinar discussing why better understanding of model uncertainties is vital when models are used to inform large infrastructure decisions, and showcasing the new functionalities that we integrated into the DAFNI platform to perform uncertainty analysis of infrastructure models. Webinar recordings remain available on Youtube through the DAFNI account |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.youtube.com/watch?v=QPfj9jfMoaM&t=2s |
| Description | EPSRC Supergen Energy Networks Hub Risk and Resilience Day 2024 |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Poster presentation of project plan, feedbacks collected on key priorities for better understanding uncertainty in energy systems networks from energy modellers, researchers, asset owners and regulators |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.riskday.co.uk/2024 |
| Description | Environment Agency Modelling Advisory Group (MAG) "Uncertainty Workshop" |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | We were invited to present our methods for investigating propagation of uncertainties to water resources managers from water companies in England and Wales (the meeting was organised by the Environment Agency of England and Wales) and to discuss how these methodologies could be used to inform modelling work for the upcoming cycle of Water Resources Management Plans. |
| Year(s) Of Engagement Activity | 2025 |
