PYRAMID: Platform for dYnamic, hyper-resolution, near-real time flood Risk AssessMent Integrating repurposed and novel Data sources
Lead Research Organisation:
Loughborough University
Department Name: Architecture, Building and Civil Eng
Abstract
Flooding has been identified by the government as the number one priority and risk to the UK. Flooding already causes millions of pounds worth of damage to people's homes, infrastructure and the economy every year, and is projected to become even more severe under climate change. Being able to plan for, respond to and manage flooding effectively is therefore essential.
We are lucky to have a tradition of flood management in the UK led by the Environment Agency. Operational flood models use meteorological data combined with elevation data to show us where flooding will occur. These models produce flood risk maps for planning and forecasting purposes and have helped us design flood defences for many areas.
However, flooding is not only dependent on the topography of an area. There are many other factors at play that evolve over time: culverts can get blocked, flood gates are left open and flood walls can fall into disrepair. This can dramatically alter the extent and depth of a flood. Not only that, but our exposure to flood risk changes too. Far less disruption occurs from a flood overnight than during rush hour traffic. A prime example of this is the flooding of Boscastle in 2004. During the event, 116 cars parked in a carpark were washed downstream, blocking a bridge, causing water to back up and flood unexpected areas. If the rain had fallen in the evening, the cars would not have been in the carpark and the impact of the flood would have been smaller. Could we have predicted this? Can we reduce the impact of flooding for similar future events? We think that with the right data and tools, we can.
We will build a tool that will change how we respond to flood risks as they evolve. The tool will allow flood risk managers to deploy just-in-time maintenance and alleviation measures, such as clearing critical blocked culverts or setting up mobile flood defences. To achieve this, the tool will incorporate brand new types of data and cutting edge flood models into an easy-to-use online platform that allows users to visualise evolving flood risks. The platform (called PYRAMID) will be developed in conjunction with the Environment Agency, local authorities and community groups to ensure that it delivers relevant information for critical decision-making in near-real time. The platform will have toolkits to make it easy for communities to incorporate their data, providing essential local information.
The new data driving this modelling will be key. The data that we need are available but sit fragmented across a range of organisations in difficult-to-use formats. We will use artificial intelligence to extract this useful information from hidden datasets, such as old reports, flood asset registers and various types of satellite imagery. In addition, we want to incorporate brand new information from novel sensors that are being deployed as part of Newcastle University's Urban Observatory. These sensors monitor things like soil moisture and rainfall at very high resolutions, as well as other factors like traffic and congestion. We can also monitor the condition of specific factors affecting flood risk, such as whether particular culverts are blocked or whether certain flood walls are in poor condition. These factors can be monitored by looking at a combination of satellite remote sensing and sensors deployed on lorries and other vehicles. We will also harness data collected communities and citizens.
All of this information will be put into our flood models. We have a hyper-resolution hydrodynamic flood model that can accurately simulate the movement of debris in flood flows at a centimetre scale. This model will work in conjunction with a broader catchment model, which will provide information on the hydrological conditions in the wider area. The platform will be trialled in Newcastle to take advantage of existing government investments in the Urban Observatory and a legacy of flood research conducted here.
We are lucky to have a tradition of flood management in the UK led by the Environment Agency. Operational flood models use meteorological data combined with elevation data to show us where flooding will occur. These models produce flood risk maps for planning and forecasting purposes and have helped us design flood defences for many areas.
However, flooding is not only dependent on the topography of an area. There are many other factors at play that evolve over time: culverts can get blocked, flood gates are left open and flood walls can fall into disrepair. This can dramatically alter the extent and depth of a flood. Not only that, but our exposure to flood risk changes too. Far less disruption occurs from a flood overnight than during rush hour traffic. A prime example of this is the flooding of Boscastle in 2004. During the event, 116 cars parked in a carpark were washed downstream, blocking a bridge, causing water to back up and flood unexpected areas. If the rain had fallen in the evening, the cars would not have been in the carpark and the impact of the flood would have been smaller. Could we have predicted this? Can we reduce the impact of flooding for similar future events? We think that with the right data and tools, we can.
We will build a tool that will change how we respond to flood risks as they evolve. The tool will allow flood risk managers to deploy just-in-time maintenance and alleviation measures, such as clearing critical blocked culverts or setting up mobile flood defences. To achieve this, the tool will incorporate brand new types of data and cutting edge flood models into an easy-to-use online platform that allows users to visualise evolving flood risks. The platform (called PYRAMID) will be developed in conjunction with the Environment Agency, local authorities and community groups to ensure that it delivers relevant information for critical decision-making in near-real time. The platform will have toolkits to make it easy for communities to incorporate their data, providing essential local information.
The new data driving this modelling will be key. The data that we need are available but sit fragmented across a range of organisations in difficult-to-use formats. We will use artificial intelligence to extract this useful information from hidden datasets, such as old reports, flood asset registers and various types of satellite imagery. In addition, we want to incorporate brand new information from novel sensors that are being deployed as part of Newcastle University's Urban Observatory. These sensors monitor things like soil moisture and rainfall at very high resolutions, as well as other factors like traffic and congestion. We can also monitor the condition of specific factors affecting flood risk, such as whether particular culverts are blocked or whether certain flood walls are in poor condition. These factors can be monitored by looking at a combination of satellite remote sensing and sensors deployed on lorries and other vehicles. We will also harness data collected communities and citizens.
All of this information will be put into our flood models. We have a hyper-resolution hydrodynamic flood model that can accurately simulate the movement of debris in flood flows at a centimetre scale. This model will work in conjunction with a broader catchment model, which will provide information on the hydrological conditions in the wider area. The platform will be trialled in Newcastle to take advantage of existing government investments in the Urban Observatory and a legacy of flood research conducted here.
Planned Impact
We categorise beneficiaries into two main groups.
Practitioners, regulators and policymakers: beneficiaries include organisations such as the Environment Agency, who are responsible for managing flood risk, forecasting and warning the public of floods and who still have gaps in their understanding of other data that may help strengthen their understanding of flood risk, as well as provide evidence for decision making; the Department for Environment, Food and Rural Affairs (Defra), with overall policy responsibility for flood and coastal erosion risk in England; the Department for Communities and Local Government (DCLG) with responsibility for coordinating UK resilience to major floods through the coordination of regional and local organisations and emergency planning.
This research would also be of interest to the Committee on Climate Change, to inform the next UK Climate Change Risk Assessment and subsequent action. Other users with potential benefits from this research are Category 1 and Category 2 responders as laid out in the Civil Contingencies Act 2004 (e.g. emergency services, transport and highways agencies, utilities) and the general public. To date citizen science data are less readily used by professionals to support real applications, despite offering new and different types of data which can fill data gaps at a local level.
Our proposed approach would also help support local Environment Agency Community Engagement Officers, who work with residents, public groups, land owners, businesses and schools to help them plan and prepare to reduce the impacts of a flood event. They will also help to build trust between community groups and our partner organisations, and raise awareness through education.
Community, charity and local interest groups, and citizen scientist networks: by working with a community group directly as a project partner (Action 4 Acomb), and indirectly through the facilitation of various groups by our environmental charity project partners (Tyne Rivers Trust) the project focuses on live flood risk challenges and issues in the citizen science pilot: sustainable data collection; data organisation, analysis and visualisation tools; accessible data integrated with 'traditional' sources of data.
When it comes to understanding flood risk and management, our stakeholders and beneficiaries face common issues with regards to: lack of data, or sustainable data collection to understand complex environmental issues and pressures, or to provide the evidence-base to make decisions or to lobby for interventions; ability to analyse and visualise data, either as a single data source or integrated with 'traditional' or national sensor networks, or sources of data that are often siloed, inaccessible, or archived after project completion in different organisations; tools and platforms that readily assimilate the most useful and applicable data and state-of-the art modelling to understand flood risk in near real-time.
This project will address these issues by:
Collaborating with a range of stakeholders (including citizens, government agencies and industry) to co-design, co-produce, co-evaluate and co-promote a web-application tool, and to extract, 'hidden data' that may inform understanding flood risk and management.
Creating a dynamic flood risk component dataset which will extract multi-scale information from fragmented heterogeneous datasets, integrate, and structure the data needed to model cascading failures important for flood risk.
Assimilating the new datasets into cutting-edge, physically-based hydrological and hydrodynamic models to predict plausible mechanisms and outcomes of flooding from rainfall to inundation.
An ultimately, to develop a web platform demonstrator to interrogate observations and model outputs, and visualise dynamic flood risk maps with (near) real-time updates.
Practitioners, regulators and policymakers: beneficiaries include organisations such as the Environment Agency, who are responsible for managing flood risk, forecasting and warning the public of floods and who still have gaps in their understanding of other data that may help strengthen their understanding of flood risk, as well as provide evidence for decision making; the Department for Environment, Food and Rural Affairs (Defra), with overall policy responsibility for flood and coastal erosion risk in England; the Department for Communities and Local Government (DCLG) with responsibility for coordinating UK resilience to major floods through the coordination of regional and local organisations and emergency planning.
This research would also be of interest to the Committee on Climate Change, to inform the next UK Climate Change Risk Assessment and subsequent action. Other users with potential benefits from this research are Category 1 and Category 2 responders as laid out in the Civil Contingencies Act 2004 (e.g. emergency services, transport and highways agencies, utilities) and the general public. To date citizen science data are less readily used by professionals to support real applications, despite offering new and different types of data which can fill data gaps at a local level.
Our proposed approach would also help support local Environment Agency Community Engagement Officers, who work with residents, public groups, land owners, businesses and schools to help them plan and prepare to reduce the impacts of a flood event. They will also help to build trust between community groups and our partner organisations, and raise awareness through education.
Community, charity and local interest groups, and citizen scientist networks: by working with a community group directly as a project partner (Action 4 Acomb), and indirectly through the facilitation of various groups by our environmental charity project partners (Tyne Rivers Trust) the project focuses on live flood risk challenges and issues in the citizen science pilot: sustainable data collection; data organisation, analysis and visualisation tools; accessible data integrated with 'traditional' sources of data.
When it comes to understanding flood risk and management, our stakeholders and beneficiaries face common issues with regards to: lack of data, or sustainable data collection to understand complex environmental issues and pressures, or to provide the evidence-base to make decisions or to lobby for interventions; ability to analyse and visualise data, either as a single data source or integrated with 'traditional' or national sensor networks, or sources of data that are often siloed, inaccessible, or archived after project completion in different organisations; tools and platforms that readily assimilate the most useful and applicable data and state-of-the art modelling to understand flood risk in near real-time.
This project will address these issues by:
Collaborating with a range of stakeholders (including citizens, government agencies and industry) to co-design, co-produce, co-evaluate and co-promote a web-application tool, and to extract, 'hidden data' that may inform understanding flood risk and management.
Creating a dynamic flood risk component dataset which will extract multi-scale information from fragmented heterogeneous datasets, integrate, and structure the data needed to model cascading failures important for flood risk.
Assimilating the new datasets into cutting-edge, physically-based hydrological and hydrodynamic models to predict plausible mechanisms and outcomes of flooding from rainfall to inundation.
An ultimately, to develop a web platform demonstrator to interrogate observations and model outputs, and visualise dynamic flood risk maps with (near) real-time updates.
People |
ORCID iD |
| Qiuhua Liang (Principal Investigator) |
Publications
Tong X
(2023)
An improved non-point source pollution model for catchment-scale hydrological processes and phosphorus loads
in Journal of Hydrology
Xing Y
(2022)
Improving the performance of city-scale hydrodynamic flood modelling through a GIS-based DEM correction method
in Natural Hazards
Xiong Y
(2024)
Simulation of the Full-Process Dynamics of Floating Vehicles Driven by Flash Floods
in Water Resources Research
Xiong Y
(2022)
A fully coupled hydrodynamic-DEM model for simulating debris dynamics and impact forces
in Ocean Engineering
| Description | The key research findings from PYRAMID include: 1) the complex flow dynamics induced by flood waves and floating debris interacting with building structures can be simulated using a physically based modelling framework developed through the project; 2) the simulation efficiency of the model can be substantially improved using the modern graphics processing units based high-performance computing technology 3) the new model can be applied to assess surface water flood risk by directly considering the influence of large-scale floating debris 4) by integrating with new remote sensing data to identify the source and type of potential floating objects, the model can be used to simulate the whole-process of debris dynamics from initiation, transport and interacting with structures/infrastructure. 5) through embedding into the Data & Analytics Facility for National Infrastructure (DAFNI), the models delivered through the project are able to support national flood risk modelling and assessment, provide data and results to inform decision-making. |
| Exploitation Route | Clearly the new urban surface water flood modelling capacity developed through the project will be of interests to Newcastle city council, EA and a range of other stakeholders. Engagement events were organised to interact with these stakeholders, disseminate the outputs and encourage uptake. In addition to practical impact, the scientific value of the new modelling methods is clear. The model will be finally open-sourced for different users, which is now under development through the Loughborough University EPG project (EPG162: 20/11/23) funded by the EPSRC Impact Acceleration Account. |
| Sectors | Communities and Social Services/Policy Digital/Communication/Information Technologies (including Software) Education Environment Government Democracy and Justice Transport |
| URL | https://projects.urbanobservatory.ac.uk/projects/pyramid |
| Description | The research has led to the delivery of a new modelling suite for simulating the detailed physical process of floating objects induced and driven by highly dynamic surface water floods and their interaction with building structures/infrastructure. The new model provides new capability for surface water flood modelling, capturing an important flow phenomenon that is often observed during such events. The new model has potential to improve the current flood modelling and risk assessment practice which is based on 'clean' water assumption, and can potentially provide more reliable flood risk information to inform urban planning and flood risk management. Project engagement events have also been planned to disseminate the research outputs. The resulting modelling tools will be made open-source for different users and up-take, which is now under development through the Loughborough University EPG project (EPG162: 20/11/23) funded by the EPSRC Impact Acceleration Account. The research has significantly contributed to the enhancement of international reputation of Prof Liang and his research group, leading to successful award of the prestigious UNESCO Chair in Informatics and Multi-hazard Risk Reduction, establishment of the new International Centre for Informatics and Disaster Resilience (ICIDR), and also the 11th Prince Sultan Bin Abdulaziz International Prize for Water (PSIPW) - Surface Water category. Prof Liang has been invited to joint international scientific committees of the important international conferences, become visiting professor of Chengdu University of Technology in China and nominated to Royal Academy of Engineering and Academy Europea during or shortly after the project. Prof Liang was also elected to become a fellow of the Royal Academy of Engineering. |
| First Year Of Impact | 2018 |
| Sector | Communities and Social Services/Policy,Digital/Communication/Information Technologies (including Software),Education,Environment,Government, Democracy and Justice,Transport |
| Impact Types | Societal Economic Policy & public services |
| Description | Standardising High-Performance Integrated hydrodynamic Modelling System (HiPIMS) for flood modelling and RIsk managemenT (SPIRIT) |
| Amount | £49,930 (GBP) |
| Funding ID | EPG162: 20/11/23 |
| Organisation | Loughborough University |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 01/2024 |
| End | 12/2024 |
| Title | An Integrated hydrological-hydrodynamic Model for Simulating Floods and Floating Debris Using Machine Learning Method to Identify Debris |
| Description | An integrated model was developed to predict the entire rainfall-runoff and flooding process, including floating debris. In this model, boundary conditions (i.e., flow discharge) are provided by a hydrological model called SHETRAN and the debris information, i.e., location, height and weight, is derived from the machine learning model. Then, the dynamic movement of floating objects initiated by flood waves was simulated using the High-Performance Hydrodynamic Model for Surface Water Flooding and Floating Debris. The integration work frame was developed based on DAFNI platform. This represents one of the core research deliverables of PYRAMID. |
| Type Of Material | Computer model/algorithm |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | The machine learning model can combine multiple data streams so this integrated model possesses a reliable routine for dataset maintenance and update. The new model can predict the entire flooding process and floating debris at unprecedented resolution and can potentially produce more reliable risk information to inform urban planning and flood risk management. |
| Title | High-Performance Hydrodynamic Model for Surface Water Flooding and Floating Debris |
| Description | A new modelling component for simulating the dynamic movement of floating objects initiated by flood waves has been developed and coupled with the Loughborough High-Performance Integrated hydrodynamic Modelling System (HiPIMS) to predict the full-process dynamics from initiation, transport to interacting with building structures. This represents one of the core research deliverables of PYRAMID. |
| Type Of Material | Computer model/algorithm |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| Impact | Currently, surface water flood modelling only considers 'clean water'. But a dynamic surface water flood event may initiate and transport floating objects, e.g. cars, tree logs, bins, and exacerbate flood impact. The new model will allow direct consideration of the extra risk/impact of these floating debris imposed to people, property and infrastructure, which better reflects reality and can potentially produce more reliable risk information to inform urban planning and flood risk management. |
| URL | https://www.sciencedirect.com/science/article/pii/S0029801822008435 |
| Title | New high-performance real-time flood modelling/forecasting tool |
| Description | Through PYRAMID, an innovative high-performance computer model has been further developed to simulate in real-time the flood hydrodynamics induced by intense rainfall, taking into account floating debris. In the current practice, 'clear water' assumption is normally made. But it is observed that floating objects are often carried along by transient flash flood flows, exaggerating impact on structures and imposing further threat to people. Coupling an existing hydrodynamic model (HiPIMS) with a new discrete element model to represent floating debris, the new model can simulate the complex interactive debris enriched flash flood flow and impact on structures. |
| Type Of Material | Computer model/algorithm |
| Year Produced | 2022 |
| Provided To Others? | No |
| Impact | This will provide a new modelling approach that may step change the current flood risk assessment practice. The model is still being refined and more pathways to impact will be explored in the later stage of the project. |
| Title | Platform for Dynamic, Hyper-resolution, Near-real Time Flood and Floating Debris Modelling |
| Description | PYRAMID has been implemented as a demonstrator workflow on the STFC DAFNI platform. This workflow reads external data like rainfall, water level, etc, from open source such as EA, MetOffice, etc. It contains a machine learning model to extract the boundary boxes of floating debris, a hydrological model to simulate river flow for long term, and a hydrodynamic model coupled with discrete element model to simulate surface water flood and the movement of floating debris during flood events. Individual models consisting of simulators, data-collectors and data converters form the discrete elements of the workflow. |
| Type Of Material | Computer model/algorithm |
| Year Produced | 2023 |
| Provided To Others? | No |
| Impact | PYRAMID will benefit policymakers, businesses, communities and individuals. The near-real-time flood modelling platform demonstrates a new methodology and tool for assessing, analysing, monitoring and forecasting the state of flood risk at higher spatial and temporal resolutions than previously seen. This will enable greater capacity to explain and engage with stakeholders around flood risk than previously possible and will be fine-tuned with our project partners. |
| URL | https://github.com/NCL-PYRAMID |
| Description | Collaboration with Prof Cathryn Birch from University of Leeds in Surface Water Flood Forecasting Research |
| Organisation | University of Leeds |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | The partnership was established through PI Liang's attending the iCASP enhanced SWF forecasting workshop organised by Prof Birch from University of Leeds. Liang contributed to discussion of surface water flood forecasting technologies at the workshop, subsequently discussed with Prof Birch and representatives from the EA and Flood Forecasting Centre about future research opportunities in this topic. This has led to new partnership to engage future research to address current technical challenges in surface water flood forecasting, initiating new ideas for future funding opportunities. |
| Collaborator Contribution | Prof Birch introduced their research and discussed ideas for future collaboration, as well as introducing EA and Flood Forecasting Centre into the collaboration network. |
| Impact | The partnership has directly led to the development of a large grant application submitted to NERC. |
| Start Year | 2022 |
| Description | EGU conference |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The EGU General Assembly 2023/2024 brings together geoscientists from all over the world to one meeting covering all disciplines of the Earth, planetary, and space sciences. The EGU aims to provide a forum where scientists, especially early career researchers, can present their work and discuss their ideas with experts in all fields of geoscience. |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://www.egu23.eu |
| Description | PYRAMID Workshop 1 (online): Project launch & stakeholder perspectives |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | This was the first stakeholder engagement workshop for the project, which took place online in April 2021 with the following objectives: 1. Launch PYRAMID project; 2. Familiarise partners and stakeholders with aim, objectives & vision; 3. Understand stakeholder perspectives and needs; 4. Understand how partners and stakeholders can support the project. The workshop was attended the project team and representatives from the government agencies (e.g. EA, Met Office, Flood forecasting Centre), local council (Newcastle Council), industry (Network Rail, JBA) and Tynes River Trust, etc. Whilst it was organised online, the workshop created useful discussion and outcomes that helped refine PYRAMID research plan and focus. |
| Year(s) Of Engagement Activity | 2021 |
| Description | PYRAMID webinar (Online) |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Media (as a channel to the public) |
| Results and Impact | PYRAMID members hosted an online seminar to introduce this project briefly. More than 60 researchers in related areas attended this event and they raised a lot of valuable questions and discussions. The channel Constructing a Digital Environment uploaded the record to YouTube afterwards (https://www.youtube.com/watch?v=iuqiKAqkAJc), expanding the project's influence and attracting more attention. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.youtube.com/watch?v=iuqiKAqkAJc |
| Description | Workshop 2: PYRAMID - Next steps |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | people from other universities and research institutions joined the workshop online. We demonstrated the outcomes and progress of the PYRAMID project, where we are at, what we can do and what are our limits. It provides opportunities for discussions and feedback, including how this could be used, potential improvements and real-time decision-making scenarios, which increased interest in related research areas. |
| Year(s) Of Engagement Activity | 2023 |
| Description | Writeathon/Hackathon (regular) |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Schools |
| Results and Impact | Regular Writeathons/Hackathons were held every 3 months with the following objective: 1. bring together members from different institutions to work collaboratively; 2. share information/resources with other WP members; 3. tutored by professional personnel from organizations such as JBA and DAFINI platform to enhance coding or technology-related skills. These events led to the development of new ideas or approaches to existing problems, and the outcomes include numerical modelling tools and paper drafts. |
| Year(s) Of Engagement Activity | 2021,2022,2023 |
| Description | iCASP enhanced SWF forecasting workshop |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | The iCASP enhanced surface water flood forecasting workshop was organised by the University of Leeds in November 2022 as part of a project funded through the Yorkshire Integrated Catchment Solutions Programme (iCASP). The workshop aimed to engage with government agencies including the Environment Agency, Met Office and Flood Forecasting Centre, local government users of flood forecasting products and academics to disseminate research outputs and receive feedback. Attending the workshop resulted in new collaboration partnerships with Leeds, Oxford, Met Office, EA and Flood Forecasting Centre, which has contributed to the development of a NERC large grant proposal. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://icasp.org.uk/enhanced-surface-water-flood-forecasts-summer-2022-yorkshire-testbed/ |