Real-time digital optimisation and decision making for energy and transport systems
Lead Research Organisation:
Imperial College London
Department Name: Aeronautics
Abstract
In this project, we will seamlessly combine two disciplines that have been historically received continuous government and industrial funding: physics-based modelling, which is generalisable and robust but may require tremendous computational cost, and machine learning, which is adaptive and fast to be evaluated but not easily generalisable and robust. The intersection of the two spawns scientific machine learning, which maximises the strengths and minimises the weaknesses of the two approaches.
The data will be provided by high-fidelity simulations and experiments, from the UK state-of-the-art facilities and software. The efficiency of the machine learning training will be maximised for the algorithms to require minimal energy (thereby, producing minimal emissions by minimising electricity consumption). This project builds upon large UK and EU funded expertise in scientific machine learning and simulation, which will be generalised to fast, real-time decision making. The most significant bottleneck of most scientific machine learning is that they need time to be re-trained offline when new data becomes available. We will transform offline paradigms into real-time approaches for the models to re-adapt and provide accurate estimates on the fly. This project will culminate into the delivery of practical digital twins (defined as digital counterparts of real world physical systems or processes that can be used for simulation, prediction of behaviour to inputs, monitoring, maintenance, planning and optimisation) to solve currently intractable problems in wind energy, hydrogen, and road transportation. This project will transfer the technical achievements and real-time digital twin to policy-making.
The data will be provided by high-fidelity simulations and experiments, from the UK state-of-the-art facilities and software. The efficiency of the machine learning training will be maximised for the algorithms to require minimal energy (thereby, producing minimal emissions by minimising electricity consumption). This project builds upon large UK and EU funded expertise in scientific machine learning and simulation, which will be generalised to fast, real-time decision making. The most significant bottleneck of most scientific machine learning is that they need time to be re-trained offline when new data becomes available. We will transform offline paradigms into real-time approaches for the models to re-adapt and provide accurate estimates on the fly. This project will culminate into the delivery of practical digital twins (defined as digital counterparts of real world physical systems or processes that can be used for simulation, prediction of behaviour to inputs, monitoring, maintenance, planning and optimisation) to solve currently intractable problems in wind energy, hydrogen, and road transportation. This project will transfer the technical achievements and real-time digital twin to policy-making.
Publications
Bempedelis N
(2024)
Data-driven optimisation of wind farm layout and wake steering with large-eddy simulations
in Wind Energy Science
Nóvoa A
(2024)
Inferring unknown unknowns: Regularized bias-aware ensemble Kalman filter
in Computer Methods in Applied Mechanics and Engineering
Xia C
(2024)
Active flow control for bluff body drag reduction using reinforcement learning with partial measurements
in Journal of Fluid Mechanics
Description | Submission to Environmental Audit Committee - Sustainable electrification of the UK economy |
Geographic Reach | National |
Policy Influence Type | Contribution to a national consultation/review |
URL | https://committees.parliament.uk/writtenevidence/121655/html/ |
Description | NVIDIA |
Organisation | NVIDIA |
Country | Global |
Sector | Private |
PI Contribution | --> discussion with NVIDIA with the aim to prepare a proposal for the ExCALIBUR project (software development) |
Collaborator Contribution | --> discussion with NVIDIA with the aim to prepare a proposal for the ExCALIBUR project (software development) |
Impact | --> preparation of a proposal for the ExCALIBUR project (software development) |
Start Year | 2020 |
Title | 2DECOMP&FFT |
Description | The 2DECOMP&FFT library is a software framework written in modern Fortran to build large scale parallel applications. It is designed for applications using three-dimensional structured meshes with a particular focus on spatially implicit numerical algorithms. However, the library can be easily used with other discretisation schemes based on a structured layout and where pencil decomposition can apply. It is based on a general-purpose 2D pencil decomposition for data distribution and data Input Output (I/O). A 1D slab decomposition is also available as a special case of the 2D pencil decomposition. The library includes a highly scalable and efficient interface to perform three-dimensional Fast Fourier Transforms (FFTs). The library has been designed to be user-friendly, with a clean application programming interface hiding most communication details from application developers, and portable with support for modern CPUs and NVIDIA GPUs (support for AMD and Intel GPUs to follow). |
Type Of Technology | Software |
Year Produced | 2023 |
Open Source License? | Yes |
Impact | Possibility to use GPU hardware |
URL | https://www.theoj.org/joss-papers/joss.05813/10.21105.joss.05813.pdf |
Title | Xcompact3d |
Description | Xcompact3d is a Fortran-based framework of high-order finite-difference flow solvers dedicated to the study of turbulent flows. Dedicated to Direct and Large Eddy Simulations (DNS/LES) for which the largest turbulent scales are simulated, it can combine the versatility of industrial codes with the accuracy of spectral codes. Its user-friendliness, simplicity, versatility, accuracy, scalability, portability and efficiency makes it an attractive tool for the Computational Fluid Dynamics community. XCompact3d is currently able to solve the incompressible and low-Mach number variable density Navier-Stokes equations using sixth-order compact finite-difference schemes with a spectral-like accuracy on a monobloc Cartesian mesh. It was initially designed in France in the mid-90's for serial processors and later converted to HPC systems. It can now be used efficiently on hundreds of thousands CPU cores to investigate turbulence and heat transfer problems thanks to the open-source library 2DECOMP&FFT (a Fortran-based 2D pencil decomposition framework to support building large-scale parallel applications on distributed memory systems using MPI; the library has a Fast Fourier Transform module). When dealing with incompressible flows, the fractional step method used to advance the simulation in time requires to solve a Poisson equation. This equation is fully solved in spectral space via the use of relevant 3D Fast Fourier transforms (FFTs), allowing the use of any kind of boundary conditions for the velocity field. Using the concept of the modified wavenumber (to allow for operations in the spectral space to have the same accuracy as if they were performed in the physical space), the divergence free condition is ensured up to machine accuracy. The pressure field is staggered from the velocity field by half a mesh to avoid spurious oscillations created by the implicit finite-difference schemes. The modelling of a fixed or moving solid body inside the computational domain is performed with a customised Immersed Boundary Method. It is based on a direct forcing term in the Navier-Stokes equations to ensure a no-slip boundary condition at the wall of the solid body while imposing non-zero velocities inside the solid body to avoid discontinuities on the velocity field. This customised IBM, fully compatible with the 2D domain decomposition and with a possible mesh refinement at the wall, is based on a 1D expansion of the velocity field from fluid regions into solid regions using Lagrange polynomials or spline reconstructions. In order to reach high velocities in a context of LES, it is possible to customise the coefficients of the second derivative schemes (used for the viscous term) to add extra numerical dissipation in the simulation as a substitute of the missing dissipation from the small turbulent scales that are not resolved. Xcompact3d is currently being used by many research groups worldwide to study gravity currents, wall-bounded turbulence, wake and jet flows, wind farms and active flow control solutions to mitigate turbulence. |
Type Of Technology | Software |
Year Produced | 2019 |
Open Source License? | Yes |
Impact | see list of publications |
URL | http://www.incompact3d.com |
Title | https://github.com/AI-for-Net-Zero |
Description | Software implementing the algorithmic outputs on Real Time optimisation and decision making for energy and transport systems. The algorithms can be accessed from the wider community here: https://github.com/AI-for-Net-Zero |
Type Of Technology | Software |
Year Produced | 2023 |
Open Source License? | Yes |
Impact | State of the art algorithms enabling the real-time optimisation and decision making for energy and transport systems. |
URL | https://github.com/AI-for-Net-Zero |