On the way to the asymptotic limit: mathematics of slow-fast coupling in PDEs
Lead Research Organisation:
UNIVERSITY OF EXETER
Department Name: Mathematics
Abstract
The main motivation for this proposal is the pressing need to understand oscillatory stiffness with finite time-scale separation in PDEs and its effects on their numerical analysis. Though this subject has been of interest for many years, because of its wide impact on physical applications, it has become even more important recently because of its potential to revolutionize numerical methods in advance of the shift to next-generation computer architectures (e.g. contenders for ARCHER2 and beyond).
The intimate relationship between the mathematical structure of the equations, their numerical approximation, and the associated physical phenomenon has been understood since the beginning of scientific computing. A classic example is Jules Charney, who, in his 1948 paper, examined weather maps and deduced 'slow' equations that filtered out the fast oscillatory waves responsible for the numerical instabilities first observed by L.F. Richardson in 1922. These equations not only lead to the first realistic numerical weather prediction, but also gave rise to fundamental understanding of the physics of baroclinic instability, the key energy transfer mechanism behind the fluid dynamics of the formation of weather systems.
Since those early days, mathematical analysis, numerical analysts and fluid and continuum dynamics have all made advances toward understanding this subject of oscillations in nonlinear phenomenon. In fact, there are pieces of the puzzle scattered throughout the literature of each subject, but no comprehensive theory has been fully realized.
We propose that a fruitful path to advance the understanding of oscillations in nonlinear PDEs is the missing theory of finite-time scale separation, which is fundamentally an issue of nonlinear interactions, called resonances, between the key frequencies of the PDE. Exact sets of resonances are formed of nonlinear triads and are the only part of the solution that manifests in the asymptotic limit. In physical reality, where the time scale separation is finite, there are additional 'near resonances'. The mathematical definition of near-resonant-sets and their impact on understanding fluid dynamics and advancing mathematical and numerical analysis is a rich ground to cover and is one of the topics that will be explored in this project through a novel technique of frequency-averaging developed by the PI and her collaborators.
The finite time-scale separation case is fundamentally important for advancing numerical methods for next generation computer architectures. By applying this new technique to numerical algorithms, the PI and her collaborators were able to resolve the near-resonances completely missed by implicit methods, and construct the first proofs of superlinear convergence for oscillatory time-parallel numerical methods. In doing so, their algorithm achieved parallel speed-ups of over 100 over standard methods.
Given the crucial role of oscillations in reducing time-to-solution for the numerical solution of PDEs, the time is right for advancing the subject. This project proposes a solution to address this long-standing problem of finite time-scale separation in PDEs by uniting PDEs analysis, numerical analysis, continuum dynamics, and computational science. It provides a direct line-of-sight from the heart of mathematical analysis into advances required to meet the goals for next-generation high performance computing.
The intimate relationship between the mathematical structure of the equations, their numerical approximation, and the associated physical phenomenon has been understood since the beginning of scientific computing. A classic example is Jules Charney, who, in his 1948 paper, examined weather maps and deduced 'slow' equations that filtered out the fast oscillatory waves responsible for the numerical instabilities first observed by L.F. Richardson in 1922. These equations not only lead to the first realistic numerical weather prediction, but also gave rise to fundamental understanding of the physics of baroclinic instability, the key energy transfer mechanism behind the fluid dynamics of the formation of weather systems.
Since those early days, mathematical analysis, numerical analysts and fluid and continuum dynamics have all made advances toward understanding this subject of oscillations in nonlinear phenomenon. In fact, there are pieces of the puzzle scattered throughout the literature of each subject, but no comprehensive theory has been fully realized.
We propose that a fruitful path to advance the understanding of oscillations in nonlinear PDEs is the missing theory of finite-time scale separation, which is fundamentally an issue of nonlinear interactions, called resonances, between the key frequencies of the PDE. Exact sets of resonances are formed of nonlinear triads and are the only part of the solution that manifests in the asymptotic limit. In physical reality, where the time scale separation is finite, there are additional 'near resonances'. The mathematical definition of near-resonant-sets and their impact on understanding fluid dynamics and advancing mathematical and numerical analysis is a rich ground to cover and is one of the topics that will be explored in this project through a novel technique of frequency-averaging developed by the PI and her collaborators.
The finite time-scale separation case is fundamentally important for advancing numerical methods for next generation computer architectures. By applying this new technique to numerical algorithms, the PI and her collaborators were able to resolve the near-resonances completely missed by implicit methods, and construct the first proofs of superlinear convergence for oscillatory time-parallel numerical methods. In doing so, their algorithm achieved parallel speed-ups of over 100 over standard methods.
Given the crucial role of oscillations in reducing time-to-solution for the numerical solution of PDEs, the time is right for advancing the subject. This project proposes a solution to address this long-standing problem of finite time-scale separation in PDEs by uniting PDEs analysis, numerical analysis, continuum dynamics, and computational science. It provides a direct line-of-sight from the heart of mathematical analysis into advances required to meet the goals for next-generation high performance computing.
Planned Impact
The proposed research uses a recently successful theory for frequency averaging in nonlinearity to unite mathematical analysis, fluid mechanics, numerical analysis, and computing to provide new algorithms favourable for application on next-generation computers.
We expect there to be intradisciplinary beneficiaries in each subject area because of the wide reach of the strategically selected research team. But in addition, this project offers a unique opportunity for subjects at the heart of mathematics, like analysis, to have a clear line of sight to advance computing on new architectures. Thus, this project has the potential to accelerate UK mathematics contributions, beyond journal articles, to the global conversation taking place now about next generation computing.
The new wave/mean-flow theory we propose not only benefits fundamental research in fluid mechanics, but we also will apply it to in situ data in the Arctic Ocean, allowing the advances of this research to be accessible to oceanographers and atmosphere and ocean modellers through direct collaboration.
One of the key ideas of this proposal has already demonstrated that it is possible to make significant gains in the parallel performance for computing by reaching deeply into mathematical analysis. By advancing this idea further, the fundamental gains in understanding proposed in this project will continue to benefit numerical analysis and so on into numerical algorithm development. This benefit is likely to have significant impacts in the climate and weather community through already established collaborations with UK Met Office's next-generation numerics, the Gung-Ho project, which the PI and 2 of the Co-I are already members.
Because our new theories will be realised in open-source code in the Firedrake/Gusto framework, it will be of benefit all those who use and develop finite elements.
In addition, one of the Co-I on our project is a Research Software Engineer (RSE) with access to UK's new ARM-based architecture; GW4's Isambard. This new architecture has an international community of its own, making it likely that the advances from this project will be felt in other fields of computing that participate in the ARM architecture. In addition, the advances of this project are likely to be felt in the UK's RSE network (through the annual conference), and therefore, likely to advance UK's national computing capability.
We expect there to be intradisciplinary beneficiaries in each subject area because of the wide reach of the strategically selected research team. But in addition, this project offers a unique opportunity for subjects at the heart of mathematics, like analysis, to have a clear line of sight to advance computing on new architectures. Thus, this project has the potential to accelerate UK mathematics contributions, beyond journal articles, to the global conversation taking place now about next generation computing.
The new wave/mean-flow theory we propose not only benefits fundamental research in fluid mechanics, but we also will apply it to in situ data in the Arctic Ocean, allowing the advances of this research to be accessible to oceanographers and atmosphere and ocean modellers through direct collaboration.
One of the key ideas of this proposal has already demonstrated that it is possible to make significant gains in the parallel performance for computing by reaching deeply into mathematical analysis. By advancing this idea further, the fundamental gains in understanding proposed in this project will continue to benefit numerical analysis and so on into numerical algorithm development. This benefit is likely to have significant impacts in the climate and weather community through already established collaborations with UK Met Office's next-generation numerics, the Gung-Ho project, which the PI and 2 of the Co-I are already members.
Because our new theories will be realised in open-source code in the Firedrake/Gusto framework, it will be of benefit all those who use and develop finite elements.
In addition, one of the Co-I on our project is a Research Software Engineer (RSE) with access to UK's new ARM-based architecture; GW4's Isambard. This new architecture has an international community of its own, making it likely that the advances from this project will be felt in other fields of computing that participate in the ARM architecture. In addition, the advances of this project are likely to be felt in the UK's RSE network (through the annual conference), and therefore, likely to advance UK's national computing capability.
Publications
Bauer W
(2021)
Higher order phase averaging for highly oscillatory systems
Bauer W
(2022)
Higher Order Phase Averaging for Highly Oscillatory Systems
in Multiscale Modeling & Simulation
Bauer W
(2018)
Energy-enstrophy conserving compatible finite element schemes for the rotating shallow water equations with slip boundary conditions
in Journal of Computational Physics
Bendall T
(2020)
A compatible finite-element discretisation for the moist compressible Euler equations
in Quarterly Journal of the Royal Meteorological Society
Cheng B
(2021)
Convergence rate estimates for the low Mach and Alfvén number three-scale singular limit of compressible ideal magnetohydrodynamics
in ESAIM: Mathematical Modelling and Numerical Analysis
Cheng B
(2023)
Near-resonance approximation of rotating Navier-Stokes equations
in Nonlinearity
Description | o We have developed new frequency-averaged equations motivated by fast singular limits that can help in describing wave and mean flow interactions in fluids, an advance over existing methods. These results will be submitted for publication this year. o We have developed a new time stepping method where we can take long time steps, far beyond limitations normally thought of as key for accurate and stable numerical methods, and which have the potential to make better use of new parallel computer architectures. o We have developed new iterative algorithms for parallel construction of the action of the exponential of a skew-adjoint matrix, facilitating fast integration of highly oscillatory systems. We have developed a framework for computing higher-order corrections to phase-averaged highly oscillatory systems, which can be used as a corrector step in time-integration schemes with large timesteps. We have developed a compatible finite element discretisation for the phase averaged rotating shallow water equations on the sphere and are currently investigating stability properties. o We have developed new results for three-scale singular limits o Some outcomes of our 'blue skies' basic mathematical research form the basis of an EXCALIBUR proposal which has been funded. Our blue-skies time-stepping algorithms may be key importance to high performance computing. Its importance and relevance is still to be determined, put in code, through the EXCALIBUR programme.. |
Exploitation Route | Other researchers are already exploring our papers on alternative ways to solve fluid dynamics equations with oscillations. Though too early for operational models, such as the Met Office's weather forcasting, the potential to explore these idealised methods for practical use is currently underweigh through a new funded grant ased on our outcomes last year. |
Sectors | Energy Environment Healthcare |
Description | Some of these findings have been used in the EXCALIBur grant for exascale computing. Further, there may be further impacts if and when these types of algorithms are used for the new exascale computer. |
First Year Of Impact | 2019 |
Sector | Environment,Other |
Impact Types | Societal Economic Policy & public services |
Description | SPF EX20-8 Exposing Parallelism: Parallel- in-Time (DN517492) |
Amount | £1,200,000 (GBP) |
Funding ID | SPF EX20-8 Exposing Parallelism: Parallel- in-Time (DN517492) |
Organisation | Meteorological Office UK |
Sector | Academic/University |
Country | United Kingdom |
Start | 05/2021 |
End | 05/2024 |
Description | Dr Haut at Lawrence Livermore National Laboratory USA |
Organisation | Lawrence Livermore National Laboratory |
Country | United States |
Sector | Public |
PI Contribution | Dr. Haut and I, along with a PhD student Adam Peddle, have written a paper on time-parallel time stepping using the mathematics of nonlinear resonance. |
Collaborator Contribution | It was a collaboration on both sides -- the paper(s) are a product of both me and my team and Dr. Haut at LLNL> |
Impact | Parareal Convergence for Oscillatory PDEs with Finite Time-scale Separation, SIAM J. of Scientific Computing, 2019. |
Start Year | 2018 |