Large deviation techniques for model coarse graining
Lead Research Organisation:
University of Warwick
Department Name: Mathematics
Abstract
Physical systems of interest to society are extremely complex. For example, the atmosphere and ocean of Earth, relevant for questions of global warming, long time climate estimates or prediction of extreme whether events, consists of a tremendeous number of interacting systems, each with many degrees of freedom. It is impossible to consider the system in its full complexity when trying to make predictions, in particular if the questions concern long-time prediction or rare events.
Indeed, multiscale systems are ubiquitous in nature: the underlying processes relevant to many physical phenomena often happen on vastly different length- or time-scales. This opens up the possibility of coarse-graining and averaging, where fast, fluctuating degrees of freedom can be considered as effective noise on slow degrees of freedom. In particular, this helps to reduce, or coarse-grain, complex physical models into much simpler models that are tractable analytically or numerically to enable prediction and deeper understanding of the involved processes.
Rare events, for example conformational changes of the relevant unknowns, are particularly interesting and rich in such a setup. In stochastic systems, unlikely fluctuations can push the system from its typical state into other, meta-stable configurations with often vastly different properties. Examples are chemical reactions, phase transitions, weather patterns, protein folding, or persistent structures in fluid flow. In such situations, large deviation theory gives precise and rigorous estimates of the probabilities and mechanisms of these conformational changes, by generalising the notion of free energy and entropy to arbitrary stochastic systems.
Obtaining explicit large deviation principles in this multiscale setup is a big challenge, since the associated fluctuations stem from averaging of complex physical processes, and therefore are generally non-linear, non-Gaussian, or even non-Markovian. The computation of large deviation principles in such a setup is of high importance, as it would allow us to estimate transition probabilities on the effective, coarse-grained model, without the need to consider all (fast, unimportant) degrees of freedom, thus making computation feasible.
The proposal concerns itself with the development of theory and numerical algorithms in the above situation, and to make available the developed techniques to applied sciences. The PI will apply these large deviation methods for multiscale systems and coarse-grained models to three concrete problems: (i) Metastability in atmospheric jets, where turbulent fluctuations facilitate the disappearance of planetary jets in atmospheric flow, (ii) magnetically confined fusion experiments, where conformational changes in the boundary layer in plasma reactors prevent efficient confinement, and (iii) fibre-optics communications, where random fluctuations in optical fibres lead to bit-flips in photonic communication.
All theoretical research efforts will result in the development of algorithms or software implementations permitting the re-use by researchers in other fields that are concerned with rare events in multiscale systems.
Indeed, multiscale systems are ubiquitous in nature: the underlying processes relevant to many physical phenomena often happen on vastly different length- or time-scales. This opens up the possibility of coarse-graining and averaging, where fast, fluctuating degrees of freedom can be considered as effective noise on slow degrees of freedom. In particular, this helps to reduce, or coarse-grain, complex physical models into much simpler models that are tractable analytically or numerically to enable prediction and deeper understanding of the involved processes.
Rare events, for example conformational changes of the relevant unknowns, are particularly interesting and rich in such a setup. In stochastic systems, unlikely fluctuations can push the system from its typical state into other, meta-stable configurations with often vastly different properties. Examples are chemical reactions, phase transitions, weather patterns, protein folding, or persistent structures in fluid flow. In such situations, large deviation theory gives precise and rigorous estimates of the probabilities and mechanisms of these conformational changes, by generalising the notion of free energy and entropy to arbitrary stochastic systems.
Obtaining explicit large deviation principles in this multiscale setup is a big challenge, since the associated fluctuations stem from averaging of complex physical processes, and therefore are generally non-linear, non-Gaussian, or even non-Markovian. The computation of large deviation principles in such a setup is of high importance, as it would allow us to estimate transition probabilities on the effective, coarse-grained model, without the need to consider all (fast, unimportant) degrees of freedom, thus making computation feasible.
The proposal concerns itself with the development of theory and numerical algorithms in the above situation, and to make available the developed techniques to applied sciences. The PI will apply these large deviation methods for multiscale systems and coarse-grained models to three concrete problems: (i) Metastability in atmospheric jets, where turbulent fluctuations facilitate the disappearance of planetary jets in atmospheric flow, (ii) magnetically confined fusion experiments, where conformational changes in the boundary layer in plasma reactors prevent efficient confinement, and (iii) fibre-optics communications, where random fluctuations in optical fibres lead to bit-flips in photonic communication.
All theoretical research efforts will result in the development of algorithms or software implementations permitting the re-use by researchers in other fields that are concerned with rare events in multiscale systems.
Planned Impact
Multiscale systems are ubiquitous in nature. In those, certain phenomena cannot be adequately modeled without the technology I am developing: Whenever the system is too complex for analytical treatment, and numerical experiments are too costly, rare events can no longer be treated with traditional methods. In this research project, I will develop methods to effectively compute rare events in stochastic systems with scale separation using algorithms based on large deviation theory. As such, it provides valuable tools to parties interested in quantifying the risk of such events, in particular in situations where direct experiments are hard to perform. An increased confidence in rare event probability predictions has the potential of acting as guideline for policy makers in devising strategies to counter the associated challenges.
Specifically, the PI has taken care to identify and address concrete applications in theoretical physics and engineering that are directly impacted by the proposed research and can benefit from the research output. In particular, the PI already established contact to three possible applications in the fields of atmosphere dynamics, plasma physics, and photonics, which themselves are fields of high societal and economic impact with respect to the possibilities of their prospective breakthroughs in climate science, power generation, and communication technologies.
Concretely, as immediate impact, the research output and theoretical results of the proposed programme will be framed in the form of either implementable algorithms or software packages with reference implementations, and will be made available to interested researchers as well as the public sector in the form of open source software. This amplifies the potential impact of the scientific output by providing third parties with immediate steps to apply the theoretical results to their own field.
In the medium term, in particular towards the end of the project, and possibly further, spin-off results for fields of application distinct from the above are envisioned. In particular, the research output will be of use for investigating population dynamics, fluid turbulence, and ocean surface waves. The PI intends to disseminate the research output to those fields by strengthening his existing network and establishing further collaborations.
In the long term, broader impact of the proposed research arises from its fundamental contributions to the computation of rare events in spatially extended stochastic systems, which form the basis of almost every field in physics, biology, and engineering. As such, the scientific output of the programme allows researchers in a broad variety of fields to obtain more reliable predictions of rare event probabilities at higher computational efficiency, and in particular for systems for which such quantitative estimates are infeasible with other methods.
Specifically, the PI has taken care to identify and address concrete applications in theoretical physics and engineering that are directly impacted by the proposed research and can benefit from the research output. In particular, the PI already established contact to three possible applications in the fields of atmosphere dynamics, plasma physics, and photonics, which themselves are fields of high societal and economic impact with respect to the possibilities of their prospective breakthroughs in climate science, power generation, and communication technologies.
Concretely, as immediate impact, the research output and theoretical results of the proposed programme will be framed in the form of either implementable algorithms or software packages with reference implementations, and will be made available to interested researchers as well as the public sector in the form of open source software. This amplifies the potential impact of the scientific output by providing third parties with immediate steps to apply the theoretical results to their own field.
In the medium term, in particular towards the end of the project, and possibly further, spin-off results for fields of application distinct from the above are envisioned. In particular, the research output will be of use for investigating population dynamics, fluid turbulence, and ocean surface waves. The PI intends to disseminate the research output to those fields by strengthening his existing network and establishing further collaborations.
In the long term, broader impact of the proposed research arises from its fundamental contributions to the computation of rare events in spatially extended stochastic systems, which form the basis of almost every field in physics, biology, and engineering. As such, the scientific output of the programme allows researchers in a broad variety of fields to obtain more reliable predictions of rare event probabilities at higher computational efficiency, and in particular for systems for which such quantitative estimates are infeasible with other methods.
People |
ORCID iD |
| Tobias Grafke (Principal Investigator) |
Publications
Alqahtani M
(2021)
Instantons for rare events in heavy-tailed distributions
in Journal of Physics A: Mathematical and Theoretical
Alqahtani M
(2021)
Extreme events and instantons in Lagrangian passive scalar turbulence models
Alqahtani M
(2022)
Extreme events and instantons in Lagrangian passive scalar turbulence models.
in Physical review. E
Alqahtani M
(2020)
Instantons for rare events in heavy-tailed distributions
Börner R
(2024)
Saddle avoidance of noise-induced transitions in multiscale systems
in Physical Review Research
Ferré G
(2021)
Approximate Optimal Controls via Instanton Expansion for Low Temperature Free Energy Computation
in Multiscale Modeling & Simulation
Frishman A
(2022)
Mechanism for turbulence proliferation in subcritical flows
in Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences
Frishman A
(2022)
Dynamical landscape of transitional pipe flow.
in Physical review. E
| Description | The research has led to the development of new mathematical techniques for calculating the probability of extremely rare events in complex systems, harnessing in particular a separation of time scales present in the system. These techniques are useful for estimating the likelihood of events that have a low probability of occurrence but can have a big impact, such as extreme weather events, stock market crashes, or major shifts in climate, all of which regularly include a vast range of time scales. The group developed a method for accurately calculating the limits of these rare event probabilities and created algorithms to quantify them. They achieved this by combining concepts from probability theory and quantum field theory, yielding numerical algorithms that allow for precise and quantitative predictions of rare event probabilities. The major breakthrough is the ability to estimate limiting probabilities by calculating functional determinants around the most likely scenario that could lead to a given rare event. In simple terms, the group has found a way to predict the probability of very rare but impactful events by taking into account the natural fluctuations that occur around the most likely scenario for that event, and demonstrated the applicability of the method for real world systems including liquid nanofilms, climate tipping events, and the creation of turbulence in pipes. |
| Exploitation Route | The major impactful application area that directly benefits from this research is climate science: It simultaneously includes highly complex systems with a vast distribution of timescales, for which we care strongly about the probabilities of rare but impactful events. The outcomes of this funding could be directly applied to a variety of climate models and scenarios, most importantly the Atlantic meridional overturning circulation ("Gulf stream") and noise-induced shutdown of this important climate phenomenon. |
| Sectors | Environment |
| Title | Raw data and figure scripts from Mechanism for turbulence proliferation in subcritical flows |
| Description | The subcritical transition to turbulence, as occurs in pipe flow, is believed to generically be a phase transition in the directed percolation universality class. At its heart is a balance between the decay rate and proliferation rate of localized turbulent structures, called puffs in pipe flow. Here, we propose the first-ever dynamical mechanism for puff proliferation-the process by which a puff splits into two. In the first stage of our mechanism, a puff expands into a slug. In the second stage, a laminar gap is formed within the turbulent core. The notion of a split-edge state, mediating the transition from a single puff to a two puff state, is introduced and its form is predicted. The role of fluctuations in the two stages of the transition, and how splits could be suppressed with increasing Reynolds number, are discussed. Using numerical simulations, the mechanism is validated within the stochastic Barkley model. Concrete predictions to test the proposed mechanism in pipe and other wall-bounded flows, and implications for the universality of the directed percolation picture, are discussed. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| URL | https://rs.figshare.com/articles/dataset/Raw_data_and_figure_scripts_from_Mechanism_for_turbulence_p... |
| Title | Raw data and figure scripts from Mechanism for turbulence proliferation in subcritical flows |
| Description | The subcritical transition to turbulence, as occurs in pipe flow, is believed to generically be a phase transition in the directed percolation universality class. At its heart is a balance between the decay rate and proliferation rate of localized turbulent structures, called puffs in pipe flow. Here, we propose the first-ever dynamical mechanism for puff proliferation-the process by which a puff splits into two. In the first stage of our mechanism, a puff expands into a slug. In the second stage, a laminar gap is formed within the turbulent core. The notion of a split-edge state, mediating the transition from a single puff to a two puff state, is introduced and its form is predicted. The role of fluctuations in the two stages of the transition, and how splits could be suppressed with increasing Reynolds number, are discussed. Using numerical simulations, the mechanism is validated within the stochastic Barkley model. Concrete predictions to test the proposed mechanism in pipe and other wall-bounded flows, and implications for the universality of the directed percolation picture, are discussed. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| URL | https://rs.figshare.com/articles/dataset/Raw_data_and_figure_scripts_from_Mechanism_for_turbulence_p... |
| Title | Supplementary Material (data): Spontaneous Symmetry Breaking for Extreme Vorticity and Strain in the 3D Navier-Stokes Equations from Spontaneous symmetry breaking for extreme vorticity and strain in the 3D Navier-Stokes equations |
| Description | In this supplemental material, we provide movies, raw data and python scripts to generate the figures of the paper. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| URL | https://rs.figshare.com/articles/dataset/Supplementary_Material_data_Spontaneous_Symmetry_Breaking_f... |
| Title | Supplementary Material (data): Spontaneous Symmetry Breaking for Extreme Vorticity and Strain in the 3D Navier-Stokes Equations from Spontaneous symmetry breaking for extreme vorticity and strain in the 3D Navier-Stokes equations |
| Description | In this supplemental material, we provide movies, raw data and python scripts to generate the figures of the paper. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| URL | https://rs.figshare.com/articles/dataset/Supplementary_Material_data_Spontaneous_Symmetry_Breaking_f... |
| Description | Interview Spektrum popular science magazine |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Public/other audiences |
| Results and Impact | Interview with the German popular science magazine 'Spektrum' about Large Deviations in Liquid Nanofilms. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.spektrum.de/news/nano-monsterwellen-in-hauchduennen-fluessigkeitsfilmen/2191872 |
| Description | Press release 'Going Rogue' - Warwick University |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Public/other audiences |
| Results and Impact | Press release by the University of Warwick concerning Rogue Nanowaves for thin liquid films. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://warwick.ac.uk/newsandevents/pressreleases/?newsItem=8a17841a8b3cb121018b4382282c1d5e |
| Description | Quanta Magazine Interview/Podcast |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | An interview was given to Quanta Magazine about the research regarding extreme event quantification for the understanding of extreme ocean surface waves. |
| Year(s) Of Engagement Activity | 2020 |
| URL | https://www.quantamagazine.org/the-grand-unified-theory-of-rogue-waves-20200205/ |
| Description | Scientific American |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | Interview with Scientific American about the connection between Large Deviation Theory and Oceanic Rogue Waves |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.nationalgeographic.com/premium/article/mathematicians-may-soon-be-able-to-predict-enormo... |
| Description | Scientific American Interview |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | An interview was given to Scientific American, a large popular science magazine with international audience. |
| Year(s) Of Engagement Activity | 2020 |
| URL | https://www.scientificamerican.com/article/new-model-predicts-sudden-rogue-waves/ |