A scalable dynamical core for Next Generation Weather and Climate Prediction - Phase 2

Lead Research Organisation: University of Exeter
Department Name: Engineering Computer Science and Maths

Abstract

Historically, major improvements in the accuracy of numerical weather forecasts and climate simulations have come from the increased resolution enabled by the exponential growth in computer power. In order to achieve further gains in accuracy through further increases in resolution, it will be necessary to exploit the massively parallel computer architectures that are becoming available. However, current state-of-the-art operational algorithms are not expected to perform well beyond a few thousand processors: the grid structure of the traditional latitude-longitude grid means that interprocessor communication eventually but inevitably becomes a bottleneck.

The overall aim of the proposed project is to develop a new, three-dimensional, fully compressible dynamical core suitable for operational global and regional weather and climate prediction, as well as for research use, on massively parallel machines, and to demonstrate its accuracy, efficiency, and scalability. The accuracy should be comparable to that of existing state of the art algorithms. The algorithm must be efficient enough to run in the available operational time slots, and it must scale well on 100,000 to 1000,000 processors.

Phase 1 of this project (Feb 2011 - Jan 2013) addressed several of the basic scientific questions that underpin the development, including choice of quasi-uniform horizontal grid, choice of horizontal discretization, choice of transport scheme, time integration scheme, and some of the computer science aspects of the project. Several candidate approaches were tested and evaluated in a simplified two-dimensional fluid system (the Shallow Water Equations), and a small number of promising approaches were identified for further development in Phase 2.

Phase 2 of this project will build on the progress made in Phase 1 in order to develop a three-dimensional, fully compressible dynamical core. The work in Phase 2 falls broadly into three work packages:

* Vertical aspects. The stability and accuracy of the discretization depends crucially on the choice of vertical coordinate, the choice of thermodynamic variables predicted, and the vertical placement of variables relative to each other (`staggering'). It will also depend on the details of how, for example, the pressure gradient term is evaluated, especially near steep mountains, and how the vertical discretization couples with the horizontal discretization. Building on current understanding, candidate schemes will be formulated and tested.

* Code design and development. The code for the three-dimensional dynamical core will be based around a carefully designed software framework. The interface between the numerical discretization and its parallel implementation will be optimized, so that modifications to the former require minimal knowledge of the latter. The software framework will be highly flexible, so that it can easily accommodate future evolution of the dynamical core, such as changes in grid structure.

* Testing. The behaviour of complex numerical algorithms can be difficult to predict theoretically, even when individual components are well understood and tested. It will be vital, therefore, to test comprehensively the proposed formulations at the earliest opportunity, and revise if necessary. Early testing will focus on the shallow water formulation arising out of Phase 1 of the project, and on one-dimensional (column) and two-dimensional (vertical slice) prototypes of the vertical formulation. Testing of the three-dimensional formulation will begin as soon as code is available.

Planned Impact

Society benefits in numerous ways from accurate weather forecasts, via a wide range of weather-sensitive businesses and services (aviation, construction, energy, retail, ... etc.) as well as direct use by the public. Accurate forecasts of extreme weather events are particularly valuable in terms of minimizing risks to property as well as human life and health. Accurate predictions of climate change, particularly at a regional level, are essential for both climate-sensitive businesses and for policy makers, who must evaluate the costs and benefits (both economic and societal) of possible mitigation and adaptation measures. The proposed project will continue the drive towards more accurate weather and climate prediction by providing a key computational tool: a scalable atmospheric dynamical core that can take advantage of future massively parallel computing platforms to achieve higher resolution. Thus, the ultimate beneficiaries are the public, businesses, and policy makers who benefit from operational weather forecasts and climate predictions produced by the Met Office (as well as other users of the Met Office Unified Model around the world).

The immediate beneficiaries are the Met Office themselves. The proposal has been developed in close collaboration with the Met Office, and the project will involve a close partnership with the Met Office, building on the successful relationships and practices developed in Phase 1. UK academics and Met Office staff will be fully integrated in a single project team. There will be frequent project meetings, comprising quarterly plenary workshops interspersed with quarterly topical meetings, with day-to-day communication via a project email list and TWIKI. This close partnership will ensure that the project addresses the needs of the Met Office, is compatible with the other components of their operational system (physical parameterizations, data assimilation), and that the results pull through into their operational activities as rapidly and directly as possible.

The results of this project will be of great interest to the growing number of other groups around the world, both in operational centres and in and academic research, who, driven by the parallel scalability issue, are developing new atmospheric models. They will also be of wider interest to the computational fluid dynamics and high performance computing research communities. Results of this project will be published in the peer reviewed literature, and presented at relevant conferences and workshops, to reach the widest possible audience in both communities.

Publications

10 25 50
publication icon
Bell M (2016) Numerical instabilities of vector-invariant momentum equations on rectangular C-grids in Quarterly Journal of the Royal Meteorological Society

publication icon
Bendall T (2022) A solution to the trilemma of the moist Charney-Phillips staggering in Quarterly Journal of the Royal Meteorological Society

publication icon
Maynard C (2020) Multigrid preconditioners for the mixed finite element dynamical core of the LFRic atmospheric model in Quarterly Journal of the Royal Meteorological Society

publication icon
Melvin T (2019) A mixed finite-element, finite-volume, semi-implicit discretization for atmospheric dynamics: Cartesian geometry in Quarterly Journal of the Royal Meteorological Society

publication icon
Melvin T (2018) Choice of function spaces for thermodynamic variables in mixed finite-element methods in Quarterly Journal of the Royal Meteorological Society

publication icon
Melvin T (2017) Wave dispersion properties of compound finite elements in Journal of Computational Physics

 
Description We are developing a new atmospheric model dyanmical core for the Met Office forecast system suitable for massively parallel computers. Radically new numerical methods are being developed and used to achieve accuracy and efficiency. Most recently (2017) theoretical and numerical results have indicated the best choice of finite element function space for the representation of the buoyancy variable in an atmospheric model. This represents a key design choice for the next generation Met Office dynamical core. In 2019 we published results from a prototype three-dimensional dynamical core.
Exploitation Route The new dynamical core will be incorporated into the Met Office weather and climate modelling system and used for operational forecasting and for climate research.
Sectors Environment

 
Description The findings of this research are underpinning the Met Office development of the dynamical core of its next generation weather and climate prediction model. The new model should be as accurate as its predecessor but should be able to exploit future massively parallel computer architectures. Coding of the next generation dynamical core began in 2013. In 2018 the results of this project continue to influence the development of the new Met Office dynamical core. In 2021 a version of the Met Office climate model based on the new dynamical core is able to produce credible simulations of the climate system.
Sector Environment
Impact Types Economic

 
Title Mimetic finite element shallow water model 
Description Computer model to integrate the shallow water equations using a novel mimetic finite element method. 
Type Of Material Computer model/algorithm 
Year Produced 2013 
Provided To Others? Yes  
Impact The methods used have been extended to three dimensions for use in a next-generation dynamical core for the Met Office weather and climate prediction system. 
 
Title Mimetic finite volume shallow water model 
Description Computer model to integrate the shallow water equations using a novel mimetic finite volume method. 
Type Of Material Computer model/algorithm 
Year Produced 2014 
Provided To Others? Yes  
Impact The methods helped to inform further developments that are now being used to develop a next-generation weather and climate prediction model at the Met Office. 
URL http://www.geosci-model-dev.net/7/909/2014/gmd-7-909-2014.html
 
Description Gung Ho consortium 
Organisation Daresbury Laboratory
Country United Kingdom 
Sector Private 
PI Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model. The Exeter contribution focused on accurate balance and conservation properties.
Collaborator Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model.
Impact The collaboration encompasses mathematics, numerical methods, computer science, and environmental prediction. The results are being further developed by the met Office towards an operational prediction system.
Start Year 2011
 
Description Gung Ho consortium 
Organisation Imperial College London
Country United Kingdom 
Sector Academic/University 
PI Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model. The Exeter contribution focused on accurate balance and conservation properties.
Collaborator Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model.
Impact The collaboration encompasses mathematics, numerical methods, computer science, and environmental prediction. The results are being further developed by the met Office towards an operational prediction system.
Start Year 2011
 
Description Gung Ho consortium 
Organisation Meteorological Office UK
Country United Kingdom 
Sector Academic/University 
PI Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model. The Exeter contribution focused on accurate balance and conservation properties.
Collaborator Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model.
Impact The collaboration encompasses mathematics, numerical methods, computer science, and environmental prediction. The results are being further developed by the met Office towards an operational prediction system.
Start Year 2011
 
Description Gung Ho consortium 
Organisation University of Leeds
Country United Kingdom 
Sector Academic/University 
PI Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model. The Exeter contribution focused on accurate balance and conservation properties.
Collaborator Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model.
Impact The collaboration encompasses mathematics, numerical methods, computer science, and environmental prediction. The results are being further developed by the met Office towards an operational prediction system.
Start Year 2011
 
Description Gung Ho consortium 
Organisation University of Manchester
Country United Kingdom 
Sector Academic/University 
PI Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model. The Exeter contribution focused on accurate balance and conservation properties.
Collaborator Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model.
Impact The collaboration encompasses mathematics, numerical methods, computer science, and environmental prediction. The results are being further developed by the met Office towards an operational prediction system.
Start Year 2011
 
Description Gung Ho consortium 
Organisation University of Reading
Country United Kingdom 
Sector Academic/University 
PI Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model. The Exeter contribution focused on accurate balance and conservation properties.
Collaborator Contribution The partnership developed algorithms to form the basis for a future, highly scalable, weather and climate prediction model.
Impact The collaboration encompasses mathematics, numerical methods, computer science, and environmental prediction. The results are being further developed by the met Office towards an operational prediction system.
Start Year 2011