Abstracting the hardware: Assembly algorithms for numerical weather prediction on emerging massively parallel architectures

Lead Research Organisation: Imperial College London
Department Name: Earth Science and Engineering

Abstract

Weather forecasting and climate simulation are both founded on solving large systems of equations, called partial differential equations or PDEs which describe the flows in the atmosphere. Hitherto, the software which solves PDEs, including the existing Met Office Unified Model, has been written for specific sorts of hardware by people who had to be experts both in the science they were modelling and in programming. However, large and rapid changes are now occurring in computer hardware. The emergence of new massively parallel platforms, such as graphical processing units (GPUs) and multicore CPU systems is requiring very different approaches to low-level programming and, importantly, different approaches for different hardware platforms. It also requires new research into the best optimisation strategies for these platforms. The current approach to writing scientific software will not deliver the changes that are required within the industrial and government funding resources available nor will it keep up with changing hardware platforms. This project will test the existing and candidate new discretisations for the Unified Model core by using a new approach which separates the specification of individual work items of numerical computation from how those work items are shared out over a parallel computer. This will enable decisions about how a new model should be written. In particular, it will enable us to distinguish between those algorithms which just don't work very well at high levels of parallelism and those which need to be implemented differently to work in very parallel contexts. It will also enable the same algorithm to be tested in different implementations for different platforms to establish the best combinations of algorithm, implementation and platform. In this way it will also provide some future-proofing to a new Unified Model as low-level changes to reflect new types of parallel hardware will be possible without rewriting the whole model for each new computer platform.

Publications

10 25 50
 
Description The outcome of this grant was an initial design for the data structures and execution model for the next Met Office forecast system.
Exploitation Route The outcome of this grant was further developed in Gung Ho Phase 2, resulting in decisions on numerics and a prototype implementation. It will be further taken forward into production by the Met Office.
Sectors Environment

 
Description The output of this grant is decisions and design which have been taken up by the Met Office.
First Year Of Impact 2013
Sector Environment
Impact Types Societal,Economic,Policy & public services

 
Description Gung Ho Phase 2
Amount £295,534 (GBP)
Funding ID NE/K006789/1 
Organisation Natural Environment Research Council 
Sector Public
Country United Kingdom
Start 04/2013 
End 04/2016
 
Title Firedrake 
Description Firedrake is an automated system for the portable solution of partial differential equations using the finite element method (FEM). Firedrake enables users to employ a wide range of discretisations to an infinite variety of PDEs and employ either conventional CPUs or GPUs to obtain the solution. 
Type Of Technology Software 
Year Produced 2013 
Open Source License? Yes  
Impact Firedrake is a principle test platform for the development of Gung Ho, the future UK Met Office dynamical core. 
URL http://www.firedrakeproject.org/