Data assimilation in highly nonlinear geophysical systems: particle filters with localization
Lead Research Organisation:
University of Reading
Department Name: Meteorology
Abstract
Data assimilation is at the heart of many activities in geophysical sciences, being it meteorology, oceanography, hydrology, seismology etc. In data assimilation numerical models of a certain (geophysical) system are combined with observations from that system. The purpose of doing this can either be forecasting, model improvement or trying to understand the system under study better. To start with forecasting of e.g. weather, the present-day state-of-the-art models would not do a very good job without the continuous feeding of observations into them. The these models are quite good in representing the physical and chemical processes in the atmosphere, but need information on the actual state of the atmosphere before a good forecast can be made. The same is true for all geophysical fields. With regard to model improvement and system understanding data assimilation can also play a very important role. The models contain several processes that are not well described due to either resolution problems or poorly known physics. This results in several (sometimes hundreds) of poorly known parameters, which can be estimated by data assimilation. Finally, by using a model in which observations have been assimilated the real atmospheric (oceanic etc.) can be studied, instead of the model representation. Several methods to perform data assimilation have been implemented in large-scale geophysical systems. All of them are based on linearisations of some kind. Examples are the Ensemble Kalman Filter and the 4-Dimensional Variational method (4D-Var). Due to increasing model resolution more and more processes are being resolved in the models, and these processes tend to be more and more nonlinear. An example is cloud formation and precipitation in the atmosphere. The data-assimilation community is looking hard for methods that can handle these nonlinearities. It has been argued for a long time now that particle filters good do the job. In principle, these methods are fully nonlinear. However, applications of particle filters in meteorology and oceanography are limited to small dimensional systems due to the enormous number of particles that have to be used. On way to solve this problem is by trying to increase the effective size of the ensemble of particles. This can be done by so-called localization. This technique is used extensively in the Ensemble Kalman Filter, without which that method would not work on operational numerical weather prediction or large-scale ocean models. In localization one allows observations to have only influence on a limited area of the domain, only on the area close to the observation. This results in a local estimation problem, and the number of ensemble members compared to the number of unknowns (only those in that area) increases considerable. If one divides the whole model domain up into 1000 of those smaller areas, the effective ensemble size increases with a factor 1000. One cannot use localization directly in a particle filter, and in this proposal three new ways of doing it are investigated in a suite of geophysical models, running from very simple to close to operational. The objectives of this proposal are: - Generate a data-assimilation method for highly nonlinear large-dimensional geophysical systems. Since the models and observation operators are becoming more and more nonlinear, this objective is highly relevant to NERC. The methods developed will be applicable to all NERC-related research fields. - Make the field of particle filtering accessible for geophysics. Particle filters are one of the few methods that are fully nonlinear and have strong potential to be applicable in large-scale systems. - Investigate the use of localization for particle filtering to achieve the above mentioned goals. - Demonstrate the use of localization in a large-scale application in meteorology.
Organisations
People |
ORCID iD |
Peter Jan Van Leeuwen (Principal Investigator) |
Publications
Goodliff M
(2015)
Comparing hybrid data assimilation methods on the Lorenz 1963 model with increasing non-linearity
in Tellus A: Dynamic Meteorology and Oceanography
Van Leeuwen P
(2015)
Dynamic Data-Driven Environmental Systems Science
Van Leeuwen P
(2015)
Nonlinear Data Assimilation
Van Leeuwen P
(2011)
Efficient nonlinear data-assimilation in geophysical fluid dynamics
in Computers & Fluids
Description | We have investigated the use of so-called localisation in nonlinear data assimilation, specifically in particle filters. Localisation is a method whereby the data assimilation is done in relatively small areas of the model domain. This would allow for efficient fully nonlinear data assimilation. However, all localisation methods that are around either directly or implicitly rely on the possibility to add model states together. When this is done in nonlinear models (so when nonlinear data-assimilation would be useful) the resulting model states can be strongly out of balance. This leads to the generation of spurious features in the subsequent model forecasts in typical geophysical models, as atmospheric and oceanographic models. Concluding, our investigations have shown that proper localisation cannot be done in particle filters at this moment. |
Exploitation Route | We have shown that proper localisation cannot be done in particle filters for models of geophysical processes. |
Sectors | Environment |
Description | We have studied the possibility of localisation in particle filters in detail, and have not been able to find a satisfactorily solution. The issue is that particle filters are designed for nonlinear systems and all forms of localisation that are available at the moment rely, implicitly, on the additive nature of model states. However, when nonlinear model states are added the resulting state will be strongly out of equilibrium, or balance, resulting in the generation of spurious gravity waves etc, ruining the weather forecasts. We did investigate a existing methodology that looked promissing in detail and found that the method was inconsistent. Correcting the mistakes in the literature made all promises disappear. However, it did provide us with a better understanding of the Ensemble Kalman Filter, the most used data-assimilation method, and that work is now under review. |
Sector | Environment |