Virtual Integration of Satellite and In-Situ Observation Networks (VISION)
Lead Research Organisation:
University of Cambridge
Department Name: Chemistry
Abstract
The recent expansion in satellite Earth observations is providing an ever growing set of data that can help us understand the Earth System. This is mirrored by the increase in in-situ observational data from aircrafts, ships and other platforms. These data are ripe for exploitation by various modelling systems, such as in the creation of digital twins of the environment to improve our understanding and decision making processes.
The BAe-146 aircraft of the FAAM Airborne Laboratory is a key part of NERCs observational portfolio, which has recently received £49M of funding to extend its lifetime out to 2040. Following these upgrades, FAAM will undertake around 70 flights per year from 2026 onwards. However, these flights are costly, with each flying hour having a full economic cost of £20,000 (£4000-5000 for the flight time itself) and emitting 6.5 tonnes of CO2. Currently, FAAM accounts for 3.8% of NERCs CO2 emissions, and while other mitigation strategies are already taking place, these do not consider the flights themselves.
It is estimated that 20-40% of all FAAM flights may be suboptimal, where the data produced from the flights has a reduced scientific benefit. In this project we will develop a digital twin to improve campaign planning operations for the FAAM aircraft, both to improve the flight plans to better match the scientific aims, and also to reduce the number of flights necessary to achieve those aims. This will therefore both reduce FAAMs CO2 emissions and improve the quality of its scientific output.
We will develop this digital twin by developing a standalone open-source toolkit, built within an already-used Python package that complies with international data standards, improving its interoperability between models. The VISION toolkit will allow for a variety of observations, and in this project we will focus on satellite observations and flight data collected by FAAM. We will demonstrate this toolkit within two different modelling systems; the Forecasting Operations for Research Campaigns and Experiments (FORCE) modelling infrastructure, a forecast system designed for flight planning operations, and within the UK Earth System Model (UKESM) to highlight its use to the international climate modelling community to better inform governments and policymakers.
While we focus on these two applications of the VISION toolkit, it could be applied to a large number of international modelling systems and incorporate observations from a wide variety of platforms. At the completion of this project, alongside a detailed project report, we will also run a training event for the international community to learn how to implement this toolkit within their own model infrastructure.
Our team brings together atmospheric modellers, observational scientists, software engineers from the National Centre for Atmospheric Science (NCAS), and satellite experts from the National Centre for Earth Observation (NCEO) and the UK Earth Observation Climate Information Service (UK EOCIS) to deliver a novel framework to reduce the carbon footprint of the UK research aircraft and to provide a toolkit that will allow for better integration of models and observations.
The BAe-146 aircraft of the FAAM Airborne Laboratory is a key part of NERCs observational portfolio, which has recently received £49M of funding to extend its lifetime out to 2040. Following these upgrades, FAAM will undertake around 70 flights per year from 2026 onwards. However, these flights are costly, with each flying hour having a full economic cost of £20,000 (£4000-5000 for the flight time itself) and emitting 6.5 tonnes of CO2. Currently, FAAM accounts for 3.8% of NERCs CO2 emissions, and while other mitigation strategies are already taking place, these do not consider the flights themselves.
It is estimated that 20-40% of all FAAM flights may be suboptimal, where the data produced from the flights has a reduced scientific benefit. In this project we will develop a digital twin to improve campaign planning operations for the FAAM aircraft, both to improve the flight plans to better match the scientific aims, and also to reduce the number of flights necessary to achieve those aims. This will therefore both reduce FAAMs CO2 emissions and improve the quality of its scientific output.
We will develop this digital twin by developing a standalone open-source toolkit, built within an already-used Python package that complies with international data standards, improving its interoperability between models. The VISION toolkit will allow for a variety of observations, and in this project we will focus on satellite observations and flight data collected by FAAM. We will demonstrate this toolkit within two different modelling systems; the Forecasting Operations for Research Campaigns and Experiments (FORCE) modelling infrastructure, a forecast system designed for flight planning operations, and within the UK Earth System Model (UKESM) to highlight its use to the international climate modelling community to better inform governments and policymakers.
While we focus on these two applications of the VISION toolkit, it could be applied to a large number of international modelling systems and incorporate observations from a wide variety of platforms. At the completion of this project, alongside a detailed project report, we will also run a training event for the international community to learn how to implement this toolkit within their own model infrastructure.
Our team brings together atmospheric modellers, observational scientists, software engineers from the National Centre for Atmospheric Science (NCAS), and satellite experts from the National Centre for Earth Observation (NCEO) and the UK Earth Observation Climate Information Service (UK EOCIS) to deliver a novel framework to reduce the carbon footprint of the UK research aircraft and to provide a toolkit that will allow for better integration of models and observations.
Publications
| Description | This was a technical project to develop a digital twin of the FAAM Airborne Laboratories BAe-146 research aircraft. We have succuessfully incorporated this within the FORCE flight planning system developed at the National Centre for Atmospheric Science at the University of Leeds. We have also implemented the required software improvements within the cf-python library for use by the community and have published the VISION toolkit software that can be used efficiently within the Met Office Unified Model and other general circulation models to efficiently output model data at the locations and times of in-situ observations. |
| Exploitation Route | The VISION toolkit and cf-python are provided as open-source software and we welcome their uptake by the research community and we are actively working with a number of groups and individuals to help them make use of it for their research. The FORCE planning tool is available to users of FAAM for their own flight planning needs. |
| Sectors | Aerospace Defence and Marine Environment Government Democracy and Justice |
| URL | https://doi.org/10.5194/gmd-18-181-2025 |
| Title | VISION: Collated subset of FAAM ozone data 2010 to 2020 |
| Description | This is a subset extacted from the FAAM dataset containing ozone measurements made on board the FAAM aircraft using the TECO 49 UV photometric ozone instrument between 2010 and 2020. This dataset was compiled to facilitate data access and integration for the Virtual Integration of Satellite and In-situ Observation Networks (VISION) project (NE/Z503393/1) Data for all flights were extracted from the core FAAM data and new files were created which have the following advantages: - consistent variable names across the whole time period. - data points with missing coordinates, or ozone being flagged as inadequate, have been removed. - files are fully CF-compliant. - files contain geospatial coordinates and ozone - filenames contain flight date, unique flight identifier and name of the measurement campaign associated to the flight. This dataset is a subset of the Facility for Airborne Atmospheric Measurements (FAAM) flights dataset collection https://catalogue.ceda.ac.uk/uuid/affe775e8d8890a4556aec5bc4e0b45c |
| Type Of Material | Database/Collection of data |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | Used in the development of the VISION toolkit. Data processed from an existing FAAM dataset, but made more machine readable for use by the VISION software. |
| URL | https://catalogue.ceda.ac.uk/uuid/8df2e81dbfc2499983aa87781fb3fd5a/ |
| Title | VISION: UKESM1 hourly modelled ozone for comparison to observations |
| Description | Two UK Earth System Model (UKESM1) hindcasts have been performed in support of the Virtual Integration of Satellite and In-situ Observation Networks (VISION) project (NE/Z503393/1). Data is provided as raw model output in Met Office PP (32-bit) format that can be read by the Iris (https://scitools-iris.readthedocs.io/en/stable/) or cf-python (https://ncas-cms.github.io/cf-python/) libraries. This is global data at N96 L85 resolution (1.875 x 1.25, 85 model levels up to 85km). Simulations were performed on the Monsoon2 High Performance Computer (HPC). The first dataset (Jan 1982 to May 2022) contains hourly ozone concentrations on the lowest model level (20m above the surface). The second dataset (Jan 2010 to Dec 2020) contains hourly ozone concentrations and hourly Heaviside function on 37 fixed pressure levels. Data is only provided for days in which ozone was measured by the FAAM aircraft (for comparison purposes). Ozone data is provided in mass mixing ratio (kg species/kg air). |
| Type Of Material | Database/Collection of data |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | Used in the development of the VISION toolkit. |
| URL | https://catalogue.ceda.ac.uk/uuid/300046500aeb4af080337ff86ae8e776/ |
| Title | VISION-toolkit |
| Description | Toolkit for the VISION (Virtual Integration of Satellite and In-Situ Observation Networks) project. |
| Type Of Technology | Software |
| Year Produced | 2024 |
| Open Source License? | Yes |
| Impact | Version 1.0 of the VISION toolkit as described in Russo et al. 2025. This includes the in-situ observation capabilities as demonstrated with FAAM and ATom flight campaigns and comparisons to ships, bouys, and surface stations. |
| URL | https://doi.org/10.5194/gmd-18-181-2025 |
| Title | cf-python |
| Description | The Python cf package is an Earth Science data analysis library that is built on a complete implementation of the CF data model. While the VISION project has not developed cf-python from scratch, we have added functionality to improve the existing software. |
| Type Of Technology | Software |
| Year Produced | 2024 |
| Open Source License? | Yes |
| Impact | The VISION project has added functionality to the existing cf-python package, specifically: Improve the performance of reading and accessing the data of PP and UM fields files (https://github.com/NCAS-CMS/cf-python/issues/746) Allow a halo to be added by cf.Field.indices and cf.Field.subspace (https://github.com/NCAS-CMS/cf-python/issues/759) Added spherical regridding to discrete sampling geometry destination grids (https://github.com/NCAS-CMS/cf-python/issues/716) Added 3-d spherical regridding to cf.Field.regrids, and the option to regrid the vertical axis in logarithmic coordinates to cf.Field.regrids and cf.Field.regridc (https://github.com/NCAS-CMS/cf-python/issues/715) New keyword parameters to cf.wi: open_lower and open_upper (https://github.com/NCAS-CMS/cf-python/issues/740) Allow DSG trajectories with identical trajectory_id values to be aggregated (https://github.com/NCAS-CMS/cf-python/issues/723) New methods: cf.Field.pad_missing and cf.Data.pad_missing (https://github.com/NCAS-CMS/cf-python/issues/717) New keyword parameter to cf.Field.insert_dimension: constructs (https://github.com/NCAS-CMS/cf-python/issues/719) |
| URL | https://ncas-cms.github.io/cf-python/index.html |
