Application of novel 3D imaging techniques to quantify biomass and secondary production associated with North Sea artificial structures.

Lead Research Organisation: Scottish Association For Marine Science
Department Name: Contracts Office

Abstract

Anthropogenic structures are deployed in marine environments to support industrial activities worldwide. Sessile epibiota rapidly colonise structures in the sea, in turn attracting mobile invertebrates, fish and top predators. Understanding the ecosystem effects of the increasing number of man-made structures in marine environments is a priority for research, and necessary to support sustainable installation and decommissioning practices worldwide.

Secondary production is a measure of energy flow through the food-web, and relates directly to ecosystem function, thus secondary production is a proxy for ecosystem function. In order to understand the relationship between secondary production and wider ecosystem processes (e.g. mobile mega fauna behaviour), we need to accurately predict secondary production (the focus of this proposal), and make this data available to ecosystem modellers.

Obtaining bespoke data on secondary production associated with offshore structures is limited by the time/cost constraints of conducting dedicated ecological surveys. Offshore energy operators use remotely operated vehicles (ROVs) to obtain videos of infrastructure for maintenance purposes. These videos cover all structures types, ages and locations. Recent advances in "Structure from Motion Photogrammetry" mean that it is now possible to generate 3D images of epibiota from this video footage, and use the 3D images to estimate the biovolume of epibiota. Biovolume can be converted to biomass, then to secondary production, by applying taxa-specific conversion factors. By pairing 3D imaging with supervised machine learning algorithms to automatically identify taxa, (and then apply the taxa-specific conversions), large volumes of ROV data can be rapidly processed to produce high-resolution estimates of secondary production for entire structures /production basins.

In a previous feasibility study, we pioneered 3D imaging of man-made structures in temperate and tropical waters, and used these images to estimate epibiota biovolumes. We have developed and applied protocols to convert biovolumes into biomass via taxon-specific calibration curves. Here, we propose to generate 3D images for 85 man-made structures located in the North Sea, and wider UK waters, using existing ROV footage. From the images, we will estimate the biovolume of the observed taxa. We will then develop/refine machine learning algorithms to automatically identify the taxa within the 3D images, and apply taxa-specific volume-to-mass calibration curves. We will bring these developments together to estimate secondary production on the 85 man-made structures, and develop a statistical model of secondary production as a function of structure location, type and age, which can be applied to other structures. Our novel approach will enable us to
(1) generate, for the first time, an estimate of secondary production across all offshore energy structures within the whole North Sea ecosystem,
(2) predict changes to ecosystem function stemming from a range of installation/decommissioning scenarios, and
(3) cross-validate/compare our estimates to natural reef habitats and structures in Gulf of Mexico, Australia and the Gulf of Thailand, where similar techniques are being applied.

Our research, which addresses INSITE2 Challenges 2 and 3, will significantly advance our understanding of the ecological role played by man-made structures, and serve as an evidence base to support local, regional and global assessments of the ecosystem-scale consequences of installing and removing structures. Through development of 3D imaging and auto-ID, we will also deliver a novel monitoring tool that facilitates a strategic whole-system approach to the monitoring/regulation of offshore structures. Such a tool could be readily applied to historic industry data for ecological (and engineering) applications.

Planned Impact

Our Pathways to Impact and careful choice of partners will deliver immediate and long-term benefits to industry, governments and society. The non-academic beneficiaries of the NorthSea3D project are listed below:

Benefits to Offshore Energy Industry: Operators face a challenge in selecting the most economical, and environmentally justified, methods for decommissioning infrastructure. In all major production basins, operators must assess the environmental impacts of decommissioning and undertake stakeholder consultations. NorthSea3D will provide two key benefits to industry:

Benefit 1: The regional estimates of epibiota secondary production and biomass associated with platforms, made available via open-access GIS layers, will serve as an evidence-base to support environmental impact assessments facilitating fast, effective and transparent decision-making. Operators will be able to use the data layers to optimise decommissioning practices, meet their environmental goals and demonstrably, and transparently, comply with relevant national/international legislation. Common research methodologies and access to comprehensive environmental data for production basins will help operators adopt globally standardised approaches to environmental impact assessment. Efficient decision-making and standardised global assessments will reduce decommissioning costs and maintain 'social licence' to operate in the sector.

Benefit 2: The development and application of methods to accurately estimate the mass of epibiota associated with platforms represents an avenue for significant cost reductions to global industry (and governments/society - see below). Accurate mass estimates will benefit industry via (1) informing selection of epibiota (marine growth/biofouling ) removal strategies and lifting/vessel procedures and technology during decommissioning, (2) optimising cleaning regimes to minimise disruption to energy generation and the marine environment and (3) informing the design of new infrastructure to account for the damaging consequences of biofouling (abrasion, component wear).

Benefits to governments: European governments (and elsewhere) are liable for significant proportions (up to 70%) of decommissioning costs (total UK costs ~£82.7 billion). Policy decisions, therefore, have major budgetary implications for society, as well as environmental consequences, and it is vital that they are based on the best available scientific evidence. The NorthSea3D project will contribute to a network of national and international scientists, promoting a common research framework that will enhance consistency and transparency in decommissioning policies and, ultimately, help ensure the sustainable exploitation of global marine ecosystems.

Benefits to society and the general public: Evidence-based decommissioning policies will directly benefit society by ensuring efficient use of public money and continued protection of environmental and stakeholder needs including ecosystem-service provision. This will secure the future of shared resources and ocean-derived societal benefits on a global scale. The NorthSea3D project will provide long-term benefits to society through knowledge exchange with governments and the provision of data to support policy development at local, national and international levels.
We have demonstrated the ability to achieve significant impact from our offshore energy research, with our results currently being used to support international policy development and to support industry in selecting cost-effective, environmentally-sound decommissioning strategies (see previous track record). We will use our existing excellent knowledge exchange pathways in combination with the project partners' networks to maximise the economic and societal benefits of the NorthSea3D project.

Publications

10 25 50
 
Description INSITE Biodiversity Webinar
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
 
Description 3D benthos mapping with deep learning
Amount £3,312 (GBP)
Funding ID 2022REP6 
Organisation Natural Environment Research Council 
Sector Public
Country United Kingdom
Start 07/2022 
End 09/2022
 
Title Semantic segmentation model for North Sea benthos. 
Description Sematic segmentation model trained on North Sea benthos commonly found on offshore structures. Model based on DeepLab V3+, using a focal loss function. We are iteratively updating this model. 
Type Of Material Computer model/algorithm 
Year Produced 2023 
Provided To Others? No  
Impact We have trained a machine to identify, from industry ROV footage, marine growth, improving the efficiency of data extraction. We are using our models as part of our public outreach offering (see URL link below) - and embedding these models into virtual realities to assist public/scientific exploration. 
URL https://sketchfab.com/3d-models/sams-photogrammetry-and-auto-id-c4f9cba68fa542aeab096518de6f4960
 
Description SEA-AI - a related project building on NS3D innovations 
Organisation NatureScot
Country United Kingdom 
Sector Public 
PI Contribution We are developing our AI-based approaches, developed in NS3D, to seabed imagery in support of statutory assessments for fish-farm licensing applications.
Collaborator Contribution We are running the project.
Impact Ongoing knowledge exchange. This is multiparter.
Start Year 2022
 
Description Biological colloquium presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact Presentation "3D photogrammetry and automated marine life identification - concepts, opportunities and challenges" to under/post-grad students in University of Kaiserslautern, Germany.
Year(s) Of Engagement Activity 2021
 
Description Conference presentation (MARESEDU-2021) by Joe Marlow 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact E-conference presentation
Year(s) Of Engagement Activity 2021
 
Description Conference presentation at Partnership for Research in Marine Renewable Energy (PRIMaRE) 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Conference presentation at Partnership for Research in Marine Renewable Energy (PRIMaRE) 2021
Year(s) Of Engagement Activity 2021
 
Description Conference presentation at Structures in the Environment, MASTS (Marine Alliance for Science and Technology for Scotland) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact A presentation at MASTS (Marine Alliance for Science and Technology for Scotland) 'Structures in the Environment' conference.
Received interest in our work from other attendees.
Year(s) Of Engagement Activity 2021
 
Description Dynamic Earth 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact Careers showcase for schoolchildren aged 10-16 at Edinburgh Dynamic Earth. We showcased our technologies that we have developed using a range of visual media techniques.
Year(s) Of Engagement Activity 2023
 
Description MASTS ASM Poster presentation by Joe Marlow 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Discussion around, and presentation of, conference e-poster
Year(s) Of Engagement Activity 2021
 
Description MASTS SIME Presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation of NS3D progress at Marine Alliance for Science and Technology for Scotland conference on Structures in the Marine Environment.
Year(s) Of Engagement Activity 2022
 
Description MASTS SIME poster Presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Poster presentation of NS3D progress at Marine Alliance for Science and Technology for Scotland conference on Structures in the Marine Environment.
Year(s) Of Engagement Activity 2022
 
Description MASTS Workshop presentation by Joe Marlow 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Marine Alliance for Science and Technology, Scotland panel discussion participant.
Year(s) Of Engagement Activity 2021
 
Description Poster presentation of NS3D progress at Marine Alliance for Science and Technology for Scotland Annual Science Meeting. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Poster presentation of NS3D progress at Marine Alliance for Science and Technology for Scotland Annual Science Meeting.
Year(s) Of Engagement Activity 2022
 
Description Presentation at UHI Shetland on NS3D project 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact A public talk on the NS3D project, covering the innovative methods developed and the results so far at UHI Shetland
The audience expressed an interest in the machine learning methods used and led to discussions around the project/other applications of the technology.
Year(s) Of Engagement Activity 2022
 
Description Presentation to Lochaber ideas week 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Panel participant on 'Ideas week' highlighting innovations in marine industries and monitoring.
Year(s) Of Engagement Activity 2022
 
Description Presentation to Marine Scotland Science (ScotMER group) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Presentation on core NS3D outputs to ScotMer Group,
Year(s) Of Engagement Activity 2022
 
Description Presentation to NatureScot 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation to NatureScot, highlighting innovations with NS3D.
Year(s) Of Engagement Activity 2022
 
Description Presentation to end-users 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact INSITE Biodiversity webinar - converting INSITE outputs into outcomes. Broad ranging discussion about how NS3D innovations can inform ecosystem modelling and biodiversity assessment.
Year(s) Of Engagement Activity 2023
 
Description Short talk at Expanding & Exploring the "T" in MASTS (Marine Alliance for Science and Technology for Scotland) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Short talk at Expanding & Exploring the "T" in MASTS (Marine Alliance for Science and Technology for Scotland)
Year(s) Of Engagement Activity 2021
 
Description Workshop presentation 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation to the INSITE Programme Advisory Group
Year(s) Of Engagement Activity 2022