MEFA: Mapping and Enabling Future Airspace

Lead Research Organisation: University of Birmingham
Department Name: Electronic, Electrical and Computer Eng

Abstract

Manned and unmanned airspace is undergoing a revolution. By 2030 air traffic is estimated to quadruple with a doubling of the total number of manned aircraft and unmanned air vehicles (UAVs). This explosive growth will change and congest already heavily used airspace. UAVs occupy airspace in a similar way to birds with both flying at overlapping altitudes and velocities. Therefore, as evidenced by the recent drone incursions at Gatwick airport, there is a pressing need to be able differentiate UAVs from natural organisms (e.g. birds) that use the same airspace. There are limited detailed data on how birds use airspace, especially in light of unprecedented rates of urbanisation, characterised by increasing high-rise building, increased artificial light (AL), and changing patterns of infrastructure. All are rapidly re-shaping habitats used by migratory and non-migratory species.

The interaction between built infrastructure and AL, and its influence on bird biology, is now the focus of research addressing migration ecology, especially of birds, and mortality caused by brightly lit urban structures (e.g. monuments, buildings, communication towers). Increased use of glass and other highly reflective surfaces on high-rise buildings has increased the frequency of bird strikes and thus bird mortality. In 2004, the British Trust for Ornithology (BTO) estimated 100 million birds struck windows each year in the UK.

This project primarily uses a 'staring' form of radar sensor developed specifically to track drones. Contrary to previous radar research, individual birds and drones are observable within small groups that allows finer measurement of trajectories than has been achieved previously. However, for sufficiently reliable surveillance of controlled unmanned-airspace, the fundamental challenge is to discriminate small drones from birds. Bird species have specific flight patterns that are distinguishable from those of UAVs. The research will develop algorithms to distinguish between drones and birds, individual birds in small groups (typically 2-5) and potentially individual birds in larger flocks. Deep learning algorithms will be developed and tested for their ability to distinguish between birds and drones, and between different bird groups. The project cuts across the EPSRC's themes of "Living with Environmental Change (ecosystem challenge)" and "Global Uncertainties (threats to infrastructures)", to develop a cutting-edge system with the ability to simultaneously mitigate security risks to birds and humans alike.

Planned Impact

Summary: By being able to differentiate birds from drones and different species of birds from one another this research will open new vistas on bird behaviour and the impact of urban developments on bird flight patterns, bird strikes, and mortality. It will create a monitoring system that is critical to the future commercial exploitation of the new unmanned airspace.

Societal Impact:
There is an acute need to understand how the complex land use configurations found in cities and the patterns in building form, design and function confine and structure urban airspaces, thereby constraining use by wildlife and unmanned aerial vehicles (UAVs). Crucially, planners and city engineers need better targeted information concerning the interaction between lighting and built infrastructure so the impact on wildlife can be minimized. Moreover, improved characterisation of the lighting infrastructure associated with different landcover and land use will help with future proofing through cycles of urban regeneration and change of use.

Commercial Impact:
A recent House of Commons briefing paper (CBP 7734, 31 August 2017) stated "Achieving the full and safe integration of drones (UAVs) into non-segregated airspace is the underlying policy objective of Government. To achieve this requires technology, which is not yet fully developed, for sensing and avoiding air traffic under all possible scenarios". Radar has been identified as a core component of a future Air Traffic Management (ATM) system that will have to cope with a quadrupling in the number of aircraft over the next 10-15 years. Currently, no radar sensors are able to detect UAVs and distinguish them from birds with a reliability that meets ATM safety standards. In addition, drone incursions at airports present a severe safety hazard as well as directly impacting their economic viability. Robust and reliable radar surveillance is a core component of any 24 hour, all-weather, counter-drone capability. Further, this dramatic change in airspace occupancy will also impact bird populations in unresolved ways. Therefore, this project will create an enhanced sensing capability to open up new commercial opportunities in line with EPSRC's prosperity outcomes while also providing answers to core emerging environmental questions.

Academic Impact and National Importance:
This research will benefit national and international researchers by establishing ways in which information is encoded into radar echoes enabling UAVs and birds to be differentiated. The core knowledge will be generic and applicable to other use cases such as for autonomous driving, vital-sign health monitoring of people as well as military and security applications etc. This project will also provide foundational information enabling design of future radar sensors for ATM/UTM in congested, low altitude skies. The UK will benefit through development of high-performing all-weather, day-night, sensors that can be sold across the world.

New Experts:
The research training component of this project will include internships in industry and leading laboratories so that the expertise is developed with an appreciation of exploitation requirements. The University of Birmingham and the University of Leicester will establish a team that will be expert in radar sensing, advanced signal processing for target recognition, bird measurements and behaviours. These skills will be exploited in the radar sensing industry, academia and government agencies such as the CAA, NATS, Government departments and the BTO.
 
Description Key findings so far have included methods of robust classification of drones vs birds using deep learning techniques, and methods of enhancing drone parameter information space through signal processing. Work in both areas is ongoing and will be finalised by project end. Bird behaviour during disturbances (e.g. fireworks) has been studied and this work will continue until project end too.
Exploitation Route The research has created core knowledge on how drone parameters can be physically extracted from radar data, and how drones may be robustly classified against birds. The underpinning methods and techniques are generic and could provide the basis for further optimisation by academia or considered for adoption by industry.
Sectors Aerospace, Defence and Marine

 
Description Department of Transport - Catapult
Amount £84,969 (GBP)
Organisation Department of Transport 
Sector Public
Country United Kingdom
Start 04/2020 
End 01/2025
 
Description Drone classification with radar
Amount £350,000 (GBP)
Organisation Plextek 
Sector Private
Country United Kingdom
Start 08/2020 
End 03/2021
 
Description ROPER
Amount £350,000 (GBP)
Organisation Thales Group 
Sector Private
Country France
Start 11/2020 
End 10/2021
 
Description Ubiquitous radar networks for urban situational awareness
Amount £160,000 (GBP)
Funding ID DSTL0000005696 
Organisation Defence Science & Technology Laboratory (DSTL) 
Sector Public
Country United Kingdom
Start 08/2022 
End 07/2023
 
Title Activity windows 
Description This dataset consists of the number of tracks and the mean and standard deviation of track features (height, speed, minimum height, maximum height) over different temporal windows (1-minute, 10-minute, hourly, daily), provided as CSVs. 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? No  
Impact This dataset allows for manageable file sizes for modelling activity data across large temporal windows. 
 
Title Bird occupancy histograms 
Description Tool that combines historical tracks of birds within the field of view of a radar and combines them to bird occupancy maps showing areas of increased or reduced bird activity over a timespan. 
Type Of Material Computer model/algorithm 
Year Produced 2021 
Provided To Others? No  
Impact The tool helps us understand areas of increased bird activity and the times of day it takes place. This is in turn informing bird movement in urban areas, as well as quantifying false alarm levels (drones mistaken as birds) and their geographical disparities in a counter-drone surveillance setting. 
 
Title Codebase for processing data 
Description The large amount of data collected needed a system to organise and create outputs. There exists too much data for manual creation of datasets, so an automatic system for the creation of datasets was made. The output of the codebase allows for the creation of balanced, tractable and traceable datasets split into train, test and validation subsets and the creation of images for input to classifiers. The codebase handles both control, labelled targets for the creation of datasets of specific target configurations, but also for simulated/synthetic data and opportune, untruthed targets which has allowed for some novel experimentation. Further fine control of the used data included fusing the raw data information with trajectory and other feature information that can itself be output and used for classification experiments, but also to crop and filter the existing data to fit to user specification and improve the reliability of results. 
Type Of Material Data analysis technique 
Year Produced 2022 
Provided To Others? No  
Impact This has allowed for the rapid creation of datasets for classification experiments which has supported a number of existing and upcoming publications. The feature outputs of the tooling allowed has enabled the output of attractive figures that help to illustrate results and seed inspiration and hypotheses for further research opportunities, such as the plotting of the trajectories used in datasets, the creation of histograms and plots of key radar meta-data eg. SNR, target range and height, and derivates. 
 
Title Drone and bird radar dataset- monostatic 
Description An extensive radar dataset including radar signatures of 3 different drones and a variety of birds, with ground truth. All radar data are acquired from the same radar, used for both pulse transmission and echo reception. 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? No  
Impact The radar data have been used and are continuing to be used for the development of CNN algorithms and concepts for drone classification, which have resulted in a recent journal paper and a few more in the pipeline. The data cannot be shared externally due to commercial agreements with the radar manufacturer. 
 
Title Drone modelling tool 
Description Analytical model of echoes of drones in flight. 
Type Of Material Computer model/algorithm 
Year Produced 2022 
Provided To Others? No  
Impact The model is able to predict radar signatures of drones in flight, taking into account variable rotor speeds. This not only helps with the interpretation of real echo data, but also can be used as the stepping stone to augmenting CNNs for drone classification with synthetic data. 
 
Title Heatmap Tool 
Description A self-contained, binary level programme to rapidly aggregate the tracker output of the radar over arbitrary time window to produce a heatmap of the target coverage. 
Type Of Material Data analysis technique 
Year Produced 2022 
Provided To Others? No  
Impact The large volumes of data collected by the radar takes a long time to process. This tool written in rust allows for fast plotting and aggregation of long temporal windows eg. several months, supporting research for short and long term analysis of avian behaviour. The tool is flexible allowing input of the proprietary format output of the radar system and also the open Asterix formatted data. The tool is simple to use with a GUI, and interns have used this to analyse and present findings to the research staff, giving them experience of the output of a real radar system. 
 
Title L-band CSV tracks 
Description The dataset consists of classified (bird) tracks converted to CSV format, with one CSV per 24-hour period. A summation CSV is then provided for each 24-hour period, consisting on one observation per track detailing the means and SDs of track features. 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? No  
Impact This dataset allows for general use within the ecology community as it is provided in a well-adopted format that can easily be used with standard coding languages (R, python etc.). The size of the files is also reduced through compression to .parquet formatting. 
 
Title Staring radar data 
Description This is a data set of echoes recording using a special staring form of radar. The objects in the data include drones, birds, vehicles in a variety of settings and times of year. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact The data has been used to develop a CNN algorithm that differentiates birds and drones, although this is still being assessed. 
 
Description Thales-Aveillant collaboration 
Organisation Thales Group
Country France 
Sector Private 
PI Contribution We have formalised a close collaboration with Thales-Aveillant. The company are supplying two radars that will be used on this award (although funded separately). The first of these two radars has been delivered and installed on campus at the university of Birmingham. The formalisation of the collaboration is part of the contract to purchase the two radars and has already enabled joint experimental trials, sharing of data and general aspects of know-how.
Collaborator Contribution Monthly meetings are held with the Thales-Aveillant CTO at which exchanges of various sorts are discussed. A workshop (funded separately) has been held at which both the Thales-Aveillant and Birmingham teams presented on drone-bird classification and embryonic activity around cognitive signal processing concepts. Further workshops are planned.
Impact The closeness of the collaboration has resulted in a successful proposal to fund research into classification techniques - reported in "further funding".
Start Year 2020
 
Description EuRad workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Technical workshop on drone detection delivered at the European Radar Conference (EuRad) as part of the European Microwave Week 2022.
Year(s) Of Engagement Activity 2022
 
Description IRS 2022 Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Technical workshop delivered at the International Radar Symposium 2022.
Year(s) Of Engagement Activity 2022
 
Description Poster presentation IRAC 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presented a poster on work looking at quantifying bird disturbance from fireworks within a major city.
Year(s) Of Engagement Activity 2022
URL https://globam.science/irac-2022/
 
Description Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact A workshop was held, attended by representatives of the Thales-Aveillant company and University of Birmingham academics, research fellows and PhD researchers. The main objective was to help build the relationship between the industrial and academic reams by creating a more complete awareness of each others goals and capabilities.
Year(s) Of Engagement Activity 2020
 
Description Workshop - Aeroecology 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Attended and presented work relating to the tracking and quantification of bird movement across Birmingham to a workshop focused on aeroecology applications using radar technology.
Year(s) Of Engagement Activity 2022