Scalable Track Analytics

Lead Research Organisation: University of Liverpool
Department Name: Electrical Engineering and Electronics

Abstract

This project is focused on using large historic records of sensor data from port security systems to identify the types of ship present and accurately reflect the sub-types present, i.e., perform classification and clustering in a dynamic context.

Ports deploy radars, cameras and other sensors to maintain awareness of the ships in and around the port. While ships can deliberately communicate their type (e.g., fishing boat, ferry, yacht, tug), some do not. Even those that do fail to fully characterise all the information that might be pertinent to the port (e.g., the type of fishing boat etc). A current project at the University of Liverpool is investigating how to use geometric data structures to create an abstraction of such historic data. Using this abstraction, the project is then performing behavioural classification and clustering. Unfortunately, the current processing chain requires the iterative sequential reprocessing of the data (i.e., iteratively analysing the data from start to finish) and assumes a feed-forward model (i.e., such that the pre-processing that generates the abstraction cannot be refined to improve the classification and clustering).

This project will seek to develop algorithmic approaches that can replace the current sequential and feed-forward processes with alternatives that are better suited to fully exploiting implementation on emerging many cored processing architectures. The project will involve extensive interactions with Denbridge Marine, a small company based near to Liverpool which delivers port security systems to customers around the globe. Denbridge Marine will help provide access to pertinent data, ensure that the research is well focused on challenges that their customers pose and provide a route for the techniques developed to be applied in the context of meeting those customers' needs.

Planned Impact

This CDT's focus on using "Future Computing Systems" to move "Towards a Data-driven Future" resonates strongly with two themes of non-academic organisation. In both themes, albeit for slightly different reasons, commodity data science is insufficient and there is a hunger both for the future leaders that this CDT will produce and the high-performance solutions that the students will develop.

The first theme is associated with defence and security. In this context, operational performance is of paramount importance. Government organisations (e.g., Dstl, GCHQ and the NCA) will benefit from our graduates' ability to configure many-core hardware to maximise the ability to extract value from the available data. The CDT's projects and graduates will achieve societal impact by enabling these government organisations to better protect the world's population from threats posed by, for example, international terrorism and organised crime.

There is then a supply chain of industrial organisations that deliver to government organisations (both in the UK and overseas). These industrial organisations (e.g., Cubica, Denbridge Marine, FeatureSpace, Leonardo, MBDA, Ordnance Survey, QinetiQ, RiskAware, Sintela, THALES (Aveillant) and Vision4ce) operate in a globally competitive marketplace where operational performance is a key driver. The skilled graduates that this CDT will provide (and the projects that will comprise the students' PhDs) are critical to these organisations' ability to develop and deliver high-performance products and services. We therefore anticipate economic impact to result from this CDT.

The second theme is associated with high-value and high-volume manufacturing. In these contexts, profit margins are very sensitive to operational costs. For example, a change to the configuration of a production line for an aerosol manufactured by Unilever might "only" cut costs by 1p for each aerosol, but when multiplied by half a billion aerosols each year, the impact on profit can be significant. In this context, industry (e.g., Renishaw, Rolls Royce, Schlumberger, ShopDirect and Unilever) is therefore motivated to optimise operational costs by learning from historic data. This CDT's graduates (and their projects) will help these organisations to perform such data-driven optimisation and thereby enable the CDT to achieve further economic impact.

Other organisations (e.g., IBM) provide hardware, software and advice to those operating in these themes. The CDT's graduates will ensure these organisations can be globally competitive.

The specific organisations mentioned above are the CDT's current partners. These organisations have all agreed to co-fund studentships. That commitment indicates that, in the short term, they are likely to be the focus for the CDT's impact. However, other organisations are likely to benefit in the future. While two (Lockheed Martin and Arup) have articulated their support in letters that are attached to this proposal, we anticipate impact via a larger portfolio of organisations (e.g., via studentships but also via those organisations recruiting the CDT's graduates either immediately after the CDT or later in the students' careers). Those organisations are likely to include those inhabiting the two themes described above, but also others. For example, an entrepreneurial CDT student might identify a niche in another market sector where Distributed Algorithms can deliver substantial commercial or societal gains. Predicting where such niches might be is challenging, though it seems likely that sectors that are yet to fully embrace Data Science while also involving significant turn-over are those that will have the most to gain: we hypothesise that niches might be identified in health and actuarial science, for example.

As well as training the CDT students to be the leaders of tomorrow in Distributed Algorithms, we will also achieve impact by training the CDT's industrial supervisors.

Publications

10 25 50

Studentship Projects

Project Reference Relationship Related To Start End Student Name
EP/S023445/1 01/04/2019 30/09/2027
2298146 Studentship EP/S023445/1 01/10/2019 30/09/2023 Emmanouil Pitsikalis
 
Description During year one and year two we focused on two tasks. The first one focuses on ship type classification using maritime data transmitted from the Automatic Identification System (AIS) and vessel images. We developed a novel neuro-fuzzy model that combines both sources of information and achieves higher scores than using each source separately but also offers a level of explainability. The second task relates to complex event processing. Specifically, we have developed a new logic based temporal phenomena representation language that allows the definition of both instantaneous and durative phenomena and the relations between them. The language has formal semantics, executable semantics and comes along with an open source implementation of a complex event processing system called Phenesthe. Phenesthe consumes an input stream, and by using definitions of phenomena provided by the user, it will produce a stream of time associated phenomena detections. Phenesthe has been tested on real world historical maritime data and proven to be capable of processing around 130K thousand input events in less than 2 seconds. Both of the aforementioned tasks are accompanied by a conference publication. As current work, we are making headway on a definition learning algorithm that allows learning definitions of phenomena from ground truth data in our language and at the same time we are deploying phenesthe on real maritime streams of information provided by Denbridge Marine Ltd.
Exploitation Route So far the outcomes of this funding are undeniably useful in the maritime domain. Our ship type classification algorithm and our complex event processing engine allow surveillance of maritime vessels, therefore promoting safety and abidance to regulations. For example our ship type classification model can help in verifying the reported ship types of vessels---usually when vessels are found to be involved in illegal activities they report a false ship type---, while our complex event processing engine allows the detection of normal vessel behaviour such as moored vessels and trips but also dangerous situations like anchor violation etc. Although we are focusing on the maritime domain, our contributions so far are generic and can be applied in other domains. For example since our language does not require prior programming knowledge, medical doctors can define phenomena that will aid the monitoring of their patients.
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Energy,Financial Services, and Management Consultancy,Healthcare

URL https://github.com/manospits/Phenesthe
 
Description Our stream processing engine, is currently being deployed and tested by Denbridge Marine Ltd. In the end it is expected that our processing engine will provide phenomena detections visually on the map with the aim of aiding the VTS operators in detecting potentially time-critical dangerous ship situations. Apart from Denbridge, our open-source stream processing engine is available online and has attracted the interest of other people working in other domains e.g., cryptocurrencies.
First Year Of Impact 2021
Sector Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software)
 
Title Phenesthe 
Description Phenesthe (orig. fa??es?a?) is a system for the representation and processing of instantaneous and durative temporal phenomena. Temporal phenomena may be 1. events (instantaneous), 2. states (durative) 3. dynamic temporal phenomena (durative). Given an input stream of input phenomena Phenesthe will produce the instants or intervals at which user defined temporal phenomena are true or hold. More details can be found in "M. Pitsikalis, A. Lisitsa, and S. Luo, "Representation and Processing of Instantaneous and Durative Temporal Phenomena," in Logic-Based Program Synthesis and Transformation, vol. 13290, E. De Angelis and W. Vanhoof, Eds. Cham: Springer International Publishing, 2022, pp. 135-156. doi: 10.1007/978-3-030-98869-2_8." 
Type Of Technology Software 
Year Produced 2021 
Open Source License? Yes  
Impact This is an open-source project designed for complex event processing. It is currently being deployed with Denbridge Marine Ltd a global provider of maritime solutions for aiding VTS operators detecting maritime activities of interest. Since this is a generic application, it can work with other domains, such as in healthcare for aiding doctors monitor their patients. The language is formally described and doesn't require prior programming skills for writing phenomena definitions.