Near Real-Time Update Streaming for Distributed Dynamic Graphs

Lead Research Organisation: Queen Mary University of London
Department Name: Sch of Electronic Eng & Computer Science

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Publications

10 25 50
publication icon
Steer B (2020) Raphtory: Streaming analysis of distributed temporal graphs in Future Generation Computer Systems

publication icon
Steer B (2017) Raphtory

publication icon
Steer B (2017) Cytosm

publication icon
Erb B (2018) Graphtides

publication icon
Steer B (2017) Raphtory

Studentship Projects

Project Reference Relationship Related To Start End Student Name
EP/N50953X/1 30/09/2016 29/09/2021
1803769 Studentship EP/N50953X/1 01/11/2016 29/04/2020 Benjamin Steer
 
Description Defined the model for a temporal property graph, the update semantics for said model (the addition, removal and mutation of vertices and edges)
A practical manner of ingesting streams of graph updates into temporal graph maintained over a distributed set of machines.
A method for performing analysis over distributed temporal graphs. 1: Allowing users to investigate how the model/underlying data has changed over time. 2: allowing users to include time as a first order citizen within analytics such as in temporal shortest path.
A framework for benchmarking streaming graph analytics systems, merging components from pure stream processing benchmarks and traditional static graph benchmarks.
Exploitation Route The current work has focused much on social network analysis and there is still a lot of space to explore in this domain i.e. niche community detection and mutation (extremist groups on twitter). However, there is also much future work exploring other areas such as transport networks and financial ecosystems.
Sectors Communities and Social Services/Policy

Creative Economy

Digital/Communication/Information Technologies (including Software)

Financial Services

and Management Consultancy

Transport

 
Title Raphtory: A Distributed System for Temporal Graph Analysis 
Description Raphtory is a distributed system that can create in real time a distributed temporal graph from multiple data sources, and perform continuous graph analysis on the managed graph. The software can run standalone on a single machine, or deployed as a set of Docker images in a cluster (AWS and Microsoft Azure have been tested). The released software started as the outcome of a PhD studentship but it has evolved into a collaborative open source project with multiple contributors, 
Type Of Technology Software 
Year Produced 2019 
Open Source License? Yes  
Impact The Raphtory software project has gained significant interest from researchers and industry. There are four different companies who are evaluating Raphtory for adoption on some of their internal use cases, as well as active research collaborations with four additional institutions. Currently 45 developers have starred the project, and 9 other members who have provided contributions to it. 
URL https://raphtory.github.io/