Nodes from the Underground: Causal and Probabilistic Approaches for Complex Transportation Networks

Lead Research Organisation: University College London
Department Name: Statistical Science

Abstract

An efficient transportation system is vital to the economic and social well-being of large cities. The transport demand implied by economic growth, however, requires transport networks to become more and more complex, making their management difficult. Fortunately, modern systems such as the London Underground generate vast amounts of data that can be analysed to better understand passenger behaviour and needs. Besides understanding the typical daily patterns that we can observe on a regular basis, Data Science methods allows us to look into in the less usual events such as unplanned disruptions that are still important to any user, and to also model individualised behaviour instead of only aggregates.

In a large system such as the London Underground, signal failures and disruptive events eventually take place, requiring passengers to change plans in a variety of ways. This research provides advanced statistical modelling and machine learning approaches to learn from past events to examine how passengers adapt themselves when a disruption occurs. When a disruption takes place, the model will provide information of likely changes, such as increased number of passengers leaving a station because they could not reach their destination. These models are important for transport authorities to understand the resilience of the system, different combinations of location and time of a disruption, and unusual responses from passengers that may motivate different communication strategies to inform users of better travel adjustments. This research also opens up conceptual ideas to be exploited in the future using new technologies to monitor and adaptively respond to passenger needs in a more optimised and time-effective way.

Planned Impact

Among the potential non-academic beneficiaries, we list:

1. Transport authorities such as Transport for London. Although most of the transport authorities have their own analytics teams and vast expertise, they are welcoming of academic research, as made explicit in the Letter of Support provided to us by TfL. In particular, research motivated by basic methodology is important to them, as it focuses on complex models which are not straightforward to integrate with current systems, but which in the long run offers offer potentially important contributions. In addition, by the completion of our research, we will provide these beneficiaries with methodologies and tools that will enhance the operational management of public urban railway systems.

2. Users of large transport systems. Millions of daily users of large transport systems such as London Underground have the potential to benefit directly from a system that reacts quickly and adaptively to disruptions, saving time and reducing the stress of commuting in a big city. This includes secondary effects on productivity gained by more efficient transportation in the society as a whole. In January 2015, Dr Silva and Dr Kang presented preliminary work related to this proposal at the Science Museum "Lates" event, in South Kensington. There was an overwhelmingly positive response from the museum attendees to the type of work we intend to continue in depth with this grant. The general public, and Underground users among them, appreciates the fact that scientific community engages in rigorous research to improve their quality of life.

3. City administrators. Good urban infrastructure has long-term economic benefits. The confidence given by a state-of-the-art transport system is a major factor boosting the profile of cities that expect to be labelled as "world-class" environments for businesses and quality of life. Much of London's reputation, for instance, can be traced back to reliance on its public transport network, including the oldest underground network in the world. Knowing the limitations of its transport system as facilitated by new technologies provides crucial information for the city management.

4. Companies working on complex systems and smart city solutions. Understanding behaviour under disruption is relevant to organisations such as taxi companies, which may benefit for the outcomes of this research as knowing excess demand generated from passengers interrupting their journey can also be used to allocate more vehicles to serve customers that would otherwise arrive late at their destinations. Companies who provide general apps of interest for city dwellers may potentially benefit from APIs streaming forecasts of reactions to disruptions in the transportation network, as some users may be interested in avoiding overcrowded locations. We intend to work closely with these beneficiaries, for example, through UCL's Knowledge Transfer resources.

5. Other companies/researchers working on transport problems outside the domain of passenger movement. The ideas developed in this project are also relevant to other transportation problems in networks, such as computer networks and other applications discussed in research areas such as network tomography. Part of the technology on computational methods developed here can be transferred to these domains mainly through general multi-disciplinary journals as well as journals and conferences in targeted fields.

Publications

10 25 50
 
Description Our first published work provides a novel way of estimating how full particular links in the London Underground are at any particular moment. It requires nothing but anonymised smart card data, such as the Oyster. It was developed in a way of making the process scalable and therefore make use of as many records as possible without the need of ignoring less common journeys. This can allow a more refined 'tomography' of the inner workings of the Underground and aid the understanding of how demand varies within the day at different locations. In our current stage, we have also drafted ways of improving personalised origin-destination predictions so that we can better understanding how navigation changes one a a unplanned disruption takes place. We are also developing ways of understanding which parts of a journey contributed to a high variability of the travel time of individuals during an unplanned disruption. We are currently working on implementing and testing such models, with planned feedback from Transport for London. Delays happened in 2020 due to caring duties that were particularly overloaded due to the Covid situation. Progress continues in 2021.

A piece of work is currently under preparation is being carried out jointly with Professor Arthur Gretton from the Gatsby Unit, UCL. We are developing general machine learning methodology to predict the volume of passengers exiting at a region in which trains stopped running due to an unplanned disruption. This machine learning methodology is a major generalisation of past work done by the investigators in the sense it adapts itself to less detailed information than previously required while providing also a more detailed report of the outcomes, such as a distribution over possible actions taking place in the system.

We are currently in the process of finalising two pieces of work. The first is joint with Professor Edoardo Airoldi from Temple University and consists of understanding what distinguishes passengers who are caught in the middle of an unplanned disruption. We sort them in terms of places where they exit at the affected region while establishing a relationship to where they might be at the start of the event. This will allow us further insights on how people might change their navigation plans and which kind of information might be provided to facilitate their journeys.

The second piece of work is joint with Professor Mike Batty (Centre for Advanced Spatial Analysis, UCL) and Dr Chen Zhong (Geography, King's College) on characterising how different journey lengths cluster depending on the point of origin and direction of travel. This will allow us to better understand economical clusters within large cities such as London and Seoul and provide bridges to further modelling of disruptions depending on particular regions it takes place.
Exploitation Route We have been discussing our progress in a series of meetings with Transport for London. Technology transfer is expected at the end of the award.
Sectors Digital/Communication/Information Technologies (including Software),Transport

 
Description Meeting with Transport for London 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Industry/Business
Results and Impact These are recurrent meetings with Transport for London, where we meet staff members, discuss our plans and how they complement the current work done by their data analytics team, and how technology transfer can be carried in the future.
Year(s) Of Engagement Activity 2017
 
Description Presentation on latest outcomes to research experts, University of Bath 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Presentation by PDRA Nicolo Colombo at University of Bath describing details of current work-in-progress, including a small tutorial on the background material.
Year(s) Of Engagement Activity 2019
 
Description Presentation to business students, Temple University USA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Undergraduate students
Results and Impact I was invited for a lecture for business students of Temple University (Philadelphia, USA) concerning my past and ongoing research along with Prof Edoardo Airoldi on practical issues faced by us and solved during the development of this activity. The presentation included a seminar on methods, data and results followed by a 30 minute Q&A.
Year(s) Of Engagement Activity 2018
 
Description Transport Showcase talk 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact This was an event showcasing research done at UCL on all aspects of data-driven transport research. The audience included members of industry and government, where we explained our activities and impact.
Year(s) Of Engagement Activity 2019