Drawing and Visualisation of Dynamic Multivariate Graphs for Social Networks

Lead Research Organisation: Swansea University
Department Name: College of Science

Abstract

Networks, or graphs, are pervasive in our modern society. A network consists of entities, or nodes, and a set of relationships between those entities, or edges. When we consider social media services (Facebook, Twitter, etc), nodes correspond to user accounts and edges would be friendships between these users. Nodes often have information associated with them, or attributes. In a social network, these attributes could be as simple as demographic data or information that a particular user has at a given time. In an intelligent infrastructure setting, where nodes and edges correspond to a road network, the level of congestion along stretches of road would be an attribute of the network. In general, networks that have attributes associated with their nodes and edges are called multivariate networks and are an emerging area of information visualisation.

Multivariate networks can also be dynamic. That is, either the structure of the network itself or the attributes associated with the nodes and edges can change over time. In a social network setting, friendships are formed and are broken, evolving the network. Information that a friend might have can spread from node to node cascading through the network structure. In a city, new roadways can be built or closed, corresponding to structural changes in the network. Levels of congestion vary throughout the course of the day and therefore the attributes can change as well. Networks where the structure and/or attributes change over time are dynamic multivariate networks and understanding how they operate is critical for these applications and many others. In information visualisation, this emerging area has received much recent attention.

The challenge of this work occurs when the network structure and/or the attributes change over time and we would like to visualise these changes effectively. As many networks, particularly social networks, do not have inherent spatial positions for the nodes, we are free to choose these positions. Also, we are free to choose the encodings for the attributes. However, we must do so in a way that is both computationally efficient and perceptually effective for the end user of the visualisation.

In this work, we look at perceptually effective ways for drawing and visualising dynamic multivariate graphs. We work closely with research scientists at the Oxford Internet Institute to ensure impact on software that is already in use with various user communities. For this work, we are inspired by studies in psychology and perception in order to drive the design of algorithms to draw the graph and interactive methods for their visualisation. We concentrate on methods for drawing and visualising both evolving structure and evolving attributes. In order to ensure our algorithms conform to the desired perceptual criteria, we evaluate our computational processes through metric evaluations and evaluate our visualisations through user centred experimentation. By working closely with our collaborators in social networks, we ensure the work is relevant for analysing social networks.

Planned Impact

Impact is embedded into the proposed research. This impact lies directly in the area of social networks and sociology, influencing applications already in use by various user communities. The algorithms developed and validated as part of this research have the potential to assist projects conducted at the Oxford Internet Institute that have been designed to improve the quality of life of users involved in two projects. We will work closely with the OII in order to accelerate this impact.

Network visualisation in sociology is rapidly becoming essential to robust methods for data collection and interpretation. The results from the proposed research will be applied to several on-going projects such as CollegeConnect, funded by the Bill and Melinda Gates Foundation, and the RADAR project, funded by the National Institute of Health and administered by the Feinberg School of Medicine at Northwestern University. In both cases, Dr. Bernie Hogan[1] is employing network data collection methods and requires visualisation tools in order to make sense of this data.

CollegeConnect helps high school students find out about university by processing and visualising data from their social media platforms. By providing a visualisation of their Facebook network, the application makes ties to communities that the potential student may know to help them with these education-related decisions. This information is especially important if the student does not know someone directly who has gone to university themselves. As social media networks are pervasive, it also increases the accessibility of this information to a wider audience of young adults.

The second application processes contagion patterns in HIV networks. In this project, the research team aims to combine a number of different networks including: drug, sex and social networks across multiple participants in order to help these groups. Both projects require extensive visualisations. While it is understood that visualisation is important for increasing respondent satisfaction and decreasing burden, the network visualisation methods that work best for these circumstances have still to be understood.

The algorithms developed as part of this project have the potential for a significant impact on both projects. This research will help increase respondent satisfaction and increase retention rates of participants in these programs. These projects intend to collect longitudinal data and having functional and successful visualisations is a key part of this process. The expertise of the PI in the generation of new visualisation approaches for multivariate networks will help support these two software systems that are already in use. In particular, these visualisation systems will benefit from drawing upon the knowledge base of experimentally validated best practices for visualisation. Thus, by supporting contemporary work on multivariate network visualisation, such as the research proposed in this grant, we can accelerate the impact of this research not only in the area of sociology and social networks but on two visualisation applications already in use by these communities.

A second possible impact area that we intend to pursue is that of intelligent infrastructure for sustainable cities. Multivariate networks have the potential for substantial impacts in this area: from traffic flows through a city to the flow of information across social media services. Although this impact area is secondary to this grant, we intend to initiate research activities that explore the possibilities for applying this research to the area of intelligent infrastructure. Both industrial and academic communities will be encouraged to participate in these activities.

[1] http://www.oii.ox.ac.uk/people/?id=140
 
Description The award began in October 2015. Initial work on this topic was accepted as a ACM CHI Note (Internationally leading conference in Human-Computer Interaction). This paper reports on how people think about their social communities when presented with a visualisation of their social network. The results were compared with many automatic community finding algorithms.

Subsequently, we have two other outputs in 2016. In the first, a EuroVis 2016 paper published in Computer Graphics Forum, we present an experiment that discusses the perception of orderability in visual channels. This work supports the perceptual experiments required to support the work in this grant. The second paper was published at InfoVis 2016 in IEEE Transactions on Visualisation and Computer Graphics. The paper discusses the perceptual implications of sampling graphs on the perception of the resultant visualisations. The work adds to the body of perceptual validation required for this grant and provides important results on visualisation effectiveness in the big data age.

In 2017, we published "Drawing Dynamic Graphs Without Timeslices" at Graph Drawing 2018. This publication was the primary output of WP1 and presented an algorithm for drawing dynamic graphs without first sampling along the time axis and projecting the information down onto timeslices. The work has receive international attention.
The Graph Drawing 2018 paper describes a new model for drawing and visualising dynamic graphs without the use of timeslices. This work has a high degree of novelty and will likely make a strong academic impact. The article was accepted at TVCG in Dec. of 2018 with some excellent reviews and has already garnered some significant attention.

In 2020, research associated with the award was used in early prototypes for visualisations of contact tracing network simulations which lead to an EPSRC COVID-19 grant on contact tracing visualisation. The work is still being considered for integration in software that helps our response to the pandemic.
Exploitation Route The benefits of the CHI paper provides a validation for automatic community finding algorithms. In particular, according to our experiment InfoMap most closely resembles the idea of human communities when a person is asked to annotate them over top of a visualisation.

The EuroVis 2016 paper describes how orderability is perceived depending on the choice of visual channel. This has implications on the multivariate side of multivariate graph visualisation.

The InfoVis 2016 paper describes how sampling influences the perception of node-link diagrams. In the big data age, sampling is undertaken to deal with data sets at scale. Thus, we need to understand the implication of these activities on visualisations.

The Graph Drawing 2018 paper describes a new model for drawing and visualising dynamic graphs without the use of timeslices. This work has a high degree of novelty and will likely make a strong academic impact. The article was accepted at TVCG in Dec. of 2018 with some excellent reviews and has already garnered some significant attention. It has the potential to change how we draw and visualise Event-Based networks (in particular Social Media networks such as Twitter).

The research associated with the award was used in early prototypes for visualisations of contact tracing network simulations which lead to an EPSRC COVID-19 grant on contact tracing visualisation. The work is still being considered for integration in software that helps our response to the pandemic.
Sectors Digital/Communication/Information Technologies (including Software)

URL http://dynnoslice.cs.swansea.ac.uk/
 
Description The work was used in a study to analyse social networks of a vulnerable population associated with the RADAR project. The findings of this study are starting to influence the design of netcanvas which is a tool used for the capture of such social networks: http://networkcanvas.com/ A quote from our impact partner: The collaboration with Dr Archambault was done using data from Network Canvas, a social network data collection tool my team produced in collaboration with Northwestern university. From Dr Archambault's perspective this was an ideal opportunity to explore the properties of graphs drawn in real world circumstances. From my perspective this was an opportunity to embed grounded and scientific insights into the next iteration of Network Canvas. My team has received generous funding from the American National Institute of Health [NIH] to develop, extend and harden Network Canvas, yet, we have had limited opportunities to make decisions about future design based on evidence. The insights provided have led to us reorganizing the layout of the main screen to make it more usable and more effective. This will make a considerable difference in the quality of reporting on social ties, particularly social ties in public health and clinical settings. The award has led to the formation of MLVis, a workshop that integrates machine learning and visualisation. The workshop has been held consecutively for five years now at EuroVis -- a top visualisation conference. The workshop has led to special issues in journals on the topic of machine learning and visualisation. The award has lead to software that is currently being used in prototypes to visualise the content of contact tracing networks in response to the COVID-19 pandemic. Understanding these event-based networks is critical to the next stage of easing restrictions where the individual networks among smaller groups of people can be modelled. DynNoSlice came out of this project. A multivariate version of this algorithm is now created. If it was not for this funding, this new algorithm would have not been written.
Sector Digital/Communication/Information Technologies (including Software),Healthcare
Impact Types Societal

 
Description College of Science Research Fund (Travel Award)
Amount £800 (GBP)
Organisation Swansea University 
Sector Academic/University
Country United Kingdom
Start 05/2016 
End 05/2016
 
Description Visual Analytics for Explaining and Analysing Contact Tracing Networks
Amount £292,071 (GBP)
Funding ID EP/V033670/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2020 
End 02/2022
 
Description Collaboration with Glasgow Intitute of Health and Wellbeing 
Organisation University of Glasgow
Department Institute of Health and Wellbeing
Country United Kingdom 
Sector Academic/University 
PI Contribution I am currently exploring implications of this research in the area of public health with the Glasgow Institute of Health. This collaboration started through contacts developed over the course of this grant. The main purpose is to explore applications of the research to networks in public health.
Collaborator Contribution Partners have hosted me for a few visits and we have discussed research problems. Collaboration is at an early stage at this point.
Impact Collaboration is still early stage.
Start Year 2017
 
Description Drawing Characteristics of Social Networks for At Risk Communities 
Organisation University of Oxford
Department Oxford Internet Institute
Country United Kingdom 
Sector Private 
PI Contribution Working with the Oxford Internet Institute, we are currently studying properties of social network drawings made by at risk groups. These drawings of the network are made by the members of the community themselves who have knowledge of the actors in the network. The analysis was conducted anonymously and only consisted of understanding properties of the geometry of the network layout.
Collaborator Contribution The Oxford Internet Institute was able to provide access to this very important and valuable data set on which we were able to conduct our analysis.
Impact This is a multi-disciplinary collaboration with sociologists. We are currently finishing the analysis of hundreds of social networks in order to summarise drawing characteristics of people creating drawings of their own social networks. The study will help our colloborators understand properties of their tool so that they can improve it in future versions. Also, it will help us from a multivariate graph perspective in that we will gain a better understanding of how humans draw their own networks. We are currently in the process of writing up this research. A publication is expected on this work later in the year.
Start Year 2015
 
Description Dynamic Networks Visual Analytics: Approaches to facilitate visual analysis of complex and dynamic network data (Shonan Seminar, Tokyo, Japan) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The Shonan Workshop on Dynamic Graph Analytics will allow me to network with world leaders in the area of dynamic graph visualization. Also, it is likely to provide an opportunity to share preliminary results of this new grant.

The workshop is a Dagstuhl style workshop, consisting mainly of specialists in this particular field, early career researchers, and post graduate students. The venue not only provides a place to discuss rescent results but also provides an opportunity for participants to work on new problems leading to future publications and funding opportunities.
Year(s) Of Engagement Activity 2016
URL http://shonan.nii.ac.jp/shonan/blog/2015/10/22/dynamic-networks-visual-analytics-approaches-to-facil...
 
Description Machine Learning Methods in Visualisation for Big Data Now a Recurring Event at EuroVis 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact MLVis is now an established workshop at EuroVis, a top conference in the visualisation field. It will be held in conjunction with EuroVis 2019 in Porto, and it has been invited to be part of the 2020 conference in Norrkoping. The topic of this conference is how machine learning methods can best benefit from visualisation (e.g. explainable AI) and how visualisation can benefit from machine learning (e.g. automatic forms of aggregation/abstraction for large datasets). The activity is a workshop with a call for papers and an international PC with important leaders in the ML and VIS communities. We plan on having invited talks, some of which are held in conjunction with other workshops at the conference. Also, tutorials in this area are presented by the organisers. The event is now in its fifth year.
Year(s) Of Engagement Activity 2016,2017,2018,2019,2020,2021
URL https://www.tuni.fi/mlvis2020/
 
Description Organisation of Invited Machine Learning Methods in Visualisation for Big Data, Workshop at EuroVis 2016 (Groningen, Netherlands) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The activity is an academic tutorial for reasearchers in the area of information visualisation on the subject of machine learning algorithms and big data. As an organizer of this workshop, the tutorial constains some preliminary work on multivariate graphs that I have undertaken in relation to this grant. This workshop would help introduce this area and novel methods for visualization. In particular, static multivariate graphs and the area of graph mining to this community.

The workshop takes place in June 2016 and is co-located with EuroVis, a premier venue for visualization research:
http://www.cs.rug.nl/jbi/eurovis2016/Co-locatedEvents/Co-locatedEvents
Year(s) Of Engagement Activity 2016
URL http://mlvis2016.hiit.fi/
 
Description Organisation of Invited Machine Learning Methods in Visualisation for Big Data, Workshop at EuroVis 2017 (Barcelona, Spain) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The activity is an academic tutorial for reasearchers in the area of information visualisation on the subject of machine learning algorithms and big data. As an organizer of this workshop, the tutorial constains some preliminary work on multivariate graphs that I have undertaken in relation to this grant. This workshop would help introduce this area and novel methods for visualization. In particular, dynamic multivariate graphs and visualisation. The workshop takes place in June 2017 and is co-located with EuroVis, a premier venue for visualization research: http://eurovis2017.virvig.es/index.php/co-located-events

This workshop/tutorial was invited due to the success of the first event which took place at EuroVis 2016
Year(s) Of Engagement Activity 2017
URL http://mlvis2017.hiit.fi/
 
Description Organisation of Invited Machine Learning Methods in Visualisation for Big Data, Workshop at EuroVis 2018 (Brno, Czech Republic) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact For the third year running, we organised a workshop at EuroVis, a top conference in the visualisation field, on machine methods in machine learning. The activity is an academic tutorial for reasearchers in the area of information visualisation on the subject of machine learning algorithms and big data. For the first year, we invited papers and participation from the community. As an organizer of this workshop, the tutorial constains work on multivariate graphs that I have undertaken in relation to this grant. This workshop would help introduce this area and novel methods for visualization. In particular, dynamic multivariate graphs and visualisation. The workshop takes place in June 2018 and is co-located with EuroVis, a premier venue for visualization research.
Year(s) Of Engagement Activity 2016,2017,2018
URL https://events.uta.fi/mlvis2018/
 
Description Organisation of Reimagining the Mental Map Shonan Seminar 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact We are running a Shonan Workshop on the mental map and drawing stability. This workshop will attract international participation to discuss the topic of stability and dynamic data. The workshop is intended to start new research directions and collaborations. Many of the ideas stem from those explored in this grant.
Year(s) Of Engagement Activity 2018
URL http://shonan.nii.ac.jp/shonan/blog/2017/01/10/reimagining-the-mental-map-and-drawing-stability/