Seeing Data: are good big data visualisations possible?

Lead Research Organisation: University of Sheffield
Department Name: Sociological Studies

Abstract

Seeing Data focuses on how people perceive representations of big data; that is, data visualisations. The proposed research starts from the premise that data are constructed by human decisions made during the data generation process. They are never raw, but always cooked (Bowker 2005); they do not just exist, but need to be generated (Manovich 2011). But big data are often assumed to 'just exist', and their representation through visualisations are taken as windows onto the world, even though some commentators have highlighted the dangers of such assumptions. For example Crawford (2013) states that 'the map is not the territory' in order to warn us against seeing visual representations of things as the things themselves.

A second premise of the research is that the main way in which the general public gets to access big data is through data visualisations, 'the representation and presentation of data that exploits our visual perception abilities in order to amplify cognition' (Kirk 2013). Data visualisations, like the big data on which they are often based, are becoming increasingly ubiquitous: David McCandless's billion-dollar-o-gram, an animated visualisation of years lost due to US gun deaths and the website We Feel Fine which captures sentiment expressed online are just three examples of widely circulating data visualisations.

If big data are constructed by the ways in which they are generated and if data visualisations are the main source of popular access to big data, then critical questions about the role of data visualisations need to be asked. We need to explore whether, given these factors, effective big data visualisations are ever possible, and if so, how effectiveness might be measured. In order to answer these questions, more understanding of the reception of data visualisations is needed. Seeing Data addresses this issue. The proposed research involves generating big data, combining it with existing data, visualizing that data, and examining the reception of these visualisations amongst the general public, who are the main consumers of data visualisations. Through these methods, the research will develop understanding of the reception of data visualisations, which will then be shared with the producers and consumers of such visualisations. Thus the research aims to enhance both the production and consumption of data visualisations.

Questions about the reception of big data visualisations will be addressed through collaborative research carried out by a new media scholar, a data visualisation expert, a social science researcher working with large scale data and a visual communications scholar. Our empirical research takes as a case study data about a contentious social issue, migration, which is held by the Migration Observatory (MigObs) at the University of Oxford. MigObs aims to provide impartial, evidence-based analysis of data on migration and migrants in the UK, to inform media, public and policy debates; our research will explore whether data visualisations make it possible to meet this aim. Combining existing data about migration with newly-generated datasets, we will recruit field-leading data visualizers to produce visualisations of MigObs data. We will examine the reception of these visualisations in detail through in-depth focus group discussions with consumers of visualisations from the general public. To support this case study, we will also ask other consumers to keep diaries of their encounters with data visualisations in their everyday lives and their reactions to them. Thus we will explore whether effective big data visualisations are possible, given the constructedness of data and visualisations, what effectiveness might mean in this context and how effectiveness might be measured. We will also concretely help MigObs address some of the challenges it faces in clearly communicating its data to a range of stakeholders.

Planned Impact

The two main non-academic beneficiaries of the research are ordinary consumers of visualisations and data visualisation professionals.

Seeing Data aims to have an impact on ordinary consumers of data visualisations, helping them to develop their visualisation literacy through a project website entitled 'Making Sense of Visualisations' which will be publicized through a series of launch events. This will be the first known resource actively targeted at the general public which aims to develop such literacy. It will draw from knowledge about the reception of data visualisations developed through the research. It will be designed to acquaint site visitors with a range of contemporary visualisation techniques and the limitations of data visualisations. Once Seeing Data is complete, we will explore the possibilities of a) developing the content of this website into an eBook or App with financial support from the University of Leeds and b) embedding this resource within secondary level curricula.

We also aim to have an impact on the practice of data visualization. Much current practice in this sector is based on the gut feelings, design instincts and aesthetic preferences of data visualisation professionals. Very little empirical research has been done with consumers of visualisations to understand the reception of visualisations. Thus the project will contribute much-needed knowledge to the sector, which we hope will form the basis of future visualisation practice. In order to have this impact, industry professionals will be engaged in the research in a number of ways. The involvement of Kirk as an equal partner in this research provides direct access to leading practitioners globally and guarantees the project's ability to have an impact on the field. Seeing Data involves engaging four data visualisation professionals to produce visualisations of migration data that will be used as a case study in the research. This constitutes another form of knowledge exchange, in that ideas exchanged in the process of collaboration may impact on the ways in which all parties approach their work. The research findings will also be disseminated at key sector events (such as EuroVis and Strata Conference) and online via a range of outlets: our project website; Kirk's Visualising Data blog; on Twitter; and in other online spaces.

The research will also have a positive impact on the work of MigObs, helping it to address the challenges it faces in clearly communicating its data to a range of stakeholders. The visualisations produced through this project will enhance the ability of MigObs to communicate migration data effectively to a wide audience. Understanding of the reception of visualisations developed on the project will help MigObs in the longer-term task of implementing best practice and developing mechanisms for assessing the effectiveness of its visualisations. In addition, as the research addresses two issues of contemporary concern - a) how big data visualisations get consumed by the general public, and b) migration - it provides excellent opportunities for media coverage. We will exploit media engagement opportunities to communicate our research to the general public which may also result in a range of impacts.
 
Description 1. These factors affect engagement with data visualisation: subject matter; source/media location; beliefs and opinions; confidence in ability to make sense of them; emotions.
2. Emotions play an important role in shaping engagement with data visualisation. Users respond emotionally to: the data themselves; the visual style and design of visualisations; subkect matter; source/location; perceived skills to decode.
3. Findings listed in (1) and (2) have implications for how we define the effectiveness of a visualisation, and for how we approach statistical education. We need to define effectiveness more broadly, moving beyond notions of speed of comprehension and memorability. And given the important role played by emotions in engaging with datavis, we need to consider what feelings-based/arts-based (rather than cognitive/rational) approaches to statistical education might make possible.
4. Conventions used in visualisations play a role in making visualisations and the data within them seem objective. They constrain visualisers from fully realising their objective of making data accessible and transparent through visualisations.
Exploitation Route Research into different approaches to statistical education.
Scaling up this qualitative study, to involve larger numbers, carry out online, do international comparison etc.
Research into how to promote visualisation literacy.
Research into how visualisers can account for diversity in their audiences.
Sectors Creative Economy,Digital/Communication/Information Technologies (including Software),Education

URL http://seeingdata.org/
 
Description It has had an impact on the visualisation practice of Andy Kirk, who was a partner on the research. I believe it will impact on other data visualisers too, but it is too early to record details on this.
First Year Of Impact 2015
Sector Creative Economy,Digital/Communication/Information Technologies (including Software)
Impact Types Cultural,Societal

 
Description Big talk about big data
Amount £3,970 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 01/2014 
End 08/2014
 
Description Magdalen Fellow by Examination in Political and Development Studies (Junior Research Fellowship)
Amount £116,523 (GBP)
Organisation University of Oxford 
Department Magdalen College Oxford
Sector Academic/University
Country United Kingdom
Start 10/2018 
End 09/2021
 
Description Norwegian Media Authority Research Funds
Amount kr 116,000 (NOK)
Organisation Norwegian Media Authority 
Sector Public
Country Norway
Start 04/2016 
End 06/2017
 
Description Relating to Data: understanding data through visualisations
Amount £173,586 (GBP)
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 10/2016 
End 09/2019
 
Description Research Council of Norway Research Grants
Amount kr 229,000 (NOK)
Funding ID 259536/F10 
Organisation Research Council of Norway 
Sector Public
Country Norway
Start 09/2016 
End 12/2019
 
Description What can data visualisation do? (ESRC Festival of Social Science event)
Amount £1,500 (GBP)
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 11/2015 
End 11/2015
 
Description Seeing Data partners 
Organisation Clever Franke
Country Netherlands 
Sector Private 
PI Contribution We (the research team) were equal partners with Visualising Data in the research. We commissioned Clever Franke to produce data visualisations to use as case studies in the research. We have since submitted several collaborative grant applications with both organisations, some of them successful.
Collaborator Contribution We (the research team) were equal partners with Visualising Data in the research. We commissioned Clever Franke to produce data visualisations to use as case studies in the research. We have since submitted several collaborative grant applications with both organisations, some of them successful.
Impact All Seeing Data attributed awards result from the collaboration with Clever Franke. Most Seeing Data attributed engagement activities result from the collaboration with Visualising Data.
Start Year 2014
 
Description Seeing Data partners 
Organisation Visualising Data
Country United Kingdom 
Sector Private 
PI Contribution We (the research team) were equal partners with Visualising Data in the research. We commissioned Clever Franke to produce data visualisations to use as case studies in the research. We have since submitted several collaborative grant applications with both organisations, some of them successful.
Collaborator Contribution We (the research team) were equal partners with Visualising Data in the research. We commissioned Clever Franke to produce data visualisations to use as case studies in the research. We have since submitted several collaborative grant applications with both organisations, some of them successful.
Impact All Seeing Data attributed awards result from the collaboration with Clever Franke. Most Seeing Data attributed engagement activities result from the collaboration with Visualising Data.
Start Year 2014
 
Title Seeing Data website 
Description 'Understanding Data Visualisation' (http://seeingdata.org/understanding-data-visualisations/) is an interactive, online resource to help non-experts develop their understanding of data visualisation. 
Type Of Technology Webtool/Application 
Year Produced 2015 
Impact Not yet known. 
URL http://seeingdata.org/understanding-data-visualisations/
 
Description Data Stories podcast 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Forthcoming Data Stories podcast, by Helen Kennedy & Andy Kirk
Year(s) Of Engagement Activity 2016
URL http://datastori.es/
 
Description Data Visualisation Literacy: learning to see (tableau) 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Webinar for Tableau, data visualisation software producers. Delivered by Andy Kirk.
Webinar here: http://www.tableau.com/learn/webinars/data-literacy-learning-to-see?es_p=847905
Slides here: http://www.visualisingdata.com/2015/09/talk-slides-from-second-tableau-2015-webinar/
Year(s) Of Engagement Activity 2015
URL http://www.tableau.com/learn/webinars/data-literacy-learning-to-see?es_p=847905
 
Description Data Visualisation event for Jam Packed (Leeds) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact A workshop as part of Jam Packed 2015, a series of community computing events (https://jampackeduk.wordpress.com/), targeted at early secondary school children.
Year(s) Of Engagement Activity 2015
URL https://jampackeduk.wordpress.com/
 
Description Data is social! (Oxford) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact An interactive talk as part of the Ashmolean Museum, Oxford's, Live Friday! series, where the museum opens up on Friday evenings to the general public, with a series of live events & performances relating to a theme. The talk 'data is social!' was delivered in the March 2015 event on the theme of social animals. Delivered by William Allen.
Year(s) Of Engagement Activity 2015
URL http://www.ashmolean.org/livefriday/
 
Description Developing Visualisation Literacy (Oxford/Sheffield) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other audiences
Results and Impact A workshop, delivered twice, in Oxford and in Sheffield, to academics interested in developing their visualisation literacy (so not targeted at people already knowledgeable about visualisation).
Year(s) Of Engagement Activity 2015
 
Description How Do Civil Society Organisations Perceive 'Evidence-Based' Research, and What Opportunities Does This Present for Research Practice? (NCVO) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Seminar at NCVO (National Council for Voluntary Organisations) conference
Year(s) Of Engagement Activity 2015
 
Description How migration visualisations persuade us that they are correct 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Blog post on COMPAS (Centre on Migration, Policy & Society, University of Oxford) blog
Year(s) Of Engagement Activity 2016
URL http://www.compas.ox.ac.uk/2016/how-migration-visualisations-persuade-us-that-they-are-correct/
 
Description How people engage with data visualisations and why it matters, CILIP (Chartered Institute of Library & Info Professionals) blog post 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Blog post for Chartered Institute of Library & Info Professionals blog. Second most popular post on the blog of 2015.
Year(s) Of Engagement Activity 2015
 
Description How people respond to data visualisations (Sheffield) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact A talk as part of Government Researchers North / Department of BIS one-day regional conference held in Sheffield in December 2015. Delivered by Helen Kennedy.
Year(s) Of Engagement Activity 2015
 
Description How people respond to data visualisations (Sheffield) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact A talk to the local branch of the Royal Statistical Society, delivered by Helen Kennedy.
Year(s) Of Engagement Activity 2016
 
Description How people respond to data visualisations and why this matters, RSS national conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact A talk at the Royal Statistical Society (RSS) national conference
Year(s) Of Engagement Activity 2016
 
Description Seeing Data website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The Seeing Data (http://seeingdata.org/) website is engagement focused - it aims to help non-experts develop visualisation literacy and to inform them about our research findings.
Year(s) Of Engagement Activity 2015
URL http://seeingdata.org/
 
Description Seeing Data, Feeling Numbers: responding emotionally to data visualisations 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Feature in an AHRC Booklet entitled 'Big Data in the Arts & Humanities: some arts and humanities research council projects'
Year(s) Of Engagement Activity 2015
 
Description Seeing Data: Visualisation design should consider how we respond to statistics emotionally as well as rationally (LSE impact blog post) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Blogpost for LSE Impact Blog, statistics re. reach not yet known.
Year(s) Of Engagement Activity 2015
URL http://blogs.lse.ac.uk/impactofsocialsciences/2015/07/22/seeing-data-how-people-engage-with-data-vis...
 
Description Seeing Data: are good big data visualisations possible? 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Part of Leeds Digital which aims to make connections between businesses, start up, researchers, open data groups, civil servants.
Year(s) Of Engagement Activity 2017
 
Description Seeing Data: how do people engage with data visualisations & what does this mean for academics? 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact A talk at a PhD training day on visual methods, for White Rose PhD students.
Year(s) Of Engagement Activity 2015
 
Description Seeing Data: how do people engage with data visualisations? webinar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact A webinar about Seeing Data research, with approx 20 participants, some of whom followed up suggesting future research collaboration.
Year(s) Of Engagement Activity 2015
 
Description Talking Data Visualization Research (policyviz) 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Podcast for PolicyViz website, delivered by Andy Kirk.
Year(s) Of Engagement Activity 2015
URL http://policyviz.com/talking-data-visualization-research-andy-kirk/
 
Description Views from Seeing Data: three blogposts on Visualising Data website/blog. 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Three blogposts reporting on Seeing Data research findings on widely-read Visualising Data website:
http://www.visualisingdata.com/2015/10/views-from-seeing-data-research-part-1/
http://www.visualisingdata.com/2015/12/views-from-seeing-data-research-part-2/
http://www.visualisingdata.com/2016/02/views-from-seeing-data-research-part-3/.
Year(s) Of Engagement Activity 2015,2016
URL http://www.visualisingdata.com/2015/10/views-from-seeing-data-research-part-1/
 
Description Visualisation: same data, different experience (print publication) 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Article in Significance, the magazine of the Royal Statistical Society. By Helen Kennedy & Andy Kirk.
Year(s) Of Engagement Activity 2016
URL http://onlinelibrary.wiley.com/enhanced/doi/10.1111/j.1740-9713.2016.00876.x
 
Description Visualising Data workshops 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Andy Kirk regularly delivers training workshops through his consultancy Visualising Data (http://www.visualisingdata.com/training/). As a result of collaborating on Seeing Data, these workshops are now informed by, and refer to, Seeing Data research findings.
Year(s) Of Engagement Activity 2015,2016
URL http://www.visualisingdata.com/training/
 
Description Visualising UK Immigration For and With Non-Academics: Visual Literacy, Engagement 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Visualising UK Immigration For and With Non-Academics: Visual Literacy, Engagement, Impact. Centre for Digital Scholarship Seminar, 2 February, Oxford, UK.
Audience: library professionals, digital humanities scholars
Number: c. 10
Year(s) Of Engagement Activity 2016
URL http://blogs.bodleian.ox.ac.uk/digital/2016/01/18/william-allen/
 
Description What Can Data Visualisation Do For Your Research? (Engage, Oxford) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Engage: What Can Data Visualisation Do For Your Research? University of Oxford IT and Information Skills Series, March, Oxford, UK.
Audience: general university members, all disciplines
Year(s) Of Engagement Activity 2016
 
Description What Can Data Visualisation Do For Your Research? (Engage, Oxford) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Engage: What Can Data Visualisation Do For Your Research? University of Oxford IT and Information Skills Series, March, Oxford, UK.
Audience: general university members, all disciplines
Year(s) Of Engagement Activity 2016
 
Description What can data visualisation do? Sheffield 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Half-day event for professionals & public as part of ESRC Festival of Social Science.
Year(s) Of Engagement Activity 2015
URL http://www.sheffield.ac.uk/faculty/social-sciences/digital-society-network/events1/whatcandatavisdo
 
Description Why Visualising Immigration Matters 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Why Visualising Immigration Matters. Academic IT Services Live Data Project, 16 November, Oxford, UK.
Audience: mix of IT professionals, researchers on visualisation
Year(s) Of Engagement Activity 2015
 
Description Why should social scientists in migration studies care about big data? 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Blogpost on COMPAS (Centre on Migration, Policy & Society, University of Oxford) blog
Year(s) Of Engagement Activity 2014
URL http://www.compas.ox.ac.uk/2014/why-should-social-scientists-in-migration-studies-care-about-big-dat...