Visualising the UK General Election 2015 TV Debates

Lead Research Organisation: University of Leeds
Department Name: School of Media & Communication

Abstract

During the 2010 general election the first ever televised leaders' debates to be held in the United Kingdom took place. A key argument in favour of these televised events was that they could reach a wider audience than is usual for politically-related content and that, after watching them, normally apolitical debate-watchers might be better informed about election issues; more likely to discuss policies with their friends and families; and more likely to vote than those who are not exposed to the debates. In short, televised election debates perform a heuristic function, providing voters with resources that enable them to carry out their normative role as informed and reflective citizens of a representative democracy. Research conducted by Coleman et al ("Leaders in the Living Room--The Prime Ministerial Debates of 2010", Oxford: Reuters Institute, 2011) after the 2010 UK debates showed that there was a significant public appetite for this means of learning about the candidates and their policies, but that many viewers were left feeling uncertain about the meaning of what they had witnessed. This prompted a group of scholars from different disciplines - information science, political communication and design - to get together with a view to exploring how future televised leaders' debates might be made more comprehensible to groups of viewers with specific information needs.

In considering the best approach to presenting complex arguments to citizens with a view to generating better informed public debate about political issues, we have turned to the field of Computer-Supported Argumentation Visualisation (CSAV) which has a track record of utilising innovative information techniques to present complex arguments that citizens can make sense of and reflect upon in the course of policy deliberations.

Our aim in this research is to develop an open-source web-based platform that incorporates a suite of visualisation tools and to develop a working model of how this platform can be embedded within a mixed-media ecology for covering and responding to issues of public political debate. The platform will be designed with a view to i) responding to the information needs of audiences and specific types of audience member; ii) presenting the discursive content in ways that take account of the aesthetic and symbolic needs of information seekers; and iii) not only visualising the debaters' arguments by adopting innovative CSAV methods, but also visualising other features of the debates through the use of non-CSAV-specific techniques, such as word-cloud visualisations (where key words and phrases used in a debate are extracted and visualised such that graphical features like font-size, colour, and positioning are used to depict most import words and phrases) and time-series analyses (where the emphasis is on visualising the chronology of the various speech acts during the debate, so that the context "in time" of key rhetorical events can be captured).

Planned Impact

Who will benefit from the research?

Our project will seek to maximise its economic and societal impact through engagement with a range of key stakeholders including journalists and media companies, policy-makers and political organisations, and citizens themselves. Specifically, the project is designed to have a direct impact on citizenship and public access to politics through the development of a new software application that will help users to understand and evaluate election debates.

Our research is also expected to have a broader impact on knowledge and the academy by introducing an innovative new cross-disciplinary technique and methodology to the field of computer-supported argument visualisation and to the areas of e-participation, e-governance, and political communications. By working closely with relevant organisations in the media and politics as well as with academic audiences, we hope to maximise the chances of our research being adopted, applied, and developed more widely in future.

How will they benefit?

Starting with citizens, the main impact of our research will be an improvement in the quality of civic life due to them being able to better understand and evaluate political discourse. This will ideally lead to citizens being able to more directly connect to the political communications process and consequently being better able to influence policy at local and national levels.

In addition to citizens, the research will have an impact on journalists and media companies by introducing them to a proof of concept of new products and services that they can provide in their role as mediators of public political discourse. The research will also introduce journalists and the media to new skills related to their role as mediators in the political communications process.
Finally, in terms of societal impact, policy-makers and political organisations will benefit from the research due to their new understanding of how the communication of policy and debate about policy is received by the general public and how technology can be used to shape these communication practices.
 
Description Ahead of the 2017 General Election, we designed a second iteration of Democratic Reflection that would address these issues. This time we reduced the number of response statements from twenty to ten, to reduce the complexity of the task, with just one positive and negative statement per capability. We also ensured the statements were more clearly distinct from one another. Some nuance may have been lost in this process. Still, comparing the software app to other real-time response methods, the response statements available to viewers are still much richer and relate to capabilities of democratic citizenship rather than simply to positive and negative preferences. The research team also felt it would be valuable to include a measure of intensity, enabling viewers to express how strongly their supported a particular statement or not. The app uses the length of time people hold a card as a measure of intensity, with a scale ranging from 1 to 5.
To test the second version, we conducted an experiment on the BBC Question Time Leaders' Special programme on 2 June. The programme involved Theresa May (the Prime Minster and leader of the Conservative Party) and Jeremy Corbyn (the leader of the Labour Party) fielding questions from a selected studio audience and on occasion from the moderator, David Dimbleby, for forty-five minutes each. Eighteen people participated in our experiment. The sample was a convenience sample, drawn from students at the University of Leeds and their personal contacts, and it was not selected to be politically balanced or representative. This experiment generated 2876 responses over the course of the ninety minute programme.

We have developed an analytics interface to help with the analysis of the data generated by Democratic Reflection. The interface enables researchers to identify overall patterns of response and analyse responses alongside the video, either by individual response statement or per capability. Researchers can also filter the data in different ways, allowing them to compare the responses of demographic groups or the responses of participants who give different answers to questions in the pre-debate and post-debate surveys.

all 2876 responses collected during the 2 June Question Time programme. Green indicates positive responses and blue indicates negative ones. As the graph shows, a distinct shift from more negative to positive responses is evident halfway through the programme, when May's period of answering questions ends and Corbyn takes to the stage for the first time. As already noted, our sample was not designed to be representative or politically balanced. Indeed, our data suggests the panel was skewed significantly towards Corbyn.

As well as looking at overall patterns, we can investigate specific peaks of response around key moments in the programme. Systematic testing is required to assess the full value of Democratic Reflection as a method for understanding the real-time responses of audiences to political messages and to develop the app further. We conducted a user test with a nationally representative sample in 2018 and are currently analysing the data from that important experiment.

During the December 2019 general election leaders' debate between Johnson and Corbyn on ITV, we tested the Democratic Reflection tool with a live audience of 100 undecided voters. The voters were assembled to watch the debate together in a large theatre space at the University of Leeds. They were introduced to the app and given time to familiarize themselves with the statements and the app. The participants then responded using the app on their mobile devices in real time. A total of 9,592 responses were generated across the whole debate: an average of over 100 responses per respondent..
In our forthcoming report on this exercise we shall present a descriptive overview of how each politician performed in relation to each measure, allowing us to compare their performance across all five entitlements. We shall then employ an event-history analysis on the real-time data gathered during the debate in order to identify patterns over time. Time refers to the duration of the debate measured in seconds (in our analysis, we report the results using intervals of 90 seconds for the sake of making the figures more readable). We are interested in the effect this has on the use of the app to select between the positive and negative statements of the five entitlements over the duration of the debate. This method of analysis allows us to identify significant shifts in the debate as well as peaks in relation to each of our measures. Building on this analysis, we focus on a selection of these peaks and shifts in more depth, looking at the text of the debate itself and the performance of the speakers in order to see what might explain these patterns of response.
Following this exercise, we applied for HEIF funding to design a new version of the tool - which we propose to re-name. This will be completed within the next four months.
Exploitation Route We are continuing to talk to media organisations and political practitioners about their use of the Democratic Reflection tool.
Sectors Digital/Communication/Information Technologies (including Software),Government, Democracy and Justice

 
Description We worked with ITV News during the Johnson-Corbyn televised leaders' debate during the December 2019 general election. We recruited a group of 100 undecided voters to come to the University of Leeds and watch the debate while using the Democratic Reflection tool. Their immediate experiences were reported on the ITV News at Ten. We have worked on a report of the data and findings collected during the debate.
First Year Of Impact 2019
Sector Digital/Communication/Information Technologies (including Software),Government, Democracy and Justice
Impact Types Cultural,Societal

 
Title Hypermedia analytics and replays of TV election debates 
Description EDV has developed a set of hypermedia analytics of TV election debates. These result from complex analyses that are time-linked to the video of the debate. We focused on four types of analyses: audience feedback, argument mapping, debate-rule compliance, and performance. Each one results in a set of interactive visualisations that are presented together with and enhancing a debate video. We analysed the 2015 UK General Election leaders' debate. This resulted in a hypermedia dataset with timed annotations of the 2-hour debate video and transcript. We also designed and implemented an online tool to replay the debate with the interactive visualisations. The guidelines and tools for producing the analytics, the hypermedia dataset, and the online interactive will be made available for future research later in the project. 
Type Of Material Technology assay or reagent 
Provided To Others? No  
Impact We plan to launch this tool later this year, at which point we hope to be in a position to identify its social impact. 
 
Title Real-time audience feedback to television debates 
Description We have developed a new method for collecting, analysing, storing and visualising real-time audience feedback to televised contents. The method consists of a mobile web app that viewers can use as they watch live television to express their views and feelings on the contents. Responses are collected in a repository and time-linked to the broadcast. A suite of online analytics and visualisations of the data allow for analyses of response trajectories and aggregates. These can be individual or collective, based on viewer socio-demographics, political profile, etc. The method was tested live during the 2015 UK General Election leaders' debate, involving a panel of 250 viewers across the nation. This resulted in a dataset of nearly 50000 responses. The version of the feedback app consisted of 20 statements in 5 different categories (called "democratic entitlements"): information, respect, engagement, representation and change. The dataset, feedback collection tool, and online analytics will be made available for future research later in the project. 
Type Of Material Technology assay or reagent 
Provided To Others? No  
Impact It is too early to say. We are currently writing up the data analysis and have produced a funding proposal intended to broaden the impact of this tool.