Advancing Understanding in News Information, Political Knowledge and Media Systems Research

Lead Research Organisation: University of Exeter
Department Name: Politics

Abstract

For democracies to work two fundamental prerequisites are that their publics must be able to hold those in power accountable and that their electorates cast informed votes. While the exact meaning of concepts like "accountability" and an "informed vote" is contested, what is not in dispute is that they depend on individuals having certain levels of knowledge about, and engagement with, the political world, such as knowledge of who their representatives are and what they have done, which is in turn more likely if someone pays attention to the political environment.

For the vast majority of people the level of knowledge they have about politics is acquired indirectly, through exposure to media coverage of the political world, rather than directly. Most people do not get to meet their representatives, let alone ask them about their actions. Thus researchers have long been interested in both the supply of political information from media--how much, its focus and tone, hard news vs. soft news, the supply from television vs. newspapers--and its effects on individuals--does media coverage of politics serve to educate and engage them or have the opposite effects? Does it increase extant knowledge gaps among the public or close them? And scholars of comparative politics ask the additional questions of whether different media systems across countries, such as a partisan or non-partisan press, or, on television, a strong public service broadcasting tradition versus a plethora of commercial, entertainment-oriented channels makes a difference. The answers to such questions tell us a great deal about the health of a democracy.

However, previous research has come up with a variety of conflicting answers. Why? There are several possible reasons, but among the most likely is that researchers do not always use the most appropriate methods to examine media effects (e.g., often looking at people's media habits but not at the actual content of the coverage they expose themselves to) and that they are not always comparing like with like, i.e., media effects in one country may differ from those in another for very good reason.

In this project we use three publicly available secondary survey data sets--the 2009 European Election Study, 2006, 2008, and 2010 European Social Survey, and 2005-2010 British Election Study Panel--to examine 1) the substantive issue of the relationship between media coverage and political knowledge and engagement, and 2) four different methods to gauge media effects. Our focus is on the traditional media of television news and newspapers; while social media have a role to play their influence is still dwarfed by traditional media. We will link media content data that we have or that are available to each of these surveys in order to estimate the amount of exposure to political information, its subject matter, tone etc. and the consequences for political attitudes and behaviour. These data sets are cross-national, allowing us to examine the interaction of different media systems, characteristics of media content, and individuals.

Our project will show the potential of secondary data for answering fundamental questions about European democracies and the effects of media, particularly timely in an era that spans the worst financial crisis since the Great Depression of the 1930s when there are questions about people's continuing faith in democracy, and when the role of media in contemporary society is under scrutiny through bodies such as the Leveson Inquiry; while also answering the important practical questions of how to apply different methods of estimating media effects, when they are appropriate, the kinds of relationships they uncover, and when and why their findings conflict.

Planned Impact

By linking cross-national media content, political and media systems we are able to understand how both institutions and the information they produce for citizens, influences individual behaviour and thus how changes to institutions and information may affect behaviour. As the media is understood to be a major influence on individual behaviour, this global framework allows us to address the ESRC's strategic priority of influencing behaviour and informing interventions. Based on the research outputs, the proposed secondary data analysis project will produce a set of recommendations on regulatory policy and journalistic practice that will inform debate at EU and national government levels about the roles of public funding, campaign regulation and competition in producing quality information and engaging citizens. In light of ongoing discussions regarding media (e.g. Leveson inquiry), the use of secondary data will allow us to quickly identify and deliver policy recommendations. Beyond regulatory policy recommendation, understanding information and behaviour in context has broad implications for policy prescriptions about behavioural change.

1. Potential Policy and Societal Impact
- Globalisation and economic integration mean that policy makers, commercial and third sector organisations are interested in cross-national comparisons, and even cross-cultural comparisons within a single country. The research findings will contribute towards evidenced based policy making in the area of media regulation. The findings will give clear indications of funding models and the impact of market competition on the production of electorally relevant information. Public broadcasters in particular are interested in fulfilling the remit of informing citizens and can base policy recommendations on the output regarding media systems and information. Furthermore, policy recommendations will emanate regarding engaging citizens in representative democracy that may be of interest to bodies such as the Leveson Inquiry in the UK. These recommendations may also include reforms to the electoral rules. An impact advisor (see Pathways to Impact) will ensure these policy impacts are optimised.

- The user community outside academe is large and diverse. It consists of all those institutions and individuals who have a professional interest in media, media regulation, elections and electoral processes. One segment of this extra-academic user group is centered around political parties: elected office holders, party officials, campaigners, and those working in research institutes and thinktanks connected to political parties. A slightly different group consists of those representing social groups and organised interests and who equally have a stake in the outcome of elections, and sometimes in providing their members with relevant information and advice (labour unions, employers organisations, churches, sundry cause groups, formal lobbyists, etc.). Another component consists of media organisations and journalists who provide audiences (the mass audience as well as more specialised and targeted audiences) with information on elections. Finally there is a plethora of firms (mainly, but not exclusively, SME's) that cater to the rest of the extra-academic user community (market research companies, media an campaign specialists, consultancy firms, etc.).

2. Research Area Impact
Another benefit of the research is to the UK Research Area: The visibility of the UK as a venue for research on matters pertaining to electoral behaviour, electoral representation, the role of the media, the emergence and transformation of party systems and democratization will be promoted. Furthermore, our international collaboration with partners in the US will help to ensure the impact extends beyond the UK. The US partners will be involved in the workshop where we will disseminate our
 
Description For democracies to work two fundamental prerequisites are that their publics must be able to hold those in power accountable and that their electorates cast informed votes. Our project funded under the ESRC's Secondary Data Analysis Initiative asked whether media coverage of politics serve to educate and engage them or have the opposite effects? Does it increase extant knowledge gaps among the public or close them? The answers to such questions tell us a great deal about the health of a democracy. However, previous research which relies on (mostly) survey research and to a lesser extent surveys combined with media content has come up with a variety of conflicting answers. Why? There are several possible reasons, but among the most likely is that researchers do not always use the most appropriate methods to examine media effects (e.g., often looking at people's media habits but not at the actual content of the coverage they expose themselves to) and that they are not always comparing like with like, i.e., media effects in one country may differ from those in another for very good reason.
In this project we used three publicly available secondary survey data sets--the 2009 European Election Study, 2006, 2008, and 2010 European Social Survey, and 2005-2010 British Election Study Panel--to 1)examine the substantive issue of the relationship between media coverage and political knowledge and engagement, and 2) develop and test different methods of gauging media effects with secondary data. All of our analysis combines media content (direct measures of the extent of information available to citizens) with surveys (citizen's self-reports of exposure to news media).
We count our key findings as:
• Using matching procedures and data from 67 elections across Europe, we show that higher levels of electorally relevant information in newspapers tend to increase turnout differences between readers and non-readers. Through causal mediation analysis we show that campaign interest is what drives these differences.
• Using data from the 2009 European Election Study, we demonstrate that the availability of information in the news media about a party increases knowledge about its position, party information in non-quality news reduces this gap more than quality news because those consuming low quality news know less.
• Merging the first 5 rounds of the European Social Survey with a database containing thousands of national events, we demonstrate a greater degree of heterogeneity when it comes to how citizens react to political developments. In particular, some events generate significant opinion changes when groups of individuals who are "treated" are compared to "control" cases. Thus both strong and weak media effects that scholars have uncovered over the years are a function of methodological choices as well as context-specific factors such as institutional arrangements, media-systems, eras, or event characteristics.
- Using media content and survey data from two British elections (2005; 2010) to test the three traditional methods of examining media effects on political preferences. Presenting the methods side-by-side serves as a robustness check for each of these models separately. We find that the substantive results are highly method-dependent illustrating the contextual nature of media effects. Other than thinking of media effects as an one-off phenomenon, we need to think of them as partly conditional on study design features and thus the type of variation under scrutiny.
- In examining the impact of media systems on news coverage, we find that for public service broadcast outlets, the negative impact on both soft news and horse race coverage is lessened when greater electoral competition (the race is closer). Therefore, when there is a competitive electoral situation there is a greater likelihood that an outlet will carry stories about polls on public service broadcasters.
- In a laboratory experiment setting, we were able to establish that misreporting of news exposure derives from habit and leads to both over and underreporting of news attention. Recall of specific details of a news item was aided by altering the question wording.
- Merging the all waves of the European Social Survey with the political events database, our analysis suggest that some events generate significant opinion changes when groups of individuals who are "treated" are compared to "control" cases.
However, other events produce modest or even null findings with methods that employ different counterfactuals. Thus, findings of both strong and weak media effects that
scholars have uncovered over the years could be a function of methodological choices as well as context-specific factors such as institutional arrangements, media-systems, eras, or
event characteristics. Data limitations also make some research designs possible while they preclude others.

We draw two conclusions from the above research:

o Researchers should examine different methods where possible in order to check the robustness of claims of "media effects;
o Many of the contradictory findings result from invalid measures of a survey respondent's exposure to news media.

• Based on the above, we conducted experiments to determine appropriate measures of media exposure. The experiment tested how the form of the question affected over-reporting of exposure and accuracy of recall. We found that the form of the question (specific versus general) did not affect accuracy of reporting. However, the more general question led to over-reporting of media exposure.
Exploitation Route These findings can be by those interested in promoting democratic participation and those more generally interested in examining how media interventions might influence attitudes and behaviour.

In terms of democratic participation, we have demonstrated news information can mobilise citizens via making them more interested in the campaign. Therefore, those wishing to promote greater participation in the electoral process can promote policy initiatives such as increased funding to parties and increased free air time will make elections more competitive, increasing the interest in the campaign and perceived benefits of voting. This increased media coverage will also promote greater knowledge of political parties allowing citizens to make more informed decisions and improving the accountability functions of elections.

In terms of our methodological advances, those using existing surveys to study how exposure to media message influences behaviour and attitudes are encouraged to adopt our strategies of comparing across different methods of within and between subjects design with links to actual media content. Using multiple methods provides a robustness check for effects that are often small and at the same time highly conditional.
Sectors Digital/Communication/Information Technologies (including Software),Environment,Healthcare,Government, Democracy and Justice

URL http://mediaeffectsresearch.wordpress.com
 
Description We envisioned that our research would contribute to enhancing the quality of representative democracy by providing models for mobilizing informed engagement in campaigns and elections. Dan Stevens and Susan Banducci gave written and oral evidence to the Political and Constitutional Reform Committee on media and voter engagement. This evidence was based on research from this project: ? http://data.parliament.uk/writtenevidence/committeeevidence.svc/evidencedocument/political-and-constitutional-reform-committee/voter-engagement-in-the-uk/written/11058.html ? http://www.parliament.uk/business/committees/committees-a-z/commons-select/political-and-constitutional-reform-committee/news/voterengagement7/ The Committee's Fourth Report on Voter engagement in the UK was issued on 14 November, 2014. Our evidence, both written and oral, is cited on pages 11,14, 57 and 72 of this report. We have been less successful in engaging media regulators. We have been unable to engage our initial impact advisor, the BBC's Director of Editorial Policy and Standards, in our dissemination activities. We expect that this impact will develop over time.
First Year Of Impact 2014
Sector Government, Democracy and Justice
Impact Types Societal,Policy & public services

 
Description Citation in Voter engagement in the UK:Fourth Report of Session 2014-15
Geographic Reach National 
Policy Influence Type Citation in other policy documents
URL http://www.publications.parliament.uk/pa/cm201415/cmselect/cmpolcon/232/232.pdf
 
Description ERC Advanced Grant - TWICEASGOOD
Amount € 2,500,000 (EUR)
Funding ID 101019284 
Organisation European Research Council (ERC) 
Sector Public
Country Belgium
Start 01/2022 
End 12/2026
 
Description ESRC Impact Accelerator Account
Amount £3,000 (GBP)
Organisation University of Exeter 
Sector Academic/University
Country United Kingdom
Start 05/2015 
End 04/2016
 
Description Populism's Roots: Economic and Cultural Explanations in Democracies of Europe (PRECEDE)
Amount € 998,700 (EUR)
Funding ID 96 999 
Organisation Volkswagen Foundation 
Sector Charity/Non Profit
Country Germany
Start 07/2020 
End 06/2023
 
Description Small Grant
Amount £9,992 (GBP)
Organisation The British Academy 
Sector Academic/University
Country United Kingdom
Start 09/2015 
End 03/2017
 
Title Information and Turnout in European Elections 
Description This data represents individual responses to survey items from successive European election studies (1999, 2004 and 2009) linked to media content data measuring the amount of news information available to respondents. 
Type Of Material Database/Collection of data 
Year Produced 2014 
Provided To Others? Yes  
Impact The database is used in a paper currently under review. We expect others will apply the model and in their own research and use the data for instructional purposes. 
URL http://mediaeffectsresearch.wordpress.com
 
Title News Exposure Experiments 
Description These data are based on a two-wave experimental study assessing measurements of news exposure. The files include a Stata data file, a do file and a codebook. 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact These data are to be used in a research publication and have led to a request to develop a measure of media exposure for the European Social Survey. 
URL http://mediaeffectsresearch.wordpress.com/research-output/
 
Description Data Citation: You Should Do it 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Lecture to Speed Updating Event

I have been asked to give further presentations on data management, archiving and citation to academic audiences.
Year(s) Of Engagement Activity 2012
URL http://www.exeter.ac.uk/news/events/details/index.php?event=584
 
Description ESRC Secondary Data Analysis Showcase 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Policymakers/politicians
Results and Impact I facilitated the Government & Politics Group at this event hosted by the ESRC. ESRC are holding a showcase of the Secondary Data Analysis Initiative (SDAI) targeted at policymakers in the afternoon of Monday 29th February 2016 at the Royal Institute of Chartered Surveyors, 12 Great George St, London, SW1P 3AD. The event is an opportunity for attendees to learn more about the SDAI and to help shape future research themes and partnerships.

The event will demonstrate the potential for the SDAI to generate policy insights through showcasing the impacts of previous projects. There will also be thematic breakout sessions where delegates will have an opportunity to discuss their research priorities and how SDAI could be used as a mechanism to address them. The aim is to develop ideas for future research themes and proposals that could be submitted to the SDAI in the future in collaboration with partner organisations. The sessions will be led by the interests of attendees but are likely to cover themes such as: Health, Wellbeing and Ageing; Education; Economics and Business; Equality and Social Mobility; Politics and Governance; and International Development.

Speakers include a keynote from Dr Tim Leunig (Chief Scientific Adviser, Department for Education) and SDAI award holders from each of the three phases. Each breakout session will be facilitated by an academic who is part of one of the projects funded under SDAI.
Year(s) Of Engagement Activity 2016
 
Description Final Dissemination Workshop 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Our final project workshop and dissemination event was held in London on 16 June, 2014 at NatCen.
Over 20 participants registered for the event to listen to presentations of three papers from the project. This was followed by a panel discussed which generated discussion on the conduct of research on media across countries. The expert panel was comprised of practitioners from social research agencies and consultancies. They gave feedback on how to structure the research to optimise its impact on policy.

Following this workshop we were contacted about submitting written evidence on media and voter engagement to the Political & Constitutional Reform Committee.
Year(s) Of Engagement Activity 2014
URL http://mediaeffectsresearch.wordpress.com/2014/05/20/media-effects-workshop-in-london-monday-16-june...
 
Description International Women's Day - Empowering Women in Politics 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact As part of the European Parliament's activities to mark International Women's Day, DG EPRS and DG Communication are organising a joint roundtable event which will focus on empowering women in politics, with contributions on the current gender balance in the European Parliament, how media coverage impacted on women candidates standing in the last European elections and concrete steps to improve electoral success for women and reach out to new generations of women hoping to stand for office.Panel members:

Mairead McGUINNESS, Vice-President of the European Parliament;
Dimitrios PAPADIMOULIS, Vice-President of the European Parliament;
Angelika MLINAR, Member of the Committee on Women's Rights and Gender Equality;
Susan BANDUCCI, Professor, University of Exeter;
Maarja LÜHISTE, Lecturer, Newcastle University;
Laura SUDULICH, Senior Lecturer, Kent University.
Year(s) Of Engagement Activity 2017
URL https://epthinktank.eu/2017/03/13/empowering-women-requires-women-in-power/
 
Description PGR Research Training Workshop 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact PGR Training Event hosted by College of Social Science and International Studies
ESRC Data Sets: Secondary Analysis of Qualitative and Quantitative Data
Session leader: Prof Susan Banducci
Analysing existing data sets is a useful way of practicing methods of analysis, developing new insights, validating primary data and broadening the scope of an original study. The ESRC has invested in a number of longitudinal studies and all funded projects are required to archive and share data. These resources offer the researcher great opportunities for exploring existing research and conducting original research. In this workshop we will cover the advantages and approaches to secondary analysis of data, how to find data and how to prepare data for your own project. The workshop will involve practical work.
Year(s) Of Engagement Activity 2016
 
Description Secondary Analysis of Qualitative Data 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact This is an abbreviated set of slides that I have developed for a seminar on secondary analysis of qualitative data. I developed this seminar based on the ongoing research for the SDAI funded project. The aim of the lecture is to illustrate secondary data analysis of qualitative data and exposure students to the range of resources available.

Students searched database for relevant data sets for their own projects.
Year(s) Of Engagement Activity 2014
 
Description Within-Subjects Designs and Matching Methods in Stata 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Presentation given at Q-Step Exeter lanuch event on 20 March, 2014. The talk covered design and research findings from the project.

Generated interest in secondary analysis and generated visits to webpage.
Year(s) Of Engagement Activity 2014
URL http://socialsciences.exeter.ac.uk/q-step/event/