Impact of school resources and teacher pay across local authorities - a Regression Discontinuity Design

Lead Research Organisation: Institute for Fiscal Studies
Department Name: IFS Research Team

Abstract

The coalition government has recently announced the creation of a disadvantaged pupil premium aimed at reducing the attainment gap between pupils from rich and poor families. A recent White Paper also announced a focus on recruiting and retaining high quality teachers, indeed it was called "The Importance of Teaching." Along with increasing school autonomy, both represent central themes of the new coalition government's schools policy. The proposed research project will address two research questions that are crucial to determining the likely success and appropriate direction of policies in these areas:

1) What are the effects of resources on pupil attainment?
2) How important are monetary rewards in the recruitment and retention of high quality teachers?

The first question is currently the subject of much disagreement amongst researchers, partly because school resources are often themselves determined by measures of educational need. The second question has also been the focus of recent research, with evidence showing the importance of relative wage levels to improving recruitment and retention outcomes. Evidence from the US and UK both further point to the importance of teacher quality in determining pupil attainment. However, there is currently little evidence connecting monetary rewards and the recruitment and retention of high-quality teachers.

The proposed research will bring new evidence to bear on both of these questions, making use of the way funds are distributed across local authorities to account for differences in the cost of living. Specifically, although schools in the London area must pay teachers higher salaries to reflect a higher cost of living, these differences are not always fully reflected in funding differences across local authorities, e.g. both Haringey and Camden must pay teachers according to the same inner London salary scales, but Haringey receives a funding uplift of 9% and Camden an uplift of 28%. Such situations create potentially sharp variations in resources available to schools in neighbouring local authorities. Furthermore, in areas close to local authority boundaries, there is likely to be little difference in the cost of living. We will exploit such situations to estimate the effects of resources on attainment. We will first compare the level of spending per pupil and real resources (e.g. number of teacher) available to schools either side of local authority boundaries, controlling for other possible determinants of resources such as number of pupils eligible for free school meals. We will then examine the consequences of such differences in resources for pupil attainment, controlling for pupil characteristics and prior attainment. We will also test whether the effect of resources is higher or lower for disadvantaged pupils. This evidence will allow us to predict whether the pupil premium is likely to narrow the achievement gap between rich and poor pupils.

To answer the second question we will exploit differences in teacher salaries across local authority boundaries. Teachers are currently paid according to centrally-negotiated pay scales, with higher pay scales in the London area. However, since such weighting applies to particular areas, teacher salaries can vary substantially across boundaries (e.g. a newly qualified teacher in Kingston-upon-Thames can currently expect to be paid £25,200, whilst a few miles away in Surrey they could only expect £22,600). The cost of living is likely to be very similar in areas close to such local authority boundaries, creating sharp geographical variation in real teacher pay levels. We will examine whether such differences in teacher salaries lead to differences in the recruitment and retention of teachers, and how this relates to average teacher quality. This will allow us to say whether monetary incentives are likely to be an effective tool in attracting and keeping high-quality teachers.

Planned Impact

Who will benefit from this research?

Our research will examine whether extra resources can improve educational attainment, and the extent to which pecuniary rewards can be used to attract high-quality teachers. Given the creation of the disadvantaged pupil premium and the new government's focus on recruiting high-quality teachers, the results are likely to be of considerable interest to current education policymakers. Our results will thus also be of interest to academics working in these fields, both in the UK and beyond, and to members of the public keen to engage with the debate. We are likely to be able to predict the extent to which the pupil premium may narrow the achievement gap between rich and poor. We will also be able to provide high-quality evidence on the most effective strategies to recruiting high-quality teachers. Strong positive effects of pecuniary rewards would suggest that policymakers should focus upon teacher pay, whilst an absence of such an effect would suggest a focus on other factors such as the teaching environment.

Furthermore, our research findings will inform the development of a national funding formula and how schools could improve value-for-money in an era of tight budgets. The results are thus also likely to be of strong interest to education professionals.

How will we ensure they benefit?

This is a diverse set of potential beneficiaries. However, IFS has a consistent and strong track record in effective engagement with such audiences and we have used this experience and knowledge to construct a dissemination plan targeted at all of these groups.

We will hold a launch event to publicise the main policy implications of our research findings inviting all individuals on the IFS database, which includes over 2,500 individuals and several hundred public policy figures. We will produce a policy briefing explicitly detailing the implications of our findings, which will be concise, written in plain English and freely available on the IFS website. We will also produce an IFS 'press' release, which would go to interested journalists, as well as other interested parties, such as public, private and third sector organisations. This will further allow us to disseminate the findings via the print and broadcast media. Over the last year, there was an average of 600 references to IFS research in online and print media per month.

We will also exploit personal contacts to publicise the research findings to key policy advisors, civil servants and politicians, such as members of the Education Select Committee, who Sibieta has previously advised on education and school spending.

We will then further publicise our findings via online tools such as the IFS observations page and the IFS twitter account. These can be used as effective tools for influencing public debate at key moments, e.g. two IFS observations were recently the subject of online news articles on the Department for Education's website, including one explicitly related to school funding.

We will present the research findings at key conferences and seminars, targeting both policymakers, education professionals. For instance, in the past year Sibieta has presented research on school funding to groups such as the New Schools Network, Westminster Education Forum and Inside Government (all attended by a diverse range of policymakers and education professionals). We also plan to publicise our findings at academic conferences in the UK an beyond, particularly if they attended by non-academics, such as the Royal Economic Society conference.

To reach a wider academic audience we will ensure that our research papers, when published in working paper format, are widely disseminated. The IFS has a well-established working paper series and an easily-navigable web-site from which such papers can be freely downloaded. Last year, the IFS web page received an average of just over 100,000 visits a month.

Publications

10 25 50
 
Description We investigate whether pupils' attainment in school is affected by higher teacher salaries and extra resources at their school. Previous research has found it difficult to address these policy-relevant questions because there are few circumstances in which teacher salaries and resources vary in ways unrelated to teacher or pupil characteristics.

We overcome this challenge by exploiting the fact that teachers in England are paid according to centrally-negotiated pay scales, with higher pay scales in the London area to compensate teachers for a higher cost of living. At the boundary between higher and lower pay areas, teacher salaries can vary substantially, across otherwise identical neighbouring areas. These pay discontinuities can impact pupil attainment if higher salaries attract more effective teachers, or if existing teachers are induced to work harder. Moreover, in some cases, funding differences are overly generous relative to the salary difference, creating an artificial boost in school resources.

We find no evidence that higher teacher salaries improve pupil attainment. This has important consequences for the design of teacher pay policy. However, there is a significant positive impact on pupil attainment across a teacher pay boundary only where additional funding received by schools permits additional school resources. This suggests that higher levels of school resources can have modest impacts on pupil attainment, in line with recent evidence from the UK. These findings also give cause for optimism about the potential impacts of the pupil premium.
Exploitation Route In order to understand the mechanisms driving our findings, we plan to make use of newly available data on employees within schools (School Workforce Census). This will allow us to examine whether schools respond to these discontinuities by changing their pay policies. Secondly, we will be able to relate the (lack of) difference in attainment to actual differences in inside wages across schools. This has not been addressed at all in existing research. We have been formally granted access to use this data. However, this was only after a significant delay in approval by the Department for Education and delivery of the data continues to be delayed.

Our work has also enabled to us to present and interact with important groups of education policymakers. For instance, Sibieta presented analysis of future plans for school funding reform at the Westminster Education Forum in September 2013 (see ROS). Sibieta spoke at a Royal Statistical Society event at the Houses of Parliament in December 2013 about using data to provide insight into education policy. We also participated in a workshop about the large improvements in attainment in London over the past 5-10 years. Our work comparing the characteristics and outcomes at schools across London was invaluable in allowing us to contribute to discussions on this topic with policymakers.

This grant has also allowed us to develop wider expertise on teacher pay and conditions. This has enabled us to successfully apply for further funding to study the costs and benefits of different teacher training routes (PI: Ellen Greaves) and the changing fortunes of the public sector workforce more generally (PI: Luke Sibieta). Both grants are detailed on ROS.
Sectors Communities and Social Services/Policy,Education,Government, Democracy and Justice

 
Description Our interim findings were first presented at two academic seminars at the IFS and the Institute of Education in December 2012 (both on ROS). The feedback from these two seminars helped our investigation of the large difference in observable characteristics across some of the pay boundaries. It also cemented our focus on the difference in inside wages across schools. We have also sought to discuss and compare these findings with academics working on related issues (e.g. Gibbons et al, 2012; and Britton and Propper, 2012). Our main findings are detailed in a draft working paper that has been uploaded to ROS. We have chosen not to publish our findings to date due to methodological concerns resulting from the non-comparability of schools at the inner London boundary. We plan to publish this working paper in September 2013, alongside a non-technical briefing note. This will allow us to include analysis of the inside wage differential once access to the School Workforce Census has been granted. The start of a new academic year (with changes to teacher pay and conditions) will be an ideal time to publicise our findings.
First Year Of Impact 2012
Sector Communities and Social Services/Policy,Education,Government, Democracy and Justice
Impact Types Societal,Economic,Policy & public services

 
Description Public Sector Workforce: Changing Fortunes
Amount £117,250 (GBP)
Funding ID 1209004 
Organisation Joseph Rowntree Foundation (JRF) 
Sector Charity/Non Profit
Country United Kingdom
Start 01/2012 
End 12/2014
 
Description Public Sector Workforce: Changing Fortunes
Amount £117,250 (GBP)
Funding ID 1209004 
Organisation Joseph Rowntree Foundation (JRF) 
Sector Charity/Non Profit
Country United Kingdom
Start 01/2012 
End 12/2014
 
Description The future outlook for disadvantage gaps: London Schools and lessons for social mobility
Amount £25,745 (GBP)
Organisation Government of the UK 
Department Social Mobility and Child Poverty Commission
Sector Public
Country United Kingdom
Start 01/2014 
End 12/2014
 
Description Constrained optimisation? Teacher salaries, school resources and student achievement 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact This presentation was delivered at the Workforce quality in the public sector workshop on 19 February 2016 at the Institute for Fiscal Studies.
Year(s) Of Engagement Activity 2016
URL http://www.ifs.org.uk/publications/8187
 
Description Does offering higher teacher salaries improve pupil attainment? 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This was an observation published on the IFS website, which describes the key findings and policy implications of our working paper on teacher pay (W14/03) Link to observation as published: http://www.ifs.org.uk/publications/7127

Link to observation as published: http://www.ifs.org.uk/publications/7127
Year(s) Of Engagement Activity 2014
URL http://www.ifs.org.uk/publications/7127
 
Description Effect of teacher pay on pupil attainment: a regression discontinuity design 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Presentation at PEUK Conference, June 2013
Year(s) Of Engagement Activity 2013
 
Description Effect of teacher pay on pupil attainment: a regression discontinuity design 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Work in progress seminar presentation
Year(s) Of Engagement Activity 2013
 
Description Effect of teacher pay on pupil attainment: a regression discontinuity design (IoE Seminar) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Work in progress seminar
Year(s) Of Engagement Activity 2013
 
Description Fairness in School Funding 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Presentation at the Westminster Education Forum
Year(s) Of Engagement Activity 2014
 
Description Fairness in School Funding 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Presentation to key group of policymakers analysing upcoming school funding reforms in 2013-14
Year(s) Of Engagement Activity 2013
 
Description IFS Research on Education 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Seminar organised for Shadow Education Secretary, Tristram Hunt MP, to illustrate key findings from IFS research on education. We paid particular emphasis to research on resources and teachers
Year(s) Of Engagement Activity 2014
 
Description Meeting with DfE Advisor 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Meeting with advisor to the Department for Education to discuss school funding reform Discussion of options for school funding reform

Discussion of options for school funding reform
Year(s) Of Engagement Activity 2013
 
Description School Funding Reform 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Presentation at IFS Briefing on the 2013 Spending Round
Year(s) Of Engagement Activity 2013
 
Description School Funding Reform for 2015 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Meeting with DfE civil servants to discuss options for school funding reform Discussion of the relative merits of different options for school funding reform

Discussion of the relative merits of different options for school funding reform
Year(s) Of Engagement Activity 2013
 
Description School Funding in 2015-16 and Beyond 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presentation at the National Fair Funding Conference 2013
Year(s) Of Engagement Activity 2013
 
Description Spotlight: are London's schools top of the class? 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation paper presentation
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Seminar on the performance of schools in London
Year(s) Of Engagement Activity 2013
 
Description Using data to inform education policy 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Presentation to key policymakers about how data can be most effectively used to provide insight for policy. This uses the case study of the pupil premium
Year(s) Of Engagement Activity 2013