Encouraging the unemployed into sustained work: experimental evidence from the UK and the US

Lead Research Organisation: National Institute of Economic and Social Research
Department Name: National Institute of Economic & Soc Res

Abstract

In seeking to increase the employment rate in the UK, labour market policy has traditionally focused on encouraging employment entry. However, many people who leave benefit enter poorly-paid, insecure employment and before long have once again returned to welfare. For individuals stuck in such a 'low pay, no pay' cycle, labour market prospects are poor, the opportunity for progression is constrained and the risk of poverty is high. For policymakers, there are additional concerns to do with efficient functioning of the labour market and social mobility.

In view of this, there is a clear interest in encouraging those who enter work to remain in work. In both the UK and Texas, the possibility of using time-limited earnings supplements to achieve this has been trialled. The intuition behind offering support for a limited period of time rather than on an ongoing basis (as with tax credits) is that people face particular challenges as they move from benefit to employment but, if they can complete the transition successfully, their chances of remaining in work are greatly increased. Consequently, it is during the transition period that such support is most needed and this argues in favour of time-limited intervention.

While there is strong evidence that such supplements increase employment, the crucial question of how these increases arise is not well-understood. If they are due solely to more people entering work, this would indicate a failure of supplements to achieve their aim of improving retention and so the benefits that might flow from remaining longer in work - increased employment stability, skill acquisition, earnings growth, career advancement etc - are unlikely to be realised. If, on the other hand, the increases are largely attributable to more people remaining in work, this would point to the effectiveness of the supplements in supporting individuals in the early months of new employment (when the risk of job loss is highest) and suggest that such policies have the potential to address the 'low-pay, no-pay' cycle, thereby improving upward mobility in the labour market.

The first aim of the proposed study is to identify whether the positive employment effects found when trialling time-limited earnings supplements in the UK are due to increased employment retention or to increased employment entry. A similar investigation for the case of Texas will also be carried out. The results for the UK and Texas will be of interest in their own right since very little related evidence exists, but a comparison of the results may be particularly informative about whether the findings can generalise to other settings.

The second aim of the study is to understand the reasons for the differences between the UK and Texas in the effectiveness of time-limited earnings supplements for lone parents (most welfare recipients in Texas were lone parents). We will use an innovative technique to identify similar subgroups in the UK and Texas according to their estimated probability of employment in the absence of the earnings supplement. We will use impact estimates for these subgroups to explore the question of what impact the kind of supplements trialled in Texas would have had in the UK and, conversely, what impact the kind of supplements trialled in the UK would have had in Texas. This approach offers the potential to reduce the influence of observed and unobserved variation when making cross-country comparisons and so may be of use to other researchers.

Planned Impact

The proposed study builds on large-scale evaluations that have been funded by the Department for Work and Pensions (DWP) in the UK and the Department of Health and Human Services (HHS) and the Department of Labor (DOL) in the US. Consequently, these departments have an immediate interest in the project. The results of the analysis will provide insights into the effect of time-limited earnings supplements on employment retention. Very little evidence exists on this internationally so policy makers in other countries may also find the results of the analysis informative, particularly if there is some evidence of common effects across the UK and Texas.

Equipping policy-makers with high-quality information increases the likelihood that labour market policy can be developed in such a way that the 'low pay, no pay' cycle is broken. If it can assist the formulation of appropriate policy in this way, the research may prove beneficial ultimately to those individuals and families with only a weak attachment to the labour market. If policy can be effectively developed in order to increase their employment retention and consequently their resilience in work, significant benefits will result, for example: improved employment prospects, greater earnings, more rewarding work, higher standard of living and improved social mobility. Benefits felt at the broader level would include a more efficient labour market and a more skilled workforce, as individuals increase their experience and knowledge.

The work has the potential to have an immediate and long-lasting impact on policy. The applicant and his US partners have a long history of working with the DWP, the HHS and the DOL. In order to raise the profile of the research with UK policy-makers, a seminar at DWP will be arranged, with H.M. Treasury and other interested departments invited. The research will also be presented at the Work and Pensions Labour Economics conference (which is sponsored by the DWP) in order to disseminate more broadly across interested government officials.
 
Description This project examined the extent to which the positive impacts of ERA in Texas and the UK were attributable to increased employment retention rather than increased employment entry. The interest in this question stems from the fact that if individuals can be helped to stay longer in work, they can gain valuable work experience, acquire new skills, increase their earnings, enjoy greater employment stability and so on. If, on the other hand, increased overall employment resulted largely from increased employment entry, ERA would have done little to address the low-pay no-pay cycle.

In the UK, ERA was found to increase unemployment exit but not to affect retention. Prolonged unemployment spells can damage longer-term prospects. By shortening unemployment spells, ERA had a more prolonged effect on the long-term unemployed (Dorsett, 2014)

The US trials were in Corpus Christi and Forth Worth. In Corpus Christi, the sustained positive impact on employment was due to both employment retention and employment entry effects but the retention effect faded over time. In Fort Worth, there were smaller effects. There was some indication that employment retention might have been improved, but only in the short-term (Dorsett, Hendra and Robins, 2014).

Comparing lone parents in the UK and the US, the larger impacts in the US cannot be explained by differences in observed characteristics. Rather, unobserved characteristics appear important; ERA worked better for those who would otherwise be slower to enter work and less well for those who would otherwise be slower to leave work. The fact that these groups are present in different proportions in Texas and the UK accounts for much of the difference in observed impacts.

We also found that, in the UK, ERA impacts were greater in offices that emphasised in-work advancement, support while working and financial bonuses for sustained employment, and also in those offices that assigned more caseworkers to ERA participants. Offices that encouraged further education
had smaller employment impacts (Dorsett and Robins, 2014).

We provide some evidence that providing temporary support in this way may harm well-being in the long-run (Dorsett and Oswald, 2014).

Lastly, we have examined the sensitivity of experimental results to the data used to estimate impacts. We have explored why estimates based on survey data can give different results from those based on administrative data and, in doing so, have highlighted the need to pay attention to the possibility that data features may influence the statistical properties of an RCT.
Exploitation Route The results provide some guidance for the development of policy. They highlight the difficulty of increasing retention. However, ERA-type interventions have been shown to have positive impacts. The findings identify particular features of ERA in the UK that were associated with effectiveness. The results caution that such interventions may have unexpected negative impacts on well-being. This is an important finding and suggests that relevant evidence from other studies should be examined. Lastly, our exploration of data issues highlights the need for those carrying out experiments to pay close attention to the characteristics of the underlying data.
Sectors Government, Democracy and Justice

 
Description Can temporary in-work support help the long-term unemployed enter sustained work? 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact More than 9,000 reads. Picked up and covered by the Wall Street Journal - http://blogs.wsj.com/economics/tag/richard-dorsett/. Contacted by senior policymaker, pleased to see the follow-on analysis of a large government intervention.

This was dissemination activity.
Year(s) Of Engagement Activity 2013
URL http://www.voxeu.org/article/temporary-work-support-and-long-term-joblessness
 
Description Helping the long-term unemployed 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Blog post on the NIESR website based on the additional analysis of UK ERA carried out as part of this ESRC project. Approximately 800 reads.

Dissemination
Year(s) Of Engagement Activity 2013
URL http://niesr.ac.uk/blog/helping-long-term-unemployed
 
Description In-work benefits and human well-being: a randomized controlled trial 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The paper has been presented at IZA Bonn, City University, London (HM Treasury) and universities of Oslo, Oxford, Paris, Sussex, Warwick and UCL and J-PAL.




The results have been picked up and discussed in three independent blogs:

http://www.economist.com/blogs/freeexchange/2014/03/work-benefits
http://stumblingandmumbling.typepad.com/stumbling_and_mumbling/2014/02/policy-the-aspirations-gap.html
http://inequalitiesblog.wordpress.com/2012/07/19/when-social-policy-goes-wrong/
Year(s) Of Engagement Activity 2013,2014,2015
 
Description Invited seminar at the Danish National Centre for Social Research, Copenhagen. Presented the paper: The effect of temporary in-work support on employment retention: evidence from a field experiment 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact First presentation of the paper examining the employment entry and employment retention effects of the Employment Retention and Advancement demonstration. The discussion of the paper and its results prompted some revisions to the analysis.

The purpose of the talk was to disseminate and invite comment. The paper was revised in the light of the discussion.
Year(s) Of Engagement Activity 2013
 
Description Invited seminar at the IFS: Comparing the employment effects of time-limited in-work support in Texas and the UK - an analysis of two experiments 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Presentation at the Institute for Fiscal Studies on 8 July 2013. Findings from a comparison of the Employment Retention and Advancement demonstrations in Texas and the UK. The focus of the presentation was on understanding the reasons behind the stronger effects in Texas than in the US. The presentation raised some questions over the methodological approach, which has influenced revisions to the paper.

Dissemination
Year(s) Of Engagement Activity 2013
 
Description Public policy conference (New Mexico) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact I presented a paper entitled "Administrative and Survey Data in the UK Employment Retention and Advancement Demonstration" at the 2014 APPAM Fall Research Conference (https://appam.confex.com/appam/2014/webprogram/start.html). This was part of a panel entitled "Survey Data Versus Administrative Data in Evaluation". It subsequently led to a article published in "Evaluation Review".
Year(s) Of Engagement Activity 2014
URL https://appam.confex.com/appam/2014/webprogram/Paper9287.html