Exploring the Nature of Ethnic Disparities in Sentencing through Causal Inference

Lead Research Organisation: University of Leeds
Department Name: Law

Abstract

Few principles are more fundamental to a liberal society than equality under the law, and few public acts epitomise that principle more clearly than sentencing hearings. Understandably, the study of ethnic disparities in sentencing has attracted vast research efforts. Empirical studies have shown how offenders from ethnic minority groups tend to receive harsher punishments than white offenders after committing similar crimes. These disparities have been documented in great detail; being corroborated across jurisdictions, offence types, and sentence outcomes. However, one key question remains: can such disparities be taken as evidence of discrimination?

Research based on real cases cannot randomise offenders by their ethnicity, hence, how do we know that those disparities are not due to unobserved relevant case characteristics? For example, we would expect to see differences in sentence severity for similar crimes committed by black and white offenders if white offenders are shown to plead guilty more often than black offenders. The analytical response to this problem has been to 'control for' any relevant case characteristics. But what if those differences are based on case characteristics - such as offender dangerousness - that cannot be easily measured, nor controlled for? And, what if those case characteristics are not neutrally defined but subject to potential discriminatory practices? These are important methodological questions that remain unresolved. Here, we suggest using the new sentencing datasets made available by Administrative Data Research UK, and some of the latest sensitivity analysis techniques developed by epidemiologists to overcome this methodological impasse.

Sensitivity analysis is used to test the robustness of findings in contexts where key research assumptions are likely violated. The most famous example of this dates back to the 'smoking cause lung cancer' debate, which dragged on for decades because of the absence of experimental evidence. This was until Cornfield et al. (1959) demonstrated that the effect of any relevant unobserved factors (e.g. genes predisposing to nicotine craving while simultaneously carcinogenic) ought to be unrealistically high in order to explain the observed associations between lung cancer and smoking. We suggest following a similar approach here. Rather than uncritically dismissing ethnic disparities because of their inability to make perfect 'like with like' comparisons, we pose the following question: what should the strength of the unobserved relevant case characteristics be to explain away the ethnic disparities observed? Estimating that threshold will allow us to make a more informed judgement regarding whether the observed ethnic disparities represent evidence of discrimination.

Beyond their academic merit, the questions to be explored in this project are of fundamental interest to all criminal justice agencies. Various elements of the project, including its research questions, have been co-designed in collaboration with representatives of the England and Wales Bar Association, Sentencing Council, Crown Prosecution Service, and Sentencing Academy, which feature amongst the project's external partners. As a result, our findings will be directly relevant and available to the key policy-makers in charge of monitoring and redressing ethnic disparities in our jurisdiction. Ultimately, this project will help enhance the public debate around ethnic disparities in the criminal justice system throughout the nation. Regardless of the findings obtained, undertaking an independent and unprecedentedly robust examination of ethnic disparities in sentencing will increase transparency in the criminal justice system, signalling integrity and contributing to restore public trust.
 
Title Compilation of sentencing datasets across Europe 
Description We co-organised an online workshop to share sources of sentencing data available across different European jurisdictions. We recruited participants from 12 different jurisdictions, who shared the characteristics and access protocols of the sentencing datasets from their jurisdictions. 
Type Of Material Improvements to research infrastructure 
Year Produced 2024 
Provided To Others? Yes  
Impact We have documented a wide range of new cross-jurisdictional sentencing research projects being discussed as a result of our workshop. 
URL https://empiricalresearchonsentencing.wordpress.com/events/
 
Title R code to conduct sensitivity analysis for missing data 
Description This is the code developed to facilitate undertaking sensitivity analysis for missing data in individuals' ethnicity, under a different range of missing data scenarios. 
Type Of Material Improvements to research infrastructure 
Year Produced 2023 
Provided To Others? Yes  
Impact A number of participants in our ESRC workshop have reported having used this code to facilitate sensitivity analyses for missing data in similar questions of disparities in health and criminal justice settings. 
URL https://github.com/sggi-76/Missing_data_sensitivity_tutorial
 
Description ESRC Research Methods e-Festival workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Workshop showing how to undertake sensitivity analysis to assess the robustness of estimates of ethnic disparities in sentencing to problems of missing data in offenders' ethnicity.
Year(s) Of Engagement Activity 2023
URL https://www.ncrm.ac.uk/training/RMeF2023/programme/
 
Description I was invited presentation from the Ministry of Justice 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact I was invited to present the findings from this project at the Ministry of Justice 'Areas of Research Interest Seminar Series'.
There were over 100 researchers and policy makers from the Ministry of Justice attending the event in person and online.
Year(s) Of Engagement Activity 2022
 
Description I was invited to give a public lecture at De Monfort University (Leicester) entitled: 'Assessing the Robustness of the Evidence on Ethnic Disparities in Sentencing' 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact I gave a public talk in the main auditorium of de Monfort University.
The talked covered the different forms of evidence pointing at discriminatory practices in the Crown Court.
Year(s) Of Engagement Activity 2022
URL https://www.dmu.ac.uk/about-dmu/events/events-calendar/2022/october/contemporary-issues-in-sentencin...
 
Description Invitation to present at the Seminario de Investigacion Criminologica Concepcion Arenal 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Jose Pina-Sánchez was invited to speak at the international seminar of the centre for Criminal Justice studies at the Universidad de Girona.
Year(s) Of Engagement Activity 2023
URL https://www.udg.edu/ca/grupsrecerca/scpic/seminari-concepcion-arenal
 
Description Invitation to present at the launch event of the report: Equality and diversity in the work of the Sentencing Council 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Jose Pina-Sánchez was invited to present his critique of the report commissioned for the Sentencing Council for England and Wales on equality and diversity.
Year(s) Of Engagement Activity 2023
URL https://www.nottingham.ac.uk/sociology/events/event-details/2022-23/sentencing-council-report-launch...
 
Description Invitation to talk at the Leeds Institute for Data Analytics - Societies, launch event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Jose Pina-Sánchez was invited to present at the launch event of the Leeds Institute for Data Analytics - Societies.
Year(s) Of Engagement Activity 2023
URL https://lida.leeds.ac.uk/annual-showcase-2023/societies/
 
Description Panel presentation entitled: 'Ethnic Disparities in Sentencing?', delivered at the European Society of Criminology 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I chaired this panel and delivered a short presentation entitled: 'Ethnic Disparities in Sentencing: Warranted or Unwarranted?'. The panel was attended by approximately 40 academics.
Year(s) Of Engagement Activity 2022
 
Description Provided evidence to the House of Commons Justice Committee inquiry on the subjects of public opinion of sentencing and sentencing disparities 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact I was invited to participate in a roundtable discussion with the House of Commons Justice Committee to provide evidence in relation to their inquiry on Public Opinion and Understanding of Sentencing.
I took this opportunity to suggest strategies to reduce sentence severity and ethnic disparities.
Year(s) Of Engagement Activity 2022
 
Description Sentencing Disparities Symposium 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact We organised a 2-day symposium on disparities in sentencing, bringing together academics, practitioners and policy makers from across Europe.
Year(s) Of Engagement Activity 2023
URL https://empiricalresearchonsentencing.files.wordpress.com/2023/03/program_disparities-symposium-1.pd...
 
Description Virtual Study Group - Maths for Justice 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Study participants or study members
Results and Impact Jose Pina-Sánchez led a three-day Virtual Study Group with the Institute for Mathematical Innovation on the theme of 'Disparities in Criminal Justice Decision-Making'
Year(s) Of Engagement Activity 2023
URL https://imibath.ac.uk/news/maths-for-justice-virtual-study-group/