Exploring the Nature of Ethnic Disparities in Sentencing through Causal Inference
Lead Research Organisation:
University of Leeds
Department Name: Law
Abstract
Few principles are more fundamental to a liberal society than equality under the law, and few public acts epitomise that principle more clearly than sentencing hearings. Understandably, the study of ethnic disparities in sentencing has attracted vast research efforts. Empirical studies have shown how offenders from ethnic minority groups tend to receive harsher punishments than white offenders after committing similar crimes. These disparities have been documented in great detail; being corroborated across jurisdictions, offence types, and sentence outcomes. However, one key question remains: can such disparities be taken as evidence of discrimination?
Research based on real cases cannot randomise offenders by their ethnicity, hence, how do we know that those disparities are not due to unobserved relevant case characteristics? For example, we would expect to see differences in sentence severity for similar crimes committed by black and white offenders if white offenders are shown to plead guilty more often than black offenders. The analytical response to this problem has been to 'control for' any relevant case characteristics. But what if those differences are based on case characteristics - such as offender dangerousness - that cannot be easily measured, nor controlled for? And, what if those case characteristics are not neutrally defined but subject to potential discriminatory practices? These are important methodological questions that remain unresolved. Here, we suggest using the new sentencing datasets made available by Administrative Data Research UK, and some of the latest sensitivity analysis techniques developed by epidemiologists to overcome this methodological impasse.
Sensitivity analysis is used to test the robustness of findings in contexts where key research assumptions are likely violated. The most famous example of this dates back to the 'smoking cause lung cancer' debate, which dragged on for decades because of the absence of experimental evidence. This was until Cornfield et al. (1959) demonstrated that the effect of any relevant unobserved factors (e.g. genes predisposing to nicotine craving while simultaneously carcinogenic) ought to be unrealistically high in order to explain the observed associations between lung cancer and smoking. We suggest following a similar approach here. Rather than uncritically dismissing ethnic disparities because of their inability to make perfect 'like with like' comparisons, we pose the following question: what should the strength of the unobserved relevant case characteristics be to explain away the ethnic disparities observed? Estimating that threshold will allow us to make a more informed judgement regarding whether the observed ethnic disparities represent evidence of discrimination.
Beyond their academic merit, the questions to be explored in this project are of fundamental interest to all criminal justice agencies. Various elements of the project, including its research questions, have been co-designed in collaboration with representatives of the England and Wales Bar Association, Sentencing Council, Crown Prosecution Service, and Sentencing Academy, which feature amongst the project's external partners. As a result, our findings will be directly relevant and available to the key policy-makers in charge of monitoring and redressing ethnic disparities in our jurisdiction. Ultimately, this project will help enhance the public debate around ethnic disparities in the criminal justice system throughout the nation. Regardless of the findings obtained, undertaking an independent and unprecedentedly robust examination of ethnic disparities in sentencing will increase transparency in the criminal justice system, signalling integrity and contributing to restore public trust.
Research based on real cases cannot randomise offenders by their ethnicity, hence, how do we know that those disparities are not due to unobserved relevant case characteristics? For example, we would expect to see differences in sentence severity for similar crimes committed by black and white offenders if white offenders are shown to plead guilty more often than black offenders. The analytical response to this problem has been to 'control for' any relevant case characteristics. But what if those differences are based on case characteristics - such as offender dangerousness - that cannot be easily measured, nor controlled for? And, what if those case characteristics are not neutrally defined but subject to potential discriminatory practices? These are important methodological questions that remain unresolved. Here, we suggest using the new sentencing datasets made available by Administrative Data Research UK, and some of the latest sensitivity analysis techniques developed by epidemiologists to overcome this methodological impasse.
Sensitivity analysis is used to test the robustness of findings in contexts where key research assumptions are likely violated. The most famous example of this dates back to the 'smoking cause lung cancer' debate, which dragged on for decades because of the absence of experimental evidence. This was until Cornfield et al. (1959) demonstrated that the effect of any relevant unobserved factors (e.g. genes predisposing to nicotine craving while simultaneously carcinogenic) ought to be unrealistically high in order to explain the observed associations between lung cancer and smoking. We suggest following a similar approach here. Rather than uncritically dismissing ethnic disparities because of their inability to make perfect 'like with like' comparisons, we pose the following question: what should the strength of the unobserved relevant case characteristics be to explain away the ethnic disparities observed? Estimating that threshold will allow us to make a more informed judgement regarding whether the observed ethnic disparities represent evidence of discrimination.
Beyond their academic merit, the questions to be explored in this project are of fundamental interest to all criminal justice agencies. Various elements of the project, including its research questions, have been co-designed in collaboration with representatives of the England and Wales Bar Association, Sentencing Council, Crown Prosecution Service, and Sentencing Academy, which feature amongst the project's external partners. As a result, our findings will be directly relevant and available to the key policy-makers in charge of monitoring and redressing ethnic disparities in our jurisdiction. Ultimately, this project will help enhance the public debate around ethnic disparities in the criminal justice system throughout the nation. Regardless of the findings obtained, undertaking an independent and unprecedentedly robust examination of ethnic disparities in sentencing will increase transparency in the criminal justice system, signalling integrity and contributing to restore public trust.
Organisations
Publications
Pina-Sánchez J
(2022)
Ethnic Disparities in Sentencing: Warranted or Unwarranted?
Veiga A
(2022)
Racial and ethnic disparities in sentencing: What do we know, and where should we go?
in The Howard Journal of Crime and Justice
Title | Compilation of sentencing datasets across Europe |
Description | We co-organised an online workshop to share sources of sentencing data available across different European jurisdictions. We recruited participants from 12 different jurisdictions, who shared the characteristics and access protocols of the sentencing datasets from their jurisdictions. |
Type Of Material | Improvements to research infrastructure |
Year Produced | 2024 |
Provided To Others? | Yes |
Impact | We have documented a wide range of new cross-jurisdictional sentencing research projects being discussed as a result of our workshop. |
URL | https://empiricalresearchonsentencing.wordpress.com/events/ |
Title | R code to conduct sensitivity analysis for missing data |
Description | This is the code developed to facilitate undertaking sensitivity analysis for missing data in individuals' ethnicity, under a different range of missing data scenarios. |
Type Of Material | Improvements to research infrastructure |
Year Produced | 2023 |
Provided To Others? | Yes |
Impact | A number of participants in our ESRC workshop have reported having used this code to facilitate sensitivity analyses for missing data in similar questions of disparities in health and criminal justice settings. |
URL | https://github.com/sggi-76/Missing_data_sensitivity_tutorial |
Description | ESRC Research Methods e-Festival workshop |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Postgraduate students |
Results and Impact | Workshop showing how to undertake sensitivity analysis to assess the robustness of estimates of ethnic disparities in sentencing to problems of missing data in offenders' ethnicity. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.ncrm.ac.uk/training/RMeF2023/programme/ |
Description | I was invited presentation from the Ministry of Justice |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | I was invited to present the findings from this project at the Ministry of Justice 'Areas of Research Interest Seminar Series'. There were over 100 researchers and policy makers from the Ministry of Justice attending the event in person and online. |
Year(s) Of Engagement Activity | 2022 |
Description | I was invited to give a public lecture at De Monfort University (Leicester) entitled: 'Assessing the Robustness of the Evidence on Ethnic Disparities in Sentencing' |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Undergraduate students |
Results and Impact | I gave a public talk in the main auditorium of de Monfort University. The talked covered the different forms of evidence pointing at discriminatory practices in the Crown Court. |
Year(s) Of Engagement Activity | 2022 |
URL | https://www.dmu.ac.uk/about-dmu/events/events-calendar/2022/october/contemporary-issues-in-sentencin... |
Description | Invitation to present at the Seminario de Investigacion Criminologica Concepcion Arenal |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Other audiences |
Results and Impact | Jose Pina-Sánchez was invited to speak at the international seminar of the centre for Criminal Justice studies at the Universidad de Girona. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.udg.edu/ca/grupsrecerca/scpic/seminari-concepcion-arenal |
Description | Invitation to present at the launch event of the report: Equality and diversity in the work of the Sentencing Council |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | Jose Pina-Sánchez was invited to present his critique of the report commissioned for the Sentencing Council for England and Wales on equality and diversity. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.nottingham.ac.uk/sociology/events/event-details/2022-23/sentencing-council-report-launch... |
Description | Invitation to talk at the Leeds Institute for Data Analytics - Societies, launch event |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | Jose Pina-Sánchez was invited to present at the launch event of the Leeds Institute for Data Analytics - Societies. |
Year(s) Of Engagement Activity | 2023 |
URL | https://lida.leeds.ac.uk/annual-showcase-2023/societies/ |
Description | Panel presentation entitled: 'Ethnic Disparities in Sentencing?', delivered at the European Society of Criminology |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Other audiences |
Results and Impact | I chaired this panel and delivered a short presentation entitled: 'Ethnic Disparities in Sentencing: Warranted or Unwarranted?'. The panel was attended by approximately 40 academics. |
Year(s) Of Engagement Activity | 2022 |
Description | Provided evidence to the House of Commons Justice Committee inquiry on the subjects of public opinion of sentencing and sentencing disparities |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | I was invited to participate in a roundtable discussion with the House of Commons Justice Committee to provide evidence in relation to their inquiry on Public Opinion and Understanding of Sentencing. I took this opportunity to suggest strategies to reduce sentence severity and ethnic disparities. |
Year(s) Of Engagement Activity | 2022 |
Description | Sentencing Disparities Symposium |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Other audiences |
Results and Impact | We organised a 2-day symposium on disparities in sentencing, bringing together academics, practitioners and policy makers from across Europe. |
Year(s) Of Engagement Activity | 2023 |
URL | https://empiricalresearchonsentencing.files.wordpress.com/2023/03/program_disparities-symposium-1.pd... |
Description | Virtual Study Group - Maths for Justice |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Study participants or study members |
Results and Impact | Jose Pina-Sánchez led a three-day Virtual Study Group with the Institute for Mathematical Innovation on the theme of 'Disparities in Criminal Justice Decision-Making' |
Year(s) Of Engagement Activity | 2023 |
URL | https://imibath.ac.uk/news/maths-for-justice-virtual-study-group/ |