Putting Cognitive Science to Work in the Legal System: An Evidence Based Approach to Testimony Evaluation and Beyond

Lead Research Organisation: UNIVERSITY OF EXETER
Department Name: Law School

Abstract

This programme of research will focus on using methods from law, psychology, and neuroscience to examine how the credibility, accuracy, and overall reliability of eye-witness accounts are assessed in the criminal justice system, and to design new practice and procedure to enhance the accuracy of such evaluations. The research will examine decisions of the Criminal Cases Review Commission (CCRC) and lay decision-makers (jurors) and will be conducted in collaboration with practitioner partners. As part of this research a new "Cognitive Science and Empirical Law" laboratory will be created in collaboration with the Centre for Criminal Appeals, to promote the integration of cognitive science into legal practice more generally. This has the potential to transform the administration of justice by replacing old and outdated traditions with evidence-based practice and procedure.

The first stage of the research will examine how laypeople and the Criminal Cases Review Commission (CCRC) evaluate the testimony of others in the current system, and where such evaluations are likely to agree or disagree with assessments based on scientific evidence. Research will include (i) identifying common assumptions that are made by jury-eligible adults and the CCRC when evaluating testimony, and the extent to which these assumptions are consistent scientific understanding, (ii) using psychological theory and experimental research to identify situations in which assessments of witness accounts are likely to be based on misunderstandings or failure to incorporate relevant information into decision-making, and (iii) using tools from psychology and neuroscience to examine the cognition underlying assessments of testimony and how certain assumptions or biases may be associated with underlying neural mechanisms.

The second stage of the research will assess current practice and procedure, and formulate recommendations for practice and procedure based on findings from the first stage of the research and relevant psychological theory. Importantly, research suggests that informing decision-makers of relevant science may not be sufficient to improve the effectiveness of their evaluations, and more nuanced interventions are likely to be needed. All interventions will be designed in consultation with current legal practitioners and tested in mock trials. This distinguishes the work from much existing research in psychology and law, which has not combined in-depth examination of memory and decision-making with the design of improved legal procedure and has been incorporated into the legal system in ways that are not proven to have desired effects (e.g. through judicial warnings).

The final stage of the research programme will focus on integrating my findings into current legal practice in order to have a direct impact. This will include working with practitioners, designing legal arguments, and utilizing statistical techniques such as network analyses to identify the interventions that are likely to be most effective.

A "Cognitive Science and Empirical Law" laboratory will be created in order to facilitate this research and also to promote the integration of cognitive science and empirical law into legal practice more generally. This laboratory will conduct independent research, and will also work in collaboration with the Centre for Criminal Appeals to conduct research that will directly benefit current casework. Trained student research assistants will assist with research in the laboratory. This will serve to facilitate the integration of science and the law in future scientists and legal practitioners.

Planned Impact

By enhancing our understanding of how testimony is currently evaluated and how testimony evaluation can be improved, and by facilitating the integration of cognitive science research into the legal system, this project promises a significant contribution to the criminal justice community both nationally and internationally. The project has the potential to dramatically reduce wrongful conviction and to minimize systematic failures to successfully prosecute defendants in cases in which testimony is often the primary evidence including sexual assaults, offences against children, and domestic violence. This impact will be achieved in a number of ways.

First, impact will be achieved through the production of model guidelines to be used by the Criminal Cases Review Commission (CCRC, who examine new evidence following a conviction to identify potential miscarriages of justice) when evaluating testimony. These model guidelines will be developed using cognitive science research, and will facilitate evaluations that are consistent with current scientific understanding. Guidelines will be tested in experimental research and developed following consultations with practitioners from the CCRC. This will ensure the guidelines are not only scientifically supported, but also feasible to apply in practice, and will thus ensure maximum impact.

Second, the project will identify weaknesses of current courtroom procedure involving juror evaluation of testimony and will develop suggestions for new practice and procedure to increase the accuracy of juror evaluations. Consultations with lawyers in the criminal justice system will take place throughout the research project in order to ensure that developed solutions are practical and address current weaknesses from their perspective. Concrete policy recommendations relating to criminal procedure will also be made.

Third, through identifying weaknesses in current procedure and incorrect assumptions that are typically made, the research may help to identify cases in which a defendant was wrongfully convicted. Although the research may not in itself provide a basis for an appeal, it may be used by organisations such as the Centre for Criminal Appeals when selecting potential miscarriages of justice to investigate further. The Center for Criminal Appeals will be consulted as part of this project, in order to understand testimony evaluation from their perspective and to ensure the work is useful to them.

Finally, the project's broader aim of promoting and facilitating the integration of scientific knowledge into the legal system, particularly through the creation of a Cognitive Science and Empirical Law laboratory, will have important applied impact in the criminal justice system. The laboratory will collaborate with the Center for Criminal Appeals, who will refer issues arising in current cases that are in need of appropriate empirical research, to the laboratory. In this way the laboratory can conduct research that will be directly useful in legal cases, bridging the gap between academic research and legal practice.

Publications

10 25 50
 
Description We are not yet half way into the grant but have made some important findings, as detailed below.
1. We have quantified and logged wrongful convictions and their causes in England and Wales.
2. We have provided new insight into the role of prior probability estimates on jury decisions, what these estimates look like, and how they might influence juror evaluations of testimony.
3. We have designed and tested promising new instructions that could be given to jurors to improve their evaluations of identification evidence.
4. We have discovered a new cognitive ability in matching, relevant to forensic science disciplines.
Exploitation Route My database of wrongful convictions highlighting known wrongful convictions and their causes is already being used by practitioners and researchers internationally.
My experimental work is beginning to provide insight that will be translated into policy suggestions over the next 1-2 years.
I have been invited to contribute to a number of parliamentary or select committee inquiries based on my work, and so the work is also contributing to policy in that way.
Sectors Government, Democracy and Justice

URL https://evidencebasedjustice.exeter.ac.uk/
 
Description Findings from my work have been used by practitioners, including third sector organisations, in representing their clients. My publicly available database of miscarriages of justice is used extensively by practitioners including third sector organisations such as APPEAL, academics, and the general public. Since the beginning of this year (i.e. over the last 2.5 months) it has had 16,693 visitors, averaging about 250 visitors a day. My work on guilty pleas (not the central focus of the grant but part of the grant work and run out of the new lab funded by UKRI) has been cited in a significant policy report by Fair Trials International (https://www.fairtrials.org/articles/publications/efficiency-over-justice/), and also in submissions to Parliament both by myself and by others drawing on my work (https://www.fairtrials.org/app/uploads/2022/02/Judicial-Review-and-Courts-Bill-Briefing-on-Child-Defendants-PDF.pdf). Whether the work has influenced the decisions Parliament will make is currently not known. I have also been asked to provide (by a lawyer) and have provided a statement to the Criminal Cases Review Commission regarding a potential significant miscarriage of justice. Again, the outcome of the application to the Criminal Cases Review Commission is not yet known.
First Year Of Impact 2022
Sector Government, Democracy and Justice
Impact Types Societal,Policy & public services

 
Description Cited in and supported briefing for parliamentarians on Judicial Review and Courts Bill
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
URL https://www.fairtrials.org/app/uploads/2022/02/Judicial-Review-and-Courts-Bill-Briefing-on-Child-Def...
 
Description Submission to Judicial Review and Courts Bill Public Bill Committee
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
 
Description Submission to Justice Select Committee on Open Justice
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
URL https://committees.parliament.uk/writtenevidence/40822/pdf/
 
Description Submission to the Investigation and Prosecution of Rape Home Affairs Committee
Geographic Reach National 
Policy Influence Type Contribution to a national consultation/review
URL https://committees.parliament.uk/writtenevidence/42126/pdf/
 
Description Professional Pathologies, Causal Pathways and the Post Office Miscarriages of Justice
Amount £974,629 (GBP)
Funding ID ES/X005453/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 07/2023 
End 07/2026
 
Title Miscarriages of Justice Database 
Description Searchable database containing details of error of fact miscarriages of justice from 1970 to today. 
Type Of Material Database/Collection of data 
Year Produced 2021 
Provided To Others? Yes  
Impact Has only been released recently, but should be useful for those working in criminal justice and specifically those working in criminal appeals. 
URL https://evidencebasedjustice.exeter.ac.uk/miscarriages-of-justice-registry/the-cases/
 
Description Expert advisor to APPEAL project 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact I am an expert advisor on the advisory panel for APPEAL's project on majority verdicts and racial discrimination, funded by the Baring Foundation. My role has involved advising on gathering and analysing data relating to jury decisions.
Year(s) Of Engagement Activity 2022
 
Description Expert advisor to Fair Trials International Project 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact I was an expert advisor to a Fair Trials International project on guilty pleas in young adults. My role involved advising on methodology, interpretation of research findings, and conclusions.
Year(s) Of Engagement Activity 2022
 
Description External project advisory group formed 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I have established a formal working group for my project and have been working with them to develop engagement plans for the project.
Year(s) Of Engagement Activity 2020
 
Description Interview by Wall Street Journal 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I was interviewed by the Wall Street Journal about expert evidence relating to witness testimony, with a specific focus on the Ghislaine Maxwell trial.
Year(s) Of Engagement Activity 2021
URL https://www.wsj.com/articles/ghislaine-maxwell-trial-will-put-memories-of-jeffrey-epstein-accusers-o...
 
Description Interview with BBC File on 4 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact I was interviewed as part of a BBC File on 4 programme looking into evidence retention in criminal cases.
Year(s) Of Engagement Activity 2022
URL https://www.bbc.co.uk/programmes/m0013zpl
 
Description Interview with Le Parisien 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I was interviewed by Le Parisien about the miscarriage of justice known as the Post Office Scandal.
Year(s) Of Engagement Activity 2022
URL https://www.leparisien.fr/faits-divers/scandale-des-postiers-accuses-a-tort-de-vols-au-royaume-uni-s...
 
Description Keynote address at Fair Trials International Policy Report Launch 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact I was invited to deliver and did deliver a keynote address at the launch of a Fair Trials International policy report on trial waiver systems in Europe.
Year(s) Of Engagement Activity 2021
 
Description Law Commission Talk (Lightning Session) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact I gave a talk on how designing evidence-based instructions can help improve jury decision making, specifically focused on evaluations of testimony.
Year(s) Of Engagement Activity 2021
 
Description New public-facing website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact I launched a public-facing website with a blog and accompanying infographics to make the site accessible for a variety of end users including policy-makers, lawyers, defendants and victims in the criminal justice system, and academics. The site includes infographics helping users to navigate a large registry of miscarriages of justice created and catalogued on the site, and accessible data on miscarriages of justice, guilty pleas, and online justice procedures. The site has been viewed by over a hundred users so far in including users in the UK, USA, Canada, Australia, and the Czech Republic.
Year(s) Of Engagement Activity 2021
URL https://evidencebasedjustice.exeter.ac.uk/
 
Description Presentation at Innocence Project International Virtual Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact I was selected as one of four academic speakers at the Innocence Projects Conference "Just Data: Advancing the Innocence Movement." The conference was live streamed on YouTube and has been watched by over a thousand people.
Year(s) Of Engagement Activity 2022
URL https://www.youtube.com/watch?v=cnZjf7eoCTM&t=1s
 
Description Talk to Criminal Cases Review Commission 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact I was invited to deliver a talk on my work on miscarriages of justice and guilty pleas to the Criminal Cases Review Commission (a statutory organisation responsible for reviewing potential miscarriages of justice and deciding whether to refer cases back to the Court of Appeal).
Year(s) Of Engagement Activity 2021
 
Description Talk to Youth Practitioners Association 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact I gave a talk on my work (specifically the cognitive science underlying guilty pleas in children) to the Youth Practitioners Association.
Year(s) Of Engagement Activity 2021
 
Description Two podcasts with OnRecord 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact I was interviewed twice for two podcasts with OnRecord, discussing guilty pleas, psychology and law, and the jury system.
Year(s) Of Engagement Activity 2021,2022
URL https://www.youtube.com/watch?v=zE1Bi2S-_zU