Evidence in interdisciplinary contexts: the value and ethics of randomised controlled trials

Lead Research Organisation: University of Essex
Department Name: Sociology

Abstract

Randomised controlled trials (RCTs) are tests that aim to determine the effectiveness of a wide range of things that play an important role in social life, from the safety of new pharmaceutical drugs, to the benefits of economic policies geared at reducing unemployment rates. Government bodies spend considerable financial resources trying to measure the outcomes of the policies that they fund. Despite this investment, it is often hard to determine the benefit of a specific policy, as many environmental, political or social factors external to the policy itself might have contributed to a policy's outcomes. The unique benefit of RCTs is that they use control groups and techniques of randomisation in order to scientifically determine whether or not a policy has produced a specific outcome or not.

Since the 1940s, RCTs have revolutionized the way we test and regulate new pharmaceutical drugs. More recently, a second major shift has taken place: academic experts in fields beyond medicine have adopted RCT methodologies in order to evaluate different policies in law, justice services and social welfare. In development economics, there has been a growing use of 'field trials' which use principles of randomisation to appraise the effectiveness of policies in, first example, alleviating poverty, curbing discrimination, or empowering local decision-making.

Government practitioners have also embraced RCTs. A 2012 report published by the UK Cabinet Office's Behavioural Insights Team laid out nine steps towards establishing and carrying out more RCTs to inform and formulate domestic policy. It is a similar story at the international level, where standard-setting bodies such as the World Health Organization are becoming increasingly reliant on RCT evidence in order to gauge the effectiveness of different policy approaches to healthcare delivery.

Although much research within anthropology, sociology, public health, philosophy and economics has investigated these challenges, to date there has been very little inter-disciplinary discussion between fields. This series of seminars will enable cross-disciplinary engagement with the various economic, political and ethical questions that are raised by the application of RCTs in different fields of knowledge and practice. For example, in medicine and public health, multiple concerns have been raised in relation to the ethics of withholding a needed drug from a control group on trials; whether the results from one study can apply to patients beyond the participants in a trial; and how best to encourage or to legally force private companies to publically disclose all trial results. The growing uptake of RCTs in economics and public policy both reiterates these challenges and introduces new ones. This series would launch the first major investigation into the different disciplinary uses and challenges raised by RCTs in policy-making.

Planned outputs include several academic articles, two edited journal collections (with both academic and practitioner contributors); practitioner-focused pieces, an interactive website to promote the seminars and upload papers and outputs, Twitter feed and regular blog.

Planned Impact

The seminar series will benefit a wide range of audiences, including government policy-makers, charitable organizations, UK and international funding organizations and think tanks. During the design of this research application, we have communicated closely with staff members and expert advisors at the WHO, Nuffield Council on Bioethics, Medical Research Council, each of whom has welcomed the initiative and agreed to attend and contribute to stakeholders events (see Case for Support).

The following is an indicative list of audiences and stakeholders who will be invited. Some, such as the U.S. National Committee for Responsive Philanthropy, are based outside the UK. These international groups will be kept informed of seminars outputs and discussion through regular online briefings on the seminar series' website. Travel costs have been requested to fund international collaboration and participation at targeted seminars (see Justification of Resources).

Government: David Halpern, advisor, UK Cabinet Office; Sue Kinn; Team Leader and Research Manager, Dfid, Kent Woods, CEO, Medicines and Healthcare Products Regulatory Agency (MHRA); Tim Kendall, Director, National Collaborating Centre for Mental Health; Catherine Elliot, Head of Clinical Research Support and Ethics, MRC

Charities and think-tanks: Annie Duflo, executive director, Innovations for Poverty Action (IPA); Caroline Fiennes, director, Giving Evidence; Aaron Dorfmann, executive director, U.S. National Committee for Responsive Philanthropy; Sue Daniels, executive director, European Association for Philanthropy and Giving; Julian MaCrae, director of research, Institute for Government; Wim Leereveld, CEO, Access to Medicine Foundation.

Funding Organizations: Kevin Moses, Director of Science Funding, Wellcome Trust; Hugh Whittall, director; Nuffield Council for Bioethics; Martin Hynes, Chief Executive, European Science Foundation.

Business community / representatives from academic-private partnerships: Nick Cammack, Head, Medicines Development Campus for Diseases of the Developing World, GSK; Ken Getz, senior fellow, Tufts Center for the Study of Drug Development (CSDD); John Orloff, senior VP, Global Development, Novartis; Amer Alghabban, director, global good clinical practice quality auditing, Merck Serono; Carolyn Garrood, manager, European R&D Outsourcing, Mundipharma Research Limited.

In addition to benefitting from participation in the seminars, practitioners will be catered for via the outputs and impact activities which will include special editions of journals, a dedicated website, a blog, Executive Report and several other items during and after the seminar series (see Pathways to Impact).

Publications

10 25 50
publication icon
Kelly AH (2017) The publics of public health in Africa. in Critical public health

 
Description The central objectives of this grant were to bring together a range of policy makers, scholars and early career researchers in order to explore the social and economic implications of the growing use of randomized controlled trials in development and economic policy making.

As a networking grant, the main goals were oriented at public engagement, and the main findings were a recognition of the growing interdisciplinary interest in establishing more public and scholarly forums for discussing the importance of new methodological tools for studying the impact of development policy.

We established a popular website, www.spacesofevidence.net, and a thriving listserv serving over 100 members. We also established a Facebook page with 130+ members. A total of seven major symposiums / workshops were hosted under the auspices of the grant, in Geneva, Sussex, Essex, Durham and London, Exeter and Edinburgh. In total, 400+ attendees have benefited from the discussions at these symposiums. Currently, two of the series conveners, Dr. Ann Kelly and Dr. Linsey McGoey, are jointly editing a special issue of the journal Economy and Society that features papers drawn from the series workshops. This special issue is currently in press, and will be published in April 2018, with acknowledgements extended to the ESRC.
Exploitation Route We are keen to extend the life the Spaces of Evidence website, which is funded by the ESRC, beyond the funding period of the seminars grant which concluded in October 2016. We hope other scholars and policymakers might continue to this important initiative, and are reaching out to list members to consider longer-term funding possibilities.
Sectors Communities and Social Services/Policy,Creative Economy,Education,Environment,Healthcare,Pharmaceuticals and Medical Biotechnology

URL http://spacesofevidence.net
 
Description Durham Workshop, Space of Evidence - Global Public Health 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The fifth workshop in the Spaces of Evidence, ESRC-funded series took place at Durham, co-organized with the Centre for Humanities Engaging Science and Society. Geared at a mixture of scholars and postgraduates, the discussion featured prominent lectures by two of the ESRC seminar series' international collaboratosr, Amos Laar and John Mahama, both based in Ghana. Focused on the topic of RCTs and normative questions concerning public health, evidence and altruism, the two-day-long workshop took place at the Lindisfarne Centre at St. Aidan's College at Durham University, and led a number of postgraduate students to join the Spaces of Evidence mailing list.
Year(s) Of Engagement Activity 2015
URL https://www.dur.ac.uk/dialogue/signposts/staff/?itemno=25762
 
Description ESRC seminar series launch, Geneva 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact In October 2013, through the support of ESRC seminars funding, the University of Essex jointly hosted a seminar with the World Health Organization. The meeting took place in Geneva, and brought together representatives from ten states, UN agencies, NGOs and national human rights institutions on the theme of "Evidence of human rights impact on health: successes, challenges and next steps". Attendees requested further information about the ESRC seminar series, and we received dozens of requests to the join the seminar series' mailing list, which is managed from the University of Essex.
Year(s) Of Engagement Activity 2013
URL http://blogs.essex.ac.uk/essexdaily/2013/10/25/who_geneva_event/
 
Description Early Career Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact 30 early career scholars attended an ESRC funded Spaces of Evidence workshop carried out at Sussex university in March 2015. The event was organized by three early career members of the Spaces of Evidence network: Daniela Boraschi, Philip Sayer, and Shadreck Mwale, and gave a chance for postgraduate students and postdocs to present work related the ESRC seminars award.
Year(s) Of Engagement Activity 2015
URL http://www.spacesofevidence.net
 
Description Keynote Lecture + Workshop, featuring Angus Deaton 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact In September 2014, under the aegis of the ESRC seminars grant, the grant co-convenors organized a two-day workshop on the topic of "Trials and Tribulations in Economics: New directions for economic policy evidence.' Taking place at Goldsmiths College on September 25-26, the talk featured a keynote from the Nobel Laureate Professor Angus Deaton, Princeton University. Confirmed attendees included a cross-section of academics and policymakers, including participants from the Cabinet Office's Behavioural Insights Team and Shelter, the housing charity. Total attendance was comprised of 40+ scholars and policymakers.
Year(s) Of Engagement Activity 2014
URL http://www.spacesofevidence.net
 
Description UK Launch, ESRC seminar series 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact In March 2014, a mixture of 40+ established academics and early career scholars attend the UK-based launch event for the ESRC seminar series, held at the University of Essex. The meeting, titled "The Trial on Trial: evidence in interdisciplinary contexts" featured nine talks from an interdisciplinary range of speakers, including speakers from Finland and Denmark.
Year(s) Of Engagement Activity 2014
URL http://www.spaceofevidence.net