BIG IDEAs: Using Randomised Controlled Trials to Reduce Bias in the Workplace

Lead Research Organisation: University of Exeter
Department Name: Economics

Abstract

Discrimination and social inequalities continue to pervade the workplace. The UK's Gender Pay Gap website, Equal Pay Day and the global #MeToo movement are but a few examples that highlight the growing awareness of deeply-embedded structural inequalities against women at work. These inequalities come about in part because of conscious and unconscious biases held against women - but it isn't just women who suffer. Bias is rife in the workplace towards other disadvantaged groups such as ethnic and racial minorities, people from lower socioeconomic backgrounds and the LGBTQ+ community. Although recognition of these problems is growing, businesses struggle to find solutions to level the playing field. What can we do to help reduce inequality and discrimination at work?

Through the UKRI Future Leaders Fellowship (FLF) hosted at the University of Exeter, my goal is to use causal interventions to reduce bias workplace to help create more equality at work. This project leverages the latest insights from across economics, psychology and management to design interventions that will be tested in large-scale randomised controlled trials (RCTs) within several UK organisations. These interventions will lead to a better working knowledge of how we create more fairness in the workplace, disseminated through the public-facing Centre for Behavioural Insights: Gender, Inclusivity, Diversity, Equality and Access ("BIG IDEAs") at the University of Exeter.

Gender bias is now a well-recognised phenomenon and many organisations try to tackle this problem through "unconscious bias" training. However, there is little evidence that this training works towards the advancement of women and, if anything, it can backfire, giving those completing it the false impression that they are "cured" of unconscious bias (Dobbin & Kalev 2016; Atewologun et al. 2018).

The problem in fact goes much deeper: bias is often deeply ingrained in our minds and affected, even amplified, by the institutions and social environment in which we live (Thaler & Sunstein 2008). A combination of conscious and unconscious bias have likely negatively affected the career developments of women (Bohnet 2016; Sheltzer & Smith 2014). But these biases extend also to other disadvantaged groups: workers from racial or ethnic minorities often face discrimination in the workplace, too; and so do individuals from a lower socioeconomic background (Bertrand & Mullainathan 2004; Stephens et al. 2019). My research agenda takes a comprehensive view of bias at the workplace, studying and aiming to reduce bias against these disadvantaged groups.

This project is the first to test novel interventions (possible solutions) through multiple, longitudinal RCTs inside organisations. It goes beyond the study of surveys which have looked at correlations of bias and work outcomes; instead, I propose to actually introduce and causally test interventions to reduce bias to create a more equal workplace on the ground, observing the actual hiring, promotion, and retention outcomes of disadvantaged groups.

This kind of research thrives through collaboration and co-creation with organisations. Some of my partner organisations are among the largest UK employers, including Unilever, a pioneer in addressing gender inequality. Others are start-ups and consultancies, including the Behavioural Insights Team, GapSquare and MoreThanNow, who work with influential clients who want to overcome bias against disadvantaged groups.

In sum, my research aims to test co-created interventions in the workplace to reduce bias against disadvantaged groups and contribute to a more equal society.

References: Atewologun et al (2018), Equality Human Rights Commission. Bertrand & Mullainathan (2004), AER 94(4), 991-1013. Bohnet (2016), What works, HUP. Dobbin & Kalev (2016), HBR. Thaler & Sunstein (2008), Nudge, YUP. Sheltzer & Smith (2014), PNAS 111(28) 10107-12. Stephens et al (2019), Curr Dir Psych Sci 28(1), 67-73.

Planned Impact

Who might benefit from this research?

(1) Disadvantaged groups
(2) My partner organisations: Unilever, BIT, GapSquare and MoreThanNow
(3) Corporate and non-profit organisations
(4) Government Equalities Office
(5) Equality and Human Rights Commission
(6) Harvard Gender Action Portal
(7) All-Party Parliamentary Group on Women and Work
(8) Financial Conduct Authority
(9) Advocacy groups
(10) Activists

How will they benefit from this research?

Disadvantaged groups (including but not limited to women, ethnic and racial minorities, people with low socio-economic background, and people with protected characteristics) are the main beneficiaries of this research. My research will improve the status quo for these groups who may have experienced bias and discrimination in the workplace: they will benefit by being treated more fairly, getting hired and receiving promotions adequately by organisations who use the insights from this research.

Similarly, my research will also have benefits for corporate and non-profit organisations (especially my partner organisations) who are interested in hiring and fostering the best talent. First, these organisations can learn where in their organisational process bias exists. My research will result in step-by-step guides (including off-the-shelf code) to enable organisations to identify bias in their hiring and promotion practices. Organisations who use these tools can see at which point in their pipeline a "bottleneck"-potentially caused by bias-occurs.

Second, organisations who already know they have a problem with bias against certain groups can benefit from this research by testing potential solutions to remove bias. They can use these insights through user-friendly resources I will offer: for example, booklets that give clear guidance on how to implement the tested intervention, or by signing up to a tailored workshop that I will offer through the University of Exeter's Centre for BIG IDEAs. By restructuring their hiring and promotion processes, they will hire and promote without bias, which results in a workforce that thrives in the organisation because of their achievements, not their demographic characteristics.

On the policy side, the UK Government Equalities Office (GEO) and the Equality and Human Rights Commission (EHRC) will be major beneficiaries of my research. My research will inform their future research reports and guidance on new legislation which have a combined reach to several million people. Other policy-related groups who will benefit from this research include the Harvard Gender Action Portal (GAP), the UK All-Party Parliamentary Group (APPG) on Women and Work and the Financial Conduct Authority (FCA). GAP maintains a repository of practical advice for policy-makers on how to reduce gender inequality, which my research can directly contribute to. The APPG brings together parliamentarians of all parties to discuss issues relating to women and the workplace. The APPG can benefit as my research brings recent data and evidence into their debates. In its 2017/2018 annual report, the FCA states that the "Diversity and Inclusion agenda is central to how the FCA acts, both as an employer and as a regulator" (FCA, 2018, p.4). Keen to work with researchers and be transparent about its goals and data (p. 10), the FCA would benefit from my research by bringing it into its own organisation and into its work with UK firms and consumers.

The final beneficiaries comprise of advocacy groups and activists who care about equality for all genders, ethnicities, LGBTQ+ and other disadvantaged communities. A lot of advocacy and activism is based on principles of equality and human rights, but there is not always consensus on what practical steps to take to reduce bias or discrimination. My research will benefit these advocates and activists by providing practical and evidence-based advice that they can propose to their target audience (e.g. legislators, MPs or firms).

Publications

10 25 50

publication icon
Waldfogel HB (2021) Ideology selectively shapes attention to inequality. in Proceedings of the National Academy of Sciences of the United States of America

 
Description Strategic Priorities Fund - Training grant
Amount £565 (GBP)
Organisation University of Exeter 
Sector Academic/University
Country United Kingdom
Start 02/2021 
End 05/2021
 
Description Strategic Priorities Fund - Training grant
Amount £375 (GBP)
Organisation University of Exeter 
Sector Academic/University
Country United Kingdom
Start 02/2021 
End 05/2021
 
Description Behavioural Insights Team 
Organisation Behavioural Insights Team
Country United Kingdom 
Sector Public 
PI Contribution We have helped partner organisations across four key areas: (i) identifying priority areas for tackling gender inequality and the relevant data needed to identify problems; (ii) identifying gender gaps in the data by looking at applications, performance ratings, promotions and salary; (iii) co-creating intervention that can be trialled to reduce the gender gaps, and (iv) trialling the intervention in the priority areas identified. Due to partnership agreements, we are not allowed to name individual organisations in relationship to the specific work we are doing with them at this point (until the research is complete and they have signed off on being named). However, to give an overview and some context: we have worked with one organisation on identifying unequal promotion opportunities across managers and piloting an intervention to decrease those promotion inequalities, with another organisation on identifying gender gaps in self-evaluations and manager evaluations and trialling an intervention to close self-evaluation gender gaps, and with yet another organisation on identifying gender gaps in their employees' salaries and co-creating an intervention to reduce the gender pay gap.
Collaborator Contribution BIT have invested time and effort into introducing us to partner organisations which we are currently exploring for a research partnership.
Impact Our conversations regarding a research partnership with a large insurance company were in large part due to BIT introducing us.
Start Year 2020
 
Description Ericsson 
Organisation Ericsson
Country Sweden 
Sector Private 
PI Contribution We have helped partner organisations across four key areas: (i) identifying priority areas for tackling gender inequality and the relevant data needed to identify problems; (ii) identifying gender gaps in the data by looking at applications, performance ratings, promotions and salary; (iii) co-creating intervention that can be trialled to reduce the gender gaps, and (iv) trialling the intervention in the priority areas identified. Due to partnership agreements, we are not allowed to name individual organisations in relationship to the specific work we are doing with them at this point (until the research is complete and they have signed off on being named). However, to give an overview and some context: we have worked with one organisation on identifying unequal promotion opportunities across managers and piloting an intervention to decrease those promotion inequalities, with another organisation on identifying gender gaps in self-evaluations and manager evaluations and trialling an intervention to close self-evaluation gender gaps, and with yet another organisation on identifying gender gaps in their employees' salaries and co-creating an intervention to reduce the gender pay gap.
Collaborator Contribution Ericsson have granted us access to de-identified employee data to analyse and learn from.
Impact We have a working paper (privately distributed) available at this point.
Start Year 2020
 
Description Ringier/EqualVoice 
Organisation Ringier
Country Switzerland 
Sector Private 
PI Contribution We have helped partner organisations across four key areas: (i) identifying priority areas for tackling gender and racial inequality and the relevant data needed to identify problems; (ii) identifying gender and racial gaps in the data by looking at applications, performance ratings, promotions and salary; (iii) co-creating intervention that can be trialled to reduce the gender gaps, and (iv) trialling the intervention in the priority areas identified. Due to partnership agreements, we are not allowed to name individual organisations in relationship to the specific work we are doing with them at this point (until the research is complete and they have signed off on being named).
Collaborator Contribution Ringier have granted us access to historic data as part of their EqualVoice campaign. They have also given us access to the subsidiaries EqualVoice factor tool which measures women being featured in media outlets.
Impact BIG IDEAs have access to a large set of data regarding gender of those featured by media outlets, and are in the process of analysing it and creating future projects now.
Start Year 2022
 
Description UKRI 
Organisation United Kingdom Research and Innovation
Country United Kingdom 
Sector Public 
PI Contribution We have helped partner organisations across four key areas: (i) identifying priority areas for tackling gender inequality and the relevant data needed to identify problems; (ii) identifying gender gaps in the data by looking at applications, performance ratings, promotions and salary; (iii) co-creating intervention that can be trialled to reduce the gender gaps, and (iv) trialling the intervention in the priority areas identified. Due to partnership agreements, we are not allowed to name individual organisations in relationship to the specific work we are doing with them at this point (until the research is complete and they have signed off on being named). However, to give an overview and some context: we have worked with one organisation on identifying unequal promotion opportunities across managers and piloting an intervention to decrease those promotion inequalities, with another organisation on identifying gender gaps in self-evaluations and manager evaluations and trialling an intervention to close self-evaluation gender gaps, and with yet another organisation on identifying gender gaps in their employees' salaries and co-creating an intervention to reduce the gender pay gap.
Collaborator Contribution UKRI have granted us access to de-identified employee data to analyse and learn from.
Impact We have a working paper (privately distributed) available at this point.
Start Year 2021
 
Description Unilever 
Organisation Unilever
Country United Kingdom 
Sector Private 
PI Contribution We have helped partner organisations across four key areas: (i) identifying priority areas for tackling gender inequality and the relevant data needed to identify problems; (ii) identifying gender gaps in the data by looking at applications, performance ratings, promotions and salary; (iii) co-creating interventions that can be trialled to reduce the gender gaps, and (iv) trialling the intervention in the priority areas identified. Due to partnership agreements, we are not allowed to name individual organisations in relationship to the specific work we are doing with them at this point (until the research is complete and they have signed off on being named). However, to give an overview and some context: we have worked with one organisation on identifying unequal promotion opportunities across managers and piloting an intervention to decrease those promotion inequalities, with another organisation on identifying gender gaps in self-evaluations and manager evaluations and trialling an intervention to close self-evaluation gender gaps, and with yet another organisation on identifying gender gaps in their employees' salaries and co-creating an intervention to reduce the gender pay gap.
Collaborator Contribution Unilever middle and senior managers have provided us with key insights to problems faced by large organisations in respect to hiring and promotion of diverse talent. They have granted us access to de-identified employee data to analyse and learn from. They have guaranteed an in kind contribution through our collaboration agreement.
Impact Harvard Business Review article on our work implementing a variant of the Gender Proportionality Principle at Unilever. We have a data sharing agreement in place
Start Year 2020
 
Description Article in Harvard Business Review 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Along with co-authors Siri Chilazi and Iris Bohnet, Oliver Hauser wrote an article explaining how the proportion of women drops at every level of an organisation, and putting forward our Gender Proportionality Principle as a step towards tackling this inequality. The article was published in the Harvard Business Review which has a readership of up to 250,000.
Year(s) Of Engagement Activity 2021
URL https://hbr.org/2021/11/achieving-gender-balance-at-all-levels-of-your-company
 
Description BIG IDEAs launch event 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact BIG IDEAs held its launch event virtually on 7th October 2021. Professor Iris Bohnet gave the keynote speech. There were 30 attendees from 12 different organisations and several organisations reported back to their respective teams what they had learnt. This event sparked interest in our research and organisational interest in being an official partner of BIG IDEAs.
Year(s) Of Engagement Activity 2021
 
Description BIG IDEAs website 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Our website has been live since February 2021 and we have had over 900 views as well as three inquiries wanting to engage with us in a research partnership, using our contact form from interested industry and academic potential partners. There is also section of the website called 'Toolkit' specifically aimed at policy makers in organisations and across broader society.
Year(s) Of Engagement Activity 2021
URL https://www.big-ideas-initiative.co.uk
 
Description Discussion about Technology to Advance Gender Equality at Davos 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact I was invited to be a speaker on a panel with the topic: 'Breaking Barriers with AI: A Discussion about Technology to Advance Gender Equality.' at the World Economic Forum Annual Meeting in Davos, moderated by Mark Walder (CEO of Ringier AG). This led to a new partnership with Ringier and their project EqualVoice.
Year(s) Of Engagement Activity 2022
 
Description EHRC Statutory review evidence submission 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact I submitted our paper 'Reducing discrimination against job seekers with and without employment gaps' to EHRCs review of evidence on the state of equality in Great Britain. This will help shape recommendations for dealing with inequality.
Year(s) Of Engagement Activity 2022
 
Description Economic and Social Inequality Panel 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact As part of a University of Exeter open day to secondary school students Oliver Hauser was asked to be a member on the Economic and Social Inequality panel. The panel generated engagement from the pupils and Oliver responded to several questions.
Year(s) Of Engagement Activity 2021
 
Description London Business School talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Oliver was invited to give a talk on successes and failures in academic publishing and general advice and mentoring to a group of PhD students at London Business School. The PhD students reported increased interest in inequality and how we can address it.
Year(s) Of Engagement Activity 2022
 
Description Panel on Gender and Racial Discrimination 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact 100 people from 20+ different universities attended the virtual Panel on Gender and Racial Discrimination we co-hosted. Oliver Hauser moderated the event and the panellists were: Professors Iris Bohnet (Harvard University), George-Levi Gayle (Washington University in St. Louis), Alex Imas (University of Chicago), and Michelle Ryan (University of Exeter). Several attendees asked about the BIG IDEAs initiative and the event was also uploaded to YouTube as attendees had asked to share it. The panel has over 100 views on YouTube so far.
Year(s) Of Engagement Activity 2021
URL https://www.youtube.com/watch?v=4OxsV8tDsqQ&t=1s
 
Description Podcast for Austria's Agency for Education and Internationalisation 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Schools
Results and Impact During the podcast I spoke about the BIG IDEAs project and what we are trying to achieve with it.
Year(s) Of Engagement Activity 2021
URL https://oead.at/en/news/article/2021/11/default-f9096cdad0