Equally Safe Online

Lead Research Organisation: Heriot-Watt University
Department Name: S of Mathematical and Computer Sciences

Abstract

We address the timely topic of online gender-based violence (GBV): Almost 1 in every 2 women and non-binary people (46%) reported experiencing online abuse since the beginning of COVID-19 (Glitch report, 2020). Our aim is to create 'equally safe' online spaces by prevention, intervention and support for online GBV through the development of advanced Machine Learning algorithms.

In contrast to previous research in this area, our team will include experts on GBV and online harassment to ensure that we frame the problem in a way which is most helpful to victims/survivors of GBV. In other words, we not only focus on *how* to automatically detect online abuse, but also re-think *what* it is we need to detect, how we can *support* the victims and how to *prevent* online GBV through promoting digital citizenship (i.e. prevention and intervention aimed at perpetrators and bystanders).

Our methodology is based on the Scottish Government's Equally Safe strategy and implements a Responsible Innovation Approach in a close collaboration with 3rd sector charities with a long-standing track record in this domain. Our proposal aims to create the following impacts:
1. Create longterm technical solutions to support safer online spaces, including advanced abuse detection tools, tools to automatically generate counter narratives aimed at perpetrators and bystanders, and a chatbot for providing proactive support to victims/survivors.
2. Promote 'equitable' algorithms which are able to reflect multiple perspectives/viewpoints and not marginalise minority views;
3. Increase digital literacy concerning the safe use of social media from an early age.
 
Title GBV-Resources 
Description This repository serves as a comprehensive collection of resources for the automated identification of online Gender-Based Violence (GBV) and related phenomena. 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? Yes  
Impact Research paper describing the repository available at https://aclanthology.org/2023.woah-1.17/ 
URL https://github.com/HWU-NLP/GBV-Resources
 
Description Collaboration with Charities on Gender Based Violence (Y1) 
Organisation End Violence Against Women
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution The 3 main charities (End Violence Against Women (EVAW), The Glitch, and EmilyTest) engage in supporting victims of Gender-based Violence, campaigning, and policymaking at the local government (Scotland) and UK level. One of the named researchers on the project (Poppy Gerrard-Abbott) has been previously working for EmilyTest and is leading the effort of coordinating workshops and focus groups with the partners in particular to co-create an online GBV taxonomy.
Collaborator Contribution The involvement of the 3 main charities is a key component of the project, which requires the contribution of experts in GBV (rather than Computer Science experts) to help co-create the online GBV taxonomy and dataset annotations.
Impact - 1 half-day workshop with an emphasis on giving feedback on the first draft of the online GBV taxonomy (see also the relevant outcome on the portfolio).
Start Year 2022
 
Description 1st Workshop on online GBV Taxonomy 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact 1st workshop (half-day; September 2023) with the experts from the 3 main charities only (End Violence Against Women (EVAW), The Glitch, and EmilyTest) that engage in supporting victims of Gender-based Violence, campaign and policymaking at the local government (Scotland) and UK level. The main objectives were to receive feedback on the first draft of the online GBV taxonomy that the award-holder institute (Heriot-Watt) and main partner (University of Edinburgh) had been working on during Y1 of the project. The feedback we received influenced the next steps:
a) Change the focus of the online GBV taxonomy we had established thus far to the respective parts of "textual expressions" and "cultural microaggressions" of the pyramid of discrimination and violence, rather than the extremes of it, i.e., "physical expression" and attitudes and beliefs.
b) (ongoing as of the time of submission of this outcome) Conduct several small focus groups of experts beyond the 3 main charity partners to help validate the framework. The focus groups comprise mostly experts "on the street" that directly support victims of GBV such as rape, or bereaved families.
b) identify the appropriate online venues for sourcing data of online GBV for detection annotation,
c) conduct initial discussions (only applicable from Y2 and on) on how to further recruit GBV experts from the charities for judging existing counter speech strategies.
Year(s) Of Engagement Activity 2023
 
Description 2nd Workshop on Perspectivist Approaches to NLP (NLPerspectives 2023) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact This full-day workshop was held at the European Conference on AI (ECAI) in Krakow, Poland on the 30th September 2023. It was attended by 42 researchers and featured a keynote and panel featuring international guests. Nine research papers were presented including five archival papers published in the workshop proceedings at https://ceur-ws.org/Vol-3494/
Year(s) Of Engagement Activity 2023
URL https://nlperspectives.di.unito.it/w/2nd-workshop-on-perspectivist-approaches-to-nlp/
 
Description Invited Talk at Archimedes Summer School 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Invited talk on risks of Generative AI for Question Answering with respect to faithfulness and trust. The audience was mostly early-year PhD students in Greece that were taking part on the 2-day event of the summer school. The talk created a lot of debate given the controversial nature of Generative AI and potential harms, and resulted in follow-up meetings with two students.
Year(s) Of Engagement Activity 2023
URL https://archimedesai.gr/en/two-day-workshop-on-natural-language-processing
 
Description Invited talk at Google Deep Mind, London 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact An invited talk at the Sociotechnical AI Research group, Google Deep Mind. Led to a lively discussion on fairness and ethics in NLP with industry practitioners.
Year(s) Of Engagement Activity 2023
 
Description Invited talk at Napier University School of Computing 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact An invited talk for academics and postgradute students working on NLP. This led to a paper on participatory design in NLP which we are currently working on in collaboration with Napier University.
Year(s) Of Engagement Activity 2023
 
Description Invited talk at the National Robotarium 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact An invited talk presenting recent work related to the Equally Safe Online and Gender Bias in Conversational Agents projects. Attended by members of faculty, students and members of the public.
Year(s) Of Engagement Activity 2023
 
Description Kickoff meeting with Core Charity partners 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Kickoff meeting of the project with all the stakeholders including the 3 main charities (End Violence Against Women (EVAW), The Glitch, and EmilyTest) that engage in supporting victims of Gender-based Violence, campaign and policymaking at the local government (Scotland) and UK level. The main outcome was to receive guidance and steer the award-holder institute (Heriot-Watt) and main academic partner (University of Edinburgh) toward the primary goals of the project:
a) establish the correct methodology for creating the Online GBV framework,
b) identify the appropriate online venues for sourcing data of online GBV for detection annotation,
c) conduct initial discussions (only applicable from Y2 and on) on how to further recruit GBV experts from the charities for judging existing counter speech strategies.
Year(s) Of Engagement Activity 2023
 
Description The 1st Workshop on CounterSpeech for Online Harms (CS4OA) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The workshop was collocated with the 24th meeting of SIGDial (Special Interest Group on Discourse and Dialogue), and brought together researchers form computer science and experts in policy surrounding tackling online abuse and hate speech. Eight research papers were presented along with two invited keynote talks and a panel discussion.
Year(s) Of Engagement Activity 2023
URL https://sites.google.com/view/cs4oa