Investigating public discourses around decision-making algorithms using a combined computational and discursive language analysis approach

Lead Research Organisation: University of Nottingham
Department Name: School of Computer Science

Abstract

This project examines the scope for investigating the discourse surrounding public-facing decision-making algorithms using an interdisciplinary lens. Public-facing decision-making algorithms aim to increase productivity and enable more efficient and informed decision-making. Examples include the UK's Covid-19 digital contact-tracing application and the Ofqual A Level automated algorithm used in 2020. These work without supervision and had impact on United Kingdom citizens. Investigating trust in Autonomous Systems is critical for the development of future artificial intelligence technologies as they become more relevant to our daily lives. The Trustworthy Autonomous Systems Hub adopts Devitt's view that Autonomous Systems must be trustworthy by design and perception.

The collection of opinions here will act as validation or signpost the need for alternative exploration. To analyse the views expressed, computational linguistic methods - including topic modelling, sentiment analysis and emotion detection - may be deployed. These can be non-intrusive and cost-effective, as opposed to interviews or experiments. A source of data may be social media, notably Twitter, as many who have been affected by these algorithms offer opinions on this public-access site, providing a large data set that Twitter's API can analyse in real-time.

However, these methods show limited awareness of the discursive and conversational ways in which opinions on decision-making algorithms are discussed on social media, which should be accounted for to understand this in further detail. Through initial work, popular computational linguistic methods' shortcomings include issues with the classification of negation, sarcasm and irony and difficulty in interpretation. A new approach may overcome these shortcomings by combining computational linguistic and sociolinguistic analytical methods, such as corpus linguistics and discourse analysis, where context plays an important role. Creating a hybrid approach to analysing the discourse surrounding public-facing decision-making algorithms may produce better quality insights to break down barriers to trust and adoption.

This project investigates the following questions:

- How can current forms of computational linguistic analysis support the understanding of social media public discourses around decision-making algorithms? What are the benefits and shortcomings?

- How can the discourse surrounding public-facing decision-making algorithms on social media be understood in more detail through the inclusion of discourse analysis and corpus linguistics alongside computational linguistic analysis?

- In what ways can existing computational linguistic analysis be combined with qualitative linguistic analysis to mitigate the shortcomings of existing methods?

Publications

10 25 50

Studentship Projects

Project Reference Relationship Related To Start End Student Name
EP/S023305/1 30/09/2019 30/03/2028
2445668 Studentship EP/S023305/1 30/09/2020 29/09/2024 Daniel Benjamin Heaton