AGENCY: Assuring Citizen Agency in a World with Complex Online Harms
Lead Research Organisation:
Newcastle University
Department Name: Sch of Computing
Abstract
The online world is a curious but uncertain world. It enriches many facets of life but at the same time exposes citizens to a variety of threats that may cause harm to them, their loved ones and to wider society. Many of these harms result from a complex interaction of societal processes driven by diverse stakeholders-we call these Complex Harms.
Consider for example smart homes, with devices that manage energy usage, CCTV cameras for the garage and increasingly integrated IT components throughout the house. With such technology, the dynamics in families may change, for instance offering monitoring capabilities. This may results in harms that may include domestic violence, loss of privacy and gathering of disproprotionately large sets of population data by large industries.
This raises a number of questions: What is the role of the individual, friends and family to mitigate potential harms? How can one work with the device provider to minimize harm? Should the law interfere? The AGENCY project will use a number of case studies to answer these questions: HealthTech, Identity Management, Smart Homes and Online Disinformation.
Complex harms such as above tend to happen to citizens, and, in most cases, they are not purposely caused or easily controlled by citizens. The AGENCY project believes firmly that establishing citizen agency is an absolutely necessary ingredient for any transformative approaches that resolve these complex harms. Citizens need to be empowered through agency-enhanching technologies, behaviours and processes to gain a sense of control, ownership, security, and consequently trust in their online activities.
Protecting against complex harms is a wicked problem because so many stakeholder are involved, and because many harms are unintended consequences of the practical use and evolution of technology. Therefore, mitigating complex harms requires interdisciplinary co-design principles, technology foundations and collaborative governance procedures to assure online citizen agency in the presence of multiple stakeholder interests. The project brings together computer science, user-centered design, business, psychology, sociology, legal and ethical experts.
If AGENCY succeeds, it will provide a profound understanding of the role of online agency in protecting citizens and will deliver collaborative methods, technological building blocks and scientifically grounded best practices for our society to provide more proactive and structured approaches to protecting citizens online.
Consider for example smart homes, with devices that manage energy usage, CCTV cameras for the garage and increasingly integrated IT components throughout the house. With such technology, the dynamics in families may change, for instance offering monitoring capabilities. This may results in harms that may include domestic violence, loss of privacy and gathering of disproprotionately large sets of population data by large industries.
This raises a number of questions: What is the role of the individual, friends and family to mitigate potential harms? How can one work with the device provider to minimize harm? Should the law interfere? The AGENCY project will use a number of case studies to answer these questions: HealthTech, Identity Management, Smart Homes and Online Disinformation.
Complex harms such as above tend to happen to citizens, and, in most cases, they are not purposely caused or easily controlled by citizens. The AGENCY project believes firmly that establishing citizen agency is an absolutely necessary ingredient for any transformative approaches that resolve these complex harms. Citizens need to be empowered through agency-enhanching technologies, behaviours and processes to gain a sense of control, ownership, security, and consequently trust in their online activities.
Protecting against complex harms is a wicked problem because so many stakeholder are involved, and because many harms are unintended consequences of the practical use and evolution of technology. Therefore, mitigating complex harms requires interdisciplinary co-design principles, technology foundations and collaborative governance procedures to assure online citizen agency in the presence of multiple stakeholder interests. The project brings together computer science, user-centered design, business, psychology, sociology, legal and ethical experts.
If AGENCY succeeds, it will provide a profound understanding of the role of online agency in protecting citizens and will deliver collaborative methods, technological building blocks and scientifically grounded best practices for our society to provide more proactive and structured approaches to protecting citizens online.
Organisations
- Newcastle University (Lead Research Organisation)
- Financial Conduct Authority (FCA) (Collaboration)
- Yoti Ltd (Project Partner)
- SPD Swiss Precision Diagnostics GmbH (Project Partner)
- Citizens Advice Northumberland (Project Partner)
- Future Homes Alliance (Project Partner)
- Active Building Centre (Project Partner)
- The Angelou Centre (Project Partner)
- Atom Bank plc (Project Partner)
Publications

Arnau-González P
(2023)
Toward Automatic Tutoring of Math Word Problems in Intelligent Tutoring Systems
in IEEE Access



Elliott K
(2024)
Implementing Corporate Digital Responsibility (CDR): Tackling wicked problems for the digital era: Pilot Study insights
in Organizational Dynamics

Horton K
(2023)
In search of the silver-lining : Police officers' attributions and responses to stakeholder critique
in Public Administration Review


Olabode S
(2023)
Complex Online Harms and the Smart Home: A Scoping Review
in SSRN Electronic Journal

Olabode S
(2023)
Complex online harms and the smart home: A scoping review
in Future Generation Computer Systems

Owens R
(2023)
Reimagining AI Governance: a Response by AGENCY to the UK Government's White Paper AI Regulation
in SSRN Electronic Journal
Related Projects
Project Reference | Relationship | Related To | Start | End | Award Value |
---|---|---|---|---|---|
EP/W032481/1 | 31/03/2022 | 13/07/2022 | £2,793,095 | ||
EP/W032481/2 | Transfer | EP/W032481/1 | 14/07/2022 | 30/03/2025 | £2,674,250 |
Description | Co-design workshops with citizens, academics, industry and governmental partners brought to light agency-related challenges in the use of technology in Smart Homes, Female Technologies (FemTech) and Online Disinformation. |
Exploitation Route | The outputs will be disseminated throughout the final year of the project, hoping to influence policymakers. |
Sectors | Digital/Communication/Information Technologies (including Software) |
URL | https://agencyresearch.net |
Description | AGENCY's response to the House of Lords Communications and Digital Select Committee's inquiry on large language models (LLM) |
Geographic Reach | National |
Policy Influence Type | Participation in a guidance/advisory committee |
URL | https://committees.parliament.uk/writtenevidence/124223/html/ |
Description | AGENCY's response to the House of Lords Communications and Digital Select Committee's inquiry: The future of news: impartiality, trust and technology |
Geographic Reach | National |
Policy Influence Type | Participation in a guidance/advisory committee |
URL | https://committees.parliament.uk/writtenevidence/128358/pdf/ |
Description | SMOOTH: Smoothing the Digital Identity Onboarding Process |
Amount | £35,174 (GBP) |
Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
Sector | Public |
Country | United Kingdom |
Start | 04/2023 |
End | 12/2023 |
Description | University of Birmingham Paul & Yuanbi Ramsay Research Fund |
Amount | £2,940 (GBP) |
Organisation | University of Birmingham |
Sector | Academic/University |
Country | United Kingdom |
Start | 05/2023 |
Title | A Dataset of Coordinated Cryptocurrency-Related Social Media Campaigns |
Description | The paper describing this dataset can be found here: Zilius, K., Spiliotopoulos, T., & van Moorsel, A. (2023). A Dataset of Coordinated Cryptocurrency-Related Social Media Campaigns. arXiv, 2301.06601. https://arxiv.org/abs/2301.06601 Abstract The rise in adoption of cryptoassets has brought many new and inexperienced investors in the cryptocurrency space. These investors can be disproportionally influenced by information they receive online, and particularly from social media. This paper presents a dataset of crypto-related bounty events and the users that participate in them. These events coordinate social media campaigns to create artificial "hype" around a crypto project in order to influence the price of its token. The dataset consists of information about 15.8K cross-media bounty events, 185K participants, 10M forum comments and 82M social media URLs collected from the Bounties(Altcoins) subforum of the BitcoinTalk online forum from May 2014 to December 2022. We describe the data collection and the data processing methods employed, we present a basic characterization of the dataset, and we describe potential research opportunities afforded by the dataset across many disciplines. |
Type Of Material | Database/Collection of data |
Year Produced | 2023 |
Provided To Others? | Yes |
Impact | This work led to a paper submission: https://doi.org/10.48550/arXiv.2301.06601 |
URL | https://zenodo.org/record/7539178 |
Title | MKPHOTO2023 |
Description | The MKPHOTO2023 dataset is designed to research the types of profile photos used by different types of malicious social bots. |
Type Of Material | Database/Collection of data |
Year Produced | 2024 |
Provided To Others? | Yes |
Impact | This dataset used for estimation of impact of AI-Generated photos on malicious social bots. |
URL | https://www.kaggle.com/datasets/guardeec/mkphoto2023 |
Description | FCA Finclusion Techsprint |
Organisation | Financial Conduct Authority (FCA) |
Country | United Kingdom |
Sector | Public |
PI Contribution | The collaboration involves the development of an AI-powered solution aimed at simplifying complex legal and financial services. This initiative is intended to provide users with the essential tools to understand everyday financial services and increase their chances of obtaining approval for a suitable financial product. |
Collaborator Contribution | The TechSprint provides access to the FCA's digital sandbox platform and FCA coordinators who provide advice on our solution. |
Impact | It represents a multidisciplinary collaboration involving law, computer science, and business. |
Start Year | 2024 |
Title | ARElight |
Description | ARElight is an application for a granular view onto sentiments between mentioned named entities in texts. |
Type Of Technology | Webtool/Application |
Year Produced | 2024 |
Open Source License? | Yes |
Impact | The escalating volume of textual data necessitates adept and scalable Information Extraction (IE) systems in the field of Natural Language Processing (NLP) to analyse massive text collections in a detailed manner. While most deep learning systems are designed to handle textual information as it is, the gap in the existence of the interface between a document and the annotation of its parts is still poorly covered. Concurrently, one of the major limitations of most deep-learning models is a constrained input size caused by architectural and computational specifics. To address this, we introduce ARElight, a system designed to efficiently manage and extract information from sequences of large documents by dividing them into segments with mentioned object pairs. Through a pipeline comprising modules for text sampling, inference, optional graph operations, and visualisation, the proposed system transforms large volumes of text in a structured manner. |
URL | https://guardeec.github.io/arelight_demo/template.html |
Description | AGENCY: EULA analysis workshops |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Study participants or study members |
Results and Impact | Sires of co-design workshops on how citizens understand texts of privacy policies and user agreements. |
Year(s) Of Engagement Activity | 2024 |
URL | https://guardeec.github.io/UELA_workshop/index.html |
Description | Birmingham Tech Week |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Professional Practitioners |
Results and Impact | Birmingham Tech Week is the main annual event for technology advances in the West Midlands. This item refers to the invited presentation about research in the FinTrust, UKFin and AGENCY projesct |
Year(s) Of Engagement Activity | 2023 |
Description | Data Governance in Business Intelligence and Analytics, School of Commerce, The American College, Madurai, India. |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Postgraduate students |
Results and Impact | International Conference on Commerce & Management in the Digital Era: Trends, Challenges, and Innovations held by The American College, India. Speaking to >100 PGRs in this higher education institution known for its focus on academic excellence and social relevance. The completion of 142 years of service to the field of education bears testimony to the position that the college currently enjoys. Currently the college offers thirty-two Undergraduate and nineteen Postgraduate Programmes in the main campus. And it offers thirteen Undergraduate and one Postgraduate Programmes in the satellite campus. There are nine research centers offering Ph.D. programmes in various disciplines alongside an Autonomous Centre, the internationally acclaimed, Study Centre for Indian Literature in English and Translation (SCILET). American College - Community College offers eight B. Voc. Programmes and four M. Voc. Programmes. The college was re-accredited (3rd Cycle) by NAAC with "A+" CGPA - 3.47 on a 4-point scale in 2022. The College was identified as a Mentor Institution by UGC and is consistently graded within the top 5% of Arts and Science Colleges in NIRF Ranking. The College fosters global competencies by collaborative ventures with foreign universities and institutions in USA, Germany, Canada, Slovakia, New Zealand, South Korea, Singapore and Malaysia. Its alumni shine as luminaries internationally as scientists, intellectuals, administrators, corporate managers, statesmen and leaders. |
Year(s) Of Engagement Activity | 2024 |
URL | https://forms.gle/fiwmGqYsTyJQnJY37 |
Description | Expert Fellow talk at the SPRITE+ conference: 'Coordinated Cryptocurrency-Related Social Media Campaigns' |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | I gave a talk as an Expert Fellow at the SPRITE+ conference, Belfast, UK. 28 June 2023. In this talk I discussed social media campaigns coordinated by cryptocurrency projects with the goal of manipulating the price of cryptocurrency tokens and I described a large dataset with information about such campaigns. This provided insights into how the cryptocurrency industry operates and how it interacts with its audience. This talk provided a better understanding of the complex landscape of financial harms on social media. |
Year(s) Of Engagement Activity | 2023 |
URL | https://spritehub.org/sprite-conference-belfast-28-29-june/ |
Description | Invited lecture at Northumbria University |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Undergraduate students |
Results and Impact | I gave an invited lecture on Data Security and Governance for Blockchain Technologies at Northumbria University for the module "Data Security and Governance". The lecture focused on Decentralised Finance and Digital Identities. |
Year(s) Of Engagement Activity | 2022 |
URL | https://www.northumbria.ac.uk/study-at-northumbria/courses/bsc-hons-computer-science-uuscms1?modules... |
Description | Invited talk at University of Edinburgh |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Public/other audiences |
Results and Impact | Invited talk to research group of Design Informatics and the School of Computer Science at University of Edinburgh. The talk was open to the public, but the main attendees were academics, researchers and students of the school. |
Year(s) Of Engagement Activity | 2023 |
Description | Invited talk at the Human-Centred Computing seminar at the University of Birmingham |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Postgraduate students |
Results and Impact | I gave a talk discussing Human-Centred Design of Digital Identity technologies. |
Year(s) Of Engagement Activity | 2023 |
Description | Invited talk at the SPRITE+ Conference: 'Smoothing the Digital Identity Onboarding Process' |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | Invited talk at the SPRITE+ conference, Belfast, UK. 29 June 2023. In this talk I discussed how to effectively and efficiently onboard citizens to Digital Identity systems. |
Year(s) Of Engagement Activity | 2023 |
URL | https://spritehub.org/sprite-conference-belfast-28-29-june/ |
Description | Keynote at ValueTools conference |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | An invited keynote at an academic conference to present work on financial inclusion and related issues. |
Year(s) Of Engagement Activity | 2023 |
Description | Participation in the SPRITE+ Sandpit on Future Digital Identity |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | SPRITE+ is the EPSRC-funded (grant reference EP/S035869/1) NetworkPlus for Trust, Identity, Privacy, and Security (TIPS). We work with academic and non-academic stakeholders to build and strengthen the TIPS community and identify requirements and promising new directions for research. We have a 'pump-priming' budget to fund activities that explore and test new ideas, and that create new collaborations between academic disciplines, and between academic and non-academic partners. |
Year(s) Of Engagement Activity | 2023 |
URL | https://spritehub.org/2022/09/16/call-for-participants-third-annual-sprite-sandpit/ |
Description | Post-CHI summer school |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | The summer school included a mix of keynotes and lessons from prominent academic and industry scholars working on interdisciplinary research on topics within the domain of Usable Privacy and Security. We participate in guided hands-on activities for applying what we have learned to devise novel solutions and/or research ideas for addressing practical challenges in privacy and security. It also included lab tours of academic research groups and/or industry sites in Munich University and Google. |
Year(s) Of Engagement Activity | 2023 |
URL | https://postchisummerschools.uol.de/usable-privacy-and-security/ |
Description | Presentation at REPHRAIN Showcase Workshop: Responsible Innovation Framework |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | Presented the Responsible Innovation Framework applicable to the AGENCY Project and its case studies (in particular, Smart Homes) to project partners, Advisory Board members, and policy makers at the REPHRAIN Centre. The event took place at Goodenough College (London), on 19-20 January 2023, and generated subsequent research and innovation ethics discussions and collaborations with investigators in other REPHRAIN-related projects. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.rephrain.ac.uk/rephrain-showcase-january-2023/ |
Description | Talk about Misinformation case study and preliminary findings |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Professional Practitioners |
Results and Impact | Invited talk in a panel in Athens about the challenges of misinformation. The panel was organised by third sector organisations in Athens. |
Year(s) Of Engagement Activity | 2023 |
Description | Understanding Online Discrimination: Assuring Citizen Agency in a World with Complex Online Harms (University of Malta) |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Policymakers/politicians |
Results and Impact | A core component of this conference is the production of a manifesto by young people for the attention of policy-makers, based on the conference themes. By policy-makers, we mean international policy-makers, including the EC and the OSCE. The development of a manifesto also underpins an activist approach to the conference. Over 100 students attended the conference. |
Year(s) Of Engagement Activity | 2022 |
URL | https://www.3cl.org/ourconferences/ |