Infra-Legalities: Global Security Infrastructures, Artificial Intelligence and International Law

Lead Research Organisation: University of Edinburgh
Department Name: Sch of Law

Abstract

Terrorist risks and threats are increasingly identified and countered through new forms of data analytics made possible by rapid advances in machine learning (ML) and artificial intelligence (AI). Private actors, including social media platforms, airlines and financial institutions, now actively collaborate with states and international organisations (IOs) to implement ambitious data-led security projects to support global counterterrorism efforts. The UN Security Council (UNSC) has called on all states to intensify the exchange of information about suspected terrorists by building watchlists and sharing biometric data, using ML to predictively identify 'future terrorists' in advance. Social media platforms are using AI to detect extremist content online and regulate global data flows on an unprecedented scale. Passenger data from the aviation industry is analysed to identify suspicious 'patterns of behaviour' and control the movements of risky travellers. Financial data is mined by banks to spot suspicious transactions and terrorist 'associations'.

These changes are all putting new and far-reaching global information infrastructure projects into motion. Yet the implications of these shifts for how international law is practiced, global security threats known and powerful actors held accountable remain uncertain. The data infrastructures underlying global governance have been largely neglected in legal scholarship. And whilst potential problems that AI poses (discrimination and privacy violations) are becoming clearer, solutions remain elusive - especially in the security domain, where secrecy is key and the inner workings of algorithms are 'black-boxed' even more than usual. Regulatory theorists argue that we urgently need to 'expand our frame of rights discourse to encompass our socio-technical architecture' to respond to the accountability challenges of AI (Yeung 2019). Data infrastructures, in other words, might provide the basis for reimagining how information and rights could be reconnected in our digital present.

This project rethinks global security law from the 'infrastructure space' it is creating, focusing on (i) countering terrorism online and (ii) controlling the movements of 'risky' individuals. My hypothesis is that the most far-reaching changes to global security governance are not being written in the language of international law, or created through the formal powers of states and IOs, but built through new socio-technical infrastructures and the expertise they are enabling. Data infrastructures are critical for understanding how rights might be extended through AI. I develop the concept of 'infra-legalities' (or, the regulatory effects of data infrastructures) to analyse these shifts and develop a new approach for studying international law and regulation in the age of algorithmic global governance. Infrastructure is usually disregarded as an invisible substrate on which powerful actors act. It is rarely seen as something through which knowledge and governance can be created and shaped. Drawing from Science and Technology Studies, computer science and security studies, this project performs what Bowker and Star (1999) call an 'infrastructural inversion' by mapping the seemingly mundane governance work of data infrastructures in this domain. By 'following the data' - and tracing the socio-technical relations, norms, knowledge practices and power asymmetries that security infrastructures are enacting - a different method of studying global governance can emerge.

States, IOs and tech platforms are all calling for the ethical development of AI. Different regulatory approaches are proposed with no consensus on how to mitigate the adverse effects of AI whilst embracing its vast potentialities. Studying the infra-legalities of global security law opens space for addressing these challenges and shaping current policy debates on security, trust and accountability in the age of AI and automation.

Planned Impact

This project will benefit a range of non-academic communities within and beyond the UK. Key stakeholders are listed below. See Pathways to Impact for how impacts will be realised. Key members of these communities have already agreed to participate in the project. Stakeholders will be invited to the conference in September 2022 and launch event in November 2024. The Fellow will also draw on their own strong networks and those of the Partners, Collaborators, Co-I and Advisory Group to widely publicise this project:

1. Policy practitioners, UK and Global

The project explores issues of critical policy significance - such as how rights can be protected through data infrastructures and AI, how platforms should be regulated, and how public and private actors can share data in ethical ways. Research will be disseminated to policy makers through project partners, participation at policy and project events and short publications aimed at practitioner audiences. Simon Watkin MBE (Home Office) leads UK efforts to protect rights in processing PNR data with AI and has partnered with this project because it will inform UK and global policy debates in this area. The UN Interregional Crime and Justice Research Institute (also partners) work with Interpol on AI and global security and will help disseminate the research to international policy audiences through workshops and events (eg, Interpol World conferences). The Fellow is part of the UN Counterterrorism Executive Directorate's Global Research Network (GRN) which fosters dialogue between academics and UN policymakers. The GRN coordinator has confirmed via email that CTED will help disseminate the project findings and that they are interested in its outcomes. Such support ensures the benefits of this project will reach key UK and global policy communities.

2. Internet platforms and other private actors

The Global Internet Forum to Counter Terrorism (GIFCT) is the key industry body engaged in CVE online. GIFCT fund a Global Research Network on Terrorism and Technology (GRNTT), coordinated by RUSI, who are project partners in this fellowship. Research findings will be presented at GRNTT events as short policy papers (for example, on the regulation of platforms in CVE online) and spread via the RUSI newsletter, to maximise circulation amongst platforms and policy makers. The Fellow also has good networks with counterterrorism policy leads in Google, Facebook, Twitter and Tech Against Terrorism (supported by UNCTED), and these networks will also be leveraged to maximise impact, ensure access to research participants and that findings are well disseminated.

3. Civil Society Organisations (CSOs)

The project will also benefit rights advocacy organisations and CSOs working on AI-led security practices. They will be reached through the project website, blog posts in high-profile sites (such as Just Security) and key project events in 2022 and 2024. ACLU, Fair Trials International (FTI) and the Ada Lovelace Institute engage in policy work with those affected by AI and security databases and all are project partners. Other key CSOs (eg, Open Society Institute, AI Now) will be reached through the website, public events and talks.

4. Individuals and groups affected by global security infrastructures

By investigating how security governance is transforming through data infrastructures and AI, the project will open new ways of protecting rights and accountability. This will benefit individuals who are being governed by global security infrastructures without effective redress (those on lists, passengers denied boarding, people who have online content removed). Such individuals will be reached through the website, via project partners (ACLU and FTI) and specialist legal consultants (HNK Legal) engaged to help bring targeted people into the project and file data access requests on their behalf to be used as an empirical resource (see Case for Support, Research Methods).

Publications

10 25 50
 
Description Advised Meta on proposed changes to their Global Counterterrorism policy
Geographic Reach Multiple continents/international 
Policy Influence Type Contribution to new or improved professional practice
URL https://www.infra-legalities.law.ed.ac.uk/2022/06/29/gavin-sullivan-engages-with-meta-about-their-on...
 
Description Human Rights Perspectives to the Use of AI in Counter-Terrorism Report (UN Office of Counterterrorism, UN Office of the High Commissioner for Human Rights, UN Interregional Crime and Justice Research Institute)
Geographic Reach Multiple continents/international 
Policy Influence Type Participation in a guidance/advisory committee
 
Description Invited as Expert to provide input to UN-supported initiative on online counterterrorim policy and practice
Geographic Reach Multiple continents/international 
Policy Influence Type Influenced training of practitioners or researchers
URL https://www.techagainstterrorism.org/
 
Description Invited as an expert to participate in the Global Internet Forum to Counterterrorism (GIFCT) Legal Frameworks Working Group
Geographic Reach Multiple continents/international 
Policy Influence Type Participation in a guidance/advisory committee
URL https://gifct.org/year-three-working-groups/
 
Description Participation in Global Counterterrorism Forum's (GCTF) Watchlisting Guidance Manual Initiative and Counterterrorism Watchlisting Toolkit
Geographic Reach Multiple continents/international 
Policy Influence Type Contribution to new or Improved professional practice
Impact The resultant GCTF Counterterrorism Watchlisting Toolkit (launched in October 2021) has helped to shape global policy on this issue. The GCTF's watchlisting policy work has positively recognised by the UN Security Council in UN Security Council Resolution 2617 (30 December 2021). It provides non-binding recommendations to all states for developing and strengthening national counterterrorism watchlisting systems of known and suspected terrorists, including foreign terrorist fighters in compliance with human rights.
URL https://www.thegctf.org/Portals/1/Documents/Links/Meetings/2021/19CC11MM/WatchlistingToolkit/Watchli...
 
Description Partipcated in UN Human Rights and AI in Law Enforcement Policy Consultation
Geographic Reach Multiple continents/international 
Policy Influence Type Contribution to a national consultation/review
URL https://unicri.it/topics/Toolkit-Responsible-AI-for-Law-Enforcement-INTERPOL-UNICRI
 
Description Policy Report on Global Counterterrorism to assist the philanthropic funding of Civil Society Organisations (CSOs)
Geographic Reach Multiple continents/international 
Policy Influence Type Influenced training of practitioners or researchers
URL https://www.infra-legalities.law.ed.ac.uk/2022/06/06/new-report-launched-global-counterterrorism-arc...
 
Description Artificial Intelligence and the International Rule of Law 
Organisation University of Edinburgh
Department Edinburgh Law School
Country United Kingdom 
Sector Academic/University 
PI Contribution Researcher Dimitri Van Den Meerssche contributed to the organisation of three workshops on Artificial Intelligence and the International Rule of Law (on the digital welfare state, the digital border and the digital battlefield).
Collaborator Contribution Partners Nehal Bhuta, Connor Hounslow, Christopher Johnson, Petra Molnar, Christiaan Van Veen, Liz McFall, Mark Sprevak and Rebecca Sutton contributed to the organisation of the events and the building of networks with policy actors and computer designers in the field.
Impact https://www.ai-rule-of-law.law.ed.ac.uk/
Start Year 2021
 
Description Takedowns and Transparency Research Sprint: Global Norms, Regulation and the Nature of Online Information 
Organisation Harvard University
Country United States 
Sector Academic/University 
PI Contribution Gavin Sullivan is a selected participant in a collaborative research sprint hosted by the Berkman Klein Center for Internet and Society and the Lumen Database project at Harvard University, USA. The research project began on 3 March 2022 and runs until 5 May 2022. It aims to understand the global online notice & takedown environment from a multi-stakeholder perspective and develop knowledge of content moderation practices online, whilst engaging with an interdisciplinary network of peers and scholars from around the world. The collaboration seeks to create a Draft Statement of Best Practices Regarding Takedown Transparency, primarily intended for Internet service providers that are recipients of takedown notices. Dr. Sullivan's contribution to this collaboration includes: regular participation in weekly seminars and research, sharing expertise and insights from his experience in this area (as member of the Global Internet Forum to Counter Terrorism's Transparency Working Group), and helping to collaboratively prepare a Draft Statement of Best Practices in this area.
Collaborator Contribution The partners in this collaboration help to develop the Infra-legalities project by sharing their expertise on online content moderation (particular in the US context), providing researcher access to the Lumen Database (the world's largest repository of online takedown notices), providing access to potential research participants to engage via interviews.
Impact The collaborative research sprint is still ongoing (it concludes on 5 May 2022). It aims to produce a Draft Statement of Best Practices Regarding Takedown Transparency. The collaboration is multi-disciplinary - with participants from law and internet governance - international, and includes academics and policy-practitioners.
Start Year 2022
 
Description Engaged with NATO Counterterrorism practitioners on human rights and the rule of law in AI-driven military systems 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact In April 2022 Gavin Sullivan participated in a meeting organised by NATO Defence Against Terrorism programme entited 'The Design of AI in C-UAS and the Rule of Law'. The aim of the meeting was to address problems and issues associated with translating human rights and rule of law principles into the design and use of of autonomous weapons systems in unmanned aerial systems (UAS) by NATO and other military actors.
Year(s) Of Engagement Activity 2022
 
Description Interviewed and quoted in media report 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact On 21 January 2022 Dr. Gavin Sullivan was interviewed by the online news site Middle East Eye and invited to provide insights on the proposal for Egypt to jointly co-chair the Global Counterterrorism Forum to Counterterrorism (GCTF) with the European Union. Dr. Sullivan was contacted because of his earlier public engagement work on GCTF watchlisting infrastructure - see: https://www.justsecurity.org/78779/watchlisting-the-world-digital-security-infrastructures-informal-law-and-the-global-war-on-terror/. The news story with commentary from Dr. Sullivan was internationally circulated, and led to an international coalition of 16 third-sector organisations (such as Human Rights Watch and Amnesty International) making a joint public intervention on this issue on 10 February 2022, calling for the EU to reject the proposal. See: https://www.amnesty.org/en/wp-content/uploads/2022/02/MDE1252302022ENGLISH.pdf
Year(s) Of Engagement Activity 2022
URL https://www.middleeasteye.net/news/eu-egypt-plans-bid-lead-global-counter-terrorism-body
 
Description Invited to expert Advisory Committee for funding Global Security and Civic Space initiatives 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact In March 2022 Dr. Gavin Sullivan was invited as an expert advisor on global security and human rights to join an advisory board committee of FICS - the Funders Initiative for Civil Society - to assist them with their Donor Organising Platform for new Global Initiative on Civic Space and Security. Dr. Sullivan will be part of a panel of selected experts reviewing funding applications for civil society initiatives investigating the impacts of counterterrorism governance on civic space, to be funded by Global Dialogue philanthropic partnership.
Year(s) Of Engagement Activity 2022
URL https://global-dialogue.org/programmes/funders-initiative-for-civil-society/
 
Description Invited to present research at high-level expert policy meeting 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Dr. Gavin Sullivan was invited to participate and present insights from his research at a high-level expert meeting to be held at Carlton House, London on 23 March 2022. The event - entitled, 'The UN Security Council: Assessing Twenty Years of Counterterrorism and Right-Sizing for the Future is part of the Securing the Future Initiative (SFI), jointly organised by the Royal United Services Initiative (RUSI) and The Soufan Center (USA) and funded by the European Union. The initiative aims to undertake the first-ever independent review and assessment of the UN Security Council's counterterrorism activities. It will be launched in New York and Brussels in September 2022, to coincide with the UN General Assembly meeting in New York, and will make global policy recommendations in this area.
Year(s) Of Engagement Activity 2022
URL https://thesoufancenter.org/projects/securing-the-future-initiative/
 
Description Op-Ed: Watchlisting the World: Digital Security Infrastructures, Informal Law, and the "Global War on Terror" 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Dr. Gavin Sullivan co-authored an article/op-ed on global watchlisting infrastructures on the Just Security online platform on 28 October 2021. The article was co-authored with Dr. Rebecca Mignot-Mahdavi (University of Manchester) and Professor Ramzi Kassem (City University New York). The article critically analyses the Global Counterterrorism Forum's (GCTF) Counterterrorism Watchlisting Toolkit launched in October 2021. Just Security is a leading online forum for the rigorous analysis of national security, foreign policy, and rights, based at New York University School of Law. Authors and editors include leading experts on domestic and international law and policy. It is widely read by the international counterterrorism policy-practitioner audience.
Year(s) Of Engagement Activity 2021
URL https://www.justsecurity.org/78779/watchlisting-the-world-digital-security-infrastructures-informal-...
 
Description Participation as invited expert in UN meeting on AI and Counterterrorism 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact On 9 March 2022 Dr. Gavin Sullivan was invited to present at a high-level Expert Group Meeting on Building Good Practices for the use of AI for Social Network Analysis (AI-SNA) hosted by the UN Office of Counter-Terrorism's Programme on Cybersecurity and New Technologies and the UNICRI Centre for Artificial Intelligence and Robotics. Other selected participants included experts from NATO, industry AI practitioners working closely with security and defence agencies in the US and elsewhere, and experts form the EU's Fundamental Rights Agency. The purpose of the meeting was to help develop a concept note to shape future UNOCT/UNICRI work in this area and eventually create best practice standards on the use of AI-SNA for counter terrorism in compliance with fundamental rights.
Year(s) Of Engagement Activity 2022
URL https://twitter.com/UN_OCT/status/1501702201277825025