UKRI Trustworthy Autonomous Systems Node in Governance and Regulation
Lead Research Organisation:
University of Edinburgh
Department Name: Sch of Informatics
Abstract
How can we trust autonomous computer-based systems? Autonomous means "independent and having the power to make your own decisions". This proposal tackles the issue of trusting autonomous systems (AS) by building: experience of regulatory structure and practice, notions of cause, responsibility and liability, and tools to create evidence of trustworthiness into modern development practice. Modern development practice includes continuous integration and continuous delivery. These practices allow continuous gathering of operational experience, its amplification through the use of simulators, and the folding of that experience into development decisions. This, combined with notions of anticipatory regulation and incremental trust building form the basis for new practice in the development of autonomous systems where regulation, systems, and evidence of dependable behaviour co-evolve incrementally to support our trust in systems.
This proposal is in consortium with a multi-disciplinary team from Edinburgh, Heriot-Watt, Glasgow, KCL, Nottingham and Sussex, bringing together computer science and AI specialists, legal scholars, AI ethicists, as well as experts in science and technology studies and design ethnography. Together, we present a novel software engineering and governance methodology that includes:
1) New frameworks that help bridge gaps between legal and ethical principles (including emerging questions around privacy, fairness, accountability and transparency) and an autonomous systems design process that entails rapid iterations driven by emerging technologies (including, e.g. machine learning in-the-loop decision making systems)
2) New tools for an ecosystem of regulators, developers and trusted third parties to address not only functionality or correctness (the focus of many other Nodes) but also questions of how systems fail, and how one can manage evidence associated with this to facilitate better governance.
3) Evidence base from full-cycle case studies of taking AS through regulatory processes, as experienced by our partners, to facilitate policy discussion regarding reflexive regulation practices.
This proposal is in consortium with a multi-disciplinary team from Edinburgh, Heriot-Watt, Glasgow, KCL, Nottingham and Sussex, bringing together computer science and AI specialists, legal scholars, AI ethicists, as well as experts in science and technology studies and design ethnography. Together, we present a novel software engineering and governance methodology that includes:
1) New frameworks that help bridge gaps between legal and ethical principles (including emerging questions around privacy, fairness, accountability and transparency) and an autonomous systems design process that entails rapid iterations driven by emerging technologies (including, e.g. machine learning in-the-loop decision making systems)
2) New tools for an ecosystem of regulators, developers and trusted third parties to address not only functionality or correctness (the focus of many other Nodes) but also questions of how systems fail, and how one can manage evidence associated with this to facilitate better governance.
3) Evidence base from full-cycle case studies of taking AS through regulatory processes, as experienced by our partners, to facilitate policy discussion regarding reflexive regulation practices.
Organisations
- University of Edinburgh (Lead Research Organisation, Project Partner)
- Thales Group (Collaboration)
- OPTOS plc (Collaboration, Project Partner)
- NVIDIA Limited (UK) (Project Partner)
- Altran (United Kingdom) (Project Partner)
- Vector Four Ltd (Project Partner)
- Ethical Intelligence (Project Partner)
- Aesthetic Integration Ltd. (Project Partner)
- Hexagon (United Kingdom) (Project Partner)
- D-RisQ (United Kingdom) (Project Partner)
- National Physical Laboratory (Project Partner)
- Digital Health and Care Institute (Project Partner)
- Legal & General (Project Partner)
- Ames Research Center (Project Partner)
- Craft Prospect Ltd (Project Partner)
- Defence Science and Technology Laboratory (Project Partner)
- Adelard (Project Partner)
- Thales (United Kingdom) (Project Partner)
- Microsoft (United States) (Project Partner)
- SICSA (Project Partner)
- BAE Systems (United Kingdom) (Project Partner)
- Civil Aviation Authority (Project Partner)
Publications
Gilbert S
(2023)
Learning From Experience and Finding the Right Balance in the Governance of Artificial Intelligence and Digital Health Technologies.
in Journal of medical Internet research
Hoernle N
(2022)
MultiplexNet: Towards Fully Satisfied Logical Constraints in Neural Networks
in Proceedings of the AAAI Conference on Artificial Intelligence
Inglesant P
(2021)
Asleep at the wheel? Responsible Innovation in quantum computing
in Technology Analysis & Strategic Management
Innes C
(2023)
Anticipating Accidents through Reasoned Simulation
Innes C
(2023)
Anticipating Accidents through Reasoned Modelling
| Description | The work is still on-going but as our publications show, our work has already identified a number of key themes associated with the TAS governance and regulation processes which inform our current and future work. As selected salient examples of major themes, we have clarified notions of responsibility and answerability in the specific context of the socio-technical systems we study in the project, we have identified gaps in the explainable AI field (e.g. the lack of methods for negative explanations) which we are working to fill, and we have developed a number of tools and technical frameworks aimed at helping AI developers ensure that their process and product are trustworthy. |
| Exploitation Route | As also mentioned in the next section, we are actively engaged both with policy makers and regulators, as well as our industrial partners - with whom we are co-creating our phase 2 case studies. |
| Sectors | Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Healthcare,Government, Democracy and Justice,Transport |
| URL | https://web.inf.ed.ac.uk/tas |
| Description | The project is still very much in progress, but the entries in the sections on dissemination, policy engagement and awards make clear that we have been actively engaged with impacts beyond academia, including: (1) contributions to government consultations and other aspects of policy making, (2) co-creation of case studies with industrial partners and (3) public engagement activities beyond academia and government. |
| First Year Of Impact | 2021 |
| Sector | Digital/Communication/Information Technologies (including Software),Healthcare,Government, Democracy and Justice,Transport |
| Impact Types | Societal,Economic,Policy & public services |
| Description | Adivising on and serving as member of the Legal Technologist Accreditation stream of the Law Society of Scotland |
| Geographic Reach | National |
| Policy Influence Type | Contribution to new or Improved professional practice |
| Impact | The new accreditation route recognises special expertise in technology and AI for lawyers. Uniquely, not just for the UK but internationally, it is an accreditation route administered by a professional and regulatory body (the Law Society of Scotland) that is open to non-lawyers. It incentivises training and investment in technology by law firms, assists in their digital transformation, while ensuring that professional standards are met. While there is an ongoing discussion whether there computer science should become a regulated profession, law took the lead in setting up a new way to bring software developers into the regulatory remit of a profession |
| URL | https://www.lawscot.org.uk/members/career-growth/specialisms/areas-of-specialism/accredited-legal-te... |
| Description | Digital Ethical Scotland |
| Geographic Reach | Local/Municipal/Regional |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://www.gov.scot/publications/building-trust-digital-era-achieving-scotlands-aspirations-ethical... |
| Description | Independent Advisory Group on Emerging Technologies report |
| Geographic Reach | Local/Municipal/Regional |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://www.sipr.ac.uk/wp-content/uploads/2023/02/Independent-advisory-group-on-emerging-technologie... |
| Description | Legislating for AVs in Dubai |
| Geographic Reach | Asia |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Description | Submission to the UK Governemnt co nsultation on Self-driving vehicles: new safety ambitions |
| Geographic Reach | National |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://www.gov.uk/government/consultations/self-driving-vehicles-new-safety-ambition |
| Description | TAS Response to Establishing a pro-innovation approach to regulating AI |
| Geographic Reach | National |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://www.gov.uk/government/publications/establishing-a-pro-innovation-approach-to-regulating-ai |
| Description | TAS consultation response to IP for AI generated works |
| Geographic Reach | National |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4003626 |
| Description | Written Evidence for Government Review |
| Geographic Reach | National |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://committees.parliament.uk/writtenevidence/43469/pdf/ |
| Description | Austrian Standards Senior Fellowship |
| Amount | € 3,000 (EUR) |
| Organisation | University of Graz |
| Sector | Academic/University |
| Country | Austria |
| Start | 10/2023 |
| End | 11/2023 |
| Description | Enabling a Responsible AI Ecosystem |
| Amount | £3,556,684 (GBP) |
| Organisation | Arts & Humanities Research Council (AHRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 11/2022 |
| End | 10/2025 |
| Description | Making Systems Answer: Dialogical Design as a Bridge for Responsibility Gaps in Trustworthy Autonomous Systems |
| Amount | £559,681 (GBP) |
| Funding ID | EP/W011654/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 01/2022 |
| End | 06/2024 |
| Description | Optometry Pilot Study (OPS) for remote diagnosis service in ophthalmology |
| Amount | £10,000 (GBP) |
| Organisation | Government of Scotland |
| Department | Scottish Funding Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 02/2021 |
| End | 06/2021 |
| Description | Sussex Centre on Inclusive Trade Policy |
| Amount | £4,084,093 (GBP) |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 04/2022 |
| End | 06/2026 |
| Description | TAS Hub Pump Priming Project: Critically Envisioning Biometric AI Systems |
| Amount | £38,000 (GBP) |
| Organisation | University of Edinburgh |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 01/2023 |
| End | 03/2023 |
| Description | Verified Neural Network Training for Safe Human-Robot Interaction |
| Amount | £165,000 (GBP) |
| Organisation | University of Edinburgh |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 11/2021 |
| End | 10/2023 |
| Description | Optos |
| Organisation | Optos plc |
| Department | Optos |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | Our Node Co-I Crabree and PDRA McGarry have been conducting fieldwork with the AI development team at Optos, as part of our cross-cutting theme investigations |
| Collaborator Contribution | Optos have given access to our team, and also engaged with them to explain the development process and permit observational studies as part of the ethnographic work |
| Impact | Fieldwork reports entered with paper outputs |
| Start Year | 2021 |
| Description | Thales |
| Organisation | Thales Group |
| Department | Thales UK Limited |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | Fieldwork study by Co-I Crabtree and PDRA McGarry |
| Collaborator Contribution | Time and participation of experts to assist with fieldwork, especially on |
| Impact | Report added to publications - informs the design of our next stage experiments |
| Start Year | 2021 |
| Description | AI in Health and Care: Safe and Effective Deployment |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Workshop aims to - identify and discuss some of the critical components of safe and effective deployment of AI in health and social care - when algorithm is in use; applies to integrating, piloting and routine use - does not apply to algorithm development Proposed outcomes Connections, awareness & knowledge of each other's work Discussing tricky problems or 'critical components' to: •Deepen collective understanding •Share problems we see from respective vantage points •Map potential solutions •Sum up with areas for further inquiry / allow conversation to continue |
| Year(s) Of Engagement Activity | 2021 |
| Description | Automation and Autonomous Systems Roundtable |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | UKRI has commissioned the National Coordinating Centre for Public Engagement (NCCPE) to convene a Roundtable to bring together colleagues from across UKRI and the wider research and innovation community, with interest in the areas of Automation and Autonomous systems (AAS). The work is being undertaken as part of the Sciencewise1 public dialogue programme, which is delivered by UKRI, to serve the insight and evidence needs of research funders, and policymakers. The purpose of the roundtable is to build a shared understanding of where public perspectives may be most critically needed in AAS and identify areas where further work is necessary with the possible support of the Sciencewise team. It will also explore how UKRI might best approach future cross-cutting areas like automation, which have strong public interest and significant ethical sensitivity. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Cambridge Ellis Seminar Series |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Hana Chockler invited to Cambridge ELLIS Unit seminar series on 21 April 2022, "Actual Causality, Explanations and Fairness". |
| Year(s) Of Engagement Activity | 2022 |
| URL | http://www.ellis.eng.cam.ac.uk/cambridge-ellis-seminar-series-dr-hana-chockler-21-april-2022-2-pm/ |
| Description | Chairing session: What does AI offer people as they get older and what is the role of co-design? |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | AI Scotland Summit session: 'What does AI offer people as they get older and what is the role of co-design? Aims The aims of our participation in this conference are to: • engage with a wider audience of people interested in AI matters, including Scottish Government, third sector, companies and other academia; and • raise the profile of the research to support greater impact and could lead to other opportunities for speaking, partnerships etc. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.scottishaisummit.com/ |
| Description | Collaborative Seminar with Wits University, South Africa on AI regulation |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Postgraduate students |
| Results and Impact | Two online "Masterclasses" were offered for PG students, businesses and legal practitioners across Africa to help local regulators and lawyers to build capacity in the field of AI regulation, and to inform them about recent developments in the UK and Europe that may influence their businesses. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.wits.ac.za/media/wits-university/faculties-and-schools/commerce-law-and-management/resea... |
| Description | Conference talk at Circular Economy Festival |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | L Urquhart and S Lechelt 'Fixing the Future: Right to Repair and Internet of Things', Circular Economy Festival, Chartered Institute of Waste Management |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.circulareconomyfestival.com/ |
| Description | Decision Making, Planning and Trustworthy Autonomous Systems |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | UDRC Themed Meeting on Autonomous Systems As part of the UDRC phase III, a themed meeting on Autonomous Systems will be held on Wednesday 24th November 2021. This will be an in person event with the option to attend online. This event is intended for academic researchers, industrial partners and Dstl staff to learn about and discuss current trends in Autonomous Systems. The program will consists of a series of talks from academia and defence industry. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://udrc.eng.ed.ac.uk/udrc-themed-meeting-autonomous-systems |
| Description | Examining transparency goals in medical diagnostic systems focusing on the EU Commision's proposal of the Artificial Intelligence Act |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Daria Onitiu gave the talk "Examining transparency goals in medical diagnostic systems focusing on the EU Commission's proposal of the Artificial Intelligence Act at the SLSA Annual Conference, University of York, 6-8 April 2022 |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.slsa.ac.uk/images/conferences/YORK_Full_conference_programme_FINAL.pdf |
| Description | Expecting the Future Presentation at 4S conference |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Presented the paper 'Expecting the Future: Emerging Narratives on Automated Facial and Emotion Recognition Technologies.' with D. Miranda. at the leading Science and Technology Studies event the 4S Conference 2021 Toronto, Canada/Online. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.research.ed.ac.uk/en/activities/4s-2021 |
| Description | Governance and Regulation: Bridging the Gaps between Law and Ethics |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Participated in a panel discussion today on Governance and Regulation: Bridging the Gaps between Law and Ethics, alongside AVM Tamara Jennings, Director Legal Services (RAF), Rhodri Morgan from HSE and chaired by Professor Chris Watkins, Professor in Computer Science, Royal Holloway. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.tas.ac.uk/eventslist/trusting-machines/trust-machines-conference-programme/ |
| Description | Guest Talk: Logic & Learning: From Aristotle to Neural Networks |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Invited talk to the doctoral training center UnRAVeL - UNcertainty and Randomness in Algorithms, VErification and Logic in Aachen (Virtual). |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.unravel.rwth-aachen.de/cms/UnRAVeL/Das-Graduiertenkolleg/Aktuelle-Veranstaltungen/~rjrar... |
| Description | Invited Keynote at AIES 2022 |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Shannon Vallor invited Keynote speaker at Artificial Intelligence Ethics and Society (AIES) 2022 |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.aies-conference.com/2022/ |
| Description | Invited lecture on 'Regulating for Human Centered AI' |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Invited lecture on 'Regulating for Human Centered AI' at the '2021 Bilgi University IT Law International Summer School on Artificial Intelligence'. Istanbul, Turkey / Online. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://aipractice.bilgi.edu.tr/en/ |
| Description | Invited speaker at UoE AIAI Institute Seminar series |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | "Causality for Explanations and Other Applications" talk to the AIAI institute at the School of Informatics, Edinburgh. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://web.inf.ed.ac.uk/aiai/events/seminars/7-march-2022-h-chockler |
| Description | Invited speaker: EU law through the lens of data science and computational approaches |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The workshop hosted by the University of Copenhagen discussed how digital versions of court decisions by EU and international courts can be made more accessible for legal practitioners and government decision-makers, and how AI can help in achieving access to justice. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Invited talk at International Symposium on the Verification of Autonomous Mobile Systems - VAMS |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Ram Ramamoorthy gave a talk at the International Symposium on the Verification of Autonomous Mobile Systems (VAMS), at Institut Mines-Télécom, on 9-10 March, 2023. The aim is to facilitate the transfer of knowledge and experience between academia, regulators, and industry concerning the Verification of Autonomous Mobile Systems operating over large outdoor spaces, and to work towards a report aimed at the diverse organisations involved in the use of Autonomous Systems across air, land, and sea applications, particularly those that are safety-critical. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.irt-systemx.fr/evenements/vams-is-23 |
| Description | Invited talk at the Every day Activity Science & Engineering Centre, University of Bremen |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Ram Ramamoorthy was invited to talk at the Everyday Activity Science and Engineering Centre at the University of Bremen, Germany on 5 October 2022 |
| Year(s) Of Engagement Activity | 2022 |
| Description | Invited talk at the First Annual LAST-JD-RIOE Conference of the Marie Sklodowska-Curie Action program "Rights in Internet of Everything" |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Postgraduate students |
| Results and Impact | The event was part of the Marie Sklodowska-Curie Action program "Rights in Internet of Everything", a EU project that sponsors a 3 year PhD program involving 15 European Universities It was attended by past and current students on the program, and also other PhD and Master students from participating institutions. I received several expressions of interest to come to the UK for a PhD in this field |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://rioe.oeg.fi.upm.es/conference/#contact |
| Description | Invited talk, EASE Symposium: Safe Robot Learning for Human Centred Applications |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Invited talk |
| Year(s) Of Engagement Activity | 2022 |
| Description | Invited talk,Everyday Cyborg 2.0 Workshop: Regulating AI/ML in SaMD: mapping the experimental space for AI adoption |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | The Visions of Everyday Cyborg workshop, held on the 19th and 20th of September 2022 brought together an interdisciplinary group of scholars including lawyers, medics, sociologists, cybersecurity researchers and regulatory experts to discuss the present and future of medical device regulation. The papers presented at this interdisciplinary event were diverse. They included papers looking at the immediate personal experience of receiving a pacemaker; papers presenting the results of empirical research with people who use medical devices; and theoretical papers examining the relationship beteen technology and society and developing a new conception of the person capable of making sense of our increasing integration with technology. Participants also heard papers drawing out the challenges involved in regulating medical devices which include (or consist entirely of) software. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://blog.bham.ac.uk/everydaycyborgs/wp-content/uploads/sites/95/2022/11/Birmingham-Workshop-FINA... |
| Description | Keynote Talk at Probabilistic Logic Programming Workshop, FLOC 2022 |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The Federated Logic Conference brings together several leading international conferences related to mathematical logic and computer science. FLoC2022 includes 12 conferences and over 60 workshops on topics of software/hardware verification and logic for computer science. The Department of Computer Science at the Technion campus on Haifa is proud to host FLoC 2022. The department's research activities strongly feature both logic and verification. FLoC is held every four years and involves thousands of students and researchers from industry and academia. Past instances of FLoC were held at top universities such as Oxford (2018), Vienna (2014), Edinburgh (2010), Seattle (2006) |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.floc2022.org/ |
| Description | Keynote at International Workshop on Trustworthy AI for the Future of Risk Management |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Vaishak Belle to give Keynote at The First International Workshop on Trustworthy AI for the Future of Risk Management, Belfast 14 June 2022. "Principles and Practice of Explainable Machine Learning". |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://computing.ulster.ac.uk/TAI-RM2022/ |
| Description | Keynote at The International Conference on Conceptual Structures (ICCS) |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The international conferences on conceptual structures focuses on the formal analysis and representation of conceptual knowledge, at the crossroads of artificial intelligence, human cognition, computational linguistics and related areas of computer science and cognitive science. The ICCS conferences evolved from a series of seven annual workshops on conceptual graphs, starting with an informal gathering. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://iccs-conference.org/?page_id=1099 |
| Description | Keynote talk at 2022 International Workshop on Medical Robotics and Bioengineering in the University of Strathclyde |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Ram Ramamoorthy gave the Keynote talk at the 2022 International workshop on medical robotics and bio engineering at the University of Strathclyde, Glasgow 26 August 2022 |
| Year(s) Of Engagement Activity | 2022 |
| Description | Knowing your style: An analysis of Fashion Recommender Systems within Non- Discrimination law in the EU |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Daria Onitiu gave the talk 'Knowing your style: An analysis of Fashion Recommender Systems within Non- Discrimination law in the EU' at the British and Irish Law Education and Technology Association (BILETA) Conference at the University of Exeter, April 2022 |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.bileta.org.uk/wp-content/uploads/Booklet-11-April-2022.docx |
| Description | Living with Robots: Edinburgh Futures Institute's Love Machine event season |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Will human beings ever embrace robots as a daily part of our social and economic lives? What would it mean to live well with robots? How can we ensure that robot design and development is driven by and aligned with our fundamental human needs, such as security and social connection? Where are robots already transforming our lives in ways we may not recognize, and which of our ideas about robots remain mere science fiction fantasies? Where can tomorrow's robots make the world a better place, and most importantly, better for whom? Join us for a conversation among experts in the technical, moral, social and economic dimensions of the oft-promised 'robot revolution'. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://efi.ed.ac.uk/events/living-with-robots/ |
| Description | NATO HQ 'The design of AI in C-UAS and the Rule of Law' |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Online meeting with representatives from the military (MoD and Nato) and academics on future regulatory challenges and International law of armed conflict pertaining to Counter Unmanned Aircraft Systems. The aim was to identify if the Nato policy on AI-operated drones raises new problems under international law of armed conflicts and to advice on responses |
| Year(s) Of Engagement Activity | 2022 |
| Description | Optos |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Dialogue with Optos about margins of error in machine learning |
| Year(s) Of Engagement Activity | 2021 |
| Description | Organised and ran an international day long workshop on 'Human Data Interaction Through Design: An Exploratory from Theory to Practice Using Design as a Vehicle' at 'ACM SIGCHI Conference 2021'. Yokohama, Japan/Online. |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Workshop with experts to define agenda for HDI research in HCI - involved industry, academia and beyond. Resulted in a Manifesto for action and community building follow on work. |
| Year(s) Of Engagement Activity | 2021 |
| URL | http://designresearch.works/chi2021-hdi-workshop/ |
| Description | Panellist at Science Speakeasy: Artificial Stupidity |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Ram Ramamoorthy was a panellist at this Science Speakeasy: Artificial Stupidity event at the Life Science Centre in Newcastle, 9 February 2023. Artificial Intelligence (AI) brings huge benefits to all of us. Smart assistants like Siri or Alexa, self-driving cars, clever kit that cuts corners in drug development, industry and agriculture - AI is now embedded into our personal and professional lives. But what happens when things go wrong? And how do we add in stupidity measures to stop AI from getting too clever? |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.life.org.uk/events/artificial-stupidity |
| Description | Participating in ReMeP workshop as invited particpant on roundtable on "Computational Law" |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Industry/Business |
| Results and Impact | Participated in a panel discussion on computational law as part of ReMeP - research meets practice. The aim was to introduce governments and legislators to the potential of computational law, and industry on the business opportunities to support this new form of lawmaking. The panel was attended by 140 participants A follow up request from the Austrian government to explore the possibility of a computational version of the GDPR |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://remep.live/ |
| Description | Policing Faces: Intelligent Facial Surveillance |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | L Urquhart and D Miranda. 'Policing Faces: Intelligent Facial Surveillance' ALGOPOL,Oslo - AGOPOL Online Conference: Diffusion of Policing in the Algorithmic Society |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.algorithmic-governance.com/post/agopol-online-conference-diffusion-of-policing-in-the-al... |
| Description | Presentation Intellectual Property Scholar Conference: Contextual disclosure for patenting AI inventions. |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The Program in Law, Science & Technology at Stanford Law School will host the 22nd Annual Intellectual Property Scholars Conference on August 11-12, 2022. The IP Scholars Conference brings together intellectual property scholars to present their works-in-progress in order to benefit from the critique of colleagues. The conference is co-sponsored by the Berkeley Center for Law and Technology, UC Berkeley School of Law; the Intellectual Property Law Program, Benjamin N. Cardozo School of Law at Yeshiva University; the Center for Intellectual Property Law and Information Technology, DePaul University College of Law; and the Stanford Program in Law, Science & Technology, Stanford Law School. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://conferences.law.stanford.edu/ipsc2022/ |
| Description | Presenting at Responsibility and Autonomy in Artificial Intelligence Conference |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Shannon Vallor presented 'AI and the Imperative of Responsibility: Reconceiving AI Governance as Social Care' at Oxford Conference on 'Responsibility and Autonomy in Artificial Intelligence, 27-28 June 2022. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.eventbrite.co.uk/e/responsibility-and-autonomy-in-artificial-intelligence-tickets-346203... |
| Description | Regulating Artificial Intelligence/Machine Learning (AI/ML) in Software as a Medical Device (SaMD): workshop on international alignment |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | At this workshop, we are comparing the EU and the US models for regulating ML/AIaMD with a view to navigating this dynamic field of future regulation for the UK. There are various sets of tension that need to be considered in regulation: centralised or decentralised regulation; top down, bottom up, or co-regulation; clarity/prescriptive or flexibilities; safety and/or market competitiveness; efficacy/ frequent update and regulatory burden; power/rights and duty/liabilities; pre-market and post-market duties; global models and local deployed models, as well as the evolving roles, duties, and relationship between regulators: NICE, MHRA, NHSx. |
| Year(s) Of Engagement Activity | 2022 |
| Description | Samsung AI Neurosymbolic Workshop |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The workshop is expected to bring many benefits to Samsung Research including getting insights on new applications, attracting new talent and positioning Samsung Research as the world leader in AI. However, not only Samsung will benefit from this event but also the broader academic community: registering to the workshop is free and open to the public, while the recorded talks will be provided online and without any registration. The workshop aims to bring together the best people and to learn from them. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://research.samsung.com/sanw |
| Description | Scrutinising the Use of Artificial Intelligence: A Toolkit |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | Shannon Vallor and Ram Ramamoorthy presented a seminar in June 2022 in the Scottish Parliament, which directly formed this toolkit; providing a set of questions tat can be used to ensure that the key issues in the design and use of artificial intelligence have been considered and addressed. It is intended to help ensure that AI is used appropriately and safely. The toolkit is designed particularly for the Parliament, but may have a wider use. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.scotlandfutureforum.org/scrutinising-the-use-of-artificial-intelligence-a-toolkit/ |
| Description | Seminar on legal ontologies given at ReMeP: Research Meets Practice |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Industry/Business |
| Results and Impact | ReMeP is an annual event to bring research in law and technology to practice. It is attended mainly by representatives from industry, legal practice and government Chaired panel and gave keynote talk on Legal Ontologies. 470 participants, lead to extended questions and discussions, and 2 follow up invitations Recordings of the talks are made available as training tools |
| Year(s) Of Engagement Activity | 2020 |
| URL | https://www.remep.net/materials-2020/ |
| Description | Seminar: Situated Communication |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Invited seminar by Alex Lascarides at the Universite de Paris (virtual). |
| Year(s) Of Engagement Activity | 2021 |
| Description | Speaker and panellist Sufficiency of patent disclosure on AI inventions |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Panel 3: AI-Gyro Gearloose or Little Helper? What is an AI invention?, Geneva and online, 21-22 September 2022 (by invitation. Hybrid event with over 1,000 registrations from 129 countries) |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://webcast.wipo.int/video/WIPO_IP_CONV_GE_2_2022-09-21_PM_116697 |
| Description | Speaker at AIUK, Alan Turning Institute |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | AI UK is the UK's national showcase of artificial intelligence (AI) and data science research and collaboration. Hosted by The Alan Turing Institute, AI UK 2022 explored how AI and data science could be used to solve real-world challenges. Our unique and diverse programme was thematically structured around the UK's National AI Strategy, with a broad range of interactive content including digital twins, algorithmic bias and AI ethics. AI UK 2022, was a virtual event broadcast from London, which provided world-class insights from academia, industry and the public sector across four stages. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.turing.ac.uk/ai-uk?_cldee=dmFpc2hha0BlZC5hYy51aw%3d%3d&recipientid=contact-3c291326799ce... |
| Description | TAS Conversations - EU AI Act |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | AI is changing the world we live in - how do we prepare for that? What are the risks? And how do we make sure that we create trustworthy AI? Watch this hour of top-level debate and discussion on the EU AI Act - the first-ever legal framework on artificial intelligence. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.tas.ac.uk/bigeventscpt/eu_ai_act/ |
| Description | TAS DTN Seminar: AI and the Imperative of Responsibility: Reconceiving AI Governance as Social Care |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Shannon Vallor presented 'AI and the Imperative of Responsibility: Reconceiving AI Governance as social care' at the TAS Doctoral Training Network seminar 23 June 2022 |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.tas.ac.uk/Events/tas-dtn-seminar-ai-and-the-imperative-of-responsibility-reconceiving-ai... |
| Description | Talk: Safe and secure software systems - An automated reasoning perspective |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Andrew Ireland gave this talk as part of the Heriot-Watt Summer Talk Series (Dubai) that was also promoted by the British Computer Society. |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://www.bcs.org/events/2021/june/webinar-safe-and-secure-software-systems-an-automated-reasoning... |
| Description | Teaching AI and data ethics in colleges |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | The workshop introduced questions of data ethics and data regulation to College-level teachers across all subject areas and helped them integrate issues of data ethics and AI regulation into their curricula. It discussed case studies for courses in computer science, business studies, creative industries and tourism, and introduced the main legal and regulatory issues for the use of data and AI in classroom settings. |
| Year(s) Of Engagement Activity | 2020 |
| Description | Thales |
| Form Of Engagement Activity | A formal working group, expert panel or dialogue |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Dialogue with Thales about cyber-security in autonomous systems, reported at Node annual meeting inc. partners |
| Year(s) Of Engagement Activity | 2021 |
| Description | Transparency and product safety regarding medical diagnostic systems |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Daria Onitiu gave talk at Ethicomp Conference, 26 July 2022 |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://sites.utu.fi/ethicomp2022/ |
| Description | Turing Institute, Causal Inference Interest Group |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Hana Chockler gave talk "Actual Causality, responsibility, explanations and fairness - a birds eye view" |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.causalens.com/event/actual-causality-responsibility-explanations-and-fairness-a-birds-ey... |
| Description | Turing Trustworthy AI forum |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Industry/Business |
| Results and Impact | Explore challenges in 'Human-Machine teaming' - How is an AI/ML prediction different (or not) to a decision? - What are the different human-machine management models? - What does it mean for a human to manage an AI-powered decision? |
| Year(s) Of Engagement Activity | 2021 |
| Description | Verifying AI 'Black Boxes' - Computerphile Episode |
| Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | How to we check to see if a black box system is giving us the right result for the right reason? Even a broken clock is correct twice a day! - Dr Hana Chockler is Reader in the Department of Informatics, King's College London and Principal Scientist at causaLens |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.youtube.com/watch?v=jzRrUPQgrpc&t=2s |
| Description | Workshop: a Recreational Airspace Users Workshop |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | The main item on the agenda for discussion was regulation for allowing drones to fly in the same airspace as manned aircraft. Alex Lascarides contributed to the discussion by talking about the TAS Governance Node work on simulation and testing, and on how users can interact with the simulation environment to find situations where systems might fail. The user experience that learned about at this meeting will inform our work on supporting user interaction with the simulation environment we're developing |
| Year(s) Of Engagement Activity | 2021 |
| Description | Workshop: Carnegie Trust Workshops on Artificial Intelligence and International Rule of Law |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The Artificial Intelligence and the International Rule of Law Workshop Series aims to explore fundamental questions about the relationship between international legal obligations and emerging applications of artificial intelligence (AI) that bear upon key domains of international law: the laws of war, human rights and refugee law. |
| Year(s) Of Engagement Activity | 2021 |
| Description | invited panellist on 'Trustworthy AI by Design' at the 'Centre for Internet Governance Research Annual Conference' |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Professional Practitioners |
| Results and Impact | Invited panellist on 'Trustworthy AI by Design' at the 'Centre for Internet Governance Research Annual Conference'. University of Sussex, England/Online |
| Year(s) Of Engagement Activity | 2021 |
| Description | workshop Robots and Society: Ethical, social, legal and technical perspectives on integrating social robots in the home and healthcare systems and services |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | Robots and Society: Ethical, social, legal, and technical perspectives on integrating social robots in the home and healthcare systems and services (RO-SO - Second Edition). In this workshop, propose to discuss robots as (a)social entities and their role within human-robot (asymmetric) interactions, based on the ontology of asymmetric interaction (OASIS) from Seibt, (2018). We refer to social robots here as care robots, e.g., robots that are used in home- and healthcare settings and have the capacity to interact in a sociomorphed way, by displaying social cues, or interacting through other verbal or non-verbal language forms. Specifically, the RO-SO tutorial is an updated version of the previous tutorials (see footnote 1, 2) regarding robots, ethics, legal, and technical aspects. The tutorial focuses on providing an overview and discussing the ethical, social, legal, and technical perspectives, including challenges, dilemmas, and advantages and opportunities of integrating robots as a part of home- and healthcare systems and services. The following three questions will guide the overall objective for this tutorial, but these will not limit the talks: How does the meaning of being social and/or social change when we integrate robots as a part of the home and healthcare services? What does it mean for a robot to be social, when an asymmetric social interaction takes place between humans and robots? What are some of the risks (e.g., cognitive safety) and some of the benefits (e.g., providing social settings) when we integrate social assistive robots as a part of the home and healthcare services? How does the meaning of good care change when integrating such robots as a part of the home and healthcare services? Does good care provided by a robot imply that the robot should be social? When integrated as parts of the home and healthcare services, what are some of the ethical, legal, intellectual property, and technical challenges and opportunities with social care robots? |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.jus.uio.no/ifp/english/research/projects/nrccl/viros/events/conferences/robotsandsociety... |
| Description | workshop: Governance and regulation of software as medcal device/AI as medical device |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Industry/Business |
| Results and Impact | Problematising: aiming to identify key issues surrounding software/AI-based medical devices and the difficultiesthat may arise for governance and regulation. The goal of this session to gain a clear view of the main problems; participants have different perspectives on these issues and the session is an opportunity to clarify the key challenges facing us. Solutioneering: consider potential solutions to the challenges and implications for governance and regulation. |
| Year(s) Of Engagement Activity | 2022 |