ATRACT: A Trustworthy Robotic Autonomous system to support Casualty Triage

Lead Research Organisation: Edge Hill University
Department Name: Computer Science

Abstract

In the Vietnam War, American evacuation helicopters transformed soldier survivability with the emergence of the 'Golden Hour'. This relied on air superiority and relative freedom of movement and has been the UK/US/NATO approach to battlefield casualty treatment since. However, recent proliferation and effectiveness of low-cost, accurate, shoulder-launched ground-to-air missiles has significantly disrupted helicopter operations in Ukraine and thus, presenting a heightened risk to Casualty Evacuation (CASEVAC) operations. Moreover, frontline army doctors work in world's most harsh and hostile environments, and often risk their lives while marching out and stepping in when they are needed near fighting forces. They are often required to monitor multiple casualties at a given time and prioritise whom they should be attending first based on the severity of injuries. Thus, there is an urgent unmet need for enhancing casualty survival in a contested environment where conventional helicopter CASEVAC is slow or unavailable.

Recent advancement in Artificial Intelligence (AI) and Robotic Autonomous System (RAS) provides new and future opportunities to meet this challenge. In line with this, the proposed ATRACT system is a disruptive innovation to address this unmet need in a novel way by designing, developing and field-testing a trustworthy drone-driven RAS to help frontline medics in decision-making in the first 'platinum ten minutes' following trauma. ATRACT will adopt an interdisciplinary and transformative research approach focusing on: 1) accurate search and localisation of injured soldiers using advanced manoeuvring of a drone in difficult terrains, 2) a novel platform that combines advanced multimodal sensing, beyond state-of-the-art algorithms for a robotic system to detect frontline soldiers, 3) real-time monitoring of their injury severity and vital signs for effective triage prediction/update, and 4) where medical emergency response team is available, real-time casualty information to the enroute medical team as it approaches, enabling more effective crew resource management and casualty prioritisation, thereby reducing time on the ground to maximise survivability and to minimise risk of the frontline medics being attacked.

AI and RAS are the driving forces in many industries (e.g., manufacturing, agriculture, transport, healthcare, etc.) and helping to address some of the most pressing issues facing humankind. Many such technologies have a major limitation of trustworthiness (technically robust, ethically adherent and lawful) and mainly because they typically use a "black box" approach, where AI elements are often less visible and transparent in the way data is used and operationalised from multiple sources, and frequently exhibits unconscious biases resulting in lack of control in decision-making. Moreover, they do not provide contextualised services or customised interventions to changing conditions and/or environmental settings. ATRACT will address these limitations via design and development processes which comply with the latest ethical and legal MoD AI standards, and military medical practice, incorporating principles from the WHO Surgical Checklist to align medical considerations with data quality, bias avoidance and system reliability factors. We will ensure that ATRACT is transparent, consistent and interpretable so that potential bias, legal and medical compliance, and MoD ethics can be addressed systematically at every stage of design, development and testing with expert-in-the-loop. Successful results in this context will revolutionise the way frontline health services, casualty evacuation and the delivery of emergency and lifesaving medical aid is delivered, resulting in significant health, social and economic benefits.
 
Description Fault Tolerent Multi-agent AI
Amount £35,000 (GBP)
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 01/2024 
End 05/2024
 
Description Forensic science for the justice system sandpit
Amount £639,873 (GBP)
Funding ID ES/Y010655/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 03/2024 
End 03/2025
 
Description Horizon Europe MSCA Postdoctoral Fellowships 2023
Amount £206,085 (GBP)
Funding ID EP/Z001102/1 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 08/2024 
End 08/2026
 
Description Horizon Europe Pump Priming Collaboration between UK and EU Partners 2024
Amount £10,000 (GBP)
Funding ID PPHE24\100321 
Organisation The British Academy 
Sector Academic/University
Country United Kingdom
Start 03/2024 
End 10/2024
 
Description Knowledge Transfer Partnership (KTP)
Amount £205,332 (GBP)
Funding ID 13476 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 02/2024 
End 10/2026
 
Description Knowledge Transfer Partnership (KTP)
Amount £233,507 (GBP)
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 06/2024 
End 03/2027
 
Description AI based detection and Loading of a product in the manufacturing line 
Organisation Focus Group
Country United Kingdom 
Sector Private 
PI Contribution ATRACT Project created confidence in the Industrial Partner to develop the Collaboration with the University of Brighton on developing new AI based technologies for industrial automation
Collaborator Contribution KTP
Impact A new project to develop AI based product detection, loading and unloading robotic system for the assembly line
Start Year 2023
 
Description AI-Enabled Bomb Disposal Robot for Improvised Explosive Devices 
Organisation Cardiff University
Country United Kingdom 
Sector Academic/University 
PI Contribution AI-enabled research and development of a next-generation, trustworthy, agile, semi-autonomous Explosive Ordnance Disposal (EOD) robotic system for improvised explosive devices (IED) detection and neutralization by advancing human-like robotic skills and human-robot teaming.
Collaborator Contribution Expertise in computer vision, and AI for urban sensing and mapping. Contribution towards the development of EOD-Agile Robot platform Provide expertise in Context-driven Diffusion Strategies 3-D Model Reconstruction using 2D Images
Impact The discussion is ongoing. We are discussing and developing a plan for a potential multi-disciplinary research proposal consisting of academics from Computer Science, Robotics and AI, Engineering, Human-Machine Systems, Human-Computer/Robots Interactions, Applied Ethics, Humanities and Social Sciences, and industrial partners such as Quinetic, and L3Harris.
Start Year 2023
 
Description AI-Enabled Bomb Disposal Robot for Improvised Explosive Devices 
Organisation Swansea University
Department Department of Computer Science
Country United Kingdom 
Sector Academic/University 
PI Contribution AI-enabled research and development of a next-generation, trustworthy, agile, semi-autonomous Explosive Ordnance Disposal (EOD) robotic system for improvised explosive devices (IED) detection and neutralization by advancing human-like robotic skills and human-robot teaming.
Collaborator Contribution Expertise in computer vision, and AI for urban sensing and mapping. Contribution towards the development of EOD-Agile Robot platform Provide expertise in Context-driven Diffusion Strategies 3-D Model Reconstruction using 2D Images
Impact The discussion is ongoing. We are discussing and developing a plan for a potential multi-disciplinary research proposal consisting of academics from Computer Science, Robotics and AI, Engineering, Human-Machine Systems, Human-Computer/Robots Interactions, Applied Ethics, Humanities and Social Sciences, and industrial partners such as Quinetic, and L3Harris.
Start Year 2023
 
Description AI-Enabled Bomb Disposal Robot for Improvised Explosive Devices 
Organisation University of Brighton
Department Faculty of Science and Engineering
Country United Kingdom 
Sector Academic/University 
PI Contribution AI-enabled research and development of a next-generation, trustworthy, agile, semi-autonomous Explosive Ordnance Disposal (EOD) robotic system for improvised explosive devices (IED) detection and neutralization by advancing human-like robotic skills and human-robot teaming.
Collaborator Contribution Expertise in computer vision, and AI for urban sensing and mapping. Contribution towards the development of EOD-Agile Robot platform Provide expertise in Context-driven Diffusion Strategies 3-D Model Reconstruction using 2D Images
Impact The discussion is ongoing. We are discussing and developing a plan for a potential multi-disciplinary research proposal consisting of academics from Computer Science, Robotics and AI, Engineering, Human-Machine Systems, Human-Computer/Robots Interactions, Applied Ethics, Humanities and Social Sciences, and industrial partners such as Quinetic, and L3Harris.
Start Year 2023
 
Description AI-Enabled Bomb Disposal Robot for Improvised Explosive Devices 
Organisation University of Portsmouth
Country United Kingdom 
Sector Academic/University 
PI Contribution AI-enabled research and development of a next-generation, trustworthy, agile, semi-autonomous Explosive Ordnance Disposal (EOD) robotic system for improvised explosive devices (IED) detection and neutralization by advancing human-like robotic skills and human-robot teaming.
Collaborator Contribution Expertise in computer vision, and AI for urban sensing and mapping. Contribution towards the development of EOD-Agile Robot platform Provide expertise in Context-driven Diffusion Strategies 3-D Model Reconstruction using 2D Images
Impact The discussion is ongoing. We are discussing and developing a plan for a potential multi-disciplinary research proposal consisting of academics from Computer Science, Robotics and AI, Engineering, Human-Machine Systems, Human-Computer/Robots Interactions, Applied Ethics, Humanities and Social Sciences, and industrial partners such as Quinetic, and L3Harris.
Start Year 2023
 
Description Cross-Modal Wireless Sensing for Covert Intelligence Gathering 
Organisation Imperial College London
Country United Kingdom 
Sector Academic/University 
PI Contribution Development of a feasibility study to track activities with their wireless finger print, thus enabling camera less sensing. Performed a literature review to identify the state of the art. Engagement with the research councils to develop the idea
Collaborator Contribution Conceptualisation of the ideas Mentoring of the young researchers
Impact The activity is not yet generated public outputs
Start Year 2023
 
Description Cross-Modal Wireless Sensing for Covert Intelligence Gathering 
Organisation Lancaster University
Country United Kingdom 
Sector Academic/University 
PI Contribution Development of a feasibility study to track activities with their wireless finger print, thus enabling camera less sensing. Performed a literature review to identify the state of the art. Engagement with the research councils to develop the idea
Collaborator Contribution Conceptualisation of the ideas Mentoring of the young researchers
Impact The activity is not yet generated public outputs
Start Year 2023
 
Description Object release Mechanism using drones 
Organisation L3 Commercial Aviation
Sector Private 
PI Contribution ATRACT project directly helped the development of this link. L3Harris are doing similar project on the commercial basis.
Collaborator Contribution Testing facility and development of a new drawings of the object release mechanism for the objects from the drones.
Impact A new object release mechanism for the drones
Start Year 2023
 
Description Lecture at UK Defence Academy 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact I gave a lecture on the Ethical Challenges of Remote Air Warfare to 60 Royal Air Force officers on a training course. Having addressed major challenges associated with remotely piloted aircraft systems (RAF Reaper) I used the 'ATRACT: A Trustworthy Robotic Autonomous system to support Casualty Triage' project to demonstrate the technical and ethical challenges of incorporating AI into future military drone systems.
Year(s) Of Engagement Activity 2024
URL https://www.da.mod.uk/
 
Description Panel on Responsible AI in Military 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact The REAIM Summit welcomed 2.000 attendees from 100 countries with 80 government representatives contributing to the responsible use and deployment of military AI.

Countries are attempting to implement and amend their legal systems in order to keep up with the rapidly evolving AI development. As a result, AI regulations are emerging at the state/city, industry, country, and regional levels. Despite its great benefits, properly unregulated deployment of AI algorithm poses serious concerns, including privacy violations, bias embedding, potential misuse, and unintended consequences.
Prominent experts in the field, Including Prof Peter Lee, Prof Ioannis Kakadiaris, Dr. Varuna Desilva, and Prof Tasos Dagiuklas, spoke on this panel discussion to examine the current development and future direction of responsible AI governance frameworks and their implications in the military arena. This session was moderated by Haylat Tibebu.
Year(s) Of Engagement Activity 2023
URL https://reaim2023.org/events/responsible-ai-framework-for-military-domain-development-and-critical-a...
 
Description Presentation (NATO Defence College, Rome) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I gave a presentation to @100 NATO Generals and Ambassadors from NATO member states, plus several Ambassadors from non-NATO states. The presentation was entitled 'Artificial Intelligence: Evolution, Applications and Ethics'. I used the 'ATRACT: A Trustworthy Robotic Autonomous system to support Casualty Triage' project to demonstrate the technical challenges of using AI in an autonomous drone system and using the ethics checklist I am developing in my Work Package to illustrate the ethical challenges at every stage of design, development, testing and deployment of this novel system. The presentation was followed by Q&A and discussion with senior NATO military officers and Ambassadors.
Year(s) Of Engagement Activity 2023
URL https://www.facebook.com/NATODefenseCollege/
 
Description Presentation to UK MOD AI and Autonomy Ethics Advisory Panel 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact I gave a presentation to the UK MOD AI and Autonomy Ethics Advisory Panel. The presentation was entitled 'ATRACT: A Trustworthy Robotic Autonomous system to support Casualty Triage - Creating an Ethics Checklist'. I used the ATRACT project to demonstrate the technical challenges of using AI in an autonomous drone system and using the ethics checklist I am developing in my Work Package to illustrate the ethical challenges at every stage of design, development, testing and deployment of this novel system. The presentation was followed by Q&A and discussion with members of the Ethics Panel. One senior member offered to facilitate the use of the UK Defence Academy Scientific Advisory Committee for the ethics application for the final testing of the system in 2026.
Year(s) Of Engagement Activity 2024
URL https://www.gov.uk/government/publications/ambitious-safe-responsible-our-approach-to-the-delivery-o...
 
Description Project ATRACT - war-zone triage with AI and UAVs 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact It was the press release by our University media team. This has captured various other national and international online news platforms. Some examples are:

https://www.edgehill.ac.uk/news/2023/03/edge-hill-university-launches-ai-project-to-save-lives-on-the-battlefield/
https://www.army-technology.com/features/project-atract-war-zone-triage-with-ai-and-uavs/
https://www.brighton.ac.uk/news/2023/university-of-brighton-joins-ai-project-to-save-lives-on-the-battlefield
https://www.theengineer.co.uk/content/news/aerial-ai-project-aims-to-save-lives-on-the-battlefield/
https://insights.globalspec.com/article/20215/triage-drone-promises-to-improve-casualty-rates-on-the-battlefield
https://armyvoice.gr/2023/04/atract-drone-techniti-noimosyni-pedio/
https://trends.aeroexpo.online/cat/drones-2-12.html
Year(s) Of Engagement Activity 2023
URL https://www.edgehill.ac.uk/news/2023/03/edge-hill-university-launches-ai-project-to-save-lives-on-th...
 
Description Talk and a Panel Discussion on Safety, Trust, Acceptability, Responsibility and Transparency of AI. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Study participants or study members
Results and Impact AI technologies are becoming integrated into almost every aspect of our society, ranging from healthcare and finance to transportation and education. As technology continues to evolve at a rapid pace, questions surrounding ethical implications of AI algorithms, their potential biases, and the trustworthiness of AI-driven systems become increasingly pertinent. Exploring issues of safety, trust, acceptance, responsibility, and transparency in AI and understanding the implications of these advancements is crucial.

This event will deliver a series of short presentations from experts in the development, applications and responsible use of AI, exploring these emerging topics, and provide an opportunity for attendees to pose questions to the experts and engage in discussions.

In this programme, Varuna De Silva gave a talk and participated in the panel discussion. Varuna De Silva provided a synopsis of two EPSRC funded projects focusing on Artificial Intelligence, while exploring the concepts of Safety, Trust, Acceptance, Responsibility & Transparency in AI. The first project aimed to utilize multi-agent learning to construct artificial models of footballers, serving as benchmarks for assessing the skills of real football players. The second project endeavored to create a reliable autonomous drone system for triaging wounded soldiers in battlefield scenarios. Both projects faced unique challenges associated with the principles of START, and Varuna De Silva briefly discussed how these challenges were addressed within each project.
Year(s) Of Engagement Activity 2024
URL https://ai-uk.turing.ac.uk/fringe-events/
 
Description University of Portsmouth Defence Hub's inaugural Symposium - Technical Solutions to Security Challenges 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This activity has generated interest and activities among researchers, academics, and students on the following topics:
1) Human autonomy teaming; benefits, risks and opportunities of humans teaming with adaptive systems.
2) Resilient futures; building a resilient infrastructure (both physical and societal, e.g. how to keep education going), and post-disaster/conflict risk reduction.
3) Role of cyber and wider implications in contexts from humanitarian to war.
Year(s) Of Engagement Activity 2022