<?xml version="1.0" encoding="UTF-8"?><ns2:project xmlns:ns1="http://gtr.rcuk.ac.uk/gtr/api" xmlns:ns2="http://gtr.rcuk.ac.uk/gtr/api/project" xmlns:ns3="http://gtr.rcuk.ac.uk/gtr/api/fund" xmlns:ns4="http://gtr.rcuk.ac.uk/gtr/api/person" xmlns:ns5="http://gtr.rcuk.ac.uk/gtr/api/project/outcome" xmlns:ns6="http://gtr.rcuk.ac.uk/gtr/api/organisation" ns1:created="2026-06-03T15:52:43Z" ns1:href="http://gtr.ukri.org/gtr/api/projects/24BCF400-5BE6-4832-B9BF-A3E2DC912F8B" ns1:id="24BCF400-5BE6-4832-B9BF-A3E2DC912F8B"><ns1:links><ns1:link ns1:href="http://gtr.ukri.org/gtr/api/persons/F2A8ABCC-254D-4810-953B-4643830E7D9C" ns1:rel="PM_PER"/><ns1:link ns1:href="http://gtr.ukri.org/gtr/api/organisations/13C979ED-CCCE-4C21-9953-307B6EC53D42" ns1:rel="LEAD_ORG"/><ns1:link ns1:href="http://gtr.ukri.org/gtr/api/organisations/13C979ED-CCCE-4C21-9953-307B6EC53D42" ns1:rel="PARTICIPANT_ORG"/><ns1:link ns1:end="2025-07-30T23:00:00Z" ns1:href="http://gtr.ukri.org/gtr/api/funds/7F62B327-3B7D-42AE-B2C6-EA759BFE1C0C" ns1:rel="FUND" ns1:start="2025-03-31T23:00:00Z"/></ns1:links><ns2:identifiers><ns2:identifier ns2:type="RCUK">10156846</ns2:identifier></ns2:identifiers><ns2:title>Mitigating AI Risks: Enhancing Large Language Model Safety in Robot Control</ns2:title><ns2:status>Closed</ns2:status><ns2:grantCategory>Collaborative R&amp;D</ns2:grantCategory><ns2:leadFunder>Innovate UK</ns2:leadFunder><ns2:abstractText>The increasing integration of Large Language Models (LLMs) into robotic systems enables robots to understand and respond to natural language commands. This advancement is particularly valuable in critical sectors such as healthcare, manufacturing, and smart environments, where LLM-driven robots can simplify complex operations and improve accessibility. However, as robots become more reliant on LLMs for decision-making and control, they also become vulnerable to new cybersecurity threats, raising concerns about safety, reliability, and trust in AI-driven automation.

This project directly addresses these challenges by developing an innovative AI safety framework to protect LLM-driven robots from adversarial manipulation and unintended harmful behaviours. Existing AI safety measures are not designed to handle sequential command vulnerabilities, adversarial prompts, or indirect manipulation, making LLM-based control systems particularly susceptible to exploitation. Attackers could manipulate prompts, inject harmful instructions, or exploit contextual gaps, leading to unsafe robotic actions. Even without malicious intent, LLMs may misinterpret ambiguous or sequential instructions, posing a risk to users.

To mitigate these risks, our project introduces a two-level AI safety guard architecture, integrating edge-level and on-device protection to enhance systemic AI safety in resource-constrained robotic environments.

Level 1 Edge-Level Protection: By leveraging edge computing, safety mechanisms operate closer to the source (e.g., within local networks or devices) rather than relying on remote cloud-based servers. This minimises latency, enhances privacy by keeping sensitive data local, and reduces reliance on external infrastructure.

Level 2 On-Device Protection: Lightweight AI models embedded directly within robots provide real-time anomaly detection and adversarial resilience. This ensures that even in resource-constrained robotic systems, security mechanisms can function effectively without external dependencies.

This dual-layer security model provides robust protection against adversarial attacks, ensuring that even if one layer is compromised or delayed, the other acts as a fail-safe to maintain operational integrity.

The key innovations and impact are the following:

(1) Context-Aware Safety Mechanisms: Unlike conventional AI security models, our approach ensures that robots understand the intent behind sequential commands, preventing unintended harmful actions.

(2) Lightweight AI Security for Edge and Robotics: Many existing cybersecurity solutions are too computationally intensive for real-time robot control. Our model is optimised for efficient deployment in resource-limited robotic environments.

(3) Protection Against Emerging AI Threats: By defending against prompt injection, sequential command exploitation, and adversarial manipulation, this project sets a new framework for AI security in robotics.</ns2:abstractText></ns2:project>