Supervisory Agent for Safety Improvements in AI Systems
Lead Research Organisation:
University of Nottingham
Department Name: School of Computer Science
Abstract
This research will investigate the feasibility of introducing an independent Supervisory Agent to monitor AI based agent(s) operating within an environment. The primary focus is agent(s) whose behaviour has the potential to change at run-time (for example, via techniques such as generative planning or machine learning) thus introducing unknown actions. The Supervisory Agent will monitor the intended actions of the agent(s), and prevent the execution of any harmful or unsafe actions. This may involve substituting a safe action for an unsafe action that has been suppressed.
Organisations
People |
ORCID iD |
Brian Logan (Primary Supervisor) | |
Simon Castle-Green (Student) |
Studentship Projects
Project Reference | Relationship | Related To | Start | End | Student Name |
---|---|---|---|---|---|
EP/N50970X/1 | 01/10/2016 | 30/09/2021 | |||
2102490 | Studentship | EP/N50970X/1 | 01/10/2018 | 12/12/2022 | Simon Castle-Green |
EP/R513283/1 | 01/10/2018 | 30/09/2023 | |||
2102490 | Studentship | EP/R513283/1 | 01/10/2018 | 12/12/2022 | Simon Castle-Green |