Supervisory Agent for Safety Improvements in AI Systems

This research will investigate the feasibility of introducing an independent Supervisory Agent to monitor AI based agent(s) operating within an environment. The primary focus is agent(s) whose behaviour has the potential to change at run-time (for example, via techniques such as generative planning or machine learning) thus introducing unknown actions. The Supervisory Agent will monitor the intended actions of the agent(s), and prevent the execution of any harmful or unsafe actions. This may involve substituting a safe action for an unsafe action that has been suppressed.