DISTRIBUTED SENSING, CONTROL AND DECISION MAKING IN MULTIAGENT AUTONOMOUS SYSTEMS

Lead Research Organisation: University of Southampton
Department Name: Faculty of Engineering & the Environment

Abstract

Autonomous intelligent systems will find important applications in our future society. Initial applications will be in the following areas: surveillance, intelligence gathering and operational control in the areas of disaster mitigation (earthquake, nuclear catastrophe, military combat, oil-spills at sea, transport infrastructure breakdown, analysis and assistance with terrorist attacks), space exploration at remote locations (at Trojan asteroids, on Mars and in orbit observations around planets, deep underwater explorations and robotics for offshore oil exploration disasters) followed by large scale applications such as agricultural, search and rescue, manufacturing, and autonomous household robots. These autonomous system will require quick, appropriate, and at the same time informative-to-partners, actions by teams of robots. They can also be computing network based intelligent agents with sensing and control capabilities. It will be a societal requirement that these (semi-)autonomously operating systems to inform their human supervisors about the reasoning behind their actions and their future plans in concise notes for their safety and acceptability by society.

Network based software agents have been in use by our society for some time. Our society is going through information exchange revolution that is developing towards networked intelligent devices. Many of these infrastructure systems are based on well defined discrete inputs and outputs either from human operators or from low dimensional sensor measurements. Little progress has however been made in robot intelligence of autonomy where high complexity, changing environment is to be sensed, reasoned about and acted upon quickly. Partial results have been reported in DARPA, Robocup projects that do not provide comprehensive systematic approach or are not fully publicly available. Progress has only been made in heavily infrastructured environments of robots.

We do not yet have the methodology for a set of autonomous vehicles or agent systems to operate reliably and (semi-)autonomously in complex infrastructure-free environments to solve problems efficiently with minimal human supervision. The reason is that current intelligent agent technology does not provide solutions. Sensor networks with simple computational nodes, that were developed for low power and computational resources do not provide solutions. They miss the ability of high complexity conceptual abstractions onboard a single agent. The computations of these type of agents cannot be substituted by data fusion of low complexity agents due to typical real-time and communication bottlenecks. Methods of multi-agent decentralized decision theory have been developed and very successfully used prior to this project but have not been properly exploited for multiple complex agents.

This project intends to develop a new methodology for autonomous cooperating multi-agent systems that is to boost the technological capabilities of our partner companies and the robotics industry in general. The project will provide the missing capabilities of abstractions concerning world modeling, situational awareness, learning and information management onboard a single agent. These capabilities will enable efficient realtime decision making within multi-agent cooperation and decentralized decision making in poorly structured or infrastructure free environments. These methods will connect digital computing power with human conceptual structures to enable robots to model the world with layers of high and low level concepts as humans do.

Planned Impact

The high level of autonomy levels achieved (up to 4b on the extended PACT scale and levels 7-9 on the AFRL scale by Clough) will include decentralised decision making and control by a team of autonomous intelligent agents, including coalition formation for specific goals. These results will have a major impact on industrial automation in general.

The demonstrations will demonstrate to the public the high relevance of this research to society and efficient spending of research funds in terms of the multi-agent vehicle systems. The relevance of this research for networked intelligent autonomous agents with sensing and actuator capabilities for fast response in infrastructure breakdown mitigation in rail transport, nuclear and complex manufacturing systems, will also be demonstrated.

The academic and industrial novelty of the ability of the agents to read system English (sEnglish) technical documents will raise international interest as our agents will read about new physical and mental skills, such as movement controls, movement planning, procedures of payload tasks, situational awareness techniques, response rules and behaviour constraint handling.

Our methods of building up layered abstractions of agent operations, for their physical self-control, communications and team working capabilities, will be academically significant and will show the way for future software engineering in the area of autonomous systems.

The above impact will be achieved via a series of

- Journal papers
- Conference presentations
- Workshops for our industrial partners
- Media publicity where appropriate

Publications

10 25 50

publication icon
Smyrnakis Michalis (2016) Collision Avoidance of Two Autonomous Quadcopters in arXiv e-prints

publication icon
Smyrnakis, M (2017) Consensus in cooperative behaviour of robot populations in IEEE Transaction on Automatic Control

publication icon
Smyrnakis M (2014) Coordination of control in robot teams using game-theoretic learning in IFAC Proceedings Volumes

publication icon
Smyrnakis M (2016) Fictitious play for cooperative action selection in robot teams in Engineering Applications of Artificial Intelligence

publication icon
Qu H (2014) Formulating Robot Pursuit-Evasion Strategies by Model Checking in IFAC Proceedings Volumes

publication icon
Yuan Q (2016) Improving BDD-based attractor detection for synchronous Boolean networks in Science China Information Sciences

publication icon
Smyrnakis M (2018) Improving Multi-Robot Coordination by Game-Theoretic Learning Algorithms in International Journal on Artificial Intelligence Tools

publication icon
Costalago-Meruelo A (2017) Predictive control of intersegmental tarsal movements in an insect. in Journal of computational neuroscience

publication icon
Qu Hongyang (2016) SMCL - Stochastic Model Checker for Learning in Games in arXiv e-prints

publication icon
Caicedo-Núñez C (2013) The frame alignment problem in formations of multi-agent systems in IFAC Proceedings Volumes

publication icon
Qu H (2016) Verification of logical consistency in robotic reasoning in Robotics and Autonomous Systems

 
Description By the end of May 2013 the following has been achieved: 1. Distributed frame alignment problem for multi-agent systems with missing or unreliable attitude sensors has been investigated using camera based computer vision. 2. Possibility of cooperative formation keeping using distributed control and by simple interactions has been proven for large number of spacecraft in theory and simulations. By the end of 2015: 3. Co-active type autonomous cooperation of robots has been developed based on the game theoretic principles of fictitious play 4. Logical consistency of the reasoning and provable performance of the same cooperating robots has been made formally verifiable by new methods developed during the project. 5. Multi-robot and multi-target pursuit-evasion strategies have been developed where cooperating pursuers follow an optimal clearing strategy . By the end of 2017: 6. New combined search and monitoring strategies have been developed as further development of methods in the earlier part of the project. 7. Cooperative agent templates have been developed through the sEnglish Publisher / ROS based integrated development environment for the implementation of practical robotic systems for numerous industrial applications.
Exploitation Route Currently ongoing collaborative work with industrial partners: 1. National Nuclear Laboratories / Sellafield Ltd / RACE 2. SysBrain Ltd
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Energy,Environment,Manufacturing, including Industrial Biotechology,Security and Diplomacy

URL https://www.sheffield.ac.uk/acse/research/groups/asrg/acl/project1
 
Description 1. We have used the methods developed in this project in our demonstration of the operation of autonomous robot arms at Sellafield Ltd (NNL) at their Workington Inactive Laboratory. 2. The methods have also impacted and are applied in commercial software packages produced by SysBrain Ltd for user configuration of robot interaction policies in English within the sEnglish based human-robot interaction system.
First Year Of Impact 2017
Sector Aerospace, Defence and Marine,Construction,Creative Economy,Digital/Communication/Information Technologies (including Software),Energy,Manufacturing, including Industrial Biotechology,Transport
Impact Types Cultural,Societal

 
Description Connected Autonomous Vehicles
Amount £73,000 (GBP)
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 04/2016 
End 05/2017
 
Description EPSRC: Robotics Capital Funding
Amount £1,000,000 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 03/2014 
End 04/2017
 
Description Responsive mode
Amount £450,000 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 11/2014 
End 05/2018
 
Description COSTAIN Group : Autonomous Vehicle Users 
Organisation Costain Group
Country United Kingdom 
Sector Private 
PI Contribution 3 days total length of meetings between research staff at Sheffield University and the M1 development team at junction 29 of the M1 motorway.
Collaborator Contribution Various robotic needs and development opportunities have been discussed with Costains high level (Tim Embley) and middle management (Mohammed Shah) and their colleagues.
Impact The discussions helped us identify research directions and future industrial needs
Start Year 2015