Turing AI Fellowship: Advancing Multi-Agent Deep Reinforcement Learning for Sequential Decision Making in Real-World Applications

Lead Research Organisation: University of Warwick
Department Name: WMG

Abstract

Despite being far from having reached 'artificial general intelligence' - the broad and deep capability for a machine to comprehend our surroundings - progress has been made in the last few years towards a more specialised AI: the ability to effectively address well-defined, specific goals in a given environment, which is the kind of task-oriented intelligence that is part of many human jobs. Much of this progress has been enabled by deep reinforcement learning (DRL), one of the most promising and fast-growing areas within machine learning.
In DRL, an autonomous decision maker - the "agent" - learns how to make optimal decisions that will eventually lead to reaching a final goal. DRL holds the promise of enabling autonomous systems to learn large repertoires of collaborative and adaptive behavioural skills without human intervention, with application in a range of settings from simple games to industrial process automation to modelling human learning and cognition.

Many real-world applications are characterised by the interplay of multiple decision-makers that operate in the same shared-resources environment and need to accomplish goals cooperatively. For instance, some of the most advanced industrial multi-agent systems in the world today are assembly lines and warehouse management systems. Whether the agents are robots, autonomous vehicles or clinical decision-makers, there is a strong desire for and increasing commercial interest in these systems: they are attractive because they can operate on their own in the world, alongside humans, under realistic constraints (e.g. guided by only partial information and with limited communication bandwidth). This research programme will extend the DRL methodology to systems comprising of many interacting agents that must cooperatively achieve a common goal: multi-agent DRL, or MADRL.
 
Description Shuangqing Wei 
Organisation Louisiana State University
Country United States 
Sector Academic/University 
PI Contribution Yue Jin and I conntributed ideas related to a new decentralised multi-agent reinforcement learning algorithm
Collaborator Contribution Yue Jin and I conntributed ideas related to a new decentralised multi-agent reinforcement learning algorithm
Impact An articled titled "Learning to Cooperate under Private Rewards" has been prepared and submitted at the ICML 2024 conference
Start Year 2023
 
Title Unity 3D environments 
Description We have developed two 3D environments (logistic wearers and production line) in Unity to support research in reinforcement learning. 
Type Of Technology Software 
Year Produced 2024 
Open Source License? Yes  
Impact The software is still in a private GitHub repo and will be released publicly shortly