A digital COgnitive architecture to achieve Rapid Task programming and flEXibility in manufacturing robots through human demonstrations (DIGI-CORTEX)

Lead Research Organisation: University of Sheffield
Department Name: Automatic Control and Systems Eng

Abstract

The Made Smarter review identified that the UK is lagging behind in worker productivity and could benefit from the advent of new industrial digital tools (IDTs) such as novel intelligent technologies, connected devices, robotics and artificial Intelligence. It is estimated that IDTs could contribute an additional £630bn to the UK economy by 2035 and increase the manufacturing sector growth by between 1.5 and 3% per annum [1]. For example, there is a high demand for bespoke and personalised goods in high volume [2]. In order to meet this demand, manufacturing systems need to be highly flexible, adaptable and highly automated. Since most manufacturing SMEs make use of jobshops and contribute up to 15% of the UK economy [3], equipping them with robots that can learn a task rapidly and flexibly (similar to how a human can be rapidly trained to assemble new product lines) will enable SMEs to meet high order demands thereby improving UK PLC's export opportunities and UK's GDP.

This proposal aims to investigate cognitive architectures that equips robots with the capability to rapidly learn new skills by passive observation of a human demonstrating a task to the robot and applying previously learnt skills to new task scenarios, thereby achieving task flexibility on the manufacturing floor. This opens up exciting possibilities. For one, it means that robots can be taught to do various tasks with no intensive programming required by a human. It also means that robots can be flexibly used to perform a wide variety of tasks thereby reducing the need for capital intensive, rigid and time-consuming manufacturing set ups.

There is a gap in literature of applying digital mental models on robots for building in flexible and creative robots that can be flexibly and rapidly re-tasked for various tasks. Nevertheless, there is a growing realisation that creativity is needed in industrial robots of the future and that this could be achieved through providing them with mental models [4]. For the first time ever, this proposal investigates a cognitive architecture that embeds the human cognitive capabilities of mental simulation for creative problem solving on manufacturing robots and task structure mapping in a unified framework for the purposes of achieving rapid re-tasking (task flexibility) of industrial robots via passive human demonstrations. State of the art architectures (such as SOAR and ART-R) often make use of a prior task informed rigid procedural rules that make them less amenable for exploring rapid re-tasking on robots while techniques that use machine learning paradigms (e.g deep neural networks or reinforcement learning) that require lots of data and result in task specific applications. Furthermore, these techniques are yet to be successfully combined with the creation of digital mental models through envisioning and applied to varying tasks in manufacturing environments similar to those to be investigated in this proposal. In summary, the novelty of this proposal is in the application of robot envisioned digital mental models to support them in creativity and imagination of morphological informed solutions to problems encountered in manufacturing (and other sectors outside manufacturing) as well as to support the application of previously learnt skills to new similar tasks. This will lead to rapid re-tasking and task flexibility in robots.

References:
[1] J. Maier, "Made Smarter Review," 2017.
[2] D. Brown, A. Swift, and E. Smart, "Data analytics and decision making," Inst. Ind. Res. Univ. Portsmouth, pp. 1-20, 2019, doi: 10.4324/9781315743011-9.
[3] C. Rhodes, "Business Statistics," 2019.
[4] J. B. Hamrick, "Analogues of mental simulation and imagination in deep learning," Current Opinion Behavioral Science, vol. 29, pp. 8-16, 2019.
 
Description Digital Twins for Debris capture in Space: Satellite Catapult Collaboration 
Organisation Satellite Applications Catapult
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution My team is developing vision based control algorithms to enable a robot arm capture dynamic and mobile objects on another robot arm. The idea is that the robot arms would simulate an automated capture of debris in space. This would enable the satellite catapult test out various automated capture regimes on earth before deployment in space.
Collaborator Contribution The Satellite Catapult is providing KUKA industrial robot arms onsite to validate the work my team is doing.
Impact The collaboration is resulting in software which would be deployed onsite at the Satellite Catapult.
Start Year 2022
 
Description Soft material manipulation with the University of Nottingham 
Organisation University of Nottingham
Country United Kingdom 
Sector Academic/University 
PI Contribution My research team is looking into how the architecture developed as part of DIGI-CORTEX could be applied to the manipulation of composite materials. The University of Nottingham was introduced to us by Pentaxia, our industrial partner on DigiCORTEX.
Collaborator Contribution The partner is providing composite use cases to inform the development of architecture solutions.
Impact Potential use cases to apply in our research
Start Year 2023
 
Description UK Robotics and Autonomous Systems Network 
Organisation University of Southampton
Country United Kingdom 
Sector Academic/University 
PI Contribution I am currently a co-chair of early career researcher (ECR) forum of the UK Robotics and Autonomous Systems Network (UK-RAS). I lead the ECR initiatives and am involved in developing a roadmap to inform the next generation of Robotics in the United Kingdom. I believe that my New Investigator Award was instrumental in giving me an edge to be a co-chair of this network.
Collaborator Contribution The University of Manchester is currently leading a proposal for the UK-RAS+ with me as a Co-I. I would not have had this opportunity if I had not been a co-chair on the ECR forum of UK RAS which would not have happened without my New Investigator Award. By being a Co-I on the winning UK-RAS+ grant, I would plug into the UK-wide partner Universities participating in the Network which would further increase my visibility and impact of my research.
Impact This has resulted in the submission of an EPSRC network plus proposal that will refresh the UK RAS network and lead to it being sustainable in the long term. The aim is to further consolidate all the activities taking place in the UK across the network as well as work with international collaborators to show case UK's best robotics research globally. The proposed activities taking place across the proposed RAS network would enhance robotics research in the UK and help inform policy for the uptake and deployment of RAS in various sectors of the society. It would lead to fellowships for ECRs and mid-career researchers thereby providing a sustainable pipeline of globally recognised researchers for the UK. The intended international status would also help attract the best talents to the UK. It would lead to societal, economic and policy impacts.
Start Year 2022