Learning the structure and dynamics of human environments to support intelligent mobile robot behaviour

Lead Research Organisation: University of Birmingham
Department Name: School of Computer Science

Abstract

Advances in mobile robot technology over the last 10 years has made the use of service robots (i.e. robots performing tasks for, or with, humans) in the workplace increasingly possible. The problem of building maps of environments that do not change over time has been solved for many application environments, enabling robots to move around in these places for ever-increasing durations. However, real environments do change over time as their inhabitants move around and move furniture and objects as they do so. The resulting changes to a robot's world make it difficult for it to run reliably, and thus there is a danger that we will not be able to create service robots that are able to perform useful tasks in realistic situations.

The proposed research treats the fact that a robot's environment changes regularly as an opportunity rather than a challenge. We will develop systems that are able to extract reliable, significant patterns from the changes observed by an existing intelligent robot (the Dora the Explorer robot from the CogX project). In particular we will develop two approaches. The first will capture how easy or difficult it is for a robot to move through particular parts of its map at particular times of day (e.g. due to humans getting in the way). The second approach will capture how the positions of objects in rooms change over time (e.g. the desk in my office never moves, but my chair tends to move around in front of the desk, but never near the door). Taken together these approaches will allow a robot to improve its performance on typical service robot tasks such as searching for an object in a building, whilst avoiding certain areas at certain times of day (e.g the corridor by a canteen during lunchtime), all in dynamic environments.

Our research will be informed by an advisory board of experts in reasoning about space and robot learning, and also by the security company G4S who are interested in using mobile robots to assist security guards. Our results could help them by allowing robots to choose better patrol routes through buildings, and to learn how the objects in a room are typically arranged (allowing them to spot when things change due to a burglary or other incidents). As well as presenting our results through the usual scientific channels, we will also demonstrate our finished robot system at the Thinktank science museum in Birmingham, giving the public a chance to learn more about state-of-the-art robots and AI, whilst also testing our systems in a challenging environment.

Planned Impact

This project will develop innovative approaches to making intelligent mobile robots adapt to human-populated environments. There are a wide range of applications where such abilities are necessary to ensure a robotic solution provides appropriate service, including security, healthcare (portering and monitoring), and logistics (robots finding and delivering items). As such, the results of this project will create impact by enabling companies interested in robotic solutions to take a further step towards fully autonomous, adaptive service robots.

An example of such a company is G4S, the UK and Ireland's largest security solutions group. We have been working with them to understand their requirements for mobile robots, and their needs have led in part to this research. For example, our results could be used to allow security robots to detect (statistically) unusual variations in object positions in rooms (potentially caused during a security violation). G4S's interest is evidenced by a letter of support for this project, and we will build on this by meeting with David Ella, CTO of G4S Technology, during the project to present him our results, and also to discuss potential follow-on activities such as a Knowledge Transfer Partnership.

As the demographics of our society change, in particular the ratio between the number of people surviving into old age and the number of people training to care for them, more roles in our lives will have to be filled by autonomous systems such as robots, or will require their assistance. The proposed research will have impact by enabling robots to perform more efficiently and effectively in human-populated environments (i.e. the environments where they will be required), thus benefitting society by enabling better service robots.

In order to ensure this impact can be made, it is necessary for the public in general to be more aware of the potential of service robotics, and also have a better understanding of what they can, and cannot offer. By engaging the public on the topic of autonomous robots now, we can start discussing the technological, societal and ethical issues surrounding their wider adoption. We will do this by running a week-long installation of our robot at Thinktank, Birmingham's science museum. Thinktank's interest in this installation is described in a letter of support for this project.

We will increase the impact of our research by making all of our results -- papers, software and data -- available online in a free and open manner. This will include open-source implementations of the new approaches we develop, and an open-source release of the full robot software system we will implement these approaches within. This will create impact by allowing industrial and academic groups developing intelligent mobile robots to build directly on our work, speeding up the process of creating and deploying such systems in real-world environments.
 
Description In this grant we developed a method to combine methods for planning robot behaviours under uncertainty with more qualitative goal descriptions. This allows robots to be given goals in formats which are readily provided by human input but can be addressed in a way which more naturally captures the underlying dynamics of the operating environment.
Exploitation Route We are feeding our findings into our work on long-term autonomy in everyday environments, where the developed method underlies our service robot's planning approach for long-term behaviour. This work fed into the STRANDS EU project (http://strands.acin.tuwien.ac.at/) and the resulting learning and planning system is now being resued in a range of application domains. It is being exploited with the RAIN Hub for robotics and AI in nuclear. We have also run the resulting system in client demonstrators for Accenture Labs and Honda Research Europe.
Sectors Aerospace, Defence and Marine,Agriculture, Food and Drink,Manufacturing, including Industrial Biotechology,Retail,Security and Diplomacy,Transport

 
Description EPSRC's Autonomous Robots show at Cheltenham Science Festival. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Many questions from an engaged audience.

None.
Year(s) Of Engagement Activity 2013
URL http://www.cheltenhamfestivals.com/science/whats-on/2013/autonomous-robots/
 
Description Lord Kelvin Award Lecture at the 2013 British Science Festival 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Many interested people talked to me afterwards

Further opportunities to speak at similar events.
Year(s) Of Engagement Activity 2013
URL http://www.britishscienceassociation.org/british-science-festival/news/robots-and-humans-when-two-so...
 
Description Talk at Science Museum Lates. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Lively discussions and many questions.

Nothing notable.
Year(s) Of Engagement Activity 2013