MUlti-limb Virtual Environment (MUVE) for full body and augmented interactions
Lead Research Organisation:
Imperial College London
Department Name: Bioengineering
Abstract
The MUlti-limb Virtual Environment (MUVE) is a first-of-its-kind system housed in the Human Interface Laboratory of Imperial College that enables to study the interaction of human natural limbs with robotic limbs. The robotic limbs can be worn (physically or virtually) by the human user and/or can act externally on them while MUVE yields physical, visual, auditive, and haptic interactions. For this purpose, MUVE combines (i) the most advanced treadmill based virtual reality motion suite currently available, with (ii) two robotic interfaces to smoothly interact with the arms, (iii) up to four wearable robotic arms for movement augmentation, and (iv) dedicated sensorimotor interfaces from the Human Interface lab, including instrumented objects, soft sensors and exoskeletons, advanced prostheses, high-density EMG and non-invasive neural interfaces.
This highly versatile system can be used to train tasks combining locomotion with upper-body and arm movements in physical rehabilitation, sport, or for maintenance in manufacturing and field work. It can embody movement augmentation through supernumerary wearable robotic arms (aka Dr. Octopus) for developing novel applications ranging from robotic surgery (with robotic limbs to control additional tools) to lone working (in remote locations/constrained environments). It can also be used as a development system for ergonomics testing of active exoskeletons for automotive industry workers or for supporting healthy ageing. Finally, it offers opportunities to develop new metaverse approaches with physical interaction, e.g. to provide assistance to and social interaction with elderly, or to embody virtual patients for telemedical applications.
The MUVE system is accessible to researchers and companies in the UK and globally. It is housed in Imperial's new White City campus, within a rich ecosystem of research and translation in human technologies. MUVE will allow the development of fundamentally new applications in physical rehabilitation, robotic surgery, teleoperation, ergonomics, and novel interfaces for communication technology. It will also enable researchers to systematically investigate how the central nervous system coordinates the limbs for high skill and movement restoration, as well as its potential for controlling extra degrees-of-freedom - which are open fundamental neuroscientific questions.
This highly versatile system can be used to train tasks combining locomotion with upper-body and arm movements in physical rehabilitation, sport, or for maintenance in manufacturing and field work. It can embody movement augmentation through supernumerary wearable robotic arms (aka Dr. Octopus) for developing novel applications ranging from robotic surgery (with robotic limbs to control additional tools) to lone working (in remote locations/constrained environments). It can also be used as a development system for ergonomics testing of active exoskeletons for automotive industry workers or for supporting healthy ageing. Finally, it offers opportunities to develop new metaverse approaches with physical interaction, e.g. to provide assistance to and social interaction with elderly, or to embody virtual patients for telemedical applications.
The MUVE system is accessible to researchers and companies in the UK and globally. It is housed in Imperial's new White City campus, within a rich ecosystem of research and translation in human technologies. MUVE will allow the development of fundamentally new applications in physical rehabilitation, robotic surgery, teleoperation, ergonomics, and novel interfaces for communication technology. It will also enable researchers to systematically investigate how the central nervous system coordinates the limbs for high skill and movement restoration, as well as its potential for controlling extra degrees-of-freedom - which are open fundamental neuroscientific questions.
Organisations
Publications
Carboni G
(2022)
Author Correction: Adapting the visuo-haptic perception through muscle coactivation.
in Scientific reports
| Description | The system has been setup and basic modalities have been implemented. Also we had two events with potential users for them to learn some of the opportunities enabled by it. The system has been set up on the PPMS booking system and 15 researchers have been trained to use it. |
| Exploitation Route | The system has been set up on the PPMS booking system and 15 researchers have been trained to use it. We are applying for projects that would use the system. |
| Sectors | Aerospace Defence and Marine Agriculture Food and Drink Construction Education Energy Healthcare Leisure Activities including Sports Recreation and Tourism Culture Heritage Museums and Collections Transport |
| URL | https://www.imperial.ac.uk/human-robotics/dr-octopus-/ |
| Description | A workshop and an international symposium dedicated to human interfacing and augmentation have been organised as part of the MUVE project, in November 2023 and July 2024 respectively. Further engagement activities included the production of a promotional video (https://youtu.be/rqmQXxKUauA?feature=shared), and the participation to the annual Exhibition Road Festival, as well as various other open days within the White City ecosystem. MUVE was also featured in outreach activities organised by the Department of Bioengineering, such as the Bioengineering tasted day for perspective students, as well as numerous visits by academic, industrial and other stakeholders, including a recent visit by the King on 19/02/2025. |
| Sector | Education,Healthcare,Government, Democracy and Justice,Security and Diplomacy |
| Impact Types | Cultural Societal Policy & public services |
| Description | Symposium on human interfacing and augmentation |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | This symposium on human interfacing and augmentation engaged leaders in these topics, to discuss recent advances and define the field for the next years. |
| Year(s) Of Engagement Activity | 2024 |
| Description | VIP visits |
| Form Of Engagement Activity | A press release, press conference or response to a media enquiry/interview |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Policymakers/politicians |
| Results and Impact | We have had numerous visits, such as from the wife of UK's president Zelensky together with the UK PM's wife on 29/2/2024, as well as from his Majesty the King on 19/2/2025. |
| Year(s) Of Engagement Activity | 2023,2024,2025 |
| Description | promotional video on MUVE facilities |
| Form Of Engagement Activity | Engagement focused website, blog or social media channel |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | This video demonstrates the system and explain how it can be used and booked by users from industry or academia. |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://youtu.be/rqmQXxKUauA?feature=shared |
| Description | workshop on human interfacing and augmentation |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Postgraduate students |
| Results and Impact | This workshop was to inform potential users of the MUVE system and discuss with them how to develop the system's software and wearables. |
| Year(s) Of Engagement Activity | 2023 |
