Teleoperated Robot Avatar for Healthcare monitoring and Immunocompromised Patient Assistance

This project aims to develop telerobotic avatar technology with tactile sensing, dexterous capabilities and haptic feedback for use in healthcare settings. There is a need for more efficient and intuitive teleoperated robots, a demand that became evident during the COVID-19 pandemic. Robots have the potential to support the ageing population and to assist immunocompromised patients. Teleoperable robotic avatars can provide critical support to vulnerable populations, including the elderly and immunocompromised patients, by minimizing physical contact and reducing the risk of infection. For example, patients undergoing surgery are prone to post-operative complications due to weakened immunity, which can lead to extended hospital stays and increased healthcare costs. Avatar technology could help mitigate these risks by enabling remote care, reducing hospital congestion, and ensuring faster recovery for patients. A dual arm mobile manipulator robot platform will be developed for this project with tactile sensing capability. The robotic avatar will be controlled via a virtual reality (VR) and haptic interface and guided by semi-autonomous control algorithms. The goal is to create a robust and intuitive system that can effectively support healthcare operations. Initial testing of the developed system and control strategy will be carried out in a digital model of a hospital. Various tactile teleoperation patient-assistance scenarios will be modelled, simulated and tested in this digital model with the VR haptic interface. This will be followed by testing in real-world bedside assistance scenarios with patient simulators to assess its effectiveness. The developed interface will be evaluated for various performance metrics both while teleoperating in computer simulations and during various real-world mock scenarios. The usability and cognitive load for different teleoperation modes will be systematically evaluated and optimized employing techniques like EEG and fNIRS, both with and without haptic feedback. Finally, with industrial partners' support, the system will be pilot-tested and benchmarked in real-world monitoring and patient-assistance healthcare applications. By achieving these goals, the project aims to make a significant contribution to improving patient and elderly care through innovative robotic solutions.