Robotic Assisted Surgical Guidance and Visualisation

Lead Research Organisation: Imperial College London
Department Name: Institute of Biomedical Engineering

Abstract

The use of augmented reality in surgery has risen dramatically in recent years, contributing to a range of new methods for training, education and diagnosis. In surgery, advances in medical imaging have permitted detailed pre-operative planning and intra-operative surgical guidance. One of the most promising advances in surgical technology in recent years is the introduction of robotic assisted Minimally Invasive Surgery which allows the performance of procedures that are otherwise prohibited by the confines of the operating environment. The purpose of this project is to develop novel visualisation techniques that permit in situ, in vivo integration of complex anatomical and functional information of the operating field through the use of multi-modal, multi-scale imaging data for safer and more effective surgical navigation.

Publications

10 25 50
publication icon
Fujii K (2018) Gaze gesture based human robot interaction for laparoscopic surgery. in Medical image analysis

publication icon
Merrifield R (2017) U.K. Robotics Week [Competitions] in IEEE Robotics & Automation Magazine

publication icon
Merrifield R (2015) Surgical Robot Challenge 2015 [Competitions] in IEEE Robotics & Automation Magazine

publication icon
Mylonas G (2012) Gaze-Contingent Motor Channelling, haptic constraints and associated cognitive demand for robotic MIS in Medical Image Analysis

publication icon
Mountney P (2012) Context specific descriptors for tracking deforming tissue. in Medical image analysis

publication icon
Visentini-Scarzanella M (2010) Tracking of irregular graphical structures for tissue deformation recovery in minimally invasive surgery. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

publication icon
James DR (2010) Cognitive burden estimation for visuomotor learning with fNIRS. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

publication icon
Pratt P (2010) Dynamic guidance for robotic surgery using image-constrained biomechanical models. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

publication icon
K Kwok (2010) Control of Articulated Snake Robot under Dynamic Active Constraints

publication icon
Noonan DP (2010) Force adaptive multi-spectral imaging with an articulated robotic endoscope. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

 
Description In surgery, advances in medical imaging have permitted detailed pre-operative planning and intra-operative surgical guidance. One of the most promising advances in surgical technology in recent years is the introduction of robotic assisted Minimally Invasive Surgery which allows the performance of procedures that are otherwise prohibited by the confines of the operating environment. The purpose of this project is to develop new visualisation and navigation techniques that permit in situ, in vivo integration of complex anatomical and functional information of the operating field through the use of multi-modal, multi-scale imaging and haptic feedback for safer and more effective surgical operation. The project has resulted in a real-time augmented reality system for pre- and intra-operative visualisation and navigation; integration of 3D functional imaging to provide in vivo, in situ tissue characterisation and "see-through" vision; dynamic motion stabilisation; and gaze contingent collaborative visualisation and tele-mentoring.
Exploitation Route The augmented reality visualisation methods developed can have a wide range of applications including entertainment, oil exploration, and industrial inspection. The project is in collaboration with Intuitive Surgical Inc, the leading manufacturer for surgical robots.
Sectors Digital/Communication/Information Technologies (including Software),Healthcare
URL http://www.imperial.ac.uk/hamlyn
 
Description The work has resulted in a surgical guidance and visualisation platform used for robotic surgery. The augmented reality visualisation framework - Inverse Realism has now been successfully translated clinically.
First Year Of Impact 2010
Sector Digital/Communication/Information Technologies (including Software),Healthcare
Impact Types Economic
 
Description ARAKNES
Amount € 1,381,868 (EUR)
Funding ID FP7 224565 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 05/2008 
End 04/2012
 
Description Robotic Assisted Microsurgery (Wolfson Foundation)
Amount £3,000,000 (GBP)
Organisation The Wolfson Foundation 
Sector Charity/Non Profit
Country United Kingdom
Start 02/2010 
End 04/2012
 
Description Royal Academy of Engineering Fellowship
Amount £485,228 (GBP)
Funding ID Danail Stoyanov 
Organisation Royal Academy of Engineering 
Sector Charity/Non Profit
Country United Kingdom
Start 04/2009 
End 03/2014
 
Description SCATh
Amount € 532,607 (EUR)
Funding ID FP7 248782 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 02/2010 
End 01/2013