Robotic Assisted Surgical Guidance and Visualisation

Lead Research Organisation: Imperial College London
Department Name: Institute of Biomedical Engineering

Abstract

The use of augmented reality in surgery has risen dramatically in recent years, contributing to a range of new methods for training, education and diagnosis. In surgery, advances in medical imaging have permitted detailed pre-operative planning and intra-operative surgical guidance. One of the most promising advances in surgical technology in recent years is the introduction of robotic assisted Minimally Invasive Surgery which allows the performance of procedures that are otherwise prohibited by the confines of the operating environment. The purpose of this project is to develop novel visualisation techniques that permit in situ, in vivo integration of complex anatomical and functional information of the operating field through the use of multi-modal, multi-scale imaging data for safer and more effective surgical navigation.

Publications

10 25 50
publication icon
Atasoy S (2008) A global approach for automatic fibroscopic video mosaicing in minimally invasive diagnosis. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

publication icon
Elhelw M (2008) A gaze-based study for investigating the perception of visual realism in simulated scenes in ACM Transactions on Applied Perception

publication icon
James DR (2010) Cognitive burden estimation for visuomotor learning with fNIRS. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

publication icon
Kwok KW (2009) Perceptually Docked Control Environment for Multiple Microbots: Application to the Gastric Wall Biopsy. in Proceedings of the ... IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE/RSJ International Conference on Intelligent Robots and Systems

publication icon
Kwok KW (2009) Dynamic active constraints for hyper-redundant flexible robots. in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention

publication icon
Lee SL (2010) From medical images to minimally invasive intervention: Computer assistance for robotic surgery. in Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society

 
Description In surgery, advances in medical imaging have permitted detailed pre-operative planning and intra-operative surgical guidance. One of the most promising advances in surgical technology in recent years is the introduction of robotic assisted Minimally Invasive Surgery which allows the performance of procedures that are otherwise prohibited by the confines of the operating environment. The purpose of this project is to develop new visualisation and navigation techniques that permit in situ, in vivo integration of complex anatomical and functional information of the operating field through the use of multi-modal, multi-scale imaging and haptic feedback for safer and more effective surgical operation. The project has resulted in a real-time augmented reality system for pre- and intra-operative visualisation and navigation; integration of 3D functional imaging to provide in vivo, in situ tissue characterisation and "see-through" vision; dynamic motion stabilisation; and gaze contingent collaborative visualisation and tele-mentoring.
Exploitation Route The augmented reality visualisation methods developed can have a wide range of applications including entertainment, oil exploration, and industrial inspection. The project is in collaboration with Intuitive Surgical Inc, the leading manufacturer for surgical robots.
Sectors Digital/Communication/Information Technologies (including Software),Healthcare

URL http://www.imperial.ac.uk/hamlyn
 
Description The work has resulted in a surgical guidance and visualisation platform used for robotic surgery. The augmented reality visualisation framework - Inverse Realism has now been successfully translated clinically.
First Year Of Impact 2010
Sector Digital/Communication/Information Technologies (including Software),Healthcare
Impact Types Economic

 
Description ARAKNES
Amount € 1,381,868 (EUR)
Funding ID FP7 224565 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 05/2008 
End 04/2012
 
Description Robotic Assisted Microsurgery (Wolfson Foundation)
Amount £3,000,000 (GBP)
Organisation The Wolfson Foundation 
Sector Charity/Non Profit
Country United Kingdom
Start 02/2010 
End 04/2012
 
Description Royal Academy of Engineering Fellowship
Amount £485,228 (GBP)
Funding ID Danail Stoyanov 
Organisation Royal Academy of Engineering 
Sector Charity/Non Profit
Country United Kingdom
Start 04/2009 
End 03/2014
 
Description SCATh
Amount € 532,607 (EUR)
Funding ID FP7 248782 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 02/2010 
End 01/2013