Robotic Assisted Surgical Guidance and Visualisation
Lead Research Organisation:
Imperial College London
Department Name: Institute of Biomedical Engineering
Abstract
The use of augmented reality in surgery has risen dramatically in recent years, contributing to a range of new methods for training, education and diagnosis. In surgery, advances in medical imaging have permitted detailed pre-operative planning and intra-operative surgical guidance. One of the most promising advances in surgical technology in recent years is the introduction of robotic assisted Minimally Invasive Surgery which allows the performance of procedures that are otherwise prohibited by the confines of the operating environment. The purpose of this project is to develop novel visualisation techniques that permit in situ, in vivo integration of complex anatomical and functional information of the operating field through the use of multi-modal, multi-scale imaging data for safer and more effective surgical navigation.
Organisations
Publications
Atasoy S
(2008)
A global approach for automatic fibroscopic video mosaicing in minimally invasive diagnosis.
in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
Elhelw M
(2008)
A gaze-based study for investigating the perception of visual realism in simulated scenes
in ACM Transactions on Applied Perception
Fujii K
(2018)
Gaze gesture based human robot interaction for laparoscopic surgery.
in Medical image analysis
James DR
(2010)
Cognitive burden estimation for visuomotor learning with fNIRS.
in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
Kwok KW
(2009)
Perceptually Docked Control Environment for Multiple Microbots: Application to the Gastric Wall Biopsy.
in Proceedings of the ... IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE/RSJ International Conference on Intelligent Robots and Systems
Kwok KW
(2009)
Dynamic active constraints for hyper-redundant flexible robots.
in Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
Lee SL
(2010)
From medical images to minimally invasive intervention: Computer assistance for robotic surgery.
in Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society
| Description | In surgery, advances in medical imaging have permitted detailed pre-operative planning and intra-operative surgical guidance. One of the most promising advances in surgical technology in recent years is the introduction of robotic assisted Minimally Invasive Surgery which allows the performance of procedures that are otherwise prohibited by the confines of the operating environment. The purpose of this project is to develop new visualisation and navigation techniques that permit in situ, in vivo integration of complex anatomical and functional information of the operating field through the use of multi-modal, multi-scale imaging and haptic feedback for safer and more effective surgical operation. The project has resulted in a real-time augmented reality system for pre- and intra-operative visualisation and navigation; integration of 3D functional imaging to provide in vivo, in situ tissue characterisation and "see-through" vision; dynamic motion stabilisation; and gaze contingent collaborative visualisation and tele-mentoring. |
| Exploitation Route | The augmented reality visualisation methods developed can have a wide range of applications including entertainment, oil exploration, and industrial inspection. The project is in collaboration with Intuitive Surgical Inc, the leading manufacturer for surgical robots. |
| Sectors | Digital/Communication/Information Technologies (including Software) Healthcare |
| URL | http://www.imperial.ac.uk/hamlyn |
| Description | The work has resulted in a surgical guidance and visualisation platform used for robotic surgery. The augmented reality visualisation framework - Inverse Realism has now been successfully translated clinically. |
| First Year Of Impact | 2010 |
| Sector | Digital/Communication/Information Technologies (including Software),Healthcare |
| Impact Types | Economic |
| Description | ARAKNES |
| Amount | € 1,381,868 (EUR) |
| Funding ID | FP7 224565 |
| Organisation | European Commission |
| Sector | Public |
| Country | European Union (EU) |
| Start | 04/2008 |
| End | 04/2012 |
| Description | Robotic Assisted Microsurgery (Wolfson Foundation) |
| Amount | £3,000,000 (GBP) |
| Organisation | The Wolfson Foundation |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 02/2010 |
| End | 04/2012 |
| Description | Royal Academy of Engineering Fellowship |
| Amount | £485,228 (GBP) |
| Funding ID | Danail Stoyanov |
| Organisation | Royal Academy of Engineering |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 03/2009 |
| End | 03/2014 |
| Description | SCATh |
| Amount | € 532,607 (EUR) |
| Funding ID | FP7 248782 |
| Organisation | European Commission |
| Sector | Public |
| Country | European Union (EU) |
| Start | 02/2010 |
| End | 01/2013 |