From Visual to Haptic: How do Laparoscopy Experts Estimate Haptics from Visual Cues in Robotic Surgery

To investigate whether there is a skill of transformation of visual feedback to haptic information in robotic surgery, to find out the best modality feedback to acquire such skill, to investigate the visual features that are used with such skill to estimate object stiffness.
Surgeons learn to adapt to limited haptic feedback by using visual cues to make judgements about tissue deformation. The aim of our research is to identify the visual cues that are consciously or unconsciously used by expert surgeons to navigate and manipulate the soft tissue safely during minimal-invasive and robotic surgery.
The ability to interpret visual cues is important in surgery, in which poor outcomes are largely attributable to errors of perception rather than poor motor skills. This is especially the case in Robot-assisted surgery (RIS), where the limited haptic feedback imposes a limitation to the ability of estimating the 3D shape and behaviour of the tissue. However, we know little about how trainee surgeons learn to make judgements in the visual domain. With a narrower definition of visual cues we hope to enable better decision making by students of robotic surgery that will result in less damage to the tissue and an improved learning outcome over all.

The Centre will have immediate short-term impacts on people skills and innovation pipeline, alongside key advances in scientific knowledge and techniques in Robotics and Autonomous Systems (RAS). With the strength of the programme's training emphasis on safety and responsible research and innovation (RI), we also target longer term economic and societal benefits.

Economy: It is estimated that the application of advanced robotics could generate a potential worldwide economic impact of $1.7-4.5 trillion by 2025 per year by 2025 (McKinsey). Over the last 5 years, the UK has witnessed significant new investments in robotics from both Government with the £4.7B Industrial Strategy Challenge Fund (ISCF), spawning parallel investments from industry. An example is the EPSRC £18M investment in the EPSRC ORCA Hub in RAS, led by Heriot-Watt, leveraging a further £18.5M industry investment. The potential economic impact of RAS, however, is hampered by a massive skills shortage, which the proposed CDT-RAS would address. The new jobs created by these investments will require highly specialised, yet interdisciplinary and industrially relevant skill-sets. The CDT-RAS is well positioned to supply the UK workforce in this growing area, through strong links with industry through its extensive CDT-RAS Project Partners network and through a training emphasis on 'innovation-ready' graduates. For example, our CDT-RAS students will have the opportunity to grow into industrial leaders of tomorrow through direct experience and company placements, as well as, through the CDT's extensive support for commercialisation and start-ups.

Society: Robotic and autonomous systems have already been identified by the UK government as a key component to enable safer working conditions for 'dull, dirty and dangerous' tasks in extreme and challenging environments such as offshore, nuclear, mining, and space. Moreover, there are disruptive opportunities for RAS to contribute to cost-effective and safer construction, transport, and manufacturing and improved quality-of-life through healthcare and assisted living. CDT-RAS training focuses on interdisciplinary, cross-cutting, yet responsible research and innovation to allow our future leaders to develop techniques and technologies that will have impacts in new areas, beneficially improving society beyond what we can already imagine. We will develop autonomous systems and AI enablers that are transparent to developers and end-users alike. This will allow robots and machines to work seamlessly in society both individually and in teams and comply with regulations, such as the EU General Data Protection Regulations (GDPR) and emerging IEEE standards, such as P7001 for Transparency for Autonomous Systems (for which Centre academics are members of the working group).

Science: CDT-RAS students will benefit from i) a critical mass of over 50 experienced supervisors, ii) the brand new facilities of the £27.5M National ROBOTARIUM and earlier £8M EPSRC equipment investments, as well as, iii) opportunities for international scientific and industrial lab placements. The Centre will realise scientific advancement and impact, crucial to enabling safe interaction between RAS, humans and the environment, including soft robotics, bio-inspired systems, human-robot interaction, swarms and collaborative robotics including human-robot teaming, sensing, embedded control, multi-agent decision making and maritime field robotics. The impact of the resultant research will be strengthened through top-venue publications and conference presentations, utilising student presentation/writing skills honed during the CDT-RAS training. Impact will also come through outreach such as international student robot competitions, public engagement activities such as science festivals and CDT-RAS hosted international researcher visitors and workshops.