Adaptive Sensor Fusion for Resilient Vehicle Sensing

Principal goal for project:
To develop novel multi-modal sensor fusion methodologies for more robust scene understanding in adverse weather conditions. Such scene understanding tasks include object detection, semantic segmentation and surface reconstruction. The sensors that will be exploited are radar, lidar and optical camera.
Research project:
To comprehensively perceive the surrounding environment, current advanced driver-assistance systems are usually equipped with a suite of complementary sensors, including radar, lidar and optical camera. Moreover, it is crucial for such a system to function robustly in a range of adverse weather conditions (e.g. fog, rain and snow). To this end, data from these disparate
sensors needs to be fused in a more effective manner to fully exploit their complementarity. We expect the success of this project to help progress the level of driving automation, particularly in the aforementioned complicated scenes.

The Centre will have immediate short-term impacts on people skills and innovation pipeline, alongside key advances in scientific knowledge and techniques in Robotics and Autonomous Systems (RAS). With the strength of the programme's training emphasis on safety and responsible research and innovation (RI), we also target longer term economic and societal benefits.

Economy: It is estimated that the application of advanced robotics could generate a potential worldwide economic impact of $1.7-4.5 trillion by 2025 per year by 2025 (McKinsey). Over the last 5 years, the UK has witnessed significant new investments in robotics from both Government with the £4.7B Industrial Strategy Challenge Fund (ISCF), spawning parallel investments from industry. An example is the EPSRC £18M investment in the EPSRC ORCA Hub in RAS, led by Heriot-Watt, leveraging a further £18.5M industry investment. The potential economic impact of RAS, however, is hampered by a massive skills shortage, which the proposed CDT-RAS would address. The new jobs created by these investments will require highly specialised, yet interdisciplinary and industrially relevant skill-sets. The CDT-RAS is well positioned to supply the UK workforce in this growing area, through strong links with industry through its extensive CDT-RAS Project Partners network and through a training emphasis on 'innovation-ready' graduates. For example, our CDT-RAS students will have the opportunity to grow into industrial leaders of tomorrow through direct experience and company placements, as well as, through the CDT's extensive support for commercialisation and start-ups.

Society: Robotic and autonomous systems have already been identified by the UK government as a key component to enable safer working conditions for 'dull, dirty and dangerous' tasks in extreme and challenging environments such as offshore, nuclear, mining, and space. Moreover, there are disruptive opportunities for RAS to contribute to cost-effective and safer construction, transport, and manufacturing and improved quality-of-life through healthcare and assisted living. CDT-RAS training focuses on interdisciplinary, cross-cutting, yet responsible research and innovation to allow our future leaders to develop techniques and technologies that will have impacts in new areas, beneficially improving society beyond what we can already imagine. We will develop autonomous systems and AI enablers that are transparent to developers and end-users alike. This will allow robots and machines to work seamlessly in society both individually and in teams and comply with regulations, such as the EU General Data Protection Regulations (GDPR) and emerging IEEE standards, such as P7001 for Transparency for Autonomous Systems (for which Centre academics are members of the working group).

Science: CDT-RAS students will benefit from i) a critical mass of over 50 experienced supervisors, ii) the brand new facilities of the £27.5M National ROBOTARIUM and earlier £8M EPSRC equipment investments, as well as, iii) opportunities for international scientific and industrial lab placements. The Centre will realise scientific advancement and impact, crucial to enabling safe interaction between RAS, humans and the environment, including soft robotics, bio-inspired systems, human-robot interaction, swarms and collaborative robotics including human-robot teaming, sensing, embedded control, multi-agent decision making and maritime field robotics. The impact of the resultant research will be strengthened through top-venue publications and conference presentations, utilising student presentation/writing skills honed during the CDT-RAS training. Impact will also come through outreach such as international student robot competitions, public engagement activities such as science festivals and CDT-RAS hosted international researcher visitors and workshops.