Non-contact driver attentiveness monitoring system

Lead Research Organisation: University of Bath
Department Name: Electronic and Electrical Engineering

Abstract

Data from the World Health Organisation (WHO) shows approximately 1.3 million people die annually from road crashes, which are identified as the leading cause of death for children and young adults. In the UK, there were 24,530 people killed or seriously injured in 2021 according to the estimation of the Department for Transport (DfT). Besides concerns on the road safety aspect, road traffic crashes cost most countries 3% of their gross domestic product, leading to considerable financial loss to individuals, their families, and the entire nation. Meanwhile, study has shown that human error was the sole factor in more than 50% of road accidents, and was a contributing factor in over 90%. Commonly seen human errors such as drowsy driving, distracted driving, and chemical impairment caused by alcohol or drugs form part of today's road traffic condition, threatening everyone's life safety. However, the current development in autonomous driving can't fully mitigate this issue since the takeover by a human driver is still needed before the SAE level 5 is reached, which is decades away. Propelled by societal pressure and legislation, Driver Monitoring System (DMS) was introduced by car manufacturers to tackle this long-existing problem, combining driver behaviour obtained from a camera and driving behaviour from the vehicle itself to determine the driver's state. Despite the effectiveness of existing commercial systems, the lack of direct measurement remains a challenge to further improve the accuracy. On the other hand, the already proven feasibility of extracting physiological information such as vital signs based on contactless approaches in the lab environment opens up a new avenue.
Therefore, the focus of this project is the development of a novel non-contact driver monitoring system for attentiveness detection via contactless sensors such as radar, camera, or ultrasonic sensors. Firstly, physiological information is obtained by signal processing and then compared with the ground truth from body-attached sensors to develop a robust non-contact vital sign monitoring system. On this basis, extracted features such as heart rate, respiratory rate, skin temperature, and body movements are combined with observations from real-world driving experiments and brain activity measured by EEG to develop a new model of driver attentiveness. For example, a reduction in heart rate, respiratory rate, or blink rate could be good indicators of low attentiveness.
The outcome of this research project is expected to significantly reduce the number of road crashes due to human error, thus preventing death, injuries, and the corresponding economical loss to the nation as a whole. From the research perspective, it will benefit the research in the non-contact vital sign monitoring system, bio-signal processing, driver monitoring, and attentiveness model. Besides the typical onboard driver monitoring use case, variants of this system have the potential to be expanded to other similar application scenarios, such as voyage, aviation, and aerospace.

Planned Impact

Impact Summary

This proposal has been developed from the ground up to guarantee the highest level of impact. The two principal routes towards impact are via the graduates that we train and by the embedding of the research that is undertaken into commercial activity. The impact will have a significant commercial value through addressing skills requirements and providing technical solutions for the automotive industry - a key sector for the UK economy.

The graduates that emerge from our CDT (at least 84 people) will be transformative in two distinct ways. The first is a technical route and the second is cultural.

In a technical role, their deep subject matter expertise across all of the key topics needed as the industry transitions to a more sustainable future. This expertise is made much more accessible and applicable by their broad understanding of the engineering and commercial context in which they work. They will have all of the right competencies to ensure that they can achieve a very significant contribution to technologies and processes within the sector from the start of their careers, an impact that will grow over time. Importantly, this CDT is producing graduates in a highly skilled sector of the economy, leading to jobs that are £50,000 more productive per employee than average (i.e. more GVA). These graduates are in demand, as there are a lack of highly skilled engineers to undertake specialist automotive propulsion research and fill the estimated 5,000 job vacancies in the UK due to these skills shortages. Ultimately, the CDT will create a highly specialised and productive talent pipeline for the UK economy.

The route to impact through cultural change is perhaps of even more significance in the long term. Our cohort will be highly diverse, an outcome driven by our wide catchment in terms of academic background, giving them a 'diversity edge'. The cultural change that is enabled by this powerful cohort will have a profound impact, facilitating a move away from 'business as usual'.

The research outputs of the CDT will have impact in two important fields - the products produced and processes used within the indsutry. The academic team leading and operating this CDT have a long track record of generating impact through the application of their research outputs to industrially relevant problems. This understanding is embodied in the design of our CDT and has already begun in the definition of the training programmes and research themes that will meet the future needs of our industry and international partners. Exchange of people is the surest way to achieve lasting and deep exchange of expertise and ideas. The students will undertake placements at the collaborating companies and will lead to employment of the graduates in partner companies.

The CDT is an integral part of the IAAPS initiative. The IAAPS Business Case highlights the need to develop and train suitably skilled and qualified engineers in order to achieve, over the first five years of IAAPS' operations, an additional £70 million research and innovation expenditure, creating an additional turnover of £800 million for the automotive sector, £221 million in GVA and 1,900 new highly productive jobs.

The CDT is designed to deliver transformational impact for our industrial partners and the automotive sector in general. The impact is wider than this, since the products and services that our partners produce have a fundamental part to play in the way we organise our lives in a modern society. The impact on the developing world is even more profound. The rush to mobility across the developing world, the increasing spending power of a growing global middle class, the move to more urban living and the increasingly urgent threat of climate change combine to make the impact of the work we do directly relevant to more people than ever before. This CDT can help change the world by effecting the change that needs to happen in our industry.

Publications

10 25 50

Studentship Projects

Project Reference Relationship Related To Start End Student Name
EP/S023364/1 01/04/2019 30/09/2027
2598331 Studentship EP/S023364/1 01/10/2021 30/09/2025 Gengqian YANG