FORWARN - Towards an intelligent Forward Collision Warning System

Lead Research Organisation: University of Leeds
Department Name: Institute for Transport Studies

Abstract

FORWARN aims to create a Forward Collision Warning (FCW) system that is able to consider driver distraction when making decisions on the appropriateness and timing of warnings. To achieve this, drivers will be asked to engage in a variety of distracting tasks in simulated driving scenarios requiring the engagement of a FCW. The FCW will later be 'trained' to ascertain driver distraction using vehicle- and driver-related metrics.

The research proposed here aims to bridge the gap between work on assistance systems and work on the impact of driver distractions, by understanding the relationship between distraction, warnings and driver performance. This research will examine the effect of a variety of in-vehicle distracting tasks on driving performance, and establish how these can then be taken into account when designing an advanced driver assistance system such as FCW. A particular focus of this research will be to gain a better understanding of the distracting effect of non-visual tasks, such as engagement in hands free mobile phone conversations.

FCW uses sensors and radar to scan the area ahead of the vehicle, and aims to avoid rear-end collisions, or reduce their impact, by advising drivers to brake. Some newer systems even intervene in some cases to avoid a collision. There are considerable potential benefits of such systems which have recently been proven in a large-scale Field Operational Test (FOT) in North America. However, there is a danger that systems which have permanently fixed criteria will be viewed by a significant number of drivers as presenting too many "false" (unwanted) warnings. Indeed, drivers in the U.S. Field Operational Test were keen to be able to tune the system to their personal preferences.

Therefore, one main aim of the proposed project is to use eye tracking and vehicle related performance measures to identify the information that is needed by a FCW before it can establish whether or not a driver is distracted. Upon approach to a hazardous condition, this intelligent FCW will then only be triggered after if it has ascertained that the driver is truly distracted and unable to respond to the hazard in good time. As driving is a multi-faceted activity, assessing the effects of distraction on driving performance depend on the exact driver- and vehicle-related metrics being observed as well as the nature of the distracting task itself. This project will build upon the work already conducted by the group in this area during previous European projects such as AIDE (Adaptive Integrated Driver-vehicle interfacE) and HASTE (Human machine interface And the Safety of Traffic in Europe) and a recently completed EPSRC project, EASY (Effects of Automated Systems on safetY).

Planned Impact

UK involvement in the cutting edge of research on new automotive systems is currently rather slim, as evidenced by the generally low level of UK participation in large-scale European research programmes within the automotive and technology areas. This perhaps reflects the general weakness of the UK automotive sector; although it is reassuring that there are still a number of significant UK-based research groups tackling some of these issues. Given the rapid changes in vehicle technology and the rapidly increasing role of electronic systems in new vehicles, it is vital to keep the UK at the forefront of new developments. We expect that this project, if successful in developing the systems envisaged, could have substantial spin-off potential.

This research will contribute to knowledge by bridging the gap between data filtering and mining techniques used in machine learning, to understand the effect of various in-vehicle tasks on driver distraction. The impact of this research is therefore relevant to the automotive industry, which will be able to utilise the results to create a more user friendly Forward Collision Warning system that takes action only in times of true driver distraction. Such sharing of knowledge is made easier through partnership in the project with Jaguar Land Rover Research and TRW Conekt.

The system to be investigated here could have substantial social benefits by reducing the incidence of traffic accidents caused by driver distraction. Driver distraction, as imposed for instance by Satellite Navigation systems and mobile telephone conversations has been linked to such crashes. For example, a U.S. study conducted by Virginia Tech found that distraction was a major safety issue, with almost 80% of the crashes and 65% of near-crashes involving the driver looking away from the forward roadway just prior to the onset of conflict. Inattention, including secondary task distraction, was a contributory factor in 93% of the incidents with lead vehicles. The implications of this research will also provide benefit to national and EU policy makers and road safety professionals, when considering legislation on safe use of in-vehicle systems.

Publications

10 25 50
publication icon
Kountouriotis GK (2012) The role of gaze and road edge information during high-speed locomotion. in Journal of experimental psychology. Human perception and performance

publication icon
Kountouriotis GK (2013) Optic flow asymmetries bias high-speed steering along roads. in Journal of vision

publication icon
Carsten, O; (2015) Protective or Not?

publication icon
Kountouriotis G (2015) Looking and thinking when driving: The impact of gaze and cognitive load on steering in Transportation Research Part F: Traffic Psychology and Behaviour

publication icon
Kountouriotis GK (2016) Identifying cognitive distraction using steering wheel reversal rates. in Accident; analysis and prevention

publication icon
Herbert N (2016) The effect of a simulated hearing loss on performance of an auditory memory task in driving in Transportation Research Part F: Traffic Psychology and Behaviour

publication icon
Kountouriotis GK (2016) The need for speed: global optic flow speed influences steering. in Royal Society open science

 
Description The work has established a clear distinction between distractions that require the movement of the eyes away from the road - visual distractions and those that do not (non-visual distractions).

The focus of the work is around non-visual distractions which take the 'mind off the road'. The research has established how cognitive (non-visual) distraction can be identified, and what mitigation strategies can be put into place to reduce distraction related accidents.

New metrics for identifying this type of distraction have been identified and will be used in follow on work to create a real-time algorithm for identifying non-visual distraction in the vehicle. This work has also attracted attention from students in China and collaborators in the US and industry (Volvo). It is therefore likely to have a high impact.
Exploitation Route Once the algorithm is developed and tested, it is our intention to discuss this finding with colleagues at JLR
Sectors Digital/Communication/Information Technologies (including Software),Education,Transport

 
Description This work is important for understanding the effect of non-visually distracting tasks on driver performance and road safety. With the increased use of mobile telephones, and the addition of many vehicle based and "nomadic" devices, i.e. those that are brought in to the vehicle by the user, the dangers of distraction from competing visual interfaces, which take drivers' eyes away from the road is on the increase. At the same time, our busy lives, and related stress and workload mean that we are more mentally distracted than ever before (mind wandering). In mind wandering, our eyes may be on the road, but our attention is not. To help reduce the degree of visual distraction by in-vehicles devices and interfaces, manufacturers are working on presenting information and warning to drivers in a non-visual format, such as use of handsfree telephone conversations, and voice based messages. This method of communication keeps our eyes on the road, but it can also take our mind away from the driving task, similar to mind wandering. There is not yet enough information about the effect of such non-visual distractions on crashes. The aim of FORWARN was to assess the effect of "mind off road" distraction on driving performance. Results have illustrated differences in both eye tracking patterns (compared to baseline/no distraction tasks) and steering behaviour - illustrating a "lock in" of steering performance and eye movements under cognitively distracting tasks. Drivers focus much more on the road ahead, at the expense of peripheral locations, increasing the dangers of missing objects and obstacles appearing to the left and right (eg a crossing pedestrian). Results of this work have continued in a number of related projects, including the assessment of such non-visual (cognitive) tasks on pedestrian crossing decisions (paper under review), and how such distractions affect resumption of control from automation (work which is conducted as part of a number of European funded projects, involving all leading vehicle manufacturers). The importance and dangers of cognitive (non visual) distraction is now better known, and well acknowledged by industry and policy makers. The team is currently assessing how driver detection of pedestrians is affected by such cognitively distracting (non-visual) tasks, and how this changes in night time driving conditions (as part of the EPSRC Harold project). The dangers of such Cognitive distraction have been highlighted and recognized by a number of government funding bodies such as the US NHTSA and the UK Department of Transport, and the team is currently advising the UK DfT in this context, via a systematic literature review and an expert workshop.
First Year Of Impact 2018
Sector Digital/Communication/Information Technologies (including Software),Education,Transport
Impact Types Societal,Policy & public services

 
Description HAROLD
Amount £1,000,000 (GBP)
Funding ID EP/S003576/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 01/2019 
End 06/2022
 
Description TRANSITION
Amount £560,000 (GBP)
Funding ID EP/P017517/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 09/2017 
End 09/2020
 
Description VeriCAV
Amount £2,090,983 (GBP)
Funding ID TS/S007067/1 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 11/2018 
End 04/2021
 
Description Collaboration with Johan Engstrom VTTI 
Organisation Virginia Polytechnique Institute and State University
Country United States 
Sector Academic/University 
PI Contribution The two teams have worked on two new publications based on the data collected from the FORWARN PROJECT.
Collaborator Contribution Engstrom has been lead author to two linked publications. He also promotes this work in international meetings on distraction
Impact Two publications in the publications list. one journal article and one conference proceeding which will also bee published as a journal article.
Start Year 2015
 
Description Collaboration with Seeing Machines 
Organisation Seeing Machines
Country Australia 
Sector Private 
PI Contribution The work has involved use of distracting tasks, developed in the FORWARN project, in a new study to consider how driver monitoring can be used for establishing driver distraction
Collaborator Contribution This collaboration has involved development of new algorithms and analysis of data by the two partners, to understand how driver head and eye movements can be used in the Leeds driving simulator
Impact publication pending. PhD studentship funded.
Start Year 2017
 
Description Collaboration with Sheffield 
Organisation University of Sheffield
Department School of Architecture
Country United Kingdom 
Sector Academic/University 
PI Contribution Collaboration on a new research proposal
Collaborator Contribution Leading a new responsive mode research proposal
Impact No outputs yet
Start Year 2017
 
Description Collaboration with Tsinghua University 
Organisation Tsinghua University China
Department Department of Automotive Engineering
Country China 
Sector Academic/University 
PI Contribution Collaboration of further investigations regarding measurement of cognitive load in driving. new publications have been prepared
Collaborator Contribution new data analysis
Impact Two journal publications currently in preparation
Start Year 2016
 
Description Collaboration with Volvo Cars and Volvo Technology 
Organisation Volvo Technology Corportation
Country Sweden 
Sector Private 
PI Contribution Participation as expert advisor to Volvo Cars on their project regarding Cognitive Distraction
Collaborator Contribution Discussions on linked interests. Letter of support for new EPSRC project to follow work on FORWARN - PI Wilkie - see separate entry
Impact N/a
Start Year 2013
 
Description Collaboration with Volvo Truck on a new study 
Organisation Volvo Trucks
Country Sweden 
Sector Private 
PI Contribution A new study has been conducted with Johan Engstrom at Volvo Trucks, to consider the effect of distraction on reaction to a lead car
Collaborator Contribution We are working together on a model for distraction
Impact A manuscript is currently in preparation for this work. We are also working on a review paper on the area, with Engstrom as lead author
Start Year 2014
 
Description Overview of current understanding in driver distraction 
Organisation AECOM Technology Corporation
Department AECOM, Nottingham, UK
Country United Kingdom 
Sector Private 
PI Contribution The team has been advising the Department for Transport and CCAV on research needs for mitigating driver distraction
Collaborator Contribution A joint project to identify areas for further research in this area
Impact A report with recommendations for further research has been prepared between the two teams and we are awaiting news of follow on funding
Start Year 2022
 
Description PACE proposal 
Organisation University of Leeds
Department Institute of Psychological Sciences
Country United Kingdom 
Sector Academic/University 
PI Contribution New project proposal submitted to EPSRC to continue work which is ongoing as part of FORWARN
Collaborator Contribution REsearch proposal. Not funded but revised and resubmitted as Transition project
Impact Project proposal
Start Year 2012
 
Description TRANSITION proposal 
Organisation University of Leeds
Department Leeds Institute of Cancer & Pathology
Country United Kingdom 
Sector Academic/University 
PI Contribution Collaboration with Wilkie from School of Psychology, University of Leeds
Collaborator Contribution New proposal to the EPSRC based on work in FORWARN and European Project AdaptIVE
Impact New proposal to the EPSRC based on work in FORWARN and European Project AdaptIVE
Start Year 2012
 
Description Driven to distraction 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Invited talk organised by the Irish Motor Writers Association and sponsored by Continental Tires considered the likely distracting effect of various in car systems. The event was widely covered by the Irish and international press.
Year(s) Of Engagement Activity 2013
URL http://www.tyretrade.ie/index.php/are-we-being-driven-to-distraction-by-auto-technology/5670
 
Description European Commission, Scientific Advisor, US-EU Bilateral group on Cognitive Load in driving 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Advisory group member on cognitive load/distraction. Contributing to an EC publication
Year(s) Of Engagement Activity 2013
 
Description ISO standard 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact International Organisation for Standardisation (ISO), Working Group 8 member. Contribution to work on the "Detection Response Task", a standardised task for measuring distraction from in-vehicle systems. Now to be used as a recognised standard.
Year(s) Of Engagement Activity 2012
URL https://www.iso.org/obp/ui/#iso:std:iso:17488:ed-1:v1:en
 
Description Literature review and expert workshop - Department for Transport 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact An expert workshop with industrial, policymakers and academic partners with an expertise in driver distraction, to inform further research by the UK DfT
Year(s) Of Engagement Activity 2022
 
Description Volvo Cars Advisory Meeting 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Advising volvo cars on the detrimental effects of distraction, with discussions on the effect of Cognitive distraction in particular
Year(s) Of Engagement Activity 2013