Haptic Shared Control Systems And A Neuroergonomic Approach To Measuring System Trust
Lead Research Organisation:
CRANFIELD UNIVERSITY
Department Name: Faculty of Engineering & Applied Science
Abstract
With sufficient R&D investment the UK is forecasted to experience significant economic growth across a range of sectors by 2035 delivered through automation and robotics. Relevant application areas include the design and safety of future connected autonomous vehicles, remotely monitored teleoperations, and human-robot interactions involved in surgery, nursing, manufacturing, construction, and maintenance. Achieving sufficient user trust in automation is pivotal to realising this ambition in the UK. Measuring trust in automation is critical for determining automation acceptance and its correct usage. In addition, the act of deciding to trust is based on a mixture of analytic and emotional decisions. This complexity means that the widely used questionnaire-based methods of measuring trust are insufficient. Not only do they struggle to measure the full complexity of trust, but they cannot measure changes in trust as they occur in real-time in response to automation experience.
Measuring neural responses during interaction with automation is a potential objective means to measuring trust in real-time. Our own published research has advocated using functional near infrared spectroscopy (fNIRS) where areas of the brain associated with emotional trust judgements were identified. Having a real-time marker of emotional trust is important as it allows for a measure of trust that is uncoupled from analytical decision processes; processes that are involved in a range of cognitive processes, including mental workload. The primary goal of this proposal is to identify a unique neural measurement of automation trust. We will tackle this challenge through the in parallel measurement and analysis of neural correlates of trust (fNIRS) and physiological correlates of mental workload (heart rate variability, pupillometry, galvanic skin response) during experiments where participants interact with automated teammates of varying reliable.
To demonstrate the application of a unique neural marker of automation trust we will examine how trust changes in response to the communication method between humans and automation. Conventionally, responsibility between humans and automation is "traded" from one to another as a lumped whole. For instance, the way adaptive cruise control functions in modern cars. The driver can transfer whole responsibility to the car, typically initiated by a button press. Likewise, transfers are rapid and whole in automatic emergency braking, and initiated by the automation when an imminent collision is sensed. These transitions are often called "bumpy" and are implicated in compromises to safety. A promising alternative communication method is "haptic shared control". It offers greater transparency through the continuous force feedback communication of the automation's behaviour via the system's control input (e.g., steering wheel, accelerator pedal). This means that the user is better kept "in the loop", supporting "smooth" shifts of authority in response to automation-induced faults. However, no studies have been conducted providing a comparison of trust between traded and haptic shared control. Hence, the current proposal aims to provide not an only a demonstration of the application of a neural measure of automation trust, but also addresses the fundamental lack of knowledge surrounding haptic shared control and trust.
To realise this ambitious research, we will focus on initiating a collaborative academic relationship between Coventry University and TU Delft, respective world-experts in operator physiological monitoring and haptic shared control. Together we will establish neural markers of automation trust in a series of laboratory and aviation simulation experiments that involve performing collaborative tasks with automated teammates that will communicate with human participants in various ways - i.e. traded communication versus haptic shared control communication.
Measuring neural responses during interaction with automation is a potential objective means to measuring trust in real-time. Our own published research has advocated using functional near infrared spectroscopy (fNIRS) where areas of the brain associated with emotional trust judgements were identified. Having a real-time marker of emotional trust is important as it allows for a measure of trust that is uncoupled from analytical decision processes; processes that are involved in a range of cognitive processes, including mental workload. The primary goal of this proposal is to identify a unique neural measurement of automation trust. We will tackle this challenge through the in parallel measurement and analysis of neural correlates of trust (fNIRS) and physiological correlates of mental workload (heart rate variability, pupillometry, galvanic skin response) during experiments where participants interact with automated teammates of varying reliable.
To demonstrate the application of a unique neural marker of automation trust we will examine how trust changes in response to the communication method between humans and automation. Conventionally, responsibility between humans and automation is "traded" from one to another as a lumped whole. For instance, the way adaptive cruise control functions in modern cars. The driver can transfer whole responsibility to the car, typically initiated by a button press. Likewise, transfers are rapid and whole in automatic emergency braking, and initiated by the automation when an imminent collision is sensed. These transitions are often called "bumpy" and are implicated in compromises to safety. A promising alternative communication method is "haptic shared control". It offers greater transparency through the continuous force feedback communication of the automation's behaviour via the system's control input (e.g., steering wheel, accelerator pedal). This means that the user is better kept "in the loop", supporting "smooth" shifts of authority in response to automation-induced faults. However, no studies have been conducted providing a comparison of trust between traded and haptic shared control. Hence, the current proposal aims to provide not an only a demonstration of the application of a neural measure of automation trust, but also addresses the fundamental lack of knowledge surrounding haptic shared control and trust.
To realise this ambitious research, we will focus on initiating a collaborative academic relationship between Coventry University and TU Delft, respective world-experts in operator physiological monitoring and haptic shared control. Together we will establish neural markers of automation trust in a series of laboratory and aviation simulation experiments that involve performing collaborative tasks with automated teammates that will communicate with human participants in various ways - i.e. traded communication versus haptic shared control communication.
Publications
| Title | Human-Automation Teaming: Trust and Interaction Measurement Evaluation (HAT-TIME) |
| Description | The objectives of the current EPSRC project has required the development of a novel desktop test battery to examine how changes in automation reliability on a shared control task influence the workload and trust of the human operator. The test battery, named Human-Automation Teaming: Trust and Interaction Measurement Evaluation (HAT-TIME), has been developed in MATLAB and is currently used to manipulate workload and trust in the human operator based on whether traded or shared control authority transition schemes are being employed. The first two datasets from the project is based on this iteration of the test battery. Ongoing development the test battery, which is required for later work packages, is the implementation of haptics. Specifically, to examine whether the presence of haptics forcefeedback will have an influence on human workload and trust when applied to traded and shared control authority transition schemes. A conference proceeding is in the works (for HCII 2024) covering the rationale for the development HAT-TIME, including preliminary data findings as well as providing open access to the MATLAB code. |
| Type Of Material | Physiological assessment or outcome measure |
| Year Produced | 2024 |
| Provided To Others? | No |
| Impact | The test battery is instrumental to the delivery of the current projects research aims. Findings based on the first dataset are to be published as conference proceedings at HCII 2025 in June. |
| Description | Initiation of PhD co-supervision between Cranfield, TU Delft and TNO |
| Organisation | Delft University of Technology (TU Delft) |
| Country | Netherlands |
| Sector | Academic/University |
| PI Contribution | A key focus of the current EPSRC research project is to strengthen collaborative relationships between Cranfield University and TU Delft. Following networking visits between academic staff from the associated institutes, an opportunity to propagate formal research collaborations beyond the lifespan of the current 2-year project was identified through the co-supervision of a PhD student. The doctoral student is a past MSc student of my own who has published work in the area of startle and surprise, a topic area that closed aligns with the research of the current EPSRC project. The PhD commenced in November 2024. Two research papers from this collaboration have been submitted to high impact safety journals. |
| Collaborator Contribution | TU Delft are hosting the doctoral student. They will be providing access to full motion simulators (the Simona) to support the research being conducted for this. |
| Impact | Two papers have been submitted - pre-prints included in "Publications" outputs To enhance engagement with the aviation community, a summary of this research will be published as an article in the upcoming issue of Eurocontrol's Hindsight magazine (https://skybrary.aero/articles/hindsight-eurocontrol) |
| Start Year | 2024 |
| Description | Initiation of PhD co-supervision between Cranfield, TU Delft and TNO |
| Organisation | TNO Institute for Human Factors |
| Country | Netherlands |
| Sector | Private |
| PI Contribution | A key focus of the current EPSRC research project is to strengthen collaborative relationships between Cranfield University and TU Delft. Following networking visits between academic staff from the associated institutes, an opportunity to propagate formal research collaborations beyond the lifespan of the current 2-year project was identified through the co-supervision of a PhD student. The doctoral student is a past MSc student of my own who has published work in the area of startle and surprise, a topic area that closed aligns with the research of the current EPSRC project. The PhD commenced in November 2024. Two research papers from this collaboration have been submitted to high impact safety journals. |
| Collaborator Contribution | TU Delft are hosting the doctoral student. They will be providing access to full motion simulators (the Simona) to support the research being conducted for this. |
| Impact | Two papers have been submitted - pre-prints included in "Publications" outputs To enhance engagement with the aviation community, a summary of this research will be published as an article in the upcoming issue of Eurocontrol's Hindsight magazine (https://skybrary.aero/articles/hindsight-eurocontrol) |
| Start Year | 2024 |
| Description | Initiation of student exchange program between Cranfield and TU Delft |
| Organisation | Delft University of Technology (TU Delft) |
| Country | Netherlands |
| Sector | Academic/University |
| PI Contribution | A key focus of the current EPSRC research project is to strengthen collaborative relationships between Cranfield University and TU Delft. As part of the research, TU Delft and Cranfield are in the process of setting up two 12-week internship programs that will enable students from respective institutes to undertake a 12-week research project related to the shared haptic control. This research will be supervised by myself and TU Delft academics and will contribute to the research project's work packages. |
| Collaborator Contribution | Academics at TU Delft are supporting the setup of the internship programs. A TU Delft student has been identified to undertake a 12-week research project on shared haptic control at Cranfield University. |
| Impact | No outputs have arisen so far. The collaboration is multi-disciplinary. The disciplines involved included control theory (engineering) and human-factors (psychology). |
| Start Year | 2025 |
