UKRI Trustworthy Autonomous Systems Node in Trust

Lead Research Organisation: Heriot-Watt University
Department Name: S of Mathematical and Computer Sciences

Abstract

Engineered systems are increasingly being used autonomously, making decisions and taking actions without human intervention. These Autonomous Systems are already being deployed in industrial sectors but in controlled scenarios (e.g. static automated production lines, fixed sensors). They start to get into difficulties when the task increases in complexity or the environment is uncontrolled (e.g. drones for offshore windfarm inspection), or where there is a high interaction with people and entities in the world (e.g. self-driving cars) or where they have to work as a team (e.g. cobots working in a factory).

The EN-TRUST Vision is that these systems learn situations where trust is typically lost unnecessarily, adapting this prediction for specific people and contexts. Stakeholder trust will be managed through transparent interaction, increasing the confidence of the stakeholders to use the Autonomous Systems, meaning that they can be adopted in scenarios never before thought possible, such as doing the jobs that endanger humans (e.g. first responders or pandemic related tasks).

The EN-TRUST 'Trust' Node will perform foundational research on how humans and Autonomous Systems (AS) can work together by building a shared reality, based on mutual understanding through trustworthy interaction. The EN-TRUST Node will create a UK research centre of excellence for trust that will inform the design of Autonomous Systems going forward, ensuring that they are widely used and accepted in a variety of applications. This cross-cutting multidisciplinary approach is grounded in Psychology and Cognitive Science and consists of three "pillars of trust": 1) computational models of human trust in AS; 2) adaptation of these models in the face of errors and uncontrolled environments; and 3) user validation and evaluation across a broad range of sectors in realistic scenarios. This EN-TRUST framework will explore how to best establish, maintain and repair trust by incorporating the subjective view of human trust towards Autonomous Systems, thus maximising their positive societal and economic benefits.

Publications

10 25 50
 
Description We group our key findings to date by scientific work packages.

WP2: Trust Modelling for Transparent and Explainable Interaction
A. The Node consortium implemented a Delphi Method; a systematic technique, which relies on a panel of experts to achieve consensus to evaluate which questionnaire items would be the most relevant for developing a new Propensity to Trust scale. The paper results are in themselves noteworthy, but moreover this use of the Delphi technique provides a template as an effective and economical method for achieving content validity, while also providing greater scale creation transparency.
Key Publication: Dragostinov, Y., Harðardóttir, D., McKenna, P.E., Robb, D.A., Nesset, B., Ahmad, M.I., Romeo, M., Lim, M.Y., Yu, C., Jang, Y., Diab, M., Cangelosi, A., Demiris, Y., Hastie, H., Rajendran, G. Preliminary psychometric scale development using the mixed methods Delphi technique, Methods in Psychology, Volume 7, 2022.

B. A series of Human-Robot-Interaction (HRI) experiments were conducted to explore the fundamentals of Theory of mind and their relation to Trust between robots and humans.
Key Publication: Romeo, M., Mckenna, P.E., Robb, D., Rajendran, G.., Nesset B, Cangelosi A. and Hastie, H. (2022). Exploring Theory of Mind for Human-Robot Collaboration. In Proceedings of the 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2022) **Conference Best Paper Award Finalist*

C. The Node consortium designed and implemented components of the Cognitive Architecture for Trust (CAT). CAT has been adapted to the benchmark game card selected in the first stage of the project. In the modelling experiment, a collaborative robot tries to assist a human partner, who plays a trust-based card game against another human. The robot infers its partner's trust in the robot's decision system via reinforcement learning.
Key publication: Yu, C., Serhan, B., Romeo, M., & Cangelosi, A. (2023). Robot Theory of Mind with Reverse Psychology. In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (pp. 545-547).

D. Significant progress was made with regards "Transparent Interaction for Trust", including investigating personality, affect and explanation styles for functioning and errorful robotic behaviour. Furthermore, an IEEE standard on transparent interaction for autonomous systems (P7001) was developed jointly with Node PI Prof. Hastie, who worked in the P7001 working group.
Key publications:
-Chiyah Garcia, F., Smith, S., Lopes, J., Ramamoorthy, S., and Hastie, H. (2021). Self-Explainable Robots in Remote Environments. In Proceedings of HRI '21: ACM/IEEE International Conference on Human-Robot Interaction (HRI'21).
-Gavriilidis, K., Carreno, Y., Munafo, A., Pang, W., Petrick, RP, and Hastie, H. (2021). Plan Verbalisation for Robots Acting in Dynamic Environments. In KEPS '21: Workshop on Knowledge Engineering for Planning and Scheduling (KEPS'21).
-Lim, M.Y., Lopes, J., Robb, D.A., Wilson, B.W., Moujahid, M., and Hastie, H. (2022). We are all Individuals: The role of Robot Personality and Human Traits in Trustworthy Interaction. In Proceedings of the 31st IEEE International Conference on Robot & Human Interactive Communication (ROMAN '22). **KROS Interdisciplinary Research Conference Award in Social Human-Robot Interaction**
-Nesset, B., Robb, D.A., Lopes, J. and Hastie, H. (2021). Transparency in HRI: Trust and Decision Making in the Face of Robot Errors. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction (HRI'21).
-Robb, D.A., Liu, X., and Hastie, H. (2023). Explanation Styles for Trustworthy Autonomous Systems. In Proceedings of the 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023).
-Winfield, A.F.T., Booth, S., Dennis, L.A., Egawa, T., Hastie, H., Jacobs, N., Muttram, R., Olszewska, J. I., Rajabiyazdi, F., Theodorou, A., Underwood, M., Wortham, R.H., and Watson, E.(2021). IEEE P7001: a proposed standard on Transparency. In Frontiers in Robotics and AI, section Ethics in Robotics and Artificial Intelligence.
-Zhu, H., Yu, C., & Cangelosi, A. (2022). Affective Human-Robot Interaction with Multimodal Explanations. In Proceedings of the International Conference on Social Robotics (ICSR 2022). **Finalist Best Student Paper**
-Zhu, H., Yu, C., & Cangelosi, A. (2022). Explainable Emotion Recognition for Trustworthy Human-Robot Interaction. In Context-Awareness in Human-Robot Interaction Approaches and Challenges Workshop on IEEE/ACM HRI 2022.

WP3: Adapting Trust Models for Enhanced Usability & Robustness to Human and Environmental Complexity
A. An open source Message Passing Framework (MPF) for Vision Prediction Stability in Human Robot Interaction was developed in order to stabilise vision prediction results used in HRI. This MPF includes pose estimation, object detection, hand-object detection, and gaze estimation.
Key Publication: Y. Jang and Y. Demiris (2022). Message Passing Framework for Vision Prediction Stability in Human Robot Interaction. In Proceedings of IEEE ICRA 2022.

B. A novel knowledge structure was developed that captures HRI concepts using a hierarchy of ontologies, consisting of three levels: metaontology, domain ontology, and instantiation ontology levels.

C. Significant progress in the area of assistive robotics for activities of daily living (ADL) including dressing, as well as novel interfaces for assisting in the control of complex robots using augmented reality.
Key Publications:
-Zhang, F. and Demiris, Y. (2022). Learning garment manipulation policies toward robot-assisted dressing, Science Robotics, 6 Apr 2022, Vol 7, Issue 65.
-Rodrigo Chacon-Quesada, R. and Demiris, Y. (2022). Proactive Robot Assistance: Affordance-aware Augmented Reality User Interfaces. In Proceedings ofIEEE Robotics and Automation Magazine, Jan 2022.
-Chacon-Quesada, R. and Y. Demiris, Y. (2023). Design and Evaluation of an Augmented Reality Head-Mounted Display User Interface for Controlling Legged Manipulators. In Proceedings of IEEE Conference on Robotics and Automation, London, United Kingdom.
-Chacon-Quesada, R. and Demiris, Y. (2023). Holo-SpoK: Affordance-Aware Augmented Reality Control of Legged Manipulators. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.
-Casado, F. and Demiris, Y. (2022). Federated learning from demonstration for Active Assistance to Smart Wheelchair Users. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.


WP4: User Validation and Experimental Design.
A. A substantial survey and meta-analysis of a decade's worth of trust-related HRI experiments was conducted, focusing on vulnerability.
Key Publication: McKenna, P. E., Ahmad, M. I., Maisva, T., Nesset, B., Lohan, K., & Hastie, H. (forthcoming). A Meta-analysis of Vulnerability and Trust in Human-Robot Interaction. In Transaction in Human-Robot Interaction (Special Edition).

B. An evaluation framework for trust is being developed that will inform how subjective questions are posed when garnering trust in humans.
Key Publications:
-Clinciu, M., Eshghi, A and Hastie, H. (2021). A Study of Automatic Metrics for the Evaluation of Natural Language Explanations. In Proceedings of the European Association of Computational Linguistics (EACL'21).
-Nesset, B., Rajendran, G., Lopes, J., Hastie, H. (2022). Sensitivity of Trust Scales in the Face of Errors. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction (HRI'22).

C. A unique method for automatic trust detection through interaction using linguistic cues was developed, which provides a non-invasive method for gauging trust in humans.
Key Publication: Lopes, J., and Hastie, H. (2021). The language of Persuasion, Negotiation and Trust. In Proceedings of SemDial.
D. The Node consortium developed a multimodal affective HRI framework, with visual-based and verbal-based explanation, by Layer-Wise Relevance Propagation (LRP) and Local Interpretable Mode-Agnostic Explanation (LIME). The framework was tested on the KDEF dataset, and in human-robot interaction experiments with the Pepper robot. This experimental evaluation shows the benefits of linking deep learning emotion recognition systems with explainable strategies.
-Zhu, H., Yu, C., and Cangelosi, A. (2023). Affective Human-Robot Interaction with Multimodal Explanations. In Proceedings of Social Robotics: 14th International Conference, ICSR 2022, Florence, Italy, December 13-16, 2022, Proceedings, Part I (pp. 241-252). Cham: Springer Nature Switzerland.
-Zhu, H., Yu, C., and Cangelosi, A. (2022). Explainable Emotion Recognition for Trustworthy Human-Robot Interaction. In Proceedings of Context-Awareness in Human-Robot Interaction Approaches and Challenges Workshop at IEEE/ACM HRI 2022.
Exploitation Route We are working with our project partners with the following use cases:
-Health and social care, with care providers, such Age UK Manchester,
-Remote robotics and explanability, with energy companies,
-Hospital triage robots and transparency, with the NHS,
-Assistance, e.g. person mobility (smart wheelchairs), in collaboration with the Royal Academy of Engineering,
-Collaborative robotics, with manufacturing companies, such as Siemens,
-Service robotics such as a Receptionist or Robo-barista, with the National Robotarium.
Sectors Aerospace

Defence and Marine

Agriculture

Food and Drink

Construction

Digital/Communication/Information Technologies (including Software)

Education

Energy

Healthcare

Manufacturing

including Industrial Biotechology

Retail

URL https://trust.tas.ac.uk/
 
Description (PERSEO) - European Training Network on PErsonalized Robotics as SErvice Oriented applications
Amount € 4,096,839 (EUR)
Funding ID 955778 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 01/2021 
End 12/2024
 
Description (TRAINCREASE) - From Social Interaction to Abstract Concepts and Words: Towards Human-centered Technology Development
Amount € 899,639 (EUR)
Funding ID 952324 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 01/2021 
End 12/2023
 
Description HUman-machine teaming for Maritime Environments (HUME)
Amount £1,099,367 (GBP)
Funding ID EP/V05676X/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 08/2021 
End 06/2024
 
Description Joint Research Program on Assistive Robots using Theory of Mind
Amount £12,000 (GBP)
Funding ID IEC\R2\222031 
Organisation The Royal Society 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2023 
End 03/2025
 
Description MSCA Doctoral Network TRAIL TRAnsparent InterpretabLe robots
Amount € 2,677,975 (EUR)
Funding ID 101072488 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 03/2023 
End 02/2027
 
Description ORCA Extension - Stream A
Amount £600,000 (GBP)
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 03/2021 
End 03/2022
 
Description Robot Companion with Theory of Mind for People Well-being (ToM-Well)
Amount £207,000 (GBP)
Organisation Honda R&D Europe Deutschland 
Sector Private
Country Germany
Start 03/2023 
End 02/2027
 
Title Preliminary psychometric scale development using the mixed methods Delphi technique 
Description This study implemented a Delphi Method; a systematic technique which relies on a panel of experts to achieve consensus, to evaluate which questionnaire items would be the most relevant for developing a new Propensity to Trust scale. 
Type Of Material Model of mechanisms or symptoms - human 
Year Produced 2022 
Provided To Others? Yes  
Impact Results from 28 experts produced 33 final questionnaire items that were deemed relevant for evaluating trust. We discuss the importance of content validity when implementing scales, while emphasising the need for more documented scale development processes in psychology. Furthermore, we propose that the Delphi technique could be utilised as an effective and economical method for achieving content validity, while also providing greater scale creation transparency. 
URL https://osf.io/hdkra/
 
Description Collaboration with CNR Consiglio Nazionale delle Ricerche, Palermo 
Organisation National Research Council
Country Italy 
Sector Public 
PI Contribution Both the Manchester and the CNR Palermo teams are working on Theory of Mind, which is key to this EPSRC project.
Collaborator Contribution The CNR Lab has a social and cognitive robotics lab. They specialise on modelling emotions, which complements the Manchester expertise.
Impact Funding form Royal Society for Bilateral Programme
Start Year 2023
 
Description Collaboration with the University of Swansea 
Organisation Swansea University
Country United Kingdom 
Sector Academic/University 
PI Contribution Working on a meta-analysis paper with Muneeb Ahmad.
Collaborator Contribution Collaboration in terms of analysis over 2000 papers
Impact Multi-disciplinary with Psychology and Computer Science
Start Year 2021
 
Description Propensity to Trust Scale creation 
Organisation University of Edinburgh
Country United Kingdom 
Sector Academic/University 
PI Contribution Here, we are collaborating with the Differential Psychology Research Group, Psychology, School of Philosophy, Psychology and Languages Sciences, The University of Edinburgh. We bring out expertise in how trust scales have been used in HRI research.
Collaborator Contribution Our collaborators bring their expertise in creating properly validated scales.
Impact Yavor Dragostinov, Daney Harðardóttir, Peter Edward McKenna, David A. Robb, Birthe Nesset, Muneeb Imtiaz Ahmad, Marta Romeo, Mei Yii Lim, Chuang Yu, Youngkyoon Jang, Mohammed Diab, Angelo Cangelosi, Yiannis Demiris, Helen Hastie, Gnanathusharan Rajendran, Preliminary psychometric scale development using the mixed methods Delphi technique, Methods in Psychology, Volume 7, 2022.
Start Year 2020
 
Title Message Passing Framework for Vision Prediction Stability in Human Robot Interaction 
Description To stabilise vision prediction results used in HRI, we present a message passing framework (MPF) that uses the memory of individual modules to correct each other's outputs. 
Type Of Technology Software 
Year Produced 2022 
Impact We make our code publicly available so that other HRI researchers can potentially benefit from more stabilised outputs from their vision modules. This MPF includes pose estimation, object detection, hand-object detection, and gaze estimation. 
URL https://sites.google.com/view/mpf-hri
 
Description 2021 Invited Speaker Prof. Angelo Cangelosi, US ARL Mid-Term Tech Forecasting Virtual Workshop: Artificial Intelligence, December 2021 (online) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Policymakers/politicians
Results and Impact Research funding priority workshop
Year(s) Of Engagement Activity 2021
 
Description A talk or presentation - Conference presentation, Dr David A.Robb presented "Moujahid M., Robb D.A., Dondrup C., Hastie H., Come Closer: The Effects of Robot Personality on Human Proxemics Behaviours" at RO-MAN'23 in Busan 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Dr David A. Robb presented the paper, "Moujahid M., Robb D.A., Dondrup C., Hastie H., Come Closer: The Effects of Robot Personality on Human Proxemics Behaviours" at 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) in Busan, Korea (Republic of) in August 2023.
Year(s) Of Engagement Activity 2023
URL https://ro-man2023.org/main
 
Description As part of Safer Internet Day (6th Febuary), Children's BBC created a programme included a visit to the National Robotarium. 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Schools
Results and Impact The TV included children asking about the differences between AI and Robots; seeing some robots in action, including the Mazes Task (which is an experiment in our TAS Node on Trust Project). The programme was designed to create a dialogue so that children can start to ask the right questions about these technologies.
Year(s) Of Engagement Activity 2024
URL https://www.bbc.co.uk/iplayer/episode/m001w2lh/bbc-teach-live-lessons-series-5-safer-internet-day-20...
 
Description BBC Scotland Radio Interview- Helen Hastie 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact BBC radio interview where the goal of the Node project was discussed
Year(s) Of Engagement Activity 2020
 
Description Conference Presentation at HRI 2021: Birthe Nesset 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Birthe Nesset presented her work at the HRI 2021 conference
Year(s) Of Engagement Activity 2021
URL https://dl.acm.org/doi/10.1145/3434074.3447183
 
Description Conference presentation, Dr David A.Robb presented "Lim MY , Robb DA , Wilson BW , Hastie H , Feeding the coffee habit: a longitudinal study of a robo-barista" at RO-MAN'23 in Busan 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Dr David A.Robb presented the paper, "Feeding the coffee habit: a longitudinal study of a robo-barista" at the 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) in Busan, Korea (Republic of).
Year(s) Of Engagement Activity 2023
URL https://ro-man2023.org/main
 
Description David Robb - Invited talk at Redouble 2021 (a workshop at RO-MAN2021) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact David Robb gave an invited talk at Redouble 2021 (a workshop at RO-MAN2021) https://sites.google.com/view/redouble2021 Talk Title: "Trust and Transparency in AI: One Perspective from HRI Studies "https://sites.google.com/view/redouble2021/schedule?authuser=0". Present were 10 to 100 Academic and Industry HRI scientists and practitioners
Impact: dissemination of research group's work.
Year(s) Of Engagement Activity 2021
URL https://sites.google.com/view/redouble2021/schedule?authuser=0
 
Description Dr Peter McKenna Gave a talk to GU Psych Society on transitioning from Psychology to HRI 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Dr Peter McKenna Gave a talk to GU Psych Society on transitioning from Psychology to HRI, which can be watched on youtube
Year(s) Of Engagement Activity 2021
URL https://www.youtube.com/watch?v=qll38bzlSYw
 
Description Furhat Conference Invited Speaker PI Helen Hastie 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Prof. Helen Hastie presented the Node, Human-robot teaming (HUME), ORCA and work with the Furhat.
Year(s) Of Engagement Activity 2021
URL https://www.youtube.com/watch?v=Uc-3t5gXz3g&t=2s
 
Description Helen Hastie- Tech Monitor Magazine 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Node project was mentioned in the news article
Year(s) Of Engagement Activity 2020
URL https://techmonitor.ai/automation/robotics/trust-in-robots-ocado-tharsus
 
Description IEEE RO-MAN 2022 - Presenting Paper on Trust and Theory of Mind 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact IEEE RO-MAN 2022 presentation of work on: Exploring Theory of Mind for Human-Robot Collaboration
Year(s) Of Engagement Activity 2022
URL https://www.research.manchester.ac.uk/portal/en/publications/exploring-theory-of-mind-for-humanrobot...
 
Description IWSDS Keynote: Prof. Helen Hastie 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Prof. Helen Hastie have a keynote talk where she discussed work on the Node, Human-robot teaming (HUME) and the ORCA hub
Year(s) Of Engagement Activity 2021
URL https://www.colips.org/conferences/iwsds2021/wp/
 
Description Interview for Global Chinese Network 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Interviewed about the work of The National Robotarium gave me an opportunity to speak about our research in trust.

The Chinese Global Television Network has an audience of over 1 Billion, so the potential audience is sizeable and international.
Year(s) Of Engagement Activity 2022
URL https://newseu.cgtn.com/news/2022-11-13/UK-plays-catch-up-with-artificial-intelligence-and-robotics-...
 
Description Invited Talk by Dr David A. Robb titled "What were they thinking?" at Robotics and Computer Science Seminars, Wednesday 13/12/2023 at 14:00, Atrium Space of the National Robotarium. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Invited Talk by Dr David A. Robb titled "What were they thinking?" at Robotics and Computer Science Seminars, Wednesday 13/12 at 14:00, Atrium Space of the National Robotarium.

Talk Abstract

Much of our lives are spent interacting with technology of some kind. Whatever that technology is, knowing why people use it the way they do, and what they get out of it, is valuable knowledge that can inform future developments. The pursuit of that knowledge mostly boils down to asking the question, 'What were they thinking?' Humans are endlessly fascinating beings, sometimes predictable but often highly variable. Indeed, the reasons for such variability can be part of the answer to our question. In my talk I will describe a few of the studies I have been involved in while working with interdisciplinary groups investigating what is going on at the interface between humans and their "tech". Time permitting, I will try to touch on a range of methods: qualitative, quantitative, self-report, psychometric, physiological, experimental, observational, lab-based, crowdsourced, and in-the-wild; different ways to answer our question, 'What were they thinking?'
Year(s) Of Engagement Activity 2023
URL https://www.eventbrite.com/e/what-were-they-thinking-tickets-775439509447
 
Description Joint organiser - Workshop: Effective Deployment of Subjective Measures and Questionnaires in HRI Studies 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 15 Sept 2021
Joint organisers: David Robb, Marta Romeo, Peter McKenna, Helen Hastie.
Workshop: Effective Deployment of Subjective Measures and Questionnaires in HRI Studies
https://vimeo.com/641460042
Present were 10 to 20 Academic and Industry HRI scientists and practitioners
Impact: dissemination of research group's work; potential collaboration opportunities created.
Year(s) Of Engagement Activity 2021
URL https://vimeo.com/641460042
 
Description Keynote Speaker Prof. Angelo Cangelosi, 2022 International Conference on Advanced Control, Automation and Robotics (ICACAR 2022). March 26-28, 2022 in Guangzhou, China (online) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Keynote talk to robotics community
Year(s) Of Engagement Activity 2022
 
Description Keynote Speaker Prof. Angelo Cangelosi, BPS British Psychological Society Annual Conference, 1 July 2021 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Talk to psychology conference to combine modelling and robotics
Year(s) Of Engagement Activity 2021
 
Description Maintenance and Engineering Magazine 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact Article on the node on trust
Year(s) Of Engagement Activity 2020
URL https://edition.pagesuite-professional.co.uk/html5/reader/production/default.aspx?pubname=&edid=7924...
 
Description Media article for The Conversation: 'We need to discuss what jobs robots should do, before the decision is made for us' 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The article delineates the different roles that robots and autonomous systems can play in society. As well as presenting the research done as part of our TAS Node on Trust, the article asks what roles do want these systems to take.
Year(s) Of Engagement Activity 2023
URL https://theconversation.com/we-need-to-discuss-what-jobs-robots-should-do-before-the-decision-is-mad...
 
Description Media article for The Scotsman Newspaper: 'Unlocking the full potential of robotics' 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The article describes the differents ways in which robots and autonomous systems can be used to unlock research and innovation.
Year(s) Of Engagement Activity 2023
URL https://www.scotsman.com/business/data-capital-unlocking-the-full-potential-of-robotics-at-heriot-wa...
 
Description Online Video Demonstration Presentation at HRI'22 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Video demonstration with @furhatrobotics of our Robo-barista robot that can tell if you are tired and gives you an extra shot of coffee
Year(s) Of Engagement Activity 2022
URL https://dl.acm.org/doi/10.5555/3523760.3523974
 
Description Organisation of a Robotics Collaborative Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact The workshop was with the Edinburgh Napier University, on the topic of robotics and collaboration and translation to industry/society.
Year(s) Of Engagement Activity 2023
 
Description Organised Collaborative Robotics Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact The workshop was with the University of Edinburgh, on the topic of robotics and collaboration and translation to industry/society.
Year(s) Of Engagement Activity 2022
 
Description Organised UKRI Trustworthy Autonomous Systems Node in Trust Industry Workshop. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact 14 Dec 2020
Organiser: David Robb.
UKRI Trustworthy Autonomous Systems Node in Trust Industry Workshop.
Attending were 30 Academics and Industry Partners/Practitioners
Attendees worked in breakout groups.
Impact: Research directions co-created; Workshop output was a list of Robotics Use cases desired by the parners for the Node to investigate (along with detailed discussion records).
Year(s) Of Engagement Activity 2020
 
Description PI Prof Helen Hastie talk about Robotics at National Robotarium in Scotsman's podcast 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact PI Prof Helen Hastie talk about the Node on Trust and human-robot collaboration in a Scotsman's podcast
Year(s) Of Engagement Activity 2021
URL https://www.scotsman.com/business/data-capital-podcast-how-data-and-ai-are-powering-robotics-revolut...
 
Description PI Prof. Helen Hastie was talking on BBC Scotland News today about the Node on Trust project 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact PI Prof. Helen Hastie was talking on BBC Scotland News today about the Node on Trust project
Year(s) Of Engagement Activity 2020
URL https://www.bbc.co.uk/sounds/play/m000p121
 
Description PI Prof. Helen Hastie- Living with Robots Panel Event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other audiences
Results and Impact This panel was part of the Edinburgh Futures Institute's series on Living well with Robots. This was live streamed and in-person.
Year(s) Of Engagement Activity 2023
URL https://efi.ed.ac.uk/events/living-with-robots/
 
Description Podcast Interview for the Data Capital Podcast by The Scotsman 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact I was interviewed for this podcast about 'What does Scottish Society need from robots'. On the back of this I had inquiries about our research both nationally and internationally.
Year(s) Of Engagement Activity 2022
URL https://anchor.fm/thescotsman/episodes/Data-Capital-Podcast-what-does-Scottish-society-need-from-rob...
 
Description Poster Presentation (non-archival) by Dr David Robb of "Robb D , Liu X , Hastie H, Explanation styles for trustworthy autonomous systems" at The First International Symposium on Trustworthy Autonomous Systems at Heriot-Watt-University, Edinburgh July 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Poster Presentation (non-archival) by Dr David Robb of "Robb D , Liu X , Hastie H, Explanation styles for trustworthy autonomous systems" at The First International Symposium on Trustworthy Autonomous Systems at Heriot-Watt-University, Edinburgh July 2023
Year(s) Of Engagement Activity 2023
URL https://tas.ac.uk/bigeventscpt/first-international-symposium-on-trustworthy-autonomous-systems/
 
Description Poster Presentation and online at HRI'22 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Poster Presentation and online at HRI'22 on "Sensitivity of Trust Scales in the Face of Errors"
Year(s) Of Engagement Activity 2021,2022
URL https://dl.acm.org/doi/pdf/10.5555/3523760.3523912
 
Description Poster Presentation by Dr David Robb of "Robb D , Liu X , Hastie H, Explanation styles for trustworthy autonomous systems" at AAMAS'23, in London June 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Poster Presentation by Dr David Robb of "Robb D , Liu X , Hastie H, Explanation styles for trustworthy autonomous systems" at 22nd International Conference on Autonomous Agents and Multiagent Systems 2023, in London June 2023
Year(s) Of Engagement Activity 2023
URL https://aamas2023.soton.ac.uk/
 
Description Presentation by Co-I at the Edinburgh Science Festival 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact A talk by our Co-I Thusha Rajendran on 'How Robots will help us in the future' as part of the Edinburgh Science Festival.
Year(s) Of Engagement Activity 2022
 
Description Presentation from Co-I at the National Robotarium 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact A talk from project Co-I Thusha Rajendran at the National Robotarium on 'Digital Humans: what technology reveals about our cognition, emotions and behaviour.
Year(s) Of Engagement Activity 2022
 
Description Presentation given the Origins of Mind Research Group, 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Four members of the Node team presented four presentation about different aspects of then Node to Primatologist, whose research about Chimpanzee cognition communication.

Outcome was to inform this research group about the Node, especially in our use of theory of mind as framework for understanding trust.
Year(s) Of Engagement Activity 2021
 
Description Prof. Gnanathusharan Rajendran - Interview for National Newspaper 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact On the back of this news article (below) Prof. Gnanathusharan Rajendran was interviewed by a Sun reporter about an article they wanted to write.
Year(s) Of Engagement Activity 2023
URL https://www.bbc.co.uk/news/technology-64718842
 
Description Prof. Gnanathusharan Rajendran - Interview for the Living with AI podcast about the Psychology of Trust 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Prof. Gnanathusharan Rajendran was interviewed by the Living with AI podcast about the 'Psychology of Trust'. Here I was able to discuss the complexities of understanding trust (e.g. there are individual differences in trust), so how do we create models of trust that include those.
Year(s) Of Engagement Activity 2022
URL https://lwaip.buzzsprout.com/1447474/10797316-the-psychology-of-trust
 
Description Radio Interview with Co-I on Robots and Society 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Co-I Thusha Rajendran took part in the Data Capital podcast to discuss Robots and Society.
Year(s) Of Engagement Activity 2022
URL https://anchor.fm/thescotsman/episodes/Data-Capital-Podcast-what-does-Scottish-society-need-from-rob...
 
Description Robot demonstration and video shortlisted for the Medical Robotics for Contagious Diseases Challenge. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Supporters
Results and Impact Robot demonstration and video shortlisted for the Medical Robotics for Contagious Diseases Challenge.
Year(s) Of Engagement Activity 2021
URL http://youtu.be/vrH1XW_pVxY
 
Description Robots After Dark - The Edinburgh Science Festival (a ticketed event as part of the Edinburgh Science Festival held at the National Robotarium) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Approximately 100 attended a evening event about the potential and roles of robots and AI. This event included talks, a discussion and demonstration of robots and the capabilities.
Year(s) Of Engagement Activity 2023
URL https://thenationalrobotarium.com/trust-in-robots-explored-at-the-national-robotarium-for-edinburgh-...
 
Description SCRITA Workshop Invited Speaker- PI Helen Hastie 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact IEEE Ro-man Workshop on Trust, Acceptance and Social Cues
Year(s) Of Engagement Activity 2021
URL http://scrita.herts.ac.uk/2021/
 
Description SRPe Conference Presentation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact Conference showcasing Scottish Regional Partnership in Engineering (SRPe). Prof. Hastie's talk focused on equality and diversity in Robotics.
Year(s) Of Engagement Activity 2023
 
Description STEM Event Presentation 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Undergraduate students
Results and Impact This was a Christmas event to celebrate Women in STEM, in particular robotics.
Year(s) Of Engagement Activity 2022
 
Description Scottish Government UK Industrial Strategy Newsletter 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact The Node project was featured in the Scottish Government UK Industrial Strategy Newsletter
Year(s) Of Engagement Activity 2020
 
Description Scottish Sun- Thusha Rajendran 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Scottish Sun article about robotics and autonomous systems
Year(s) Of Engagement Activity 2021
URL https://www.thescottishsun.co.uk/tech/6673730/robots-edinburgh-technology-future-scotland/
 
Description TV apperance as part of STV's Flagship news and current affairs programme: 'Artificial Intelligence is transforming our world at a rapid rate. This has generated great excitement about the benefits that advanced technology can deliver for people and businesses.' 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The programme and my interview was based around the relationship between robots and AI and how new developments in technology could be transformative for industry and society. Here, I raised trust as key issue around adoption of technologies.
Year(s) Of Engagement Activity 2023
 
Description Talk on the Psychology on Tap seminar series- Thusha Rajendran 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact Talk Entitled "A hitchhiker's guide to technology"
Year(s) Of Engagement Activity 2021
URL https://www.facebook.com/HWPsych/events
 
Description Talk to students at Secondary School in Edinburgh by Rajendran: "Aye Robot: an introduction to social and developmental robotics" 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact To presentation in introduction to AI, Social and Developmental Robotics to secondary school students - with a view to them considering this field as a career options (especially or girls). Topics included Trust in Autonomous agents.
Year(s) Of Engagement Activity 2020
 
Description The Scotsman Newspaper Article written by PI Helen Hastie 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Newspaper article in 'The Scotsman' written by PI Helen Hastie on: 'Why teaching robots and humans to trust each other is essential'.
Year(s) Of Engagement Activity 2022
URL https://www.scotsman.com/news/opinion/columnists/why-teaching-robots-and-humans-to-trust-each-other-...
 
Description Video Demonstration Presentation at HRI'22 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Video demonstration of Robot Receptionist that exhibits multi-party interactions
Year(s) Of Engagement Activity 2022
URL https://dl.acm.org/doi/10.5555/3523760.3523975
 
Description Video demonstration: HRI'21 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Video demonstration of explainable autonomous systems
Year(s) Of Engagement Activity 2021
URL https://www.youtube.com/watch?v=1CZm6bsILaw&t=4s
 
Description Workshop organisation on NLP and Trust 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Workshop organisation on NLP and Trust as part of the TAS Hub all hands meeting
Year(s) Of Engagement Activity 2021
 
Description Workshop organisation on affective human-robot interaction (AHRI) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact A workshop to provide a communication and collaboration platform for researchers from the human-robot interaction (HRI), emotion recognition, affective computing, deep learning, and healthcare communities.
Year(s) Of Engagement Activity 2022
URL https://www.a-hri.me/home
 
Description Workshop organisation with IIT and the iCub Robot 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Workshop with IIT on using the iCub robot and its application as well as technical introduction
Year(s) Of Engagement Activity 2021
 
Description Yiannis Demiris, Invited Keynote Speaker, Towards Autonomous Robotic Systems Conference (TAROS-2021), Lincoln, UK, 8-10 Sept 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Yiannis Demiris was an Invited Keynote Speaker at the conference
Year(s) Of Engagement Activity 2021
URL https://lcas.lincoln.ac.uk/wp/taros-2021/
 
Description Yiannis Demiris, Invited Keynote speaker: TransAIR Workshop on Cognitive Architectures, Bremen, Germany (virtual), 22-28 March 2021 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Yiannis Demiris was an Invited Keynote speaker at the workshop
Year(s) Of Engagement Activity 2021
URL https://www.research-in-germany.org/the-future-of-work/news-and-stories/2021-transatlantic-workshop-...
 
Description Yiannis Demiris, Invited Speaker: RSS'21 Workshop on Robotics for People (R4P): Perspectives on Interaction, Learning and Safety, at the Robotics: Science and Systems 2021 conference, 12-16 July 2021 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Yiannis Demiris was an Invited Speaker at the workshop
Year(s) Of Engagement Activity 2021
URL https://sites.google.com/view/r4p2021/speakers?authuser=0
 
Description Yiannis Demiris: Invited Keynote Speaker, IEEE 30th International Conference on Robot and Human Interactive Communication (IEEE RO-MAN 2021), 8-12 August 2021, Vancouver, Canada (virtual). 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Yiannis Demiris: Invited Keynote Speaker at the HRI conference
Year(s) Of Engagement Activity 2021
URL https://ro-man2021.org/program/keynote-speakers/