THE HEARING BODY: How auditory perception influences body representation

Lead Research Organisation: University College London
Department Name: UCL Interaction Centre

Abstract

The way we perceive, and represent, our physical body strongly predicts how we will interact with our environment. On the one hand, our awareness about the boundaries of our body, and its physical capabilities, influence our subsequent actions. For instance, we may ponder whether we can reach a particular object or whether there is enough space for us to get onto a crowded bus. On the other hand, the way in which we perceive how our body looks is critical to creating a sense of self-identity and therefore influences our self-esteem and our social interactions. Hence, understanding the mechanisms underlying body awareness is of great importance, not only for improving our knowledge about the nature of our sense of our own body, but also, given its links with self-esteem, action and our interactions, because of the impact this has on our wellbeing in social contexts.
Recent research has found that the mental representation we have of our body is not fixed but is continuously updated by the sensory and motor information received from interaction with our environment. For example, an artificial hand may feel like part of my body if I see it being touched at the same time that I feel my own, unseen, hand being touched in a similar way. This is the result of the integration of information coming from two different sensory channels - vision and touch. "I see something touching the artificial hand and I feel touch at the same time, therefore, the hand I see must be part of my body".
The primary aim of this project is to study the contribution of auditory cues to the representation of our body. Currently, there is no solid evidence linking auditory information to body-representation, although sound is known to be crucial for body perception. Unlike vision, audition provides information about the space surrounding our whole body. Like vision and touch, audition provides information about the body, via self-produced sounds, such as those associated with breathing or walking. These self-produced sounds provide crucial information about our body. For instance, the sounds produced when tapping on a surface with the hand inform us about the length and strength of our arm.
This project will investigate the importance of audition for body-representation by collecting data from a sample of over 200 adults. In the experiments, participants will be asked to execute specific actions (e.g. walking, throwing an object that creates sound) while the feedback sounds from their actions will be manipulated in real-time. The potential update in body-representation will be then quantified. We predict that altering self-produced sounds will alter body-representation. For instance, altering the perceived distance to the sound derived from tapping on a surface may give the impression that you have a longer/shorter arm.
The project will employ a multidisciplinary and innovative research methodology that will allow quantification, in parallel, of the changes evoked by altered self-produced sounds in 1) the perceived boundaries of the body, 2) the perceived possibilities for action and 3) the bodily-related emotional state (i.e. how one feels about one's body), given that the sense of one's body is tightly linked to action-awareness and self-esteem. This methodology provides a robust framework for discussing the nature of changes in body-representation and for integrating the research results into a multisensory model of body-representation.
This project will yield novel insights into the nature of the sense of body and, ultimately, will guide the design of audio-based applications that improve self-image, self-esteem, action patterns and social interaction to support wellbeing and self-directed rehabilitation. The extensive use of headphones and wearable devices (e.g. Apple iPod), and the increasing market for motion sensing input devices (e.g. Microsoft Kinect, e-textile) in society today, suggest excellent possibilities for these sound-based applications

Planned Impact

This research has potential to contribute to the nation's wealth and health because it will propose how we can use sound-based technologies, for inducing changes in body-representation (BR), that increase awareness of action possibilities and trigger specific emotional states:

(i) At the business/industrial level the project will impact health and wellbeing information and communications technology applications, by establishing links with designers of sensory-augmentation systems for entertainment, rehabilitation, behavioural change and fitness, as well as Virtual Reality (VR). The project will benefit the commercial private sector by setting the basis for designing sound-based applications that promote healthier life style by improving people's self-image, self-esteem, self-efficacy, action patterns and social interaction. This may attract the interest of companies such as Microsoft, Apple, Fujitsu, Orange or Boots. The extensive use of headphones and wearable devices (e.g. Apple iPod) and the increasing market for motion-sensing input devices (e.g. Microsoft Kinect) in society today, provide an excellent potential for consumer applications. The links with these sectors will be initiated during the project and the impact may be quickly realised in full, contributing to the nation's economic performance.

(ii) A number of general public user groups could benefit from the potential sound-based applications, that may enhance the quality of life, health and wellbeing:
a) populations with clinical disorders linked to distortion of BR. Certain types of chronic pain, affecting nearly one in seven UK citizens, are accompanied by an alteration of BR, perceived motor capabilities and emotional distress [33] (e.g. complex regional pain syndrome-CRPS, phantom limb pain, fibromyalgia, focal dystonia). These conditions adversely affect psychological wellbeing and social and working life. Similar clinical disorders linked to distortions of BR are anosognosia for hemiplegia8 and anorexia nervosa [9].
b) the general population. Every year near 40,000 UK citizens undergo plastic surgery procedures that change their bodily appearance [38]. The fitness industry is also growing exponentially, which reflects general appearance/body-related concerns. Young people's body and self-esteem may be closely linked to their emotional and physical wellbeing. Older people are often concerned about what their body can do, to the detriment of their motor performance and emotional states [39]. Induced changes in BR may lead to improved self-esteem as a result of feeling good about one's body and may promote healthy behaviour and social interaction, which are central for enhancing the wellbeing of the general population.

I will undertake a series of activities during the project lifetime to engage with these populations, the organizations supporting the clinical cohorts (e.g. the NHS) and the industries developing interactive technology for therapy. The aim will be to examine the potential benefits of the research and to inform and shape the design of new technology for wellbeing, rehabilitation and entertainment. This can contribute to fostering the nation's health and wellbeing in the short-term. The project will open discussion on the potential benefits for the clinical groups by focusing on CRPS patients, who have a particularly altered BR (e.g. an affected limb may be perceived as larger than it actually is [36]). Part of the discussion will aim to identify other potential beneficiaries.

The project will impact on my research and professional skills and will consolidate my career and development into a future research leader, by providing me with a solid research base, project management and teaching/supervision skills, as well as strong links with other researchers, technology designers and users. Similar skill development opportunities will be given to any junior staff directly associated with this project.

Publications

10 25 50
 
Description • Mental body-representations can be altered via sound: New knowledge/methodology
Using innovative virtual 3D-audio and gesture-sound interactive systems in our experiments we showed that real-time alterations of the sound generated by bodily actions can change how people mentally represent their own body. We found that (i) increasing the distance from which one hears the sounds produced by his/her hand tapping on a surface leads to perceive one's arm as being longer (Tajadura-Jiménez/2015a); (ii) altering one's footstep sounds as if produced by either a lighter body leads to changes in one's represented body size (Tajadura-Jiménez/2015b). We also demonstrated that for updates to happen: (i) the sound-feedback needs to be felt as being generated by one's body and (ii) spatiotemporal sound alterations need to be kept under certain limits (Tajadura-Jiménez/2015a; 2015c). Our studies showed for the first time that the alteration of body-representation is possible through sound-feedback, and not just through other sensory inputs, and that it follows the principles observed for visually-driven alterations. This has important theoretical implications as it suggests that body-representation is supramodal. It also has implications for real-word applications as sound-driven alterations in body-representation are more easily applied in ubiquitous settings than visual-driven ones.

• Development of a Body-Emotion-Action model to study body-representation and object interactions
Through our findings we showed an interaction between body-representation, emotional state and motor behaviour. We found that (i) altering the spatial cues of the sounds produced when tapping a surface with one's hand changes the subsequent arm movements to reach an object, as well as the perceived tactile distances on the tapping arm (Tajadura-Jiménez/2015a; submitted); (ii) altering cues related to the strength applied when tapping a surface changes one's tapping behavior and emotional state (Tajadura-Jiménez/2015c); (iii) altering walking sound cues related to body weight changes one's gait and emotional state (Tajadura-Jiménez/2015b). Our studies are first to propose a framework to jointly study body-representation, emotion and action by using multiple stimuli and measures. Of significance, we found similar principles apply to object perception during body-objects interactions: real-time manipulation of the sounds generated when touching a surface changes the perceived material properties, such as texture or hardness, and this in turn changes the touch behavior and the emotional feelings elicited by this interaction (Tajadura-Jiménez/2014; 2015c).

• New Collaborations
This award led to initiate academic collaborations across countries (France, Spain, Japan) and disciplines (with the Centre for the Study of the Senses (Philosophy); IRCAM (Acoustics/Music research); Universidad de Barcelona (Psychology/Computer Science/Virtual Reality)). Further, projects linked to this award are currently ongoing in clinical sites (Stanmore Royal National Orthopaedic Hospital) and industrial sites (NTT-Japan). Our work was chosen by artist David Byrne for a public immersive theatrical 'science exhibition'.

• Training delivered in specialist skills
This award contributed to two PhD theses by directing to complement HCI approaches with an embodied understanding of sound for health technology solutions (Newbold/2016; Singh/2014; 2016). Various undergraduate/MSc students received training; one got the best MSc thesis award (2014) and her work led to publish in the best conference in HCI (20% acceptance rate).
Exploitation Route The innovative methodological approach combining interactive multimodal-tracking and sound-feedback technologies, and the new understanding of sound manipulations affecting body-representations, have led to novel ways of investigating further the above questions by including a modality usually left out (e.g. in VR, in collaboration with Barcelona University; also in contact with industry wishing to add realism to VR). Further, HCI, computer scientists and clinical psychologists are now investigating how sound-based wearable devices could be used to develop technology-based interventions for health. For example, Bianchi-Berthouze and Cohen are investigating their use in therapies and self-management of people with chronic pain. Based on the award outcomes, we have taken a first step towards clinical interventions through a collaborative project with Stanmore Royal National Orthopaedic Hospital. We are testing our 'sonic shoes', which alter people's body-representation, gait and emotion, for treatment of body-perception distortions linked to pain. We expect that technologies and therapies integrating the award outcomes may be used to aid normalisation of distorted body-representations, for instance due to pain, limb amputation or anorexia nervosa, and also address increasing concerns on bodily appearance in the general population. Ultimately, these technologies may aid movement and enhance emotional states and well-being, thus making a socio-economic impact.
Sectors Healthcare,Leisure Activities, including Sports, Recreation and Tourism

URL https://www.ucl.ac.uk/uclic/research/project-pages/hearing-body
 
Description A significant socio-economical impact comes from the findings that arose from this project research of how interactive multimodal tracking and sound-feedback technologies can be used for inducing changes in body-representation (BR) that trigger specific action patterns and emotional states. This research has lead to a number of academic findings that we have disseminated through research publications and presentations at public events. At the business/industrial level the project has attracted the interest of companies working on information and communication technology applications, as detailed below: • We have discussed our research approach and findings with companies such as Microsoft, BBC, the Human Factors and Devices Research Team of Hyundai Motor Company or FADA-CATEC (Center for Advanced Aerospace Technologies). • We have conducted research in collaboration with the Nippon Telegraph and Telephone Corporation (NTT) in Japan, to investigate the use of sound technologies to alter BR. This collaboration has already materialized in terms of academic outputs (i.e., journal articles), and has also the potential to impact on communications technology applications. • We have established links with designers of sensory augmentation systems for entertainment and health. During the life-time of the project we built connections with virtual reality (VR) researchers through attending the UCL VR club and London VR Seminars and through presenting findings from the project at the 1st London Virtual Social Interaction Workshop, as well as through collaborations with Max Planck Institute for Biological Cybernetics and University of Barcelona. With the latter, we used VR technology to induce in older people the feelings of having a younger body. This research has led to an academic publication (Tajadura-Jimenez et al., 2017, Scientific Reports), and has also the potential to impact on the well-being of older people, who are often concerned about their body appearance and what their body can do, to the detriment of their motor performance and emotional states. • One of the project outcomes is that sound-based technologies altering BR can be used to enhance motor behaviour, such as gait, and enhance emotional state. This work, which may feed into the fitness industry, set the bases for a new grant we have received (running through 2016-2019) and which will investigate how to change sedentary lifestyles by altering BR using sensory feedback. The above-mentioned work has the potential to make a socio-economical impact on medical and social practices. It is expected that the impact on healthy groups and others with specific BR disruptions will be fully realized when new therapies and self-management technologies relying on alterations of BR, that incorporate the outputs of the project, become available to these groups. During the life-time of the project we have built connections with NHS and the team at Stanmore Royal National Orthopaedic Hospital (RNOH) and started a collaboration with them to investigate the potential use of the technologies designed in the project in therapies and self-management of people with chronic pain for treatment of body-perception distortions linked to pain. This collaboration has materialized in a journal article (Tajadura-Jiménez et al, 2017, Frontiers in Human Neuroscience) and has set the bases for further collaborative work within the medical sector. We are currently testing the potential benefit of using the technologies designed in the project in therapies for other clinical populations, including people with eating disorders or who suffered stroke (Gomez-Andres et al, 2019, Annals of the New York Academy of Sciences) and physically inactive people (Tajadura-Jimenez et al, 2019, CHI; Ley et al, 2019, ACII). The wider impact on general audiences outside scientific sectors came through participation in public and educational events, knowledge of transfer events and events with potential users in medical contexts. Public events have included showcasing our paradigms and results at the 2013 BNA Festival of Neuroscience, at the 2015 "Being Human" Festival, at the Wellcome collection ("Wrong" event in 2013 and "In Pursuit of Pain" event in 2016) and at the London Science Museum ("You have been upgraded" festival on Human Enhancement and the "Wearable 'superpowers'" event, both in 2015). Educational events have included a public display of demos on the theme "Our Bodies and Technology" for the Royal Institution & UCL Masterclass HCI for 9th grade school students. Knowledge transfer activitites with art and cultural community have included providing scientific advice to creative teams working on the multisensory representation of pain at the Barbican Centre and Battersea Arts Centre (theatre play "The shape of the pain", 2017-2018), working on an immersive theatrical art exhibition on neuroscience and perception (project led by David Byrne), participation in one of the discussion panels of "The Lab Project" organized by Camden Arts Centre and supported by the Centre and Kingsgate Workshops Trust (2015) and participation in the H2020 STARTS program of the European Commission to organise artistic collaborations with R&D projects that target innovation (2017-2018). Events with potential users in medical contexts have included organization of the event "Putting people at the centre of digital health" at the 2014 UCL Festival for Digital Health, and active participation at the 2015 event on Designing apps organized by the UCL Institute of Health Informatics. The research on this project has been featured in a series of journals and magazines such as New Scientist, Daily Mail or The Telegraph, as well as National and International Radio Programmes (BBC Radio 4, US Radio Caracol, German WPK, Danish Broadcasting Corporation) and TV Programmes (Spanish Television TVE2).
First Year Of Impact 2013
Sector Education,Healthcare,Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections
Impact Types Cultural,Societal

 
Description H2020 STARTS program of the European Commission to organise artistic collaborations with R&D projects that target innovation.
Amount € 15,000 (EUR)
Organisation European Commission H2020 
Sector Public
Country Belgium
Start 11/2017 
End 08/2018
 
Description National Programme for Research Aimed at the Challenges of Society
Amount € 39,930 (EUR)
Funding ID PSI2016-79004-R 
Organisation Spanish Ministry of Economy and Competitiveness 
Sector Public
Country Spain
Start 12/2016 
End 12/2019
 
Description Ramón y Cajal (RYC) Postdoctoral Senior Grants
Amount € 308,600 (EUR)
Funding ID RYC-2014-15421 
Organisation Spanish Ministry of Economy and Competitiveness 
Sector Public
Country Spain
Start 01/2016 
End 12/2020
 
Description Fellow of the Einstein Research Group: "Consciousness, Emotions, Values" 
Organisation Humboldt University of Berlin
Country Germany 
Sector Academic/University 
PI Contribution Fellow of the Einstein Research Group: "Consciousness, Emotions, Values". Research collaboration around the theme of sensory perception, body-perception and emotion.
Collaborator Contribution Participation in workshops and in conducting research
Impact Multidisciplinary collaboration involving Philosophy, Art and Experimental Psychology disciplines List of outputs - multi-disciplinary workshops: Einstein Inaugural Workshop "Consciousness, Emotions, Values" Jun 29 - Jul 01, 2015 Einstein Workshop, Feb 20-21, 2016 Einstein Workshop, Oct 24, 2015
Start Year 2015
 
Description "The promise of wearables/Case study: encouraging movement with chronic pain" (by Aneesha Singh/Ana Tajadura-Jimenez). Invited talk in event on Designing apps, UCL Institute of Health Informatics, University College London, March 18, 2015. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Around 50 scientists, industry professionals and general public attended this workshop, which sparkled questions and discussion afterwards on the topic of apps for health.
Year(s) Of Engagement Activity 2013,2015
 
Description "The promise of wearables/Case study: encouraging movement with chronic pain" (by Aneesha Singh/Ana Tajadura-Jimenez). Invited talk in event on Designing apps, UCL Institute of Health Informatics, University College London, March 18, 2015. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Around 50 scientists, industry professionals and general public attended this workshop, which sparkled questions and discussion afterwards on the topic of apps for health.
Year(s) Of Engagement Activity 2013,2015
 
Description Demonstration of bodily illusions that manipulate the sense of self and identity 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Many people from the public attended this event and got an understanding on the type of research we do and its applications

There was a great interest from both the public and the academic audiences.
Year(s) Of Engagement Activity 2013
URL http://www.barbican.org.uk/news/corporatenews/wonder-art-and-science-on-the-br
 
Description Demonstration of bodily illusions that manipulate the sense of self and identity 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? Yes
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Many people from the public attended this event and got an understanding on the type of research we do and its applications

There was a great interest and the Wellcome Collection has invited our group to repeat the event this year.
Year(s) Of Engagement Activity 2013
URL http://www.wellcome.ac.uk/News/2013/News/WTP053057.htm
 
Description Discussion Panel on "The Science and Culture of Sensing Sound". Step #1 of "The Lab Project" organized by Camden Arts Centre and supported by the Centre and Kingsgate Workshops Trust. July 25, 2015. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Following several discussion panels, included this one on "The Science and Culture of Sensing Sound", as part of "The Lab Project" (organized by Camden Arts Centre and supported by the Centre and Kingsgate Workshops Trust), the project culminated in a week-long exhibition in which artists created a final piece that visitors could enjoy on multiple sensory levels
Year(s) Of Engagement Activity 2015
URL http://thelabproject.tumblr.com/sensingsound
 
Description Invited talk at Brunel Design, Human Centred Design Institute (HCDI) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2013
URL http://hcdi.brunel.ac.uk/seminardetails.aspx?sid=31
 
Description Invited talk at Roehampton University 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2014
URL http://www.roehampton.ac.uk/psychology/events/
 
Description Invited talk at the Body Representation Laboratory, Birkbeck, University of London. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2014
 
Description Invited talk at the Body Representation Laboratory, Birkbeck, University of London. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2013
 
Description Invited talk at the Legos Days. IRCAM, Paris 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I was invited to give a research talk on The Hearing Body project:
"Sonification of surface interactions: Influences on body sense, surface perception, behavior and emotion". Legos Days. IRCAM, Paris

This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on ideas raised by The Hearing Body project, current and future work and possible applications of the methods and results.
Year(s) Of Engagement Activity 2014
URL http://legos.ircam.fr/?p=488
 
Description Invited talk at the Max Planck Institute for biological cybernetics. Tubingen, Germany 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2014
URL http://www.kyb.tuebingen.mpg.de/news-and-events/events/event-view/events/event///view-day%7Cpage_id-...
 
Description Invited talk at the Super-feelers workshop, London Royal College of Arts 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on auditory perception of objects and bodies as part of the "Super-feelers" workshop.
This presentation sparkled questions and very stimulating discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2014
URL http://london.eventful.com/events/superfeelers-seminar-rca-students-only-/E0-001-071587026-1
 
Description Invited talk at the Symposium on "Situated spatial cognition and social processing: body, emotions and interactions in space" 6th International Conference on Spatial Cognition 'Sapienza' University of Rome, September 7-11, 2015. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Around 60 scientists attended this symposium, which sparkled questions and discussion afterwards on the topics of spatial cognition and social processing.
Year(s) Of Engagement Activity 2015
URL http://www.icsc-rome.org/symposia/
 
Description Invited talk at the Symposium on Multimodal contributions to body representation. 16th International Multisensory Research Forum, Pisa, Italy, 13th-16th June 2015. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Around 80 scientists attended this symposium, which sparkled questions and discussion afterwards on the topic of body representation
Year(s) Of Engagement Activity 2015
URL http://www.pisavisionlab.org/imrf2015/AbstractBook.pdf
 
Description Invited talk in seminar series at Universitat Pompeu Fabra, Barcelona, May 7, 2015. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.
Year(s) Of Engagement Activity 2015
 
Description Invited talk in seminar series at the Acoustics Research Centre, University of Manchester, Salford, June 3, 2015. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.
Year(s) Of Engagement Activity 2015
 
Description Invited talk in seminar series at the Department of Computing, Goldsmiths, University of London, July 8, 2015. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact I gave a research seminar on The Hearing Body project. This presentation sparkled questions and discussion afterwards.
Year(s) Of Engagement Activity 2015
 
Description Oral & poster presentation as part of the UCLNTT Collaboration "Deep Brain Communication" Project 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact I presented a poster and a talk with results from the Hearing Body Project, which resulted from my collaboration with NTT-Japan. This presentation sparkled questions and discussion afterwards.


After my presentations, I engaged in discussion of future work and possible collaboration with academic audiences.
Year(s) Of Engagement Activity 2013
 
Description Participation at the Senses Research Day, Institute of Philosophy, London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I presented results from "The Hearing Body" project, both in a talk and in a poster, which sparkled questions and discussion afterwards.

After my talk, I discussed a possible study in collaboration with people at the Institute of philosophy, which we successfully implemented. This work is now under review.
Year(s) Of Engagement Activity 2014
 
Description Participation at the Senses Research Day, Institute of Philosophy, London 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Around 50 scientists attended this symposium, which sparkled questions and discussion afterwards on the topic of multisensory processing.
Year(s) Of Engagement Activity 2015
 
Description Participation in summer school 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I participated in a week summer school S on "Embodied Inter-subjectivity the 1st person and the 2nd person perspective", Aegina, Greece, June 9th-15th, 2013.

During the summer school I shared the results and hypotheses of the Hearing Body project, and engaged in deep conversation about the findings, and hypotheses for future work.


presented a poster with results from the Hearing Body Project. This presentation sparkled questions and discussion afterwards.
The poster title was:
Tajadura-Jiménez, A., Väljamäe, A., Toshima, I., Kimura, T., Tsakiris, M., Kitagawa, N. "Action sounds recalibrate perceived tactile distance".

After my presentation, I engaged in discussion of future work and possible collaboration with academic audiences.


I engaged in discussion of current and future work and possible collaboration with academic audiences.
Year(s) Of Engagement Activity 2013
URL http://www.pc.rhul.ac.uk/sites/lab/?page_id=610
 
Description Participation in the The conscious body workshop (Poster presented) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This workshop brought together dancers and neuroscientists to exchange ideas on body perception from very different experiences and perspectives.
I presented a poster with results from the Hearing Body Project. This presentation sparkled questions and discussion afterwards.



After my presentation, I engaged in discussion of future work and possible collaboration with dancers and academics.
Year(s) Of Engagement Activity 2012,2013
URL http://theconsciousbodymeeting.wordpress.com
 
Description Poster presentation at the London Virtual Social Interaction Workshop 2014 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I presented a poster with results from the Hearing Body Project. This presentation sparkled questions and discussion afterwards.



After my presentation, I engaged in discussion of future work, including possible applications of it and possible collaboration with academic audiences.
Year(s) Of Engagement Activity 2014
 
Description Public display of the "sonic shoes" developed as part of my Hearing Body project at the "Sounds that move us" event as part of the "Being Human Festival", London, UK (13th November 2015). 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact An special evening blending multisensory science and philosophy with talks by musicians and researchers, demonstrations of sonic illusions, digital mapping, and even 'sonic shoes'.
Year(s) Of Engagement Activity 2015
URL http://beinghumanfestival.org/event/sounds-that-move-us/
 
Description Public display of the "sonic shoes" developed as part of the Hearing Body project at the "You have been upgraded" festival on Human Enhancement, Science Museum, London, UK (25-29th March 2015). 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Near 4000 visitors from the public attended this event and got an understanding on the type of research we do and its applications
Year(s) Of Engagement Activity 2015
URL http://www.sciencemuseum.org.uk/visitmuseum/plan_your_visit/events/festivals/you-have-been-upgraded
 
Description Public experiment on group walking, with an idea developed as part of the Hearing Body project at the London Tate Exchange workshop on "Self Impressions", London, UK (24-25th March 2018). 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact Near 4000 visitors from the public attended this event and got an understanding on the type of research we do and its applications
Year(s) Of Engagement Activity 2018
URL http://www.tate.org.uk/whats-on/tate-modern/tate-exchange/workshop/self-impressions
 
Description Putting people at the centre of digital health. UCL Festival for Digital Health 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact About 100 people attended this event I co-organized and chaired at the UCL Festival for Digital Health, 30th June 2014. This event comprised short of presentations and interactive demonstrations of work at our group. The event sparkled discussion on understanding healthcare and human error, on sensing motion/emotion in healthy and chronic pain populations and on feedback to increase motivation, to promote behaviour change and to provoke changes in body perception.

Apart from the informative nature of this activity, through this event we broaden our research network, and started new collaborations.
Year(s) Of Engagement Activity 2014
URL http://www.fdh.ucl.ac.uk/event/human-factors-digital-health/
 
Description Research seminar presentation at UCL Interaction Centre 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact I gave a research seminar on The Hearing Body project at my institution. This presentation sparkled questions and discussion afterwards.

After my presentation, I engaged in discussion on The Hearing Body project, current and future work and possible applications of the results.
Year(s) Of Engagement Activity 2012
 
Description Website dedicated to the Hearing Body project 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact A website dedicated to The Hearing Body project was created to reach academics, industry, potential users and the wider public. Events related to the project and outputs of the project are summarized on this website.
Year(s) Of Engagement Activity 2012
URL https://www.ucl.ac.uk/uclic/research/project-pages/hearing-body
 
Description Workshop organisation at the Institute of philosophy 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Together with other two colleagues we organised a workshop at the Institute of philosophy on "Multisensory perspectives on peripersonal space". We invited 15 internationally known experts on the field as speakers, as well as other international attendants.

I gave an oral presentation:
Tajadura-Jiménez, A "The auditory body representation". Close to my body: Multisensory perspectives on peripersonal space (Workshop organized). Institute of philosophy, London, 14th-15th May, 2013.

THis workshop resulted in a very fruitful discussion, and it was a great opportunity to network for all attendants.
In my case, I established research links with the Institute of philosophy. I have been collaborating with its members ever since.
Year(s) Of Engagement Activity 2013
 
Description Workshop organization - "Mind the Gap: A SIG on Bridging the Gap in Research on Body Sensing, Body Perception and Multisensory Feedback" in CHI'16 Extended Abstracts: 2016 CHI Conference on Human Factors in Computing Systems. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The primary audience for this workshop is multidisciplinary and composed of HCI researchersfrom multiple areas including (but not limited to) sports, health, psychology, neuroscience, arts and games. The aim of this SIG is to create a multidisciplinary community to build synergies for further development and advances in multisensory feedback.
Year(s) Of Engagement Activity 2016
 
Description Workshop paper presentation at the TouchME workshop at CHI Conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact A person on my team presented results related to my research to an academic audience. The presentation sparkled questions and discussion afterwards.

The paper presented was:
Bianchi-Berthouze, N., Tajadura Jimenez, A. (2014). It's not just what we touch but also how we touch it. TouchME workshop, CHI Conference on Human Factors in Computing Systems, Toronto, 26th April-1st May 2014.

There was an interest on this work from the audience attending the meeting
Year(s) Of Engagement Activity 2014
URL http://chi2014.acm.org/
 
Description • Public display of demos on the theme "Our Bodies and Technology" for the Royal Institution & UCL Masterclass HCI for 9th grade school students. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Schools
Results and Impact Around 50 school students attended this event and got an understanding on the type of research we do and its applications
Year(s) Of Engagement Activity 2015
 
Description • Public display of the "sonic shoes" developed as part of my Hearing Body project at the "Wearable 'superpowers'" event at the Science Museum, London, UK (29th April 2015). 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Many people from the public attended this event and got an understanding on the type of research we do and its applications
Year(s) Of Engagement Activity 2015
URL https://www.ucl.ac.uk/archaeology/calendar/articles/2014-15-events/20150429b