PLACES: Plasticity of perception in real and virtual spaces
Lead Research Organisation:
Royal Holloway University of London
Department Name: Psychology
Abstract
Space is fundamental to physical and perceptual reality, but physical and perceptual space are not the same. Perceptual space is
created by the brain and plastically formed by the sensorimotor interactions of our body with physical reality. In the digital future,
these two spaces are joined by novel spaces experienced in virtual (VR) and extended (XR) reality as these new technologies massively
expand in work, pleasure and social interaction. The first aim of PLACES is to understand how sensorimotor interactions in virtual
environments shape perceptual space and how this interacts with virtual (VS) and real (RS) space. Secondly, deep and improved
knowledge of perceptual mechanisms is essential for the future development of VR as a key digital technology for Europe. To work for
the people, VR and XR need to be effective, comfortable, transparent and fair. These aims can only be reached by understanding and
accounting for perception in a human-centric manner. Based on these premises, the highly interdisciplinary consortium of PLACES
pursues five key objectives: to (1) use cutting-edge VR technology to advance scientific knowledge of the mechanisms of
sensorimotor perception and plasticity; (2) use our understanding about spatial perception, gaze control and sensorimotor plasticity
to advance VR technology and enhance VR applicability; (3) predict action intentions of users in VR and employ these predictions in
advanced user interfaces; (4) understand how long-term usage of VR interacts with perceptual and sensorimotor states in real space
and in virtual space; and (5) translate research findings into applied fields in vision aids and social telepresence. Reaching these
objectives will put the EU on the map as a leader in perception research and its application in VR. PLACES aims for new frontiers in
perception science and its applications and for a significant impact on the people of the EU.
created by the brain and plastically formed by the sensorimotor interactions of our body with physical reality. In the digital future,
these two spaces are joined by novel spaces experienced in virtual (VR) and extended (XR) reality as these new technologies massively
expand in work, pleasure and social interaction. The first aim of PLACES is to understand how sensorimotor interactions in virtual
environments shape perceptual space and how this interacts with virtual (VS) and real (RS) space. Secondly, deep and improved
knowledge of perceptual mechanisms is essential for the future development of VR as a key digital technology for Europe. To work for
the people, VR and XR need to be effective, comfortable, transparent and fair. These aims can only be reached by understanding and
accounting for perception in a human-centric manner. Based on these premises, the highly interdisciplinary consortium of PLACES
pursues five key objectives: to (1) use cutting-edge VR technology to advance scientific knowledge of the mechanisms of
sensorimotor perception and plasticity; (2) use our understanding about spatial perception, gaze control and sensorimotor plasticity
to advance VR technology and enhance VR applicability; (3) predict action intentions of users in VR and employ these predictions in
advanced user interfaces; (4) understand how long-term usage of VR interacts with perceptual and sensorimotor states in real space
and in virtual space; and (5) translate research findings into applied fields in vision aids and social telepresence. Reaching these
objectives will put the EU on the map as a leader in perception research and its application in VR. PLACES aims for new frontiers in
perception science and its applications and for a significant impact on the people of the EU.
Organisations
- Royal Holloway University of London (Lead Research Organisation)
- Eberhard Karls University of Tübingen (Collaboration)
- University of Münster (Collaboration)
- University of Bologna (Collaboration, Project Partner)
- ZEISS (Collaboration)
- Western Sydney University (Collaboration, Project Partner)
- Simon Fraser University (Project Partner)
- Philipps University of Marburg (Project Partner)
- World Wide Fund For Nature Deutschland (Project Partner)
- University of Rochester (Project Partner)
- University of Canterbury NZ (Project Partner)
- Zeiss (Carl Zeiss AG) (Project Partner)
- University of Hamburg (Project Partner)
- Monash University (Project Partner)
People |
ORCID iD |
| Szonya Durant (Principal Investigator) |
Publications
Stein N
(2024)
Eye and head movements in visual search in the extended field of view
in Scientific Reports
| Title | Eye and Head Movements in Visual Search in the Extended Field of View |
| Description | This repo includes the raw data files from 2 VR visual search experiments from the manuscript: "Eye and Head Movements in Visual Search in the Extended Field of View" |
| Type Of Material | Database/Collection of data |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | No impact yet. |
| URL | https://osf.io/ewsj5/ |
| Description | Reaching and grasping effects on visual perception in VR |
| Organisation | University of Bologna |
| Country | Italy |
| Sector | Academic/University |
| PI Contribution | Began researching, proposing and developing an experiment. |
| Collaborator Contribution | Input on background and experimental design. |
| Impact | Design for an experiment and some initial coding. Placement from University of Bologna to Royal Holloway and from Royal Holloway to University of Bologna (see placements). Training in Unity. |
| Start Year | 2024 |
| Description | Simulating lens distortions in VR |
| Organisation | Eberhard Karls University of Tübingen |
| Country | Germany |
| Sector | Academic/University |
| PI Contribution | We are hosting two placements on this project, providing expertise and equipment for the set up and design of experiments. |
| Collaborator Contribution | Two research assistants are working on this, bringing expertise and programming skills. The PI at Zeiss on the PLACES project helped in the development of the project. |
| Impact | This is ongoing, the placements are the current result. It is multi disciplinary between Computer Science and Psychology. |
| Start Year | 2024 |
| Description | Simulating lens distortions in VR |
| Organisation | ZEISS |
| Country | Germany |
| Sector | Private |
| PI Contribution | We are hosting two placements on this project, providing expertise and equipment for the set up and design of experiments. |
| Collaborator Contribution | Two research assistants are working on this, bringing expertise and programming skills. The PI at Zeiss on the PLACES project helped in the development of the project. |
| Impact | This is ongoing, the placements are the current result. It is multi disciplinary between Computer Science and Psychology. |
| Start Year | 2024 |
| Description | Visual search during head movements |
| Organisation | University of Münster |
| Country | Germany |
| Sector | Academic/University |
| PI Contribution | I conceptualized and ran and analysed the first experiment in this collaboration and hosted a students (see Placements section) to develop the second study we are running. |
| Collaborator Contribution | Western Sydney university helped with conceptualization and writing and presented work at the European Conference on Visual Perception 2023. Munster University contributed in terms of PhD student work developing and running experiments , analysing data and writing up the paper as well as presenting at the Visual Sciences Society 2023 conference, as well joint project management and write up. |
| Impact | There was a published paper listed under publications. There have been two placements (Markus Lappe and Niklas Stein) see under placements. An experiment is currently being run at Royal Holloway, University of London. |
| Start Year | 2023 |
| Description | Visual search during head movements |
| Organisation | Western Sydney University |
| Country | Australia |
| Sector | Academic/University |
| PI Contribution | I conceptualized and ran and analysed the first experiment in this collaboration and hosted a students (see Placements section) to develop the second study we are running. |
| Collaborator Contribution | Western Sydney university helped with conceptualization and writing and presented work at the European Conference on Visual Perception 2023. Munster University contributed in terms of PhD student work developing and running experiments , analysing data and writing up the paper as well as presenting at the Visual Sciences Society 2023 conference, as well joint project management and write up. |
| Impact | There was a published paper listed under publications. There have been two placements (Markus Lappe and Niklas Stein) see under placements. An experiment is currently being run at Royal Holloway, University of London. |
| Start Year | 2023 |
| Description | Open day to university applicants |
| Form Of Engagement Activity | Participation in an open day or visit at my research institution |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Other audiences |
| Results and Impact | This is a regular event , each time 100+ applicants and their parents visits and I demonstrate examples of VR we us as part of the project. Applicants have reported that they are more likely to apply for Psychology and parents have reported an increased interest in the subject. |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://www.royalholloway.ac.uk/student-life/visit-royal-holloway/open-days/ |
| Description | Royal Holloway Science Festival exhibition |
| Form Of Engagement Activity | Participation in an open day or visit at my research institution |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Public/other audiences |
| Results and Impact | We set up a VR headset with eye tracking and a projector so visitors could try out the types of experiments we run on the project. The Science Festival is highly attended every year and is an important part of raising awareness of science research as well as community engagement by the university with local residents. We ran at least 100 people through the the headset, some wearing it and some observing. The audience found it interesting and reported a better understanding of what might be researched using VR. |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://www.royalholloway.ac.uk/science-festival/ |