3D human tracking and scene reconstruction for audio-visual AR/VR
Lead Research Organisation:
University of Southampton
Department Name: Sch of Electronics and Computer Sci
Abstract
In this research, the student will investigate identification and tracking of people throughout complex multi-person scenes using audio-visual input from a camera for AR/VR applications. Real-time 3D scene rendering and spatial audio reproduction algorithms require listener location and head pose (sweet spot) related to the display/loudspeakers and room geometry. Real-time scene tracking and adaptive 3D scene rendering will be the goal of this project. Two types of display scenarios will be considered. First one is a personalised Head-Mounted Display (HMD) system such as a VR headset with headphones. The second type is to use a communal display (e.g., TV or car windscreen) with loudspeakers.
Organisations
Studentship Projects
Project Reference | Relationship | Related To | Start | End | Student Name |
---|---|---|---|---|---|
EP/R513325/1 | 30/09/2018 | 29/09/2023 | |||
2480933 | Studentship | EP/R513325/1 | 30/09/2020 | 31/03/2024 | Peter Hardy |
EP/T517859/1 | 30/09/2020 | 29/09/2025 | |||
2480933 | Studentship | EP/T517859/1 | 30/09/2020 | 31/03/2024 | Peter Hardy |