SHIFT - Shared Hub for Immersive Future Technologies
Lead Research Organisation:
University of Greenwich
Department Name: Creative Prof. & Digital Arts, FACH
Abstract
SHIFT - Shared Hub for Immersive Future Technologies - will deliver new facilities that brings together artist-researchers across the disciplines of film, sound and performance to explore the potential in the latest immersive tools and technologies.
SHIFT is made up of three complementary practice research laboratories:
01 - [Performance Capture] - Virtual Production Film Studio - Performance and capture in front of real-time simulated backdrops. State-ot-the-art technology for bridging the real and virtual, via high-density LED screens and real-time motion tracking technologies.
02 - [Editing and Production] - 32 Channel Ambisonic Sound Studio and VR lab - High-density hemisphere of loudspeakers for the creation and editing of immersive soundscapes.
03 - [Immersive Presentation] - Digital Immersive Theatre Upgrade - State-of-the-art performance space, bringing together 360 degree immersive projection, projection mapping, surround-sound audio, with extended lighting, rigging and digital infrastructure to create a flexible multi-functional performance space for immersion.
Working collaboratively, practice based researchers from across film, music, sound, drama and performance will use SHIFT to explore the potential and the limitations of the latest immersive tools and technologies.
Through our outputs we will:
[A] Develop new experiences, forms of expression, and ways of bringing people together with new technologies to better understand and connect with one another and the environment.
[B] Create innovative training resources for research and work in these emerging and growing areas of film, tv and theatre, thereby increasing skills in the workforce and providing cutting-edge, evidence-based guidance for professional practice.
[C] Provide robust critical reflection upon new immersive and virtual technologies via a practice research arts and humanities frame.
[D] Explore the liminal spaces of liveness/pre-recorded media, real/virtual spaces and the potential of new immersive technologies, applying practice research methods from the complementary perspectives of film, music, sound and performance to find new possibilities where they intersect.
[E] Work collaboratively to reduce inequalities in people's lives, and demonstrate the significance of the creative arts, culture, and social sciences in understanding the complexity of the human condition as it relates to wellbeing, social justice, environment, sustainability and place-making
SHIFT is made up of three complementary practice research laboratories:
01 - [Performance Capture] - Virtual Production Film Studio - Performance and capture in front of real-time simulated backdrops. State-ot-the-art technology for bridging the real and virtual, via high-density LED screens and real-time motion tracking technologies.
02 - [Editing and Production] - 32 Channel Ambisonic Sound Studio and VR lab - High-density hemisphere of loudspeakers for the creation and editing of immersive soundscapes.
03 - [Immersive Presentation] - Digital Immersive Theatre Upgrade - State-of-the-art performance space, bringing together 360 degree immersive projection, projection mapping, surround-sound audio, with extended lighting, rigging and digital infrastructure to create a flexible multi-functional performance space for immersion.
Working collaboratively, practice based researchers from across film, music, sound, drama and performance will use SHIFT to explore the potential and the limitations of the latest immersive tools and technologies.
Through our outputs we will:
[A] Develop new experiences, forms of expression, and ways of bringing people together with new technologies to better understand and connect with one another and the environment.
[B] Create innovative training resources for research and work in these emerging and growing areas of film, tv and theatre, thereby increasing skills in the workforce and providing cutting-edge, evidence-based guidance for professional practice.
[C] Provide robust critical reflection upon new immersive and virtual technologies via a practice research arts and humanities frame.
[D] Explore the liminal spaces of liveness/pre-recorded media, real/virtual spaces and the potential of new immersive technologies, applying practice research methods from the complementary perspectives of film, music, sound and performance to find new possibilities where they intersect.
[E] Work collaboratively to reduce inequalities in people's lives, and demonstrate the significance of the creative arts, culture, and social sciences in understanding the complexity of the human condition as it relates to wellbeing, social justice, environment, sustainability and place-making
Organisations
Publications
Andrew Knight-Hill
(2024)
Art of Sound: Creativity in Film Sound and Electroacoustic Music
| Description | Internal Capital Investment Match Funding |
| Amount | £350,000 (GBP) |
| Organisation | University of Greenwich |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 01/2023 |
| End | 07/2023 |
| Title | Digital Immersive Theatre |
| Description | Digital Immersive Theatre Upgrade Investigating new modes of performance with digital technology, this flexible multi-functional performance space for immersion will bring together 360º immersive projection, projection mapping, surround-sound audio, with extended lighting, rigging and digital infrastructure. 36.2 sound system with 5 multiplexed projectors for immersive projection. |
| Type Of Material | Improvements to research infrastructure |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | Public concert events and new partnerships planned and workshops scheduled. |
| Title | Immersive Sound Lab |
| Description | 32 Channel Ambisonic Sound Studio and VR lab Expanding existing research strengths, providing high resolution custom designed immersive sound lab with VR, for work in 360º film, theatre, games, data sonification, VR simulation, music and sound arts. |
| Type Of Material | Improvements to research infrastructure |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | R&D work in spatial sound. Outreach and engagement with industry partners and Association of Motion Picture Sound |
| Title | Virtual Production Film Studio |
| Description | Delivered new Virtual Production Film Studio in collaboration with MoSys Engineering. [Performance Capture] - Virtual Production Film Studio Capturing performances against real-time simulated backdrops, exploring the intersection of real/virtual worlds and unlocking the potential of new approaches to performance capture. |
| Type Of Material | Improvements to research infrastructure |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | New partnerships, new innovative research in data visualisation and virtual production tools in presentation and conferencing. |
| Description | AMPS Award Ceremony 2024 |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The Association of Motion Picture Sound (AMPS), the UK-based craft guild made up of over 540 of the most imaginative and highly experienced creative talents working in the field of sound for film, television, and games, has today announced the winners of its 11TH Annual AMPS Awards for Television Drama, Factual Film and Audio Products. AMPS Chair Andrew Wilson: "Congratulations to our 2024 Awards winners. Each year it is incredibly competitive, and this year is no exception with our nominees and winners demonstrating a vast breath of intricate sound design work. We are delighted to be able to celebrate their work with our AMPS members at our annual Awards event at the University of Greenwich, while supporting AMPS chosen charity, Hearing Dogs for Deaf People through our annual raffle." |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.amps.net/awards/2023 |
| Description | External Partners Tours - [Full Facility] |
| Form Of Engagement Activity | Participation in an open day or visit at my research institution |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Third sector organisations |
| Results and Impact | Visits from local organisations and businesses to introduce the SHIFT facilities, including: - Nucleus Arts (charity and community arts organisation) - Royal Museums Greenwich (ROI GLAM) - Happy Ghost (AI Tech Startup) - Punchdrunk (Commercial Arts and Immersive Theatre) - Passion Pictures (Animation VFX) - Edge Pictures (Animation VFX) - Mark Brown studios (Animation VFX) - Royal Borough of Greenwich (local council) - AHRC Infrastructure Team |
| Year(s) Of Engagement Activity | 2024 |
| Description | Induction & Spatial Audio Workshop - Anders Tveit - [Immersive Digital Theatre] |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Postgraduate students |
| Results and Impact | Immersive Digital Theatre Induction and Initial training. Demonstration of various orthodox and non-orthodox ambisonics techniques that will be useful for sound design and composition in Max using Spat5 library and Reaper DAW using VST plugins from both Sparta and IEM. |
| Year(s) Of Engagement Activity | 2024 |
| Description | Listening Lab - Event Series - [Spatial Audio Lab] |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Postgraduate students |
| Results and Impact | Listening Lab is a series of fortnightly listening sessions curated by postgraduate students, staff and visiting guests in the Spatial Audio Lab. Staff and student/s across both MA and PhD Music and Sound programmes of study are invited to curate a playlist of experimental music, sound art etc. for presentation / diffusion in the spatial audio lab. Each session will consist of approximately 40-45 minutes of music, followed by discussion. This can be an opportunity for you to present your own works to peers and/or perform works by other artists. Please bring mono, stereo, multichannel or high order ambisonic compositions to present on the system. Additional ad hoc sessions are run for industry professionals and guests on CPD programmes. |
| Year(s) Of Engagement Activity | 2023,2024 |
| Description | Loudspeaker Orchestra Concert Series - [Immersive Digital Theatre] |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Public/other audiences |
| Results and Impact | Immersive acoustic experiences through programmed concerts of multichannel sound design and electroacoustic music We frequently host concerts, screenings and talks showcasing the work of students, staff and international experts in the field. These concerts are open to the public and give our students the opportunity to be heard alongside world leading artists. The Loudspeaker Orchestra shares immersive listening experiences in diverse venues, via curated concerts of sound arts and contemporary music. Our Immersive Digital Theatre is a new home venue for our concerts. |
| Year(s) Of Engagement Activity | 2023,2024 |
| URL | https://www.gre.ac.uk/research/activity/las/loudspeaker-orchestra |
| Description | SHIFT Research Workshop - [VP Studio] |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Professional Practitioners |
| Results and Impact | Calling all researchers across the Faculty! You are warmly welcomed to our inaugural SHIFT Research Workshop, the first of many sessions to introduce, demystify and imagine applications for our new AHRC funded, "Shared Hub for Immersive Future Technologies". The workshop will include: • an introduction to the wider SHIFT project, • explanation of this VP Film Studio (1/3 of the SHIFT facility) • demonstrations of current active research, • and discussions of future possibilities. This session will take place in our Stockwell Street - SHIFT Virtual Production Film Studio - 11_B013 which hosts our flagship 6m by 3m LED wall surface (currently one of the highest resolution LED walls in the UK) and 180º Green Screen cove. WHAT IS VIRTUAL PRODUCTION? "On-set virtual production, also known as virtual production, or In-Camera Visual Effects, and often called The Volume, is an entertainment technology for television and film production in which LED panels are used as a backdrop for a set, on which video or computer-generated imagery can be displayed in real-time" While designed primarily to enable Virtual Production filmmaking, the LED volume can also be used for data visualisation for high resolution images, at scale making visible features that are simply not visible on a normal screen (for example the work of CAPTIVATE). Schedule: 2:00pm - Welcome and introduction to the wider SHIFT project. 2:10pm - Introduction to the SHIFT VP Film Studio. 2:20pm - Example Projects • George Spencer - "VP Splat Tests", • CAPTIVATE - "LIDAR Scan visualisation", • Yu Lun Sung - "Decolonising Virtual Production? - Optimising Skin-tone Representations and aesthetics in an LED Volume with Personal Colour Analysis" 3:30pm - Discussion 3:50pm - Closing thoughts and summary of next steps. |
| Year(s) Of Engagement Activity | 2023 |
| Description | SOUND/IMAGE Festival 2024 |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | 9-12 November 2023 at the University of Greenwich, London, UK From over 340 submissions, we curated a rich programme of complementary talks, screenings, loudspeaker orchestra concerts, and performances - bringing together composers, filmmakers, electronic musicians, live visual performers, researchers from all over the world which stimulated discussion, debate and engage diverse perspectives and new insights on sound and audiovisual practice. A special guest included John Young (a participant of the "Art of Sound: Creativity in Film Sound and Electroacoustic Music" Book), and also included the book launch for the project, in which other participants attended too. Events: 7 concerts, 2 screenings, 4 talks, installations and exhibition. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://blogs.gre.ac.uk/sound-image/2023/10/11/sound-image23/ |
| Description | TEDx Greenwich - R&D |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | The VP studio was used as a prototyping and R&D space to develop materials for presentation at TEDx Greenwich. |
| Year(s) Of Engagement Activity | 2024 |
| Description | Taco Arts Workshop - Hundred Club |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Schools |
| Results and Impact | Film and immersive audio workshop with children charity TACO arts and their 100 Club for young people. Exploring place and identify through film and sound recording workshops |
| Year(s) Of Engagement Activity | 2024 |
| Description | Virtual Production Staff Training - [Virtual Production] |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Professional Practitioners |
| Results and Impact | Training and induction on the Virtual Production film technologies used in the SHIFT laboratory. Training over 20+ days for colleagues, developing technical skills for academics and research technical professionals. |
| Year(s) Of Engagement Activity | 2023,2024 |