Immersive Pipeline 2: Out of the lab and into the wild

Lead Research Organisation: Goldsmiths University of London
Department Name: Computing Department

Abstract

The project, Immersive Pipeline 2: Out of the Lab and into the Wild, will build upon previous cutting edge research at Goldsmiths College on surround audiovisual performance environments and bring them to venues outside the university for public performances embedded in the local communities of East London and South East London. The original project took as a premise that, while virtual reality is compelling, the headsets typically used VR are socially isolating. The initial Immersive Pipeline project sought to make fully immersive sound and image in real space, as a shared, social experience. We did so using the advanced facilities of the Sonics Immersive Media Labs (SIML) at Goldsmiths. In Immersive Pipeline 2, we will take SIML off campus and bring it to community venues such as the Albany Theatre in Deptford and the Old Baths in Hackney Wick. We will bring the SIML projection technologies to these venues and work with local organisers to adapt the architecture of their spaces to set up a SIML off-site. We will curate a series of performance events that will present immersive audiovisual works to the broad general public. Having an extended residency with partner Stour Space at the Old Baths will allow time for a commissioned artist to create a new work in a community arts setting. We will also set up a scale model of the SIML, the "SIMLulator", allowing children and young people to play with a mock up. We will conduct workshops on the SIMLulator, enabling school groups and young people from the communities of East London to try their hand at producing surround a/v pieces using music and visuals from their own aesthetic cultures. We will work with a leading creatve studio, Satore Studios, to share our immersive technologies for use in fashion runway shows and large scale stadium shows. We will also partner with the new music charity, Sound & Music in their New Voices programme. This linking of IP2 and New Voices will enable the group, People Like Us, to use SIML at Goldsmiths to prepare a major US premier of a feature length immersive cinematic piece they will bring in late 2019 to the Recombinant Festival in San Francisco. In this way, the Immersive Pipeline 2 project will take research on immersive media out of the lab and into the wild, sharing our knowledge with artists and creative studios, and bring these experiences to new audiences.

Planned Impact

The Immersive Pipeline 2 project will enhance the impact of the initial project and add significant value. It will stimulate new routes to impact through local communities, and in doing so point out innovative new opportunities for societal impact not foreseen in the original project. The new forms of impact in this follow-on project will underscore the robustness and sustainability of the previous project.

Impact is fundamental to the nature of the follow-on project. By taking the research from the prior project out of the lab and into real world settings, a key objective of the new project is to create impact. This will take place in the external facing orientation of the project. The confirmed April 2019 performance at The Albany Theatre in Deptford, southeast London, will bring a Goldsmiths curated programme of immersive audiovisual performance, including works by PI Tanaka, RA Regina, and PhD student Peng, to the general public in Lewisham. The SIML residency at the Old Baths in Hackney Wick will permit an extended run where the SIML is not just set up for a single performance, but for an extended period of 3 weeks. This will allow the general public to witness the creative processes behind an audiovisual performance. By having the SIML set up for this period, our project artists will create new work in-situ in open atelier sessions where the public will witness the process of work-in-progress. Finally, by setting up the SIMLulator scale model in one of the smaller studios behind the main baths, RA Regina will be able to conduct workshops on immersive a/v production techniques open to young people from Hackney.

With these activities in Lewisham and Hackney councils, we will not only access new audiences, but create community impact by bringing advanced university research to a local setting. This adds value to the impact envisioned in the original project. It at once fulfils the potential indicated in the first project, at the same time uncovers new routes to impact not imagined in the first bid. This extension of impact from the first project can be seen by revisiting the impact statement from the original bid and seeing how they have been fulfilled or transposed. In the original project, we imagined working with museums like the V&A, while in the new project we have a confirmed date with an established community theatre. In the first project, we pointed out the potential impact in the film industry. Here in the new project, we have forged a partnership with Satore Studios who work in fashion and entertainment. In the initial project, we imagined presentations in venues like the Truman Brewery, and working with the maker community, including the student-run Hacksmiths. This is transposed to our planned presentation at the Old Baths, and working with community organisations commissioned by local authorities to create new creative quarters. These mappings can be summarised as an increased focus on performance and community with respect to what we imagined in the first bid.

Our impact plan also points out the contributions this project will make to the UK creative economy. Satore Studios will gain knowledge in assimilating our immersive technologies into their future commercial projects. Our partnership with Stour Space has led to discussions with the Splice Festival where we may have the chance to bring the SIML and our curated performance programme to a nationally recognised event in the vibrant DJ/VJ arts scene. The partnership with Sound & Music establishes a new relationship between higher education and an arts charity. Through it, the artist Vicki Bennett and her group, People Like Us, will prepare their US premier at Goldsmiths and present a VIP avant-premier to an invited London audience before a world premiere in San Francisco. This strengthens the position of creative cinematic work conceived and produced in the UK and facilitates its international distribution.

Publications

10 25 50
 
Title Cave Music, with Uta Kogelsberger 
Description Cave Music was the 3rd incarnation of this 8 channel sound installation of free standing, simulated "rock-speakers" spreading mixes of Kögelsberger's recordings captured in the mouth of a disused mine, creating a trancelike, rhythmic and ritualistic soundscape hovering between abstraction and dance track. Cave Music - a playful evocation of man's often futile attempt to control nature - took its cue from the increase of rainfall in the Lake District due to climate change. It followed on from this video installation Playing the Cave and Orchestra of Rocks not a Rock Concert. During an evening of live performances, experimental sound artists Atau Tanaka, Shelley Parker, Dane Law, and Chooc Ly created their interpretations of the original sounds. In the Battle of the Rocks, devised by Kögelsberger, the beat boxing champion Marv Radio challenged the Rocks to a battle between voice and environmental sound. 
Type Of Art Artistic/Creative Exhibition 
Year Produced 2019 
Impact Working with community arts organisation, Ugly Duck. http://uglyduck.org.uk/portfolio_page/rockconcert/ 
URL https://utakogelsberger.net/rock-concert-cave-music/
 
Title Gone Gone Beyond, by People Like Us 
Description Gone, Gone Beyond is an immersive a/v spatial cinema work by People Like Us, which breaks the rectangle, smashing the thin screen into tiny fragments, looking beyond the frame, climbing through to see what's behind. Commissioned by Naut Humon, the founder of immersive theatre project CineChamber, Gone, Gone Beyond is a 10 screen/8 speaker work by Vicki Bennett with seamless wrap around projection and surround sound, where the audience sit inside. It uses edited collage sewn together in a giant patchwork. Pull on a thread and watch whole new narratives expand and unravel all at once on a 360 palette. The project has been a work in progress since 2017, and is currently 50 minutes long. History: the initial in-process tester movie screened in San Francisco in October 2017 at RML's own Recombinant Festival at Gray Area Foundation for the Arts. Since then we have been continuing to work on content, and staged a private event in April 2019 at Goldsmiths SIML to encourage some partner support in the UK/Europe. 
Type Of Art Film/Video/Animation 
Year Produced 2019 
Impact Working with the cultural sector: Sound & Music in the UK, and the Recombinant Media Labs in San Francisco USA 
URL http://peoplelikeus.org/2019/gone-gone-beyond/
 
Title Skin Awareness II by Youhong "Friendred" Peng 
Description Dancer's body communicates with the immersive space extending the dancer's sensory. Skin-awareness explore the relationship between the body and space, and experiment with the capacity of the body while interfering with the digital technologies that change the surrounding space. The body is not only an entity, but also an action, an experience and an embodied perception. The immersive space morphs and alters with light and becomes solid, its pressure composing and decomposing the self-awareness of skin. The dancer's body is extended and manipulated as a conscious entity, exceeding the physiological object. In Skin-awareness, the embodied, symbiotic relationship of light, sound, and space is reciprocal. This work crosses the intersection of technological interventions, architectural fabrication, and contemporary dance performance. Forty laser beams controlled by mechanical robots read and encode choreography. Synergies of futuristic lighting and surrounding screens create a brief detachment from reality. Computer vision is utilized with computational precision along with the control of body movement. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2019 
Impact Working with community arts organisation, Ugly Duck http://uglyduck.org.uk/portfolio_page/skin/ 
URL http://friendred.studio/2019/04/28/skin-awareness-london-ugly-duck/
 
Description The project will lead to a public performance at the Albany Theatre in Deptford London in collaboration with Call & Response https://www.callandresponse.org.uk/ The COVID pandemic has meant that the final outcome was presented publicly online as part of the Array 360 festival and released as an immersive interactive video on YouTube https://www.youtube.com/watch?v=0WE-omAUxpw
First Year Of Impact 2020
Sector Creative Economy,Culture, Heritage, Museums and Collections
Impact Types Cultural

 
Title Immersive Pipeline whitepaper 
Description This report examines immersive experiences in the context of social shared spaces. It presents the Immersive Pipeline research project led by Prof. Atau Tanaka and funded by the AHRC/EPSRC Research and Partnership Development call for the Next Generation of Immersive Experiences from January to June 2018. It covers a historical and technological overview of state of the art on this field, cases of study and interviews in depth with some of the participants. 
Type Of Material Improvements to research infrastructure 
Year Produced 2019 
Provided To Others? Yes  
Impact making available to other audiovisual and immersive practitioners 
URL http://research.gold.ac.uk/id/eprint/28259