Building an international network for virtual dance collaboration: Deploying Goldsmiths MoCap Streamer tool for inclusive and sustainable development
Lead Research Organisation:
Goldsmiths College
Department Name: Media and Communications
Abstract
'Goldsmiths Mocap Streamer' is a software tool that was initially developed to address the issues surrounding the isolation and physical distancing of the Covid19 restrictions, by first connecting dancers remotely through a framework for motion-capture data streaming, and then seeing what kinds of emotional, aesthetic, and affective connections could be made within virtual spaces. These concerns were framed and led by our collaborating artists, honed and developed through a series of practice-led research workshops with artists both local to Goldsmiths in London, and as far away as Singapore (LASALLE) and Hong Kong (HKAPA). However, we knew that beyond the immediate concerns of the pandemic, this tool had much broader applicability, possibly offering itself as a critical turning point in a 50-year history of the aesthetic and technological evolution of telematic performance practice. Having now reached a point where we have evidenced the functionality of our Mocap Streamer framework in both technical and aesthetic-poetic terms, we now wish to roll it out to a truly international and diverse network of dance companies as a next logical step in our research process. We aim to empower performers who might not have previously considered doing digital dance work to freely experiment in the forms of aesthetic expression and meaningful communication that we have already shown are possible.
We propose that this research would have three overarching priorities:
1. A connector programme using a bursary/residency structure, to bring together small dance companies and creative technologists from diverse international backgrounds for six full months of collaborative work. We will provide them with a mocap starter toolkit and a creation/development budget, and will facilitate them to develop their own, and collaborative, digital work. We adopt a user-centred and research through design methodology - creating practice-led feedback loops to develop our framework for remote dance collaboration.
2. To continue to develop and hone our existing motion capture data streaming tool in terms of efficiency, accessibility, and user experience (UX), incorporating the creation and development of a new AI tool for motion capture system interoperability - essentially a Machine Learning algorithm that can recognise and share choreographic movement from many different motion capture systems in a truly system-agnostic mode.
3. To document and evidence our findings through a knowledge-sharing and performance showcase event, a dedicated website, and to develop a resource of open-source licensed toolkits and software.
Overall, our creative practice-led research methodology and programme of training, mentoring, and support will lead to a deeper understanding of the kinds of dance work that can be productively and economically achieved within this international network. We aim to open doors for several dance companies, to facilitate them to create new aesthetic approaches to dance work, and so that they can develop new audiences and new revenue streams, at the same time offering a credible and exciting use-case for international mocap streaming-based collaboration. It will form the basis for new ways of thinking about and working with motion-capture in dance, towards sustainable future development.
We propose that this research would have three overarching priorities:
1. A connector programme using a bursary/residency structure, to bring together small dance companies and creative technologists from diverse international backgrounds for six full months of collaborative work. We will provide them with a mocap starter toolkit and a creation/development budget, and will facilitate them to develop their own, and collaborative, digital work. We adopt a user-centred and research through design methodology - creating practice-led feedback loops to develop our framework for remote dance collaboration.
2. To continue to develop and hone our existing motion capture data streaming tool in terms of efficiency, accessibility, and user experience (UX), incorporating the creation and development of a new AI tool for motion capture system interoperability - essentially a Machine Learning algorithm that can recognise and share choreographic movement from many different motion capture systems in a truly system-agnostic mode.
3. To document and evidence our findings through a knowledge-sharing and performance showcase event, a dedicated website, and to develop a resource of open-source licensed toolkits and software.
Overall, our creative practice-led research methodology and programme of training, mentoring, and support will lead to a deeper understanding of the kinds of dance work that can be productively and economically achieved within this international network. We aim to open doors for several dance companies, to facilitate them to create new aesthetic approaches to dance work, and so that they can develop new audiences and new revenue streams, at the same time offering a credible and exciting use-case for international mocap streaming-based collaboration. It will form the basis for new ways of thinking about and working with motion-capture in dance, towards sustainable future development.
Organisations
- Goldsmiths College (Lead Research Organisation)
- University College London (Collaboration)
- Alex Whitley Dance Company (Collaboration)
- Federal University of Rio Grande (FURG) (Collaboration)
- Akram Khan Company (Project Partner)
- Alexander Whitley Dance Company Ltd (Project Partner)
- Target3D Ltd (Project Partner)
- Noitom Technology Ltd (Project Partner)
Publications
Strutt D
(2021)
Virtual relationships: the dancer and the avatar
in Theatre and Performance Design
Strutt D
(2021)
New Telematic Technologies for Remote Creation, Rehearsal and Performance of Choreographic Work
in Journal of Embodied Research
Strutt, D
(2021)
A Simple Tool for Remote Real-Time Dance Interaction in Virtual Spaces Or "Dancing in the Metaverse
in Scènes Critiques
Zylinska Joanna
(2022)
The Future of Media
| Title | Global Dance Collaboration in the Metaverse - Being Human Festival 2022 |
| Description | 7 individual works created through mentorship, supervision and through the provision of tech by the research project. The project showcase event was a combination of live, immersive screen-based performance, in-person interactive performance, and interactive installation. It was presented in a hybrid in-person and live-streamed mode with remote dancers performing together within a virtual and interactive environment works included Sufee Yama & Pichet Klunchun Dance Company (Thailand) - 'Ghra?a - Vijñana' A Thai contemporary remote performance that allows the audience to access the performers' internal space to witness memories and experiences that are triggered by scents, causing chaos to their mind and body. This metaverse dance experience will reveal their fight and struggle, and how the battle with themselves ends. Ghra?a - Vijñana is Olfactory consciousness in buddhism. Sumedha Bhattacharyya (India) & Joaquina Salgado (Argentina) - 'Water Nodes' We are water and memory is what the body carries, Like information, like energy. Water is memory. Responding to the insurmountable and collective grief, loss and the heaviness of memory experienced during the afterlife of the pandemic, Water Nodes is a hybrid immersive installation /performance (live +remote) that reminisces cross-cultural, personal, maternal histories inherited/passed on in the body. By evoking family archive photographs, spiritual and mythological references, the performance considers in the quality of water a passage for memories to flow, contain and dissipate. Katie Dale-Everett (UK) & Erin Cuevas / Matt Conway (USA, California) - Playscape: How to Build A Galaxy 'Playscape: How to Build A Galaxy' is an immersive performance installation that combines dance, motion capture technology and projected celestial graphics to open up new possibilities for physical, social and digital connection. This work is made particularly for young people who experience anxiety in social interaction, but become motivated when engaging with technology, allowing them to discover new ways of sharing space. We welcome everyone and anyone to give it a try. Clarice Hilton, Neal Coghlan, Kat Hawkins and Susanna Dye in collaboration with Candoco Dance Company (UK) - 'Beyond T-Pose: challenging normative assumptions in MOCAP' This work-in-progress deconstructs mocap data away from its normative forms, reconstructing the data to create customised visual expressions and movement interactions. In a series of short vignettes, dancers will move together through a co-created vocabulary, pushing the boundaries of what self-representation, interaction and communication can be in the metaverse. This is the culmination of a series of workshops with Candoco dance company and associated dancers Kat Hawkins, Susannah Dye, Ted Wilkinson, Paulina Porwolik and Dermot Farrell. Ânima Cia. de Dança & Pedro Rocha (Brazil) - 'Weaving through the space mass' The dance performance proposes to make visible the weave of space and its manipulation by the dancers. Considering the space around the body has a certain density, when in movement, the body is not only sustained by this mass, but also manipulates and modifies it. Letta Shtohryn (Ukraine/Malta), with dancers in UK, New York & Malta - ''Lois. Monstrous encounters'. Based on factual and fictional experiences in confined underground spaces, this remote dance collaboration explores the moment when isolated life forms encounter the Primary World. The monstrous self and the monstrous others experience inner and outer transformation of their body~mind states, asking how to share experiences and relate to one another after a period of isolation? Can some experiences be explained / related to at all? And whose voices are believed and considered valid? Afro-Sul Grupo de Música e Dança & Pedro Rocha (Brazil) & Ainslee Robson (USA, California) - 'Alma Negra' Inspired by the archetypes of the female orishas Oxum, Iansã, Iemanjá and Nanã, the performance proposes an encounter between past and present, between the Pan-African roots of Afro-Sul and the experience of dance in the metaverse and confirms that the future is ancestral. Looking back is key to a better future! |
| Type Of Art | Performance (Music, Dance, Drama, etc) |
| Year Produced | 2022 |
| Impact | All artists describe the process of creating the work as 'enriching', 'reaffirming the direction I want my company to go in', 'opening up new possibilities for me' and saying 'the significance has been massive.' We have seen our collaborators go on tho other funded projects for Arts Council, doing workshops at Indian universities 'I have already reached out and conducted a motion capture workshop at Jawaharlal Nehru University in India with Masters and PhD students'. We have seen our collaborative practices be integrated into teaching in Brazil, India, and UK |
| URL | https://www.mocapstreamer.live/showcase-12-nov-2022 |
| Description | As stated in the proposal, this project's first objective was to create an international network of dance groups who were able to collaborate remotely towards shared choreographic practice in virtual spaces. In this sense the project was a great success. We evidenced that it was possible to have dance groups in different locations around the world working through the use of the custom Mocap Streamer software tool. In addition, we showed that it was possible to create a strong sense of virtual community through these practices, with the sharing of cultural references and knowledge from Brazil to LA, from Buenos Aires to New Delhi. However, this success story was not without limitations. Through an international open-call process in January and February 2022 we received approximately 160 applications. We specified that there had to be an element of introduction to digital dance and mocap practices, as we did not want highly-experienced artists applying. We also specified that we were looking for cultural and disciplinary diversity. Through a rigorous process we selected, matchmade, equipped with tech, and thus assembled five teams of dancers and creative technologists, who with training and mentorship worked to produce 5 performance pieces which were delivered in Being Human festival 2022. https://www.mocapstreamer.live/showcase-12-nov-2022 We evidenced here that profound and meaningful work could be made at a distance, through the use of motion capture and digital tools. Artist's testimony reveals that this was transformative to their practice. The limitations of the research design and execution included: time-difference clashes, technical interdependencies, and budget clashes which were exacerbated by the remoteness of the collaboration. We also discovered a limit to truly being able to bring remote dancers together for planning, rehearsal, and performance, with many teams opting to use their own dancers in situ, even while using the remote streamer technology. It seemed too far out of many choreographers' comfort zone to create work from the ground-up, completely remotely. Despite this, strong and convincing digital work was created that truly exhibited the power of the framework. One participant Sumedha Battacharyya noted: 'Surprisingly, it was a spiritually moving experience. There is immense potential in the somatic and emotive dimension of motion capture as a technology'. Sufee Yama in Bangkok described working on the idea of Cultural Teleportation: "Working in Mocap Streamer Residency has pushed me to think about the relationship between dancers, objects and space and how these together create a new language to communicate with international audiences in real time". Extending a similar observation Wahei Lam in L.A. noted one of the huge benefits of the project included "...understanding how different perspective relates to artists' regional culture.... Stunning works". Overall, the findings by the end of project were that despite the difficulties inherent in all creative collaborative projects being somewhat exaggerated by remote collaboration across timezones and technological and cultural barriers, beautiful and powerful work could be created and shared with international audiences. |
| Exploitation Route | This project has provided strong use cases around the use of motion capture, real-time graphics, and streaming tools in international and transcultural choreographic work that we think is both inspiring and useful to other artists and creative technologists in the field, or just starting out. One of the main beneficiaries of this work has of course been the (roughly 20) dancers and digital artists that we directly worked with, and their own extended networks, with lasting changes in focus and practice being observed and described through from the end of the project to one-year-in interviews We have had a high level of engagement with the project through both the open call and final showcase performance, so we do believe that the work has had a strong impact internationally. We have been very aware of the need to be open and honest about difficulties, and this in fact formed part of our final presentation, particularly around technological barriers to access with regard to disability and neurodiversity. This showcase has been watched by around 1300 times on Youtube. I have already engaged in extensive writing for publication, most recently for a multi-volume 'Pandemic and Beyond' series for Manchester University Press. The research is also being used in material for teaching at UG and MA level. The above academic and non-academic routes to impact will most certainly play out over time, with tangible consequences of our research emerging for others in their own work over the next year or two. |
| Sectors | Creative Economy Digital/Communication/Information Technologies (including Software) Education Leisure Activities including Sports Recreation and Tourism Culture Heritage Museums and Collections |
| URL | https://www.mocapstreamer.live/research |
| Description | We feel that our research project has been contemporaneous with the work of only a few other key people in the field of digital dance in establishing a decisive and significant new research area, and furthermore, has evidenced the possibility for a notable change in the quality of creative output in the field of digital performance. Most directly this impact is shown within the work of the participants within our artist-residency programme with tangible changes in their own practice and future development anecdotally reported, but the effects of the research seem to spin out into the work of our partners, our own research team, and others within our network through new artistic projects (Figural Bodies), software (Alexander Whitley's Immersive Digital Dance Studio) and partnerships. While no immediate economic benefit is evidenced (our own showcase performance was free) we have shown the scope for large online audiences for virtual dance work that could convert into economic benefit for the artist themselves. I and other team members are now embarking on several other research projects, public exhibitions, and further applications for funding. In 2022 I was successful in winning a British Academy Innovation Fellowship to work with project Alexander Whitley Dance Company for one year, with a focus on accessibility and inclusivity in the area of digital dance. We are going to SXSW festival in Austin in March 2023 with work developed through this project and accepted into their XR Experience Spotlight programme, and we were also successful in applying to ACM SIGGRAPH later in 2023 with AWDC's Digital Dance Studio software. This will enhance our international profile, and will see us continuing to generate and share knowledge and impact about the research. In Feburary 2024 I have pursued one-year-on meetings with our artist residents which I have recorded and transcribed. It has been fascinating to find out how each of these people have developed since the residency ended, in very different ways. This has provided evidence of the continuing and sustained impact of the project for the main beneficiaries, our artist residents themselves. For participants Monica Dantas in Brazil and Sumedha Battacharya in India, the impact has mainly been felt in their academic careers as they have developed MA and PhD supervision and teaching materials directly out of the experiences they had in their residency work. This has resulted in a variety of publications, workshops, international conferences, new course materials, and ongoing research projects - leading to impacts which may unfold over many years to come. For practitioners Katie Dale Everett (Brighton), Sufee Yama (Thailand) and Joaquina Salgado (Argentina) the impacts have been felt in their professional careers, as they reported gaining the personal confidence and motivation to step-up into project lead and expert consultancy roles within their respective industries. This has led to Katie and Sufee successfully applying together for British Council funding in Thailand - a socially meaningful project that initiated through the residency programme. Meanwhile, Joaquina has moved to Germany (from Argentina) through two further residency projects, finally acquiring a 3-year professional work visa, so that she can work with professional clients and on her own artistic projects in Europe. She claims that the residency gave her the motivation to do this, and has also inspired to her to maintain international collaborative networks with her artistic community back in Argentina. Meanwhile, Katie has taken on leadership roles in arts organizations, and has had two successful arts council grants based on the continuation of residency work. Finally, Letta Shtohryn (Ukraine, currently University of Malta) has developed her artist residency work with us directly into a central case study for her PhD project. She recently in 2023 extended the work into another residency with Ars Electronica in Germany, delivering a major project with them in January 2023. She is currently writing up her PhD research in the area of live and interactive digital dance, and notes that she would never have been in this field if it hadn't been for the learning curve that our residency provided her with. |
| First Year Of Impact | 2023 |
| Sector | Creative Economy,Digital/Communication/Information Technologies (including Software),Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections |
| Impact Types | Cultural Economic |
| Description | POSTNOTE 669 May 2022 on "The impact of digital technology on arts and culture in the UK" |
| Geographic Reach | National |
| Policy Influence Type | Contribution to a national consultation/review |
| URL | https://post.parliament.uk/research-briefings/post-pn-0669/ |
| Description | Prime Ministers Council of Science and Technology event. |
| Geographic Reach | National |
| Policy Influence Type | Participation in a guidance/advisory committee |
| Description | Sufee Yama - Meta APAC Public Policy Department collaboration. |
| Geographic Reach | National |
| Policy Influence Type | Influenced training of practitioners or researchers |
| Impact | This placed our project output on a Thai national platform, recognising the use of motion capture and real-time graphics software in capturing traditional dance practices (material from this project can be see at 0.26 here https://fb.watch/iwYc7bcBf0/). This activity was designed to boost tourism in Thailand. Though no tangible figures are available, it's clear that this work has had reach and impact, with some 10k views on the video. |
| URL | https://apacpolicy.fb.com/thailand/rediscover-thailand/ |
| Description | British Academy Innovation Fellowships Scheme 2022-23 (Route A: Researcher-led) |
| Amount | £110,507 (GBP) |
| Funding ID | IF2223\230051 |
| Organisation | The British Academy |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 03/2023 |
| End | 02/2024 |
| Description | XR Network+ : Virtual Production in the Digital Economy |
| Amount | £2,659,783 (GBP) |
| Funding ID | EP/W020602/1 |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 09/2022 |
| End | 09/2027 |
| Description | British Academy Innovation Fellowship with co-applicant Alexander Whitley Dance Company. |
| Organisation | Alex Whitley Dance Company |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | This was a 12-month innovation collaboration based around issues of accessibility and inclusivity in dance tech, leading directly on from previous work funded by the AHRC. Working closely with AWDC I helped manage innovation goals around their company priorities toward three objectives which each addressed barriers to access. These were remote access and collaboration, inclusive avatar representation, and immersive 3D media. I funded and organised a set of workshops with the technology that was developed. |
| Collaborator Contribution | As co-applicant, AWDC led innovation processes, with funding from Innovate UK and Arts Council England. Together in 2023 we presented work at SxSW festival in Austin, Texas, at SIGGRAPH in L.A. and at the Prime Minister's Council of Science and Technology. We also collaborated on a series of workshops in London, Bristol, and Ipswich. |
| Impact | We have delivered and exhibited software innovation prototypes in the form of AWDCs Digital Dance Studio (DDS), DDS-VR, and the Mocap Streamer integration with DDS. This is all multi-disciplinary work involving dance, software, cultural studies, and education. |
| Start Year | 2023 |
| Description | Digital Innovation Network |
| Organisation | University College London |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | This is a network of academic and industry partners including Goldsmiths, UCL, Target3D, London College of Fashion, Marshmallow Laser Feast, Alexander Whitley Dance Company, and Sadlers Wells. Throughout 2024 there will be a series of workshops, symposiums and performances that will pull together artistic, academic and industry networks to share insight and innovation. I was instrumental in gaining funding with Alexander Whitley Dance Company to initiate this collaborative project. Goldsmiths will host the inaugural event in March 2024. |
| Collaborator Contribution | There is a wide set of partners involved each meeting monthly, and each hosting an event in the summer of 2024. |
| Impact | none yet. |
| Start Year | 2023 |
| Description | Mocap Steamer Artist Residency - Brazil |
| Organisation | Federal University of Rio Grande (FURG) |
| Country | Brazil |
| Sector | Academic/University |
| PI Contribution | Training and mentorship, induction and training sessions. Repositories of digital asset packs, resources, and training modules on Gitbook. Provision of motion capture hardware - value £6000 Bursary of £5000 |
| Collaborator Contribution | The collaboration was with the Carne Digital research group at UFGRS, working with eminent choreographers Eva Schul of Anima Dance, and Iara Deodoro of Afro Sul Dance Company. These researchers created two dance pieces that were delivered in our final showcase performance. |
| Impact | the dance works themself (decribed below) and a current dance movement archive project which is being developed in Brazil through use of the equipment and training that we provided. Alma Negra - Afro-Sul Grupo de Música e Dança & Pedro Rocha (Brazil) & Ainslee Robson (USA, California) Inspired by the archetypes of the female orishas Oxum, Iansã, Iemanjá and Nanã, the performance proposes an encounter between past and present, between the Pan-African roots of Afro-Sul and the experience of dance in the metaverse and confirms that the future is ancestral. Looking back is key to a better future! Weaving Through the Space Mass - Ânima Cia. de Dança & Pedro Rocha (Brazil) The dance performance proposes to make visible the weave of space and its manipulation by the dancers. Considering the space around the body has a certain density, when in movement, the body is not only sustained by this mass, but also manipulates and modifies it. |
| Start Year | 2022 |
| Title | Alexander Whitley Dance Company's Digital Dance Studio VR |
| Description | This is a software application developed as part of a British Academy Innovation Fellowship, in partnership with Alexander Whitley Dance Company (AWDC) and INVR Space (Berlin). It was presented as collaborative research output at SIGGRAPH 2023 in their immersive pavilion. As this applicaiton became tethered to the intellectual property of AWDC (i.e. Digital Dance Studio) we cannot make this available open-source - though there is a proposal to continue the development of the software through further AHRC /DFG funding in 2025 - in which case we would develop an open source version. we are also working to integrate the Mocap Streamer Software (also listed here ) as directly integrated into the immersive VR application. |
| Type Of Technology | Webtool/Application |
| Year Produced | 2023 |
| Impact | As this VR application was a prototype developed out of a research collaboration, it does stand separate to AWDC's Digital Dance Studio as it has been developed as a trademarked and protected desktop application product of AWDC. However, the development process and workflow, and the research insight gained through both that innovation process and its presentation at SIGGRAPH, has directly fed back into the evolution and development of the commercial product. The VR platform was also extensively tested throughout a series of workshops in the second half of 2023 in educational, creative, and accessibility/inclusivity contexts, and we are currently in the process of gathering evidence of the impacts of these workshops. Footage from the VR tools that were developed can be see here https://www.alexanderwhitley.com/dds. |
| URL | https://www.alexanderwhitley.com/dds |
| Title | Goldsmiths Mocap Streamer |
| Description | This software streams motion capture data omnidirectionally via a cloud server to any location. It is currently compatible only with Perception Neuron motion capture system. |
| Type Of Technology | Software |
| Year Produced | 2021 |
| Open Source License? | Yes |
| Impact | This tool was initally created in 2021 to share dance work internationally, through a framework for streaming motion capture data. It was rolled out globally through our FoF project 'Building an international network for virtual dance collaboration: Deploying Goldsmiths MoCap Streamer tool for inclusive and sustainable development'. It is currently being re-developed as part of ongoing research in 2024, funded by both XR Network+ and British Academy. |
| URL | https://www.mocapstreamer.live/mocap-streamer-app |
| Title | Inclusive Avatar system |
| Description | This is not quite ready but will be forthcoming at the end of March 2024. It will be available through an open-source license. As an output of several years of AHRC and British Academy research we discerned a need for an avatar system for virtual dance representation and agency which was non-realistic (in terms of face, consume, hair etc) but which captured and expressed the needs of a diverse set of dance practitioners to feel represented within a form that correlates with their need to feel embodied and expressive in the virtual space. This system allows for customisable body parts according to a huge diversity of non-normative body shapes that are not adequately represented in other avatar systems, and for amputations or prosthetics to be represented. |
| Type Of Technology | Physical Model/Kit |
| Year Produced | 2024 |
| Open Source License? | Yes |
| Impact | This avatar system is a complex enterprise, reflecting on years of AHRC-funded practice-based research experience, as well as theory about disabled and non-normative body representation in Metaverse-type virtual environments. It's impact is potentially huge, and through testing in a series of workshops in 2023 we have been through an extensive process of feedback and user input, leading to its refinement for heightening potential impact. In the first instance it is being directly incorporated into AWDC's Digital Dance Studio software which will be rolled-out as a product in 2024. Secondly it will be an open-source resource whereby users will be abe to download, customise and add to it in terms of improving and enhancing its functionality for access and inclusivity. Due to its complexity we have experienced some delays in final delivery. |
| URL | https://www.alexanderwhitley.com/dds |
| Description | Goldsmiths Mocap Streamer Collaborative Innovation Showcase |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Industry/Business |
| Results and Impact | Bringing regional and international work back to London alongside new research initiatives, we showcased collaborative projects through a day of demo, workshop, and performance. All the work presented was informed by innovation in motion-capture exploration of avatar embodiment, communication, and interaction in shared virtual spaces. This event was of interest to dance professionals, creative technologists, and anyone interested in emerging immersive performance practices. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://www.mocapstreamer.live/collaborative-innovation-showcase |
| Description | November 2022 Showcase Performance for Being Human Festival - Global Dance Collaboration in the Metaverse |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | This event was the final showcase for our 5 artist residency teams and our own disability-led research project. 7 original works were presented with Q&A and discussion over a four-hour period. Two works were presented in-person with dancers from the UK. The other five were streamed from respective locations ranging from New Delhi, to New York, to Malta, to Porto Alegre in Brazil, and finally Bangkok. It was presented in association with Being Human Festival. The in-person audience was around 60 people. The international and online audience was 500 live on the day, increasing to 1300 on the youtube link over the following week. There was a high level of participation from the in-person audience, with lively debate and an opportunity to get into motion-capture and dance within one project. A short video about the day can be seen here https://www.mocapstreamer.live/showcase-12-nov-2022 |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://www.youtube.com/watch?v=nGvJE4VaAAc&t=6815s |
| Description | Prime Minister's Council of Science and Technology - Science Museum. |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | National |
| Primary Audience | Policymakers/politicians |
| Results and Impact | We were invited to present ongoing British Academy Innovation fellowship research to the Prime Minister's Council of Science and Technology at the Science Museum in Dec 2023. The attendees were policymakers and industry leads from across the UK Creative Industries. |
| Year(s) Of Engagement Activity | 2023 |
| Description | SIGGRAPH Digital Dance Studio VR Immersive Pavilion exhibition. |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Industry/Business |
| Results and Impact | Alexander Whitley Dance Company and I were successful in our application to the highly esteemed Immersive Pavilion of ACM SIGGRAPH 2023. We presented the Digital Dance Studio VR, an innovative VR software app for digital choreographic composition, planning, teaching, learning, and rehearsal. It offers an immersive interface for creation and manipulation of choreographic sequences in virtual space through a suite of modular tools for choreographers, dancers, and other movement-based practitioners. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://s2023.siggraph.org/presentation/?id=gensub_369&sess=sess208 |
| Description | SXSW 2022 - Panel Mocap Streaming and remote dance collaboration in VR |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Industry/Business |
| Results and Impact | This was a panel discussion at South by South West Festival 2022. This panel discussed the technical, creative and conceptual issues around distributed performance experiences in VR. The conversation focussed on the VR Mocap Streamer project, a partnership between Alexander Whitley Dance Company and the Department for Media and Communications at Goldsmiths University, London, which attempts to bring live, fully embodied interactive performance from remote locations into a multi-user VR experience based on the seminal ballet The Rite of Spring. A lively discussion followed. This has directly led to the inclusion of one of our project outputs in SXSW 2023 XR Experience Spotlight programme - on the 10th to 14th March - called Figural Bodies. We also have a panel discussion 'Dance in the Metaverse - Inclusion and accessibility'. These activities are funded by British Underground, in the Future Art and Culture programme - produced by British Underground at SxSW funded by Arts Council England with additional support in 2023 from the British Council. |
| Year(s) Of Engagement Activity | 2022 |
| URL | https://schedule.sxsw.com/2022/events/PP116279 |
| Description | SXSW 2023 - Panel 'Dance in the Metaverse: Tools for Accessibility' |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Industry/Business |
| Results and Impact | A panel discussion as part of SXSW's conference program. The description was "As the metaverse becomes the proposed next frontier for embodied connection, play, and performance, its current design, representation of bodies, and technological modes of interaction remain inaccessible to many. This panel will critically discuss the barriers to access and will give insight into practical design processes which centre disability. Focusing on dance performance, the panel brings together developers, performers and researchers to discuss sustainable and inclusive design practice; i.e. streaming tools for remote participation, and machine learning for adaptive modes of embodiment in virtual spaces. To fulfil the true potential of the cultural metaverse we must start to think about challenging its normative assumptions to reach for a concept of collective affinity." |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://schedule.sxsw.com/2023/events/PP127701 |
| Description | SxSW XR Experience Exhibition - 'Figural Bodies' |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | This was a performance and exhibition installation in the XE Experience hall of SXSW festival in Austin Texas, as part of the film Festival programme. The programme descption was "Figural Bodies," created with Candoco Dance, is active research towards deconstructing mocap data from its enforced normative algorithms, celebrating subversion and difference in the immersive representation of bodies. Disabled dancers in Austin and London, connected by Goldsmiths Mocap Streamer, seek to share embodied communication through virtual interaction. The dancers communicate through a co-created movement vocabulary, using motion data and machine learning to push the boundaries of how bodies can be represented in the Metaverse. Future Art and Culture is produced by British Underground at SxSW funded by Arts Council England with additional support in 2023 from the British Council. |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://schedule.sxsw.com/2023/films/2079060 |