ARray - An augmented reality and pre-visualisation tool for the costume industry
Lead Research Organisation:
Guildhall School of Music and Drama
Department Name: Research and Enterprise
Abstract
In 2022, the Production Arts Department at the Guildhall School of Music & Drama successfully applied to the AHRC's Creative Capabilities & Research Fund (CResCa), securing over £900,000 to purchase cutting-edge digital equipment, namely SmartStage Pro XR Stage, Holosys Volumetric Capture Suite, and BlackTrax Realtime tracking. This equipment has enabled the Department to develop a credible XR (Extended Reality) studio that includes a high-quality volumetric capture system with fully integrated hardware and software necessary to allow for motion capture of people and objects in 'six degrees of freedom' (6DoF) ready for use in augmented and virtual reality (AR and VR) and virtual production. As a result, the Department has become increasingly active in technology-driven and collaborative practice-based work across the commercial and research sectors. Ongoing work facilitated by CResCa includes 'A Mid-journey Night's Dream', a project that investigates the potential for AI scenography in the Shakespearian canon, using existing mainstream platforms and bespoke machine learning systems to design stages and costumes that are built in both physical and digital processes to create an immersive XR production.
Whilst the benefits of digital technologies that allow broad and rapid ideation, sharing of ideas and the ability to prepare and visualise work for those of us working at the mise en scène end of production arts is clear, the use of digital tools for costume design is, at present, limited. During our work on 'A Mid-journey Night's Dream', for example, the School's costume lecturers have struggled to adapt to digital workflows due to a paucity of digital tools that can adequately reflect the physical demands of costume design e.g. the tactile nature of fabric, the importance of working with human bodies, the influence of lighting, and so on. Where online cataloguing of stage costumes or traditional physical costume archives exist, they tend to be basic and photographic, not capturing the 3D nature of the originals or their dynamic quality when they move. Moreover, whilst there are some similar tools on the market that provide digital solutions for costume design, such as 'Virtual Wardrobe' by Weta Digital (a software tool used to create digital costumes for films) and 'ClosetSpace' by Stylitics (a digital wardrobe organiser for personal use), there is it seems no tool that specifically addresses the needs of costume houses in streamlining the costume selection process and providing a digital platform for collaboration and experimentation. There is, therefore, a commercial need for a digital tool that can successfully integrate established working practices of costume designers with the digital workflows increasingly found elsewhere in the performing arts sector, not to mention other digital spectacle-based entertainments.
This project has been conceived to support activities enhancing self-sustaining commercial impact on the UK's costume design industry arising from work funded by the Guildhall School of Music & Drama's successful application to the AHRC's Creative Research Capabilities Strand 1 (CResCa). Using cutting-edge technologies that enable motion capture of people and objects in 6DoF ready for use in AR and VR, Guildhall School researchers will collaborate with Angels Costumes (a leading UK-based costume design house that boasts the largest collection of theatre, television and film costumes in the world) to develop a prototype subscription-based digital costume library, initially of 100 items. This digital library will enable costume designers to view manipulate costumes virtually , without the need for the physical prototypes on which the costume design industry currently relies. The development of this digital library will address a significant gap in the commercial market - no equivalent resource currently exists - and will enhance the competitiveness of the UK's costume design industry.
Whilst the benefits of digital technologies that allow broad and rapid ideation, sharing of ideas and the ability to prepare and visualise work for those of us working at the mise en scène end of production arts is clear, the use of digital tools for costume design is, at present, limited. During our work on 'A Mid-journey Night's Dream', for example, the School's costume lecturers have struggled to adapt to digital workflows due to a paucity of digital tools that can adequately reflect the physical demands of costume design e.g. the tactile nature of fabric, the importance of working with human bodies, the influence of lighting, and so on. Where online cataloguing of stage costumes or traditional physical costume archives exist, they tend to be basic and photographic, not capturing the 3D nature of the originals or their dynamic quality when they move. Moreover, whilst there are some similar tools on the market that provide digital solutions for costume design, such as 'Virtual Wardrobe' by Weta Digital (a software tool used to create digital costumes for films) and 'ClosetSpace' by Stylitics (a digital wardrobe organiser for personal use), there is it seems no tool that specifically addresses the needs of costume houses in streamlining the costume selection process and providing a digital platform for collaboration and experimentation. There is, therefore, a commercial need for a digital tool that can successfully integrate established working practices of costume designers with the digital workflows increasingly found elsewhere in the performing arts sector, not to mention other digital spectacle-based entertainments.
This project has been conceived to support activities enhancing self-sustaining commercial impact on the UK's costume design industry arising from work funded by the Guildhall School of Music & Drama's successful application to the AHRC's Creative Research Capabilities Strand 1 (CResCa). Using cutting-edge technologies that enable motion capture of people and objects in 6DoF ready for use in AR and VR, Guildhall School researchers will collaborate with Angels Costumes (a leading UK-based costume design house that boasts the largest collection of theatre, television and film costumes in the world) to develop a prototype subscription-based digital costume library, initially of 100 items. This digital library will enable costume designers to view manipulate costumes virtually , without the need for the physical prototypes on which the costume design industry currently relies. The development of this digital library will address a significant gap in the commercial market - no equivalent resource currently exists - and will enhance the competitiveness of the UK's costume design industry.