XR Network+ : Virtual Production in the Digital Economy
Lead Research Organisation:
University of York
Department Name: Electronics
Abstract
XR Network+ Virtual Production in the Digital Economy will provide a ten-year research agenda for content creation and consumption. XR Network+ is founded on research collaboration, co-creation and challenge-led innovation, and designed from the ground up to build a community of academic research and industry R&D at the convergence of ideas, technologies, and creative practice in Virtual Production (VP) to deliver impact and opportunity for the whole of the digital economy.
Virtual Production (VP) is an emergent area of multi-disciplinary activity encompassing the wider application of digital creativity techniques and technologies across many domains. It is changing the landscape of technology-driven storytelling, media, film and television content production workflows, live and immersive experiences, both large and small scale. The UK screen industries sector is currently investing heavily in traditional studio infrastructure, with demand for production space currently outstripping supply. However, compact, flexible and technology-driven VP facilities will help to shape the future of these and other studios, their production practices, the content they make and hence the audiences that consume this content. This change is based on how a new generation of real-time technologies (motion capture, spatial computing, data, AI, machine learning, volumetric capture, haptics, real-time rendering, immersive XR and responsive media) offer, for the first time, the promise of integrating production processes and workflows from initial concept through to final result.
XR Network+ will build on the success of the AHRC Creative Industries Clusters Programme (CICP) and the significant interest that has emerged from these projects in supporting R&D in XR (eXtended Reality) technologies as it converges with VP. The CICP demonstrates how leading universities can act as anchors at the centre of geographical/sectoral creative industries clusters and use their research capacity and expertise for the benefit of their SMEs, bringing opportunities for place-based growth, and economic, social and cultural impact. XR Network+ will land at a critical point, during the final year of the CICP and as a number of significant VP investments come online, offering a short window of opportunity to harness connections and capabilities. XR Network+ builds a bridge between five current CICP projects and will leverage other core UKRI, local government and industry investment. It will drive a community-led programme of complementary VP research and innovation to unlock the potential of content creation and consumption for the whole of the digital economy and related sectors.
Research challenges co-created with project partners at application include: VP Integration of virtual game worlds and physical content; sound design in VP contexts; building VP environments, characters and objects; issues of ethics and IP in the use of digital assets and data; AI and data-driven automation; translation and impact in the digital economy.
XR Network+ activities will be built across five stages corresponding to the five years of the project (1) Engage; (2) Explore; (3) Challenge; (4) Respond; (5) Report and Renew. An Annual Networking and Showcase event will provide a key point of dissemination for each stage of activity. Feasibility funding will support a potential range of research activities based on best practice from the five CICP projects: a Creative Bridge programme for early career researchers; a Knowledge Transfer Partnership Model; small grant funding; challenge funding; portfolio building; and commissioned research to evaluate the project and build a roadmap for future activity.
XR Network+ is important and timely in terms of the significant current interest and investment in VP and the need to coordinate the UK's research base alongside industry and regional investments to provide a pathway for next stage investment and growth at a national level.
Virtual Production (VP) is an emergent area of multi-disciplinary activity encompassing the wider application of digital creativity techniques and technologies across many domains. It is changing the landscape of technology-driven storytelling, media, film and television content production workflows, live and immersive experiences, both large and small scale. The UK screen industries sector is currently investing heavily in traditional studio infrastructure, with demand for production space currently outstripping supply. However, compact, flexible and technology-driven VP facilities will help to shape the future of these and other studios, their production practices, the content they make and hence the audiences that consume this content. This change is based on how a new generation of real-time technologies (motion capture, spatial computing, data, AI, machine learning, volumetric capture, haptics, real-time rendering, immersive XR and responsive media) offer, for the first time, the promise of integrating production processes and workflows from initial concept through to final result.
XR Network+ will build on the success of the AHRC Creative Industries Clusters Programme (CICP) and the significant interest that has emerged from these projects in supporting R&D in XR (eXtended Reality) technologies as it converges with VP. The CICP demonstrates how leading universities can act as anchors at the centre of geographical/sectoral creative industries clusters and use their research capacity and expertise for the benefit of their SMEs, bringing opportunities for place-based growth, and economic, social and cultural impact. XR Network+ will land at a critical point, during the final year of the CICP and as a number of significant VP investments come online, offering a short window of opportunity to harness connections and capabilities. XR Network+ builds a bridge between five current CICP projects and will leverage other core UKRI, local government and industry investment. It will drive a community-led programme of complementary VP research and innovation to unlock the potential of content creation and consumption for the whole of the digital economy and related sectors.
Research challenges co-created with project partners at application include: VP Integration of virtual game worlds and physical content; sound design in VP contexts; building VP environments, characters and objects; issues of ethics and IP in the use of digital assets and data; AI and data-driven automation; translation and impact in the digital economy.
XR Network+ activities will be built across five stages corresponding to the five years of the project (1) Engage; (2) Explore; (3) Challenge; (4) Respond; (5) Report and Renew. An Annual Networking and Showcase event will provide a key point of dissemination for each stage of activity. Feasibility funding will support a potential range of research activities based on best practice from the five CICP projects: a Creative Bridge programme for early career researchers; a Knowledge Transfer Partnership Model; small grant funding; challenge funding; portfolio building; and commissioned research to evaluate the project and build a roadmap for future activity.
XR Network+ is important and timely in terms of the significant current interest and investment in VP and the need to coordinate the UK's research base alongside industry and regional investments to provide a pathway for next stage investment and growth at a national level.
Organisations
- University of York (Lead Research Organisation)
- Victoria and Albert Museum (Project Partner)
- British Film Institute (Project Partner)
- University of Portsmouth (Project Partner)
- Game Republic (Project Partner)
- Humain Ltd (Project Partner)
- Taunt Studios (Project Partner)
- Black Goblin (Project Partner)
- Digital Catapult (Project Partner)
- Numerion Software Ltd (Project Partner)
- Enter Yes Studio Ltd (Project Partner)
- Pittswood (Project Partner)
- Arup Group (United Kingdom) (Project Partner)
- Prox and Reverie (Project Partner)
- Reflex Arc (Project Partner)
- Cloth Cat Animation Ltd (Project Partner)
- Holition Ltd (Project Partner)
- Promod Esports (Project Partner)
- ISO Design (Project Partner)
- Screen Yorkshire (Project Partner)
- Small and Clever Productions (Project Partner)
- Happy Finish (Project Partner)
- Northern Ireland Screen (Project Partner)
- City Hall Belfast (Project Partner)
- Bumpybox Ltd (Project Partner)
- CodeBase Ltd (Project Partner)
- Production Park Ltd (Project Partner)
- Abertay University (Project Partner)
- Retinize (Project Partner)
Description | Contribution to the Northern Creative Corridors Workshop: Innovation |
Geographic Reach | Local/Municipal/Regional |
Policy Influence Type | Participation in a guidance/advisory committee |
URL | https://www.thersa.org/press/releases/2023/11/grand-coalition-formed-to-create-a-northern-creative-c... |
Description | Contribution to: Creative Industries Sector Vision: A joint plan to drive growth, build talent and develop skills, Presented to Parliament by the Secretary of State for Culture, Media and Sport by Command of His Majesty June 2023 CP 863 |
Geographic Reach | National |
Policy Influence Type | Contribution to a national consultation/review |
Impact | This data in part contributed to securing funding for the CoSTAR programme that will, for the first time, provide researchers, companies and institutions across the UK with the infrastructure they need to conduct world-class research and development (R&D) in screen and performance technology. CoSTAR will support the design, development and creation of state-of-the-art facilities, resources and expertise to underpin the long-term competitiveness of the UK's screen and performance sectors. Established with £75.6 million of funding and delivered by the Arts and Humanities Research Council, the CoSTAR national network comprises a National Lab, three Network Labs and a Foresight Lab and was announced alongside the government's Creative Industries Sector Vision in June 2023. It is funded through UK Research and Innovation's Infrastructure Fund, which supports the facilities, equipment and resources that are essential for researchers and innovators to do groundbreaking work. The CoSTAR network includes: CoSTAR National Lab; CoSTAR Live Lab; CoSTAR Realtime Lab; CoSTAR Screen Lab; CoSTAR Foresight Lab |
URL | https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1162... |
Description | CoSTAR Live Lab |
Amount | £4,523,531 (GBP) |
Funding ID | AH/Y001079/1 |
Organisation | Arts & Humanities Research Council (AHRC) |
Sector | Public |
Country | United Kingdom |
Start | 09/2023 |
End | 03/2029 |
Description | Contributed to HM Government's Committee for Science and Technology Creative Industries Event, London |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | Contributed to and attended HM Government's Committee for Science and Technology Creative Industries Event, London, celebrating and promoting key outcomes and organisations in the UK's Creative Industries. The audience was mostly industry, policymakers, Government civil servants, MPs, and discussions took place on further project collaborations. |
Year(s) Of Engagement Activity | 2023 |
Description | Contributed to a panel session on creative/digital innovation at the York and North Yorkshire Business Summit |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Industry/Business |
Results and Impact | XR Stories PI Damian Murphy contributed to a panel session on regional creative/digital innovation at the York and North Yorkshire Local Enterprise Partnership Business Summit, with a particular focus on AI, XR technology and the potential impact on regional businesses. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.fsb.org.uk/event-calendar/york-north-yorkshire-business-summit-2023.html |
Description | Hosted The Open University at the XR Stories facilities in York Guildhall |
Form Of Engagement Activity | Participation in an open day or visit at my research institution |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | The XR Stories team hosted a visit from the Open University to our facilities at York Guildhall to share learning and best practice as the OU team develop their own new XR Studio facility. |
Year(s) Of Engagement Activity | 2023 |
Description | Hosted a Visit to the XR Stories facilities at York Guildhall from the Glasgow University Museums in the Metaverse project team |
Form Of Engagement Activity | Participation in an open day or visit at my research institution |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | The XR Stories team hosted a visit from the Glasgow University Museums in the Metaverse project team to our facilities at York Guildhall to share learning and best practice as the Glasgow team develop their own new XR Studio facility. |
Year(s) Of Engagement Activity | 2023 |
Description | Hosted a Visit to the XR Stories facilities at York Guildhall from the University of Warwick Innovation teams |
Form Of Engagement Activity | Participation in an open day or visit at my research institution |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | The XR Stories team hosted a visit from the University of Warwick Innovation team to our facilities at York Guildhall to share learning and best practice as the Warwick team develop their own strategic planning in this area. |
Year(s) Of Engagement Activity | 2023 |
Description | Invited Panel Member, Inspiring and Innovating for the Arts: Performance, Practice and Production, School of Arts and Creative Technologies Launch Event, University of York. |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Public/other audiences |
Results and Impact | XR Stoires PI Damian Murphy was an invited panel Member for the launch of the new School of Arts and Creative Technologies at the University of York |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.york.ac.uk/arts-creative-technologies/about/events/school-of-act-launch-event/ |
Description | Invited Speaker, Design Made It Possible: Creativity and Economic Success, The Radix Big Tent Ideas Festival, York, 2023. |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Public/other audiences |
Results and Impact | XR Stories PI Damian Murphy contributed to an expert panel as an invited speaker as part of the annual public/policy Radix Big Tent Ideas Festival, held in York, 2023. |
Year(s) Of Engagement Activity | 2023 |
URL | https://radixuk.org/events/the-radix-big-tent-ideas-festival-23-regenerate/ |
Description | Invited Speaker: Creative clusters, and next steps for growth and innovation in the UK creative industries |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | Speaking at an online meeting of the Westminster Media Forum and reporting on the work of XR Stories, "Adapting to Change, Assessing Possibilities, Prioritising R&D" and discussing funding and investment, key policy developments, local collaboration, priorities for innovation and IP, and education, skills, and the talent pipeline for the UK Creative Industries |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.westminsterforumprojects.co.uk/publication/Creative-Industry-23 |
Description | Keynote panel at DCMS We Create Conference in Manchester, celebrating launch of Create Growth Programme and Creative Industries in the North of England |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | XR Stories PI Damian Murphy contributed to a keynote panel hosted by the Minister for the Department of Culture, Media and Sport at the We Create Conference in Manchester, celebrating the launch of Create Growth Programme and Creative Industries in the North of England. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.gov.uk/government/news/culture-secretary-celebrates-northern-creativity-in-manchester |
Description | Participation in the Launch Event for the new School of Physics, Engineering and Technology at the University of York. |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | A launch event was held for the new School of Physics, Engineering and Technology at the University of York. The XR Stories team contributed to the event by showcasing their work as one of the five key strategic areas of translational research impact, 'Engineering the Metaverse'. |
Year(s) Of Engagement Activity | 2024 |
Description | Participation in the Launch Event for the new York and North Yorkshire Combined Authority |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Policymakers/politicians |
Results and Impact | On 1st February 2024 a launch event was held for the new York and North Yorkshire Combined Authority that will result in the election of a regional mayor and devolution from Government of key budgets and decision making powers. The XR Stories team contributed to the event by showcasing their work as one of the three key strategic areas for development in the region on behalf of the University of York. |
Year(s) Of Engagement Activity | 2024 |
URL | https://yorknorthyorks-ca.gov.uk/launch-event-for-combined-authority/ |
Description | Presented a seminar on XR Stories and the Creative Industries Cluster Programme at University of Salford. |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Professional Practitioners |
Results and Impact | XR Stories PI Damian Murphy presented an invited seminar on the XR Stories project and the UK's Creative Industries Cluster Programme as part of the University of Salford Acoustics Research Seminar series. The presentation highlighted relevant work in audio and acoustics in the context of wider UK Government policy to support economic growth in the creative industries through R&D. Audience was mostly researchers in the field. |
Year(s) Of Engagement Activity | 2024 |
URL | https://www.youtube.com/watch?v=pIXRLtby5xg |
Description | Presented a seminar on XR Stories and the Creative Industries Cluster Programme at the Danish Technical University, Lyngby, Denmark |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Industry/Business |
Results and Impact | XR Stories PI Damian Murphy presented an invited seminar on the XR Stories project and the UK's Creative Industries Cluster Programme at the Danish Technical University, Lyngby, Denmark. The presentation highlighted relevant work in audio and acoustics in the context of wider UK Government policy to support economic growth in the creative industries through R&D. Audience was mostly researchers in the field. |
Year(s) Of Engagement Activity | 2023 |
Description | Prime Minister's Council for Science and Technology: Infrastructure Roundtable. |
Form Of Engagement Activity | A formal working group, expert panel or dialogue |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Policymakers/politicians |
Results and Impact | Invited Speaker to the session, "How investment in arts, humanities and creativity-led research can contribute to innovation in technology-led sectors such as generative AI, research software engineering and the 'metaverse technologies", as part of the Prime Minister's Council for Science and Technology: Infrastructure Roundtable. |
Year(s) Of Engagement Activity | 2023 |
Description | Virtual Production round table at the XR Stories Culture and Heritage Event August 2023 |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Other audiences |
Results and Impact | XR Stories held a Culture and Heritage Event for 130 people at the York City Centre Guildhall. The event was conference style and included a series of talks and demonstrations, emerging relationships and projects were showcased to explore utilising XR within the culture and heritage sector. As part of the event, around half the attendees attended roundtable discussions. One of the roundtable groups asked attendees to discuss 'what is important to recognise about virtual production?', 'what are some current challenges around virtual production' and 'how can XR Network+ support the future development of the virtual production industry?'. The content of the discussion have been included in a written report (still to be published). |
Year(s) Of Engagement Activity | 2023 |
Description | XR Network+ Online Launch event |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | An online event for 180 people from academia and industry. The event included an introduction to the XR Network+ project, an explanation of the funding opportunities that XR Network+ offered in 2023 and a question and answer session for the benefit of prospective applicants to the funding calls that were available in 2023. The event resulted in applications to the XR Network+ Embedded R&D and Prototyping Impact and Acceleration funding calls as well as raising awareness future opportunities for networking with peers working in extended reality and virtual production across academia and industry. |
Year(s) Of Engagement Activity | 2023 |
URL | https://xrnetworkplus.xrstories.co.uk/event/xr-network-online-launch-event/ |
Description | XR Network+ Programme briefing for potential applicants and industry |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Other audiences |
Results and Impact | 50 people from Cardiff University staff and the local media industry, who are interested in extended reality and virtual production, attending an XR Network+ Briefing Event. There was an introduction, a presentation about the programme, an update on funded projects and future future funding rounds, an expert investigator panel, questions from the floor, then networking and engagment. |
Year(s) Of Engagement Activity | 2023 |
Description | XR Network+ Roadshow Event 2023 Ulster University |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Other audiences |
Results and Impact | 50 researchers and industry professionals attended a workshop event at Ulster University at which they learnt about the XR Network+ project, discussed the definition of virtual production and identified current challenges that the XR Network+ project might address through providing funding or creating networking opportunities. The event included an expert investigator panel, questions from the floor, and networking and engagment. Workshop discussion points were used to develop funding call guidance and application processes around the XR Network+ Project 2023 Embedded R&D in virtual production and Protyping Impact and Acceleration research activities and attendees joined the XR Network+ project mailing list to learn about future opportunities. |
Year(s) Of Engagement Activity | 2023 |
Description | XR Network+ Roadshow event 2023 University of the Arts London |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Other audiences |
Results and Impact | 50+ researchers and industry professionals attended a workshop event at University of the Arts London at which they learnt about the XR Network+ project, discussed the definition of virtual production and identified current challenges that the XR Network+ project might address through providing funding or creating networking opportunities. The event included an expert investigator panel, questions from the floor, and networking and engagment. Workshop discussion points were used to develop funding call guidance and application processes around the XR Network+ Project 2023 Embedded R&D in virtual production and Protyping Impact and Acceleration research activities and attendees joined the XR Network+ project mailing list to learn about future opportunities. |
Year(s) Of Engagement Activity | 2023 |
Description | XR Network+ Roadshow event 2023 at The University of Edinburgh |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Other audiences |
Results and Impact | 50+ researchers and postgraduate students attended a workshop event at University of Edinburgh at which they learnt about the XR Network+ project, discussed the definition of virtual production and identified current challenges that the XR Network+ project might address through providing funding or creating networking opportunities. The event included an expert investigator panel, questions from the floor, and networking and engagment. Workshop discussion points were used to develop funding call guidance and application processes around the XR Network+ Project 2023 Embedded R&D in virtual production and Protyping Impact and Acceleration research activities and attendees joined the XR Network+ project mailing list to learn about future opportunities. |
Year(s) Of Engagement Activity | 2023 |
URL | https://xrnetworkplus.xrstories.co.uk/event/scotland-launch-of-xr-network/ |
Description | XR Network+ online seminar Feb 2024: AI composure |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | Online XR Network+ seminar about a project called "AI Composure", which is a research collaboration between the University of York and dock10 and received funding from the XR Network+ Embedded R&D 2023 funding programme. Prof Florian Block (University of York) and Richard Wormwell (Dock10) gave a talk that focussed on their R&D project to tackle a major challenge for Virtual Production - simulating realistic light interactions in multi-camera green screen studios. This event is one of a monthly seminar series aimed at sharing knowledge, expereince and best practice as well as growing a network of peers working in extended reality and virtual production across academia and industry. |
Year(s) Of Engagement Activity | 2024 |
Description | XR Network+ online seminar: Towards sustainable XR and virtual production |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Other audiences |
Results and Impact | Online XR Network+ seminar about how to move towards sustainable extended reality technologies and virtual production. This event is one of a monthly seminar series aimed at sharing knowledge, experience and best practice as well as growing a network of peers working in extended reality and virtual production across academia and industry. Declan Keeney from Ulster University gave a talk on the use of virtual production technologies and their role in carbon reduction in the screen industries. This was followed by a talk by Alexandra Dales (York St John University) and Nina Willment (University of York) which explored sustainability potential and challenges associated with the immersive technology and production sector. Speakers answered questions from the audience and provided some ideas about possible areas for future research. |
Year(s) Of Engagement Activity | 2024 |
URL | https://xrnetworkplus.xrstories.co.uk/event/xr-network-seminar-how-to-move-towards-sustainable-xr-an... |
Description | XR Network+ project launch at BEYOND conference 2022 |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Other audiences |
Results and Impact | Project Investigators attended the 3-day BEYOND 2022 conference in Cardiff and hosted a panel event at which they introduced the XR Network+ project and provided an overview of the project activities and funding opportunities. This was followed by a second panel event at which experts from multiple organisations examined the potential of virtual production approaches to make the film and TV industry more environmentally sustainable. Drawing on industry experience and the latest research, panelists explored emerging thought about what virtual production is and can be, and critique claims about how new production tools can enable net zero filmmaking. The event increased awareness of the XR Network+ project and resulted in people signing up to the XR Network+ project mailing list. |
Year(s) Of Engagement Activity | 2022 |
URL | https://xrstories.co.uk/xr-stories-at-beyond-conference-2022/ |