A fear-directed approach to a novel affective virtual reality game system

Lead Research Organisation: University of York
Department Name: Computer Science

Abstract

Affective computing methods have presented potential in providing engaging and immersive game experiences, as well as in facilitating the effects of purposeful games related to emotions. There are however inconsistent findings when it comes to the assessment of biofeedback data and its interpretation into a model of emotional states. This is partly due to unfocused approaches over multiple gaming systems, a lack of informed comparisons between measurement devices, and a generalized view of emotions, reducing the complexity and usefulness of affective data. The proposed study will therefore focus only on VR systems and fear-related experiences to build a system that precisely and reliably outputs emotional data in the best possible way suited for VR games. Upon succession, this system will be able to advance emotion-related gameplay development, empathetic social agents for better interactions, as well as provide new evidence for effective psychological training interventions using affective data in video games.

Planned Impact

The IGGI Centre for Doctoral Training will impact upon

1. The Digital Games Industry: Answering a national talent shortage, IGGI will inject a cohort of 60+ exceptional PhD graduates into the UK industry, able to translate AI, data, and design research into business value. They will catalyse a deeper industry understanding of the societal and ethical impacts of games, and champion a culture which encourages and supports equality, diversity and inclusion. Industry partners are fully supportive, Sony Interactive Entertainment's letter of support states "In an industry that's moving so fast, IGGI is essential for incubating the next generation of creators and innovators".

Talent flow alone can't satisfy the knowledge and innovation needs of a games industry dominated by small businesses. IGGI offers the opportunity for step change, yielding increased profits through an internationally distinctive UK games industry which is technologically advanced and research-aware. Collaborations and placements will transfer knowledge and skills needed by the industry: GameSparks (acquired by Amazon) found that "bringing in an IGGI student meant we were able to build new machine learning models into our toolset that delivers direct value"; other IGGI students have brought, for example, procedural graffiti to Media Molecule and automated game balancing to MindArk.

2. Game Players and Wider society: Large and growing numbers of people are playing digital games with unprecedented enthusiasm. Developing games which engage a wider range of players and which increase the social value obtained through playing games can have massive benefits: both economic ones and ones which harness the massive "cognitive surplus" implied by game players who are clocking up thousands of game hours. Potential benefits here are educational (e.g. teaching data literacy), therapeutic (e.g. detecting mental health issues), and cultural (e.g. through new interactive festival installations).

3. Creatives: Games provide new forms of interactive engagement, challenging traditional approaches to media and art, and technology developed for games provide creative opportunity for a wider and more diverse group of stakeholders. The BBC believes that "Convergence of the broadcasting, film and games industries will play a significant part in shaping the future of public service delivery." New human-like AI agents will lead to creative new gameplay genres; AI-supported design tools empower professional creatives and make creative expression more accessible for novices and people with disabilities.

4. Scientists: IGGI research shows that gameplay data provides population-scale insight into traits like fluid intelligence, and gamified citizen science platforms like Zooniverse are already engaging millions of volunteer players in scientific data collection. IGGI will make game data mining and gamified citizen science readily accessible with validated methods and tools and will develop a game-specific responsible innovation framework, enabling scientists to harness this massive opportunity and ensure their work has socially desirable consequences.

5. IGGI graduates: IGGI provides a beacon for innovation in digital games, with heavy competition for PhD places allowing recruitment of top students. For each IGGI graduate, learning and conducting research alongside a strong cohort of students having related but different interests and expertise, with extensive interaction with industry, will give rise to a highly rounded and employable PhD graduate, sought by both UK games industry and the growing games research community.

IGGI investigators, supervisors and students will develop a long-term understanding of the digital games industry, which will result in a stronger industry, a wealth of fascinating new research questions, and real benefits for wider society through the now-ubiquitous medium of digital games.

Publications

10 25 50

Studentship Projects

Project Reference Relationship Related To Start End Student Name
EP/S022325/1 01/10/2019 31/03/2028
2449620 Studentship EP/S022325/1 01/10/2020 30/09/2024 Maximilian Croissant