📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

Museum Visitor Experience and the Responsible Use of AI to Communicate Colonial Collections

Lead Research Organisation: University of Sheffield
Department Name: Politics

Abstract

Museums and heritage institutions (MHIs) are increasingly using AI tools such as Machine Learning, Natural Language Processing, and Machine Vision to enhance visitor interaction with their collections. A well-established problem with AI is bias, including how AI algorithms reproduce skewed underlying data. The inaccuracy of facial recognition AI when applied to people of colour is well known example. For MHIs, a challenge for responsible AI use lies in how underlying biases in museum collections, such as those rooted in colonial knowledge and power, are reproduced through AI data processing and outputs. When seeking to publicly communicate stories of, from, and through their collections, and when using colonial collections as the 'data' for AI mechanisms that facilitate this, what might 'responsible AI' look like for MHIs? What might be the implications, challenges, and opportunities for responsible AI?

The project has been developed in consultation with The Royal Armouries, the project's external partner. The Royal Armouries are the UK's national collection of arms and armour and one of the oldest museums in the world. The museum's focus on the history of war forms a backdrop for interpretations encompassing science and technology, politics, law, art and poetry, and the wider human experience. The collaboration connects to ongoing work The Armouries are undertaking that relates to the colonial character of their collections, and to transform their digital offering for visitors. The project will work with this partner and other MHI stakeholders to ensure knowledge outcomes have wide applicability.

The project's objectives are to:

1) Scope the terrain of the context and application: map how AI has and could be used to enhance visitor experience; consider the colonial form and origin of underlying data within many museum collections; generate understandings of the actors, stakeholders, interests, and power relations that are relevant to the use of AI to communicate colonial museum collections.

2) Explore how responsible AI can be defined in the setting and application: how using underlying data from a museum's colonial collection in AI presents challenges and opportunities; explore how AI use might reproduce but also complicate colonial forms of knowledge within visitor experiences.

3) Engage with a wider community of MHIs and industry stakeholders to assess whether existing approaches to responsible AI can be used or developed for the particular challenges and opportunities of the context and application.

4) Work with these communities to develop and propose novel responsible AI tools and practices where necessary to assist MHI use of AI.

The project will yield a Toolkit, a report, and an academic journal article (detailed below). The research will benefit all MHIs who are considering utilising AI to communicate colonial collections and also yield knowledge outcomes relevant to the broader sector regarding how to navigate bias within collections and archives when utilising AI. The project will present concrete knowledge outcomes encouraging responsible development of AI tools in a museum setting, helping MHIs address the character and origin of collections and more effectively tell their many stories.
 
Title Speculative prototype museum responsible AI interface based on technical and conceptual principles. 
Description A prototype for an AI-driven visitor experience interface to showcase the technical parameters developed during the project. It is anticipated that this can provide the foundation for a further programme of research, grant capture, publication and impact. 
Type Of Art Artefact (including digital) 
Year Produced 2025 
Impact Novel prototyping for technical AI-driven interface for museums 
 
Description The project resulted in:
a) an approach to responsible AI set out in Colonial Collections and the Responsible Use of AI in Museums and Heritage Institutions: A toolkit and workbook (forthcoming); 2) the speculative development and demonstration of an example of a technical approach to RAI in the museum setting that is grounded in a resource-light and explainable technical AI architecture. We have developed this, in tandem with a human-centric approach to AI co-design, within an outline for future research.
Exploitation Route The aim of the project was develop guidance for museums and heritage sector organisations to enable them to navigate the responsible use of AI, particularly in the context of collections that are colonial in origin. This is anticipated to be the main way in which the outcomes will be utilised by others.
Sectors Culture

Heritage

Museums and Collections

 
Description It is too early to establish the full range of ways in which non academic audiences will have been impacted by the findings, however there are early indicators in this direction, for instance the project has been cited within an internal UNESCO report authored by Mathilde Pavis as an example of the development of best practice for responsible AI in heritage.
 
Description Marjory da Costa Abreu, M. 2024 Invited talk: "Ethical AI/Human-centred AI vs. Profit-driven AI: Our role as academics in maintaining sanity in the era of Big Tech world dominance", AI in Galleries, Libraries, Archives and Museums (GLAM), University of Sheffield. May 2024. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Third sector organisations
Results and Impact Talk about ethical AI for GLAM sector delegates including British Library and National Archives.
Year(s) Of Engagement Activity 2024
 
Description Richard Carter. 2024. Invited Keynote: "Extractive Pasts and Generative Futures - Reworking the Imaginaries, Ecologies, and Colonialities of AI and Heritage Collections". Artefacts XXIX/Congruence Engine Final Conference. Science Museum, London, October 2024. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Third sector organisations
Results and Impact Keynote given by Richard Carter to 100+ delegates from national and international museums about the project.
Year(s) Of Engagement Activity 2024
 
Description Richard Carter. 2025. Invited: "AI Imaginaries and Implications for Heritage Collections". AI Avatars for Visitor Engagement - Opportunities and Ethics Workshop. National Trust, Swindon, February 2025. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Talk for museum practitioners on responsible AI use
Year(s) Of Engagement Activity 2025
 
Description Sam Smith, 2025. Invited presentation: project toolkit, AIinCH (AI in Cultural Heritage) group meeting, May 2025. 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact Talk about project findings for members of the AI in cultural heritage group (heritage practitioners working with AI)
Year(s) Of Engagement Activity 2025
 
Description Workshop: Colonial Collections and the Responsible Use of AI in Museums and Heritage. Royal Armouries Museum Leeds, June 2024 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Third sector organisations
Results and Impact The aims of the workshop included bringing together different stakeholder groups, specifically museum professionals and those working in RAI. The aim of the workshop was to:
Workshop for practitioners from the museum and heritage sector. Aims:
a) undertake data gathering and knowledge exchange about the sector's use of AI and current levels of digital and AI literacy to understand what was needed to support the sector; b) to deliver a programme to support RAI literacy through targeted briefings by speakers, reflective discussions, and a speculative design exercise that synthesised RAI and decolonial concerns in the context of museum practices;
c) evaluate this programme as a basis for a RAI toolkit d) bring together the network established in through earlier consultative meetings with a view to fostering long term community, communication, and opportunities for partnership.

Speakers: Livi Adu (Independent/Museums Association, (author of the Museum Association's An ethical approach to AI guidance, and member of the MA's Code of Ethics working group), Mark Bennett (Royal Armouries Museum), Richard Carter (University of York), Tania Duarte (founder of We and AI/Better Images of AI), Amy Gaeta (Centre for the Future of Intelligence, University of Cambridge), Dawn Greenberg (BRAID/AHRC), Joanna Tidy (University of Sheffield).

• Sample feedback from participants at event workshop demonstrating an immediate impact on participant AI literacy: "I have learned so much more about AI and how to use it responsibly in the museum and heritage sector", "it was so fruitful and such a fabulous achievement - so many positive discussions".
Year(s) Of Engagement Activity 2024