Finding a place: advancing digital methods to unlock the use of digitized book illustrations in cultural institutions
Lead Research Organisation:
CARDIFF UNIVERSITY
Department Name: Sch of English Communication and Philos
Abstract
Hidden between the covers of old books lies a remarkable visual record of the world and its inhabitants. Book illustrations span centuries and represent everywhere from Wales to Wyoming. Illustrations tell stories about the ideas and beliefs of those who created and read them across time and space. They are also material objects, which circulated around the globe and contributed to transnational world views, both shared and contested. These images give new meanings to natural and built environments and foreground complex intersections between people and place in their depiction of the local and foreign, the traveller, the indigenous, colonized, and displaced. Illustrations are especially significant for cultural institutions, which are often heavily invested in locations and communities. A notion of place is intricately interwoven in the contextualization of collections and the ways in which institutions define themselves and are experienced and engaged with.
Yet historical book illustrations are rarely used or analyzed in cultural institutions, even though digitized collections of illustrations exist in libraries and are accessible online. Several factors underlie this neglect: there is a limited awareness of the importance of illustrations, especially as many have been out of sight for so long and viewed as secondary to unique artistic objects; and the sheer scale and variety of digitized illustrations makes it challenging to find relevant images and to analyze them alongside each other. To put it simply, it is difficult to identify what illustrations are 'out there' and what can be done with them even if they are found. Prior to the digitization of illustrated books, the theorist, Gérard Genette, decided against research into illustrations because the field was an 'immense continent'.
It is this 'immense continent' that the project seeks to explore by bringing together scholars in illustration, museum studies, and computer science in UK and US cultural institutions with different requirements, audiences, and collections: Special Collections and Archives, Cardiff University, the American Heritage Center, University of Wyoming, Buffalo Bill Center of the West, Lambeth Palace Library, and the National Trust. A collaborative model informs our practice, with the research questions posed by curators moulding the development of digital methods that will reveal a forgotten world of images and uncover marginalized histories. Computational tools (e.g. crowdsourced tags, caption capture, geoparsing) will be used to identify a significant subset of book illustrations of places and people from a core digitized collection of illustrated books from the British Library, thus enriching its searchability and relevance. In response to the research questions of the cultural institutions, these illustrations will then be placed in dialogue with each other and with other images and objects in collections, challenging conventional categorizations and enabling hidden histories to be revealed. Computer vision, which has rarely been used in this context, will allow us to interrogate iconographic similarities and divergences, effectively charting the construction, transformation, and subversion of visual 'stereotypes' (a term that is itself bound up in the printing of illustrations). We will for the first time be able to identify changes in illustrations of buildings or landscapes, or trace affinities and differences across representations of people, a comparative analysis that is impossible in the material form of the book.
The histories uncovered on this project are significant in themselves and in the digital methods used to reveal them. Our objective is to create an environment and infrastructural legacy that will generate a deeper knowledge of the requirements and possibilities of digital methods for understanding illustrations, and to find a place for these images within cultural institutions.
Yet historical book illustrations are rarely used or analyzed in cultural institutions, even though digitized collections of illustrations exist in libraries and are accessible online. Several factors underlie this neglect: there is a limited awareness of the importance of illustrations, especially as many have been out of sight for so long and viewed as secondary to unique artistic objects; and the sheer scale and variety of digitized illustrations makes it challenging to find relevant images and to analyze them alongside each other. To put it simply, it is difficult to identify what illustrations are 'out there' and what can be done with them even if they are found. Prior to the digitization of illustrated books, the theorist, Gérard Genette, decided against research into illustrations because the field was an 'immense continent'.
It is this 'immense continent' that the project seeks to explore by bringing together scholars in illustration, museum studies, and computer science in UK and US cultural institutions with different requirements, audiences, and collections: Special Collections and Archives, Cardiff University, the American Heritage Center, University of Wyoming, Buffalo Bill Center of the West, Lambeth Palace Library, and the National Trust. A collaborative model informs our practice, with the research questions posed by curators moulding the development of digital methods that will reveal a forgotten world of images and uncover marginalized histories. Computational tools (e.g. crowdsourced tags, caption capture, geoparsing) will be used to identify a significant subset of book illustrations of places and people from a core digitized collection of illustrated books from the British Library, thus enriching its searchability and relevance. In response to the research questions of the cultural institutions, these illustrations will then be placed in dialogue with each other and with other images and objects in collections, challenging conventional categorizations and enabling hidden histories to be revealed. Computer vision, which has rarely been used in this context, will allow us to interrogate iconographic similarities and divergences, effectively charting the construction, transformation, and subversion of visual 'stereotypes' (a term that is itself bound up in the printing of illustrations). We will for the first time be able to identify changes in illustrations of buildings or landscapes, or trace affinities and differences across representations of people, a comparative analysis that is impossible in the material form of the book.
The histories uncovered on this project are significant in themselves and in the digital methods used to reveal them. Our objective is to create an environment and infrastructural legacy that will generate a deeper knowledge of the requirements and possibilities of digital methods for understanding illustrations, and to find a place for these images within cultural institutions.
Organisations
- CARDIFF UNIVERSITY (Lead Research Organisation)
- Lambeth Palace Library (Collaboration)
- Cardiff University (Collaboration)
- NATIONAL TRUST (Collaboration)
- Buffalo Bill Centre of the West (Collaboration)
- Special Collections - Library (Collaboration)
- University of Wyoming (Collaboration)
- National Trust (Project Partner)
- Buffalo Bill Center of the West (Project Partner)
Publications
Thomas, J
(2024)
Capturing Captions: Using AI to Identify and Analyse Image Captions in a Large Dataset of Historical Book Illustrations
in Digital Humanities Quarterly
| Title | Building on Cathedrals Exhibition |
| Description | An exhibition (physical and digital) that showcased our work on the project in Lambeth Palace library |
| Type Of Art | Artistic/Creative Exhibition |
| Year Produced | 2024 |
| Impact | Showcased project findings and described impact of this project on Lambeth Palace library |
| URL | http://building-on-cathedrals.shorthandstories.com/lambeth-palace-library/index.html |
| Description | We have developed software tools that will enable cultural institutions to find relevant images in large datasets of historical images. These have been trialled and used with our partners. The tools have been made available on Github via the project website: findingaplace.org.uk. We also ran a major exhibition (digital and physical) with one of our partners that is also available via the website. |
| Exploitation Route | The tools are readily available for other institutions to use on their own datasets. They have also been incorporated into the search functions of the AHRC-funded Illustration Archive, thus making that dataset (the largest of its type in the world) more searchable for users. |
| Sectors | Culture Heritage Museums and Collections |
| URL | https://findingaplace.org.uk/ |
| Description | The tools developed on this project have been used by our partner cultural institutions to find relevant images in large digitised datasets. This project led to a study day with cultural heritage professionals (2024), which made them aware of these tools for future use. We also curated a physical and digital exhibition with a partner institution (https://building-on-cathedrals.shorthandstories.com/lambeth-palace-library/index.html), which showcases the impact of this work. |
| First Year Of Impact | 2024 |
| Sector | Culture, Heritage, Museums and Collections |
| Impact Types | Cultural |
| Title | Caption capture |
| Description | Uses AI tools to search the captions of images in digitised datasets |
| Type Of Material | Improvements to research infrastructure |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | Used by our partner institutions to search their own collections and create exhibitions |
| URL | http://github.com/irene-crepax/FindingAPlace |
| Title | CLIP model |
| Description | Model for using CLIP on large datasets of historical book illustrations |
| Type Of Material | Data analysis technique |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | Used by cultural institutions to find relevant images |
| URL | https://drive.google.com/file/d/1AT0u5xXhc4kfXzfPCzde_pG4KKtL28eH/view?usp=drive_link |
| Title | Caption capture model |
| Description | Tools for identifying and searching captions in datasets of historical images |
| Type Of Material | Data analysis technique |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | Used by cultural partners to find relevant images |
| URL | https://github.com/irene-crepax/FindingAPlace |
| Title | Integration of caption capture and CLIP tools into the Illustration Archive |
| Description | We integrated the tools developed on this project in the world's largest digital archive dedicated to historical book illustration: The Illustration Archive, thus enhancing its search functionality |
| Type Of Material | Data analysis technique |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | Increase in search functionality, which makes it easier to find relevant images. Because of these tools, we were able to find relevant images for our cultural partners |
| URL | http://illustrationarchive.cf.ac.uk |
| Description | American Heritage Center, Wyoming |
| Organisation | University of Wyoming |
| Department | American Heritage Center |
| Country | United States |
| Sector | Academic/University |
| PI Contribution | Working with AHC collections to develop our digital methods |
| Collaborator Contribution | Working with AHC collections to develop our digital methods |
| Impact | Project underway |
| Start Year | 2022 |
| Description | Buffalo Bill Center of the West |
| Organisation | Buffalo Bill Centre of the West |
| Country | United States |
| Sector | Charity/Non Profit |
| PI Contribution | Working with collections to develop digital methods |
| Collaborator Contribution | Working with collections to develop digital methods |
| Impact | Working with collections to develop digital methods |
| Start Year | 2022 |
| Description | Collaboration with ARCCA |
| Organisation | Cardiff University |
| Department | Advanced Research Computing @ Cardiff (ARCCA) |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | In the Lost Visions project, we are adding a humanities big dataset to the largely scientific projects associated with ARCCA |
| Collaborator Contribution | They have provided advice on the hosting of webservices, data storage techniques, data processing code development and selection of software packages. They also provide storage and infrastructure for the big dataset of images and the HPC resources for the processing of these. |
| Impact | The storage and infrasatructure provided by ARCCA makes it possible to work on this large datasaet of over a million illustrations |
| Start Year | 2014 |
| Description | Lambeth Palace Library |
| Organisation | Lambeth Palace Library |
| Country | United Kingdom |
| Sector | Charity/Non Profit |
| PI Contribution | Working with a curator at LPL to identify collections and curate an exhibition |
| Collaborator Contribution | Working with a curator at LPL to identify collections and curate an exhibition |
| Impact | Project is ongoing |
| Start Year | 2022 |
| Description | National Trust |
| Organisation | National Trust |
| Country | United Kingdom |
| Sector | Charity/Non Profit |
| PI Contribution | Working with collections to construct our digital methods |
| Collaborator Contribution | Working with collections to construct our digital methods |
| Impact | Project is underway |
| Start Year | 2022 |
| Description | Special Collections and Archives, Cardiff University |
| Organisation | Special Collections - Library |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Special Collections in Cardiff University is the digital hub for the project. The RA is based there |
| Collaborator Contribution | Expertise and access to collections |
| Impact | Project is still ongoing |
| Start Year | 2022 |
| Title | Caption capture tool |
| Description | Tool for capturing the captions in datasets of historical book illustrations |
| Type Of Technology | Software |
| Year Produced | 2024 |
| Impact | Currently being used by project partners prior to general release on github |
| Description | AI in Cultural Heritage workshop |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Third sector organisations |
| Results and Impact | A presentation of the project and AI tools to cultural heritage professionals in which they also discussed their own experiences of AI |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.lambethpalacelibrary.info/event/ai-in-cultural-heritage-a-series-of-talks/ |
| Description | Being Human Festival |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | Local |
| Primary Audience | Public/other audiences |
| Results and Impact | A demonstration of tools as part of the being Human Festival |
| Year(s) Of Engagement Activity | 2024 |
| Description | Creation of a short film, released on YouTube |
| Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | Film has been used to publicise the project: in conferences and social media. It has resulted in the team being contacted by interested parties |
| Year(s) Of Engagement Activity | 2023 |
| URL | https://findingaplace.org.uk/?page_id=12 |