EyCon (Visual AI and Early Conflict Photography)

Lead Research Organisation: Loughborough University
Department Name: Communication and Media

Abstract

As more and more museums and archives are making their image collections digitally available, new forms of knowledge and exploration of this growing mass of pictures from the past are needed. Computational techniques, which can process and help visualise tens of thousands of images, will be key to unlocking these digital archives in the future. One of the main achievements of the project is to create an innovative database on wartime photography that will include previously unpublished material. EyCon focuses on early conflict photography (1890-1918) documenting mass armed violence, from often overlooked colonial campaigns to the First World War. It is designed as a collection of thousands of original photographs and printed images: despite its scale, this collection will be made discoverable thanks to computational techniques. One of EyCon's tasks is to improve the recognition of objects in images that are very different from the photographs current models have trained on. EyCon will also provide and apply tools to identify similarities between photographs and printed images in contemporary prints in order to retrace the circulation of images. Various visualisations of the entire corpus will also be developed and tested to help users navigate a very large collection of images in a rewarding way.

The large-scale discovery of early wartime imagery raises a wide range of ethical and methodological issues that EyCon will directly address.

First, EyCon will develop solutions to overcome bias and inaccuracies when AI techniques are applied to a potentially contested visual heritage. Computational methods are not neutral. They may reproduce existing power structures or fail to unravel the unbalanced relationships of the past. EyCon will take great care in emphasising both the benefits and limitations of distant vision.

Second, wartime photographs can be very sensitive material, especifically in colonial and imperial contexts that are characterised by racial and gendered violence. Making these pictures available and discoverable in a sensible way that might open the way for a multiplicity of narratives and perspectives is central to the project.

Third, while EyCon will help restore the visibility of several conflicts in thousands of images, it also has to consider absent images, forms of violences and conflicts that were not recorded by cameras and that can be crushed under the weight of a large mass of digitised visual material.

The EyCon project will lead to the following research outputs:

_2 workshops organised in collaboration with Project Partners
_2 collections of essays (special issues of journals or edited volumes)
_1 demo website integrating all AI functionalities and a metasearch engine to explore data held on Huma-Num and partner institutions' servers. This website will be designed for both specialist and non-specialist end-users. It will be conceived as a user-friendly tool for everyone with or without technical expertise. It will allow us to offer increased discoverability and smart visualisations to users who want to explore the entire Eycon corpus.
_An open-source repository (Gitlab) that will make EyCon's scripts and other tools openly available to a broad community. This repository will be useful for data scientists and developers to reuse the scripts and data produced by the project. This will ensure that the project code is replicable and usable in other projects.

Archives are of course not reserved to academic researchers. The demo website will foster public engagement on the topic of early conflict photography and computational methods applied to the history of photography. Associated social media and a dedicated Eycon list-serv will help us connect with interested parties - in academia, archival institutions and beyond.

Publications

10 25 50
 
Description The EyCon project has already delivered one workshop (held at Quai Branly museum in Paris in June 2022). The UK PI/ postdoc are currently collaborating with Imperial War Museums to deliver EyCon Workshop 2 in London in June 2023.
We are also preparing two special issues of journals: all submissions have been received, and the special issues are forthcoming in 2023-2024.
We have worked closely with our French and UK project partners to collect data (56,000+ photos), and we have launched our database to make historical photographs more accessible with improved metadata and other functionalities.
Exploitation Route Our EyCon project events have brought together academics and GLAM sector professionals to discuss the issues of sensitive photographs closed to users. These events have led to further collaborations (including two grant applications to be submitted to the AHRC in Spring/ Summer 2023).
The Early Conflict Photography Database (1890-1918) that we have developed as part of the project offers increased discoverability to users who want to explore the entire Eycon corpus.
Sectors Culture, Heritage, Museums and Collections

URL https://eycon.sempiternelia.com/s/en/page/corpora
 
Description The EyCon team has worked closely with professionals in Libraries, Archives and Museums. Both EyCon workshops have been organised in cooperation with our project partners based in major cultural institutions (Quai Branly Museum in Paris hosted EyCon Workshop 1 in Paris in June 2022, and Imperial War Museums is hosting EyCon Workshop 2 in London in June 2023). We have also collaborated closely with GLAM sector project partners to collect 56,000+ photographs for the EyCon database. We have organised work groups (including at La Contemporaine in March 2023) to get feedback on our Early Conflict Photography Database. These engagement activities have led to improved discoverability for historical photographs, and to further plans for collaborations between academics and GLAM sector professionals.
First Year Of Impact 2022
Sector Culture, Heritage, Museums and Collections
Impact Types Cultural,Societal,Policy & public services

 
Description Unlocking our Digital Past with Artificial Intelligence (LUSTRE)
Amount £80,647 (GBP)
Funding ID AH/X003132/1 
Organisation Arts & Humanities Research Council (AHRC) 
Sector Public
Country United Kingdom
Start 08/2022 
End 07/2023
 
Title Early Conflict Photography Database (1890-1918) 
Description The EyCon team has worked closely with project partners to collect data necessary for the project: National Library of Scotland (2,000 photos), Archives Nationales d'Outre Mer (3,000 photos), La Contemporaine (50,000 photos, Valois collection), ECPAD (2,000 photos), thousands of pages of periodicals and magazines (Gallica, Archive.org), Service Historique de la Défense (Pétin collection), Imperial War Museums (1,000+ photos) 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? Yes  
Impact This collection of data led to the creation of a publicly available dataset, which features: enriched metadata, detection of similar images, and cropping of images contained in archival albums. 
URL https://eycon.sempiternelia.com/s/en/page/accueil
 
Description Collaboration with ANOM (Archives Nationale d'Outre-Mer) 
Organisation National Archives (France)
Country France 
Sector Public 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution _Participation in project events _Contribution to the EyCon database
Impact _Isabelle Dion (ANOM) presented a talk at EyCon Workshop 1 "Photosensitive" held in Paris in June 2022. _ANOM contributed 3,000 photos to the EyCon database.
Start Year 2022
 
Description Collaboration with Imperial War Museums 
Organisation Imperial War Museum
Country United Kingdom 
Sector Public 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution _Organisation and participation in project events _Contribution to the EyCon database
Impact _IWM is co-organising and hosting EyCon Workshop 2 on "Using Visual AI applied to Digital Archives" in June 2023. _IWM contributed 1,000+ photos to the EyCon database.
Start Year 2022
 
Description Collaboration with Musée du Quai Branly Jacques Chirac 
Organisation The musée du quai Branly - Jacques Chirac
Country France 
Sector Public 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution Organisation and participation in project events
Impact Co-organised and hosted EyCon Workshop 1 on sensitive photographs and their contemporary recirculations in June 2022.
Start Year 2022
 
Description Collaboration with National Library of Scotland 
Organisation National Library of Scotland
Country United Kingdom 
Sector Academic/University 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution Contribution to the EyCon database
Impact The National Library of Scotland contributed 2,000 photos to the EyCon database.
Start Year 2022
 
Description Collaboration with Wellcome Collection 
Organisation Wellcome Collection
Country United Kingdom 
Sector Academic/University 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution Participation in project events
Impact Harrison Pim (Wellcome Collection) presented a talk at EyCon Workshop 1 "Photosensitive" held in Paris in June 2022.
Start Year 2022
 
Description Partnership with LABEX (Laboratoire d'excellence Les passés dans le présent) 
Organisation Laboratory of Excellence Past in the Present
Country France 
Sector Academic/University 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution Expertise in History, Artificial Intelligence and Computer Science
Impact LABEX is the funder on the French side and offers various academic and non-academic opportunities of engaging with audiences in France and beyond.
Start Year 2022
 
Description Partnership with LARCA (Laboratoire de recherche sur les cultures anglophones) 
Organisation National Center for Scientific Research (Centre National de la Recherche Scientifique CNRS)
Country France 
Sector Academic/University 
PI Contribution Expertise in Digital Humanities
Collaborator Contribution Expertise in History, Artificial Intelligence and Computer Science
Impact Contribution to dataset; staff attendance, participation and organisation of workshops and academic events.
Start Year 2022
 
Description Article in The Conversation - "Photos of wartime Europe still shape views of conflict - here's how we're trying to right the record" 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Dr Katie Aske and Dr Lise Jaillant, wrote an article, "Photos of wartime Europe still shape views of conflict - here's how we're trying to right the record", published in The Conversation, 19 May 2022. It discusses the automatic response to images of conflict that is often biased or shaped by Europe. These questions are the focus of the EyCon project, which explores our westernised view of the world wars and how that is directly tied to the current inaccessibility of historical photographs and their contexts. To understand and correct this imbalance, EyCon is using artificial intelligence (AI) to improve our knowledge of often-overlooked war images from the early conflict era, from 1890 to 1918.
Year(s) Of Engagement Activity 2022
URL https://theconversation.com/photos-of-wartime-europe-still-shape-views-of-conflict-heres-how-were-tr...
 
Description Blog Post by Jonathan Dentler, EyCon team member and Postdoctoral research associate 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This blog post focuses on AI applied to historical photographs. It explains the project's goals, with a focus on the Valois collection at La Contemporaine. In particular, it considers how machine learning holds the potential for new contributions to existing scholarship on photography and emotion, as well as how the "Section photographique de l'armée" (SPA) attempted to shape the image of the war for domestic and international audiences.
Year(s) Of Engagement Activity 2022
URL https://eycon.hypotheses.org/1323
 
Description Blog Post by Elise Clerteau (ENS de Lyon) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This blog post reviewed the First EyCon Workshop "Photosensible" held at the Quai Branly museum in Paris in June 2022. It gives an overview of the presentations made by professional practitioners, industry experts and academics during this two-day workshop.
Year(s) Of Engagement Activity 2022
URL https://eycon.hypotheses.org/949
 
Description Blog Post by Soumik Mallick, EyCon team member and a research engineer at LARCA (CNRS, Université Paris-Cité) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The blog post highlights how the EyCon project is contributing to historical photograph analysis through machine learning, deep learning and computer vision. It discusses the project's development of novel methods for historical layout analysis and object detection, early-stage prototype, and in-house developed algorithm that is already proving successful in historical photograph analysis.
Year(s) Of Engagement Activity 2022
URL https://eycon.hypotheses.org/1020
 
Description EyCon Workshop 1 "Photosensible," Quai Branly Museum in Paris, June 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The EyCon project organised its first workshop in June 2022 Musée du Quai Branly Jacques Chirac on sensitive photographs, their histories, curation and recirculations. The event was divided between a workshop for professionals and a public conference. The conference was free for the public and had an interpreter for translating the English presentations into French for increasing accessibility for a diverse range of audience. The interactive event featured a series of presentations from professional practitioners and industry experts.
This event aimed at sharing perspectives on the historical and archival uses of violent imagery.
On Day 1, several specialists presented talks on the theme "photosensitive." Participants discussed issues of access to a selection of sensitive photographs, previously selected by GLAM professionals. On Day 2, public lectures focused on sensitive photographic-historical materials and on their exhibition and reception.
The workshop was an opportunity to further reflect on the 'photosensitive' central to the EyCon Project, and to lay down foundations for future collaborations between participating institutions.
Year(s) Of Engagement Activity 2022
URL https://eycon.hypotheses.org/949
 
Description EyCon Workshop 2 "Using Visual AI applied to Digital Archives" to be held at Imperial War Museums in London, June 2023 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This second EyCon workshop at the Imperial War Museums in London will include a range of sessions including short talks and practical sessions. These activities will allow close engagement with French and UK cultural institutions affected by the challenges of sensitive digitised archives. By bringing academics and project partners together, the workshop will stimulate the production of knowledge essential to address the huge challenges that specialists and non-specialists are facing when dealing with a very large amount of visual data.
Year(s) Of Engagement Activity 2023
 
Description Kick-off meeting at La Contemporaine with project partners, April 2022 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This kick-off meeting brought together project partners to discuss the creation of an ergonomic website which takes into account external references (databases) and which allows the visualization of vectors of similar images as well as new metadata created. Discussions were useful to modify metadata through the naming of conflicts. Key actions included: data collection, clipping images in albums, preparation of various interventions, events and writing of articles.
Year(s) Of Engagement Activity 2022
URL https://eycon.hypotheses.org/
 
Description Organisation of a session on "Big Cultural Heritage Data and Artificial Intelligence: the Challenge of Images," as part of the Summer School "Culture and Inclusive Heritage," Paris Nanterre University, July 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Julien Schuh, Daniel Foliard, Cyril Bruneau and Marina Giardinetti organised a session on "Big Cultural Heritage Data and Artificial Intelligence: the Challenge of Images", as part of the summer school "Culture and inclusive Heritage" organised by Ghislaine Glasson Deschaumes, EDUC-Labex PasP , Paris Nanterre University, in July 2022. This session promoted the EyCon project to an audience based in France and elsewhere.
Year(s) Of Engagement Activity 2022
 
Description Talk by Daniel Foliard and Julien Schuh, Workshop "Iconographic databases in the age of artificial intelligence: issues, state of play and perspectives," French National Library (BNF), December 2022. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Daniel Foliard (EyCon French Co-I) and Julien Schuh (EyCon French PI) gave a talk on "EyCon: Visual AI and Early Conflict Photography, using tools based on artificial intelligence and data modeling to analyze large corpora of old photography by limiting the 'Westernist' effects of manual indexing". This talk at the French National Library (BNF) promoted the project to an audience based in France and elsewhere.
Year(s) Of Engagement Activity 2022
URL https://www.bnf.fr/fr/agenda/les-bases-de-donnees-iconographiques-lheure-de-lintelligence-artificiel...
 
Description Talk by Jonathan Dentler, College Art Association Annual Conference, New York City, February 2023 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Jonathan Dentler (EyCon postdoctoral fellow) gave a presentation on "Computer Vision and the Trans-imperial Photographic Archive: The Early Conflict Photography and Visual AI (EyCon) Project." The talk promoted the project to an audience based in the United States and elsewhere.
Year(s) Of Engagement Activity 2023
URL https://www.collegeart.org/programs/conference
 
Description Talk by Julien Schuh, Ateliers du LaPIJ (Laboratory of journalistic practices and identities), Université Libre de Bruxelles, November 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Julien Schuh (EyCon French PI) presented a talk on "History of the Press, Old Photography and Artificial Intelligence" at the LaPIJ workshop. The LaPIJ workshops are intended to encourage exchanges between journalism researchers in order to respond to challenges in this field of study. The talk promoted the EyCon project to an audience based in Belgium and elsewhere.
Year(s) Of Engagement Activity 2022
URL https://lapij.ulb.ac.be/les-ateliers-du-lapij/
 
Description Talk by Julien Schuh, Daniel Foliard and Lise Jaillant, "AI and Cultural Heritage" event, Loughborough University, March 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This presentation promoted the EyCon project to an international audience. It was delivered as part of the IAS (Institute of Advanced Studies) Annual Theme "AI: Facts, Fictions, Futures" (co-led by Lise Jaillant). The virtual event in March 2022 brought together a range of academics to discuss AI & Cultural Heritage.

The role and impact of AI is not limited to the scientific area; it also has enormous significance for society and culture. In the course of this event, invited speakers considered applications of AI and digital technology in the GLAM (Galleries, Libraries, Archives, and Museums) sector, examining the collection, analysis, and dissemination of cultural heritage data, how this information might be experienced, and the ethical issues raised by these processes.
Year(s) Of Engagement Activity 2022
URL https://www.lboro.ac.uk/research/ias/events/2022/march/aiculturalheritage/
 
Description Talk by Julien Schuh, Daniel Foliard, Lise Jaillant, Marina Giardinetti and Soumik Mallick, Webinar "Artificial Intelligence in Archival Appraisal and Selection," Hub for AI Research in Archives, March 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This presentation was delivered as part of the Artificial Intelligence in Archival Appraisal and Selection Webinar organised by the Hub for Artificial Intelligence Research in Archives (HAIRA) in collaboration with the International Council on Archives (ICA). It focused on historical biases and the issue for Artificial Intelligence for archival appraisal/selection.
Year(s) Of Engagement Activity 2022
URL https://www.youtube.com/watch?v=VOAiLS3CQ_k&t=5s
 
Description Talk by Julien Schuh, Marina Giardinetti and Soumik Mallick, Conference "New Perspectives on Photography," Philipps-Universität, Marburg, July 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Julien Schuh, Marina Giardinetti and Soumik Mallick from the EyCon French team presented a talk entitled "EyCon: Computational Approaches to the Circulation of photographs in late 19th-/Early 20th-Century periodicals and beyond." The talk promoted the project to colleagues based in Germany and elsewhere.
Year(s) Of Engagement Activity 2022
URL https://arthist.net/archive/37122/lang=en_US
 
Description Talk by the EyCon team, SIFED (Symposium International Francophone sur l'Ecrit et le Document), Rennes, October 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The EyCon team presented a talk on "EyCon: Computational Approaches to the Circulation of photographs in late 19th-/Early 20th-Century periodicals and beyond." The talk promoted the project to an audience in France and beyond.
Year(s) Of Engagement Activity 2022
 
Description Working group with project partners at La Contemporaine, March 2023 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact During a one-day event (6 March 2023), the EyCon team met with selected project partners (La Contemporaine, ECPAD and Service Historique de la Défense) to get feedback on the EyCon Early Conflict Photography Database (1890-1918), leading to improvements in the way the database is structured and presented.
Year(s) Of Engagement Activity 2023