FuzzyPhoto

Lead Research Organisation: De Montfort University
Department Name: School of Media and Communication

Abstract

Study of photography as cultural history is relatively new and under-exploited discipline. It is important because the early history of photography coincides with significant global scientific, industrial, artistic, social, political and economic changes that inform understanding of the spread of scientific ideas, the relationship between science and art, the interplay between new technologies, popular culture and commerce, and the creation of personal and national identities. Access to photohistorical resources is essential for future cross-disciplinary research but these resources are often ephemeral, fragile, widely dispersed, poorly documented and difficult to access, although of enormous scope. Poor and inconsistent levels of documentation make it difficult to assess the significance of material beyond the relatively small nucleus of already well-known and heavily researched artists and scientists. However, image collections are increasingly being published online and search engines are becoming increasingly powerful, creating a timely opportunity to match photographs with other textual sources that can enrich our understanding without travel to numerous archives.
De Montfort University has created an extensive corpus of digital resources for researchers of 19th century photography comprising photographic exhibition catalogues and collections of letters. This includes two databases of the earliest known photographic exhibition catalogues: Photographs Exhibited in Britain 1839-1865 (PEIB) http://peib.dmu.ac.uk and Exhibitions of the Royal Photographic Society 1870-1915 (ERPS) http://erps.dmu.ac.uk.
These combined resources comprise the single most comprehensive record of British photographic exhibitions at this time. But these early exhibition catalogues were often devoid of pictures. A further problem is that amongst the visual arts, photography is unique - multiple versions of the same image can be produced and exhibited simultaneously at diverse locations. Photographs were commonly exhibited/published more than once, at different times, with different titles and even by different people, thus associating a specific exhibition catalogue reference with a specific image published elsewhere can be a complex and involved process.
This project will develop and test computer based "finding aids" that will be able to recommend potential matches between historical exhibition catalogue entries and images of photographs in online collections even where there is not a precise match. Incomplete data sets and imprecise information are common problems in arts and humanities research so the results of this research will be widely applicable across a wide range of subjects, allowing researchers to save considerable time and travel in the early stages of their research when identifying material most likely to be of interest to their studies and suggesting possible connections that would not otherwise be easily recognised using conventional research methods. The project outcomes will enable museums, libraries and archives to enhance the value and utility of their collections and of their online services through increased information, improved accuracy and functionality. Within the UK alone over 10,000 galleries, museums and archives could potentially benefit from this research. Within the private sector, beneficiaries will include commercial dealers and auction houses concerned with attribution and value. More accurate identification of artefacts such as photographs can help buyers and sellers and even help to prevent inadvertent export of nationally important treasures. The general public will benefit from improved accuracy and detail of information about objects in museums, libraries and archives, and lay communities of interest such as those carrying out genealogical or local history research will benefit in particular from increased access and awareness of information about historical photographs and related objects.

Planned Impact

In addition to academic researchers, teachers and students, direct beneficiaries of this research will include galleries, libraries, archives and museums with significant holdings of artefacts likely to have been previously exhibited or for which separate text records exist elsewhere. Collection holders will be able to enhance the value and utility of their collections and of their online services through increased information, improved accuracy and functionality. This is likely to include not only photographs but paintings, prints, sculpture, jewellery, furniture, fashion, costume, toys, textiles, scientific equipment, industrial products etc. In each of these contexts similar questions about attribution, manufacture, historical sequencing and development are likely to be pertinent and amenable to research using the proposed approach.There are about 2,500 museums in the UK. Of these 54 are designated National Museums. In addition to six UK National Libraries there are 979 Academic Libraries and 4,517 Public Libraries (2008-09 statistics) Out of a total estimate of 2,389, there are 122 nationally recognised archives, 654 local and 328 university, as well as 1,224 special and 61 business archives. Thus in total within the UK alone over 10,000 institutions could potentially benefit from this research.
Within the private sector beneficiaries will include commercial dealers and auction houses concerned with attribution and value. More accurate identification of artifacts such as photographs can help buyers and sellers and may even help to prevent inadvertent export of nationally important treasures.
The general public will benefit generally from improved accuracy and detail of information about objects in galleries, museums, libraries and archives and lay communities of interest such as those carrying out genealogical or local history research will benefit in particular from increased information about historical photographs and other objects available online. While the value of such benefits is hard to quantify, recent rapid growth in such activities is testament to their importance in a society characterized by high levels of mobility, multi ethnicity, breakdown of traditional family units and ties and social, economic and political isolation of disadvantaged minority groups.
Many of these benefits are potentially realizable on successful completion of this research because the results can be implemented by a significant number of leading heritage institutions who are partners in this proposal and "finder/recommender" tools produced by the project will be freely available as open source to the developer community. The inclusion of US and European partners will ensure that impact will extend beyond the the UK.
Academic staff working on the project will gain new skills in data analysis and development of computational finding aids. More importantly there will be significant transfer of these learning outcomes to the partner organizations in the heritage sector.
 
Description We have developed ways of matching messy incomplete and ambiguous records across different museums and archives that enable us to suggest similar items that visitors may also be interested in.
We have discovered what many individual photographic exhibits from the annual Exhibitions of the Royal Photographic Society 1870-1915 looked like for the first time in around 120 years and can begin to describe the visual character of some of the exhibitions.
We have uncovered some striking similarities between some records, even though they are demonstrably not the same objects.
Project blog: http://fuzzyphoto.edublogs.org
Project web site: http://fuzzyphoto.dmu.ac.uk
Exploitation Route Although developed to address a specific problem of finding pictures to match photographic exhibition records surviving from the late 19th century, the approach described here is potentially applicable to other contexts where it is necessary to find matches between equally incomplete and imprecise data held by various agencies in different data formats and to differing standards of consistency. These could be other types of cultural heritage records, for example looted art or people such as concentration camp victims, displaced persons, or contemporary contexts such as helping to identify and reunite refugees from areas of conflict or major natural disaster. Another potential application area is bioinformatics where there is a need to connect related entities, eg., drug X (also known as Y, and Z) (effects|upregulates|downregulates|drives|inhibits|represses|etc.) process A (also called B, C, D and is part of another process E,F,G) in certain cells.
We are working on a new research proposal that will build on the finding that the FuzzyPhoto matching algorithms are able to identify items that are intriguingly similar but not the same. This new project aims to create a "similarity engine" for supporting creative and serendipitous enquiry.
Sectors Communities and Social Services/Policy,Healthcare,Manufacturing, including Industrial Biotechology,Culture, Heritage, Museums and Collections,Pharmaceuticals and Medical Biotechnology,Security and Diplomacy

URL http://fuzzyphoto.dmu.ac.uk
 
Description The project end date is 31 October 2014 and a short extension was granted to allow a public lunch event to be held in conjunction with the Archives 2.0 conference at the National Media Museum. We have developed software widgets for the V&A, National Media Museum, Birmingham Library Musee d'Orsay and St Andrews University that allow visitors to those Web sites to see links to other similar items held elsewhere. Further funding has been obtained to find ways of commercialising the matching algorithms developed within the project.
First Year Of Impact 2013
Sector Culture, Heritage, Museums and Collections
Impact Types Cultural

 
Description Higher Education Innovation Fund
Amount £25,000 (GBP)
Organisation De Montfort University 
Sector Academic/University
Country United Kingdom
Start 11/2014 
End 04/2015
 
Title Lightweight Semantic Similarity metric 
Description Lightweight Semantic Similarity (LSS) is a novel Short Text Semantic Similarity (STSS) method to address the issues that arise with sparse text representation. The approach captures the semantic information contained when comparing text to process the similarity. The methodology combines semantic term similarities with a vector similarity method used within statistical analysis. A modification of the term vectors using synset similarity values addresses issues that are encountered with sparse text. LSS is comparable to current semantic similarity approaches, LSA and STASIS, whilst having a lower computational footprint. 
Type Of Material Improvements to research infrastructure 
Year Produced 2013 
Provided To Others? Yes  
Impact None yet. 
URL http://ieeexplore.ieee.org/xpl/abstractReferences.jsp?tp=&arnumber=6651309&isnumber=6651272&url=http...
 
Title Exhibitions of the Royal Photographic Society, 1870-1915 
Description This is a complete record of the annual exhibition catalogues of the Royal Photographic Society 1870-1915, stored as mySQL data files and high resolution images of the cataloge pages themselves, supplemented with images scanned from the contemporary journal 'Photograms of the Year'. The database sits behind a Web site that offers browsing of the catalogue data, images and page scans, simple quick searches by key word and advanced boolean based searching. 
Type Of Material Database/Collection of data 
Year Produced 2008 
Provided To Others? Yes  
Impact The site is very popular with researchers. However a frequent query is "where are the pictures", because only 3% of the exhibits are illustrated. this query prompted the successful FuzzyPhoto project which set out to find the missing images among museum collections, using computational search methods. FuzzyPhoto has not found around 50% of the missing images. 
URL http://erps.dmu.ac.uk
 
Title FuzzyPhoto links database 
Description A collection of matches between different museum, archive and library records where similarities have been identified, stored as hyperlinks to those matching records. 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Although the links database is not sgred directly with other groups, the contents of the database, ie. the links are embedded back into the participating institutional Web sites such that a researcher visiting for example the British Library site selects a record for which we have found similar objects elsewhere, then links to those objects are displayed on that page in situ. 
URL http://fuzzyphoto.dmu.ac.uk
 
Description FuzzyPhoto project 
Organisation Library of Birmingham
Country United Kingdom 
Sector Public 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation Louvre
Country France 
Sector Charity/Non Profit 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation Metropolitan Museum of Art
Country United States 
Sector Charity/Non Profit 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation National Media Museum
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation National Museums Scotland
Country United Kingdom 
Sector Public 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation Orsay Museum
Country France 
Sector Charity/Non Profit 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation The British Library
Country United Kingdom 
Sector Public 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation University of St Andrews
Department Library
Country United Kingdom 
Sector Academic/University 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description FuzzyPhoto project 
Organisation Victoria and Albert Museum
Country United Kingdom 
Sector Public 
PI Contribution The FuzzyPhoto project has identified matches and similarities between items held in the partners' collections and built an online recommender system to alert visitors to partners' web sites to the availability of similar items held in the other collections. The recommender system works at the level of individual object records, publishing hyperlinks to the similar items. The net result is a web of interconnections between different insitutions that guides visitors from one site to another, increasing the level of traffic overall.
Collaborator Contribution Partners have contributed access to their collection records, expert knowledge of their collections to help us select appropriate portions and to interpret their records, expert curatorial assessment of the interface designs we have produced, and technical expertise to install and test our code on their servers. The National Media Museum have also provided the project with a public launch venue at their site, coinciding with the Archives 2.0 conference that takes place there on 25 - 26 November. The value of the institutional records contributed is inestimable. These are internationally outstanding collections. The value of staff time contributed ranges from £2000 (National Media Museum), to $12,000 (Metropolitan Museum of Art), totalling around £16,000.
Impact Published conference papers. Journal papers. Exhibition at the National Media Museum.
Start Year 2012
 
Description Prince Albert research proposal 
Organisation Coventry University
Country United Kingdom 
Sector Academic/University 
PI Contribution Following an approach by the Royal Collection Trust I have written and submitted a research proposal to the AHRC to investigate the role of Prince Albert in the photographic world of the 1850s, building on the research tools and methods developed within the FuzzyPhoto project. Answers to this question are crucially needed to understand the role photography was playing in changing the public perception of the Royal family; the role that Royal patronage played in supporting technological changes within the medium during a time of rapid changes, in changing the perception of photography as an artistic medium and in creating a demand for photographic art; and enhancing the status of particular photographic artists; and Victoria and Albert's role in enhancing the status of the Photographic Society as the leading body for photography and consequential benefits for the medium in having a body able to promote photography through its journal, exhibitions and other activities.
Collaborator Contribution The Royal Collection Trust has provided Intimate knowledge of the Royal Collection and committed to at least three public exhibitions of the project outcomes, planned to coincide with the 2019 bi-centenaries of Queen Victoria and Prince Albert's birth. Proposed venues will include a major UK venue in 2019, as well as a royal venue in 2020. Two international venues are also under discussion: Coburg Castle, Germany and The Yale Center for British Art, USA. Coventry University have committed to undertaking data processing and analysis, building on the computational algorithms developed for the FuzzyPhoto project. Additionally a panel of experts have agreed to assist the project: Anne Lyden, International Photography Curator at the National Galleries of Scotland, Edinburgh; Dr Michael Pritchard, President of the Royal Photographic Society, Bath; Professor Roger Taylor, Emeritus Professor of Photographic History, De Montfort University; Dr Gil Pasternak, Senior Research Fellow Photographic History, De Montfort University; Dr Jennifer Tucker, Associate Professor of History and Science in Society, Weslyan University, USA; Dr Patrizia di Bello, Lecturer in History and Theory of Photography, Birkbeck, University of London, Dr Marta Weiss, Curator, Photographs, V&A.
Impact AHRC proposal 'Prince Albert's role in the photographic world of the 1850s' (FEC £552298) Proposal Scheme : Research Grants - Standard Proposal Call/Mode/Type : Research Grants (open call) Date and time of action: 07 Oct 2015 11:20.
Start Year 2015
 
Description Prince Albert research proposal 
Organisation The Royal Collection Trust
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Following an approach by the Royal Collection Trust I have written and submitted a research proposal to the AHRC to investigate the role of Prince Albert in the photographic world of the 1850s, building on the research tools and methods developed within the FuzzyPhoto project. Answers to this question are crucially needed to understand the role photography was playing in changing the public perception of the Royal family; the role that Royal patronage played in supporting technological changes within the medium during a time of rapid changes, in changing the perception of photography as an artistic medium and in creating a demand for photographic art; and enhancing the status of particular photographic artists; and Victoria and Albert's role in enhancing the status of the Photographic Society as the leading body for photography and consequential benefits for the medium in having a body able to promote photography through its journal, exhibitions and other activities.
Collaborator Contribution The Royal Collection Trust has provided Intimate knowledge of the Royal Collection and committed to at least three public exhibitions of the project outcomes, planned to coincide with the 2019 bi-centenaries of Queen Victoria and Prince Albert's birth. Proposed venues will include a major UK venue in 2019, as well as a royal venue in 2020. Two international venues are also under discussion: Coburg Castle, Germany and The Yale Center for British Art, USA. Coventry University have committed to undertaking data processing and analysis, building on the computational algorithms developed for the FuzzyPhoto project. Additionally a panel of experts have agreed to assist the project: Anne Lyden, International Photography Curator at the National Galleries of Scotland, Edinburgh; Dr Michael Pritchard, President of the Royal Photographic Society, Bath; Professor Roger Taylor, Emeritus Professor of Photographic History, De Montfort University; Dr Gil Pasternak, Senior Research Fellow Photographic History, De Montfort University; Dr Jennifer Tucker, Associate Professor of History and Science in Society, Weslyan University, USA; Dr Patrizia di Bello, Lecturer in History and Theory of Photography, Birkbeck, University of London, Dr Marta Weiss, Curator, Photographs, V&A.
Impact AHRC proposal 'Prince Albert's role in the photographic world of the 1850s' (FEC £552298) Proposal Scheme : Research Grants - Standard Proposal Call/Mode/Type : Research Grants (open call) Date and time of action: 07 Oct 2015 11:20.
Start Year 2015