Reflectance Transformation Imaging Systems for Ancient Documentary Artefacts

Lead Research Organisation: University of Southampton
Department Name: Faculty of Humanities

Abstract

This project will establish two Reflectance Transformation Imaging (RTI) systems for use in the recording, analysis and dissemination of ancient written artefacts and archaeological material. RTI uses images captured via digital cameras and high speed video to produce detailed models of surfaces. These can then be visualised in a way similar to interaction with the physical object. Different kinds of processing enable details to be highlighted.

The project will design systems incorporating all current best practice in the field. They will be piloted on a range of ancient written materials and on other archaeological materials, in order to develop systems and workflows suitable for rolling out across the cultural heritage sector. The project will also produce freely available blueprints and specifications for the systems, free software, and tutorial materials that will enable rapid takeup of the technology by experts and the interested public. The technology has significant industrial, commercial and public potential.

In the field of ancient document studies, the RTI systems will stimulate new research by enabling the capture of important collections that are often dispersed and difficult to access. These objects are often very hard to read and RTI will help with their interpretation. In addition, the ability to combine related documents from different collections and to link them to textual data will have a direct impact on research. Virtual access will limit the need for physical interaction with these frequently fragile, priceless objects.

In the broader field of archaeology RTI enables the detailed analysis of objects where surface texture is of particular importance, such as recording Roman brick stamps, measuring the deterioration of delicate textiles or wall paintings, and analysing lithics or bones.

The systems will be embedded in two established communities. First, the Oxford Centre for the Study of Ancient Documents. CSAD has proven its value across the broad field of ancient texts and written artefact studies. The focus of the CSAD's research on a wide range of ink-written, incised and inscribed texts addresses technical problems of digital imaging and signal-processing. The effectiveness of these has been demonstrated in a number of published studies, but work remains to be done on turning them into flexible instruments. The RTI systems will provide this flexibility across datasets and disciplines, drawing directly from CSAD's experience.

The second community is the Archaeological Computing Research Group at the University of Southampton. This group has for twenty years been at the forefront of archaeological computing teaching and research, with strong links across the academic, commercial, public and third sectors. One particular strength of the ACRG is in the capture and analysis of digital datasets from archaeological materials. This includes work developing and integrating RTI, laser scanning, and digital photogrammetry. The project members have recently submitted for publication a major study of archaeological applications of RTI in areas such as conservation, surface analysis, visualisation, public dissemination and archiving. The ACRG benefits from strong links with the School of Electronics and Computer Science at Southampton. Their involvement brings a long history in imaging approaches to cultural heritage materials, with a focus on art, and in the necessary cutting-edge electronic research core to this project. The success of these teams is further supported by the involvement of Tom Malzbender from Hewlett Packard Labs as an advisor, ensuring that the two systems are and remain at the forefront of research and value in this area.

The systems produced will be integrated into existing CSAD digital frameworks designed to improve access and analysis of the data studied. Partnership with the Archaeology Data Service will similarly safeguard the future of the archaeological data produced.

Planned Impact

The research staff employed on the project will gain a range of interdisciplinary skills, bringing them into contact with cutting edge science, ancient texts, and data integration tools. They will work with representative of the academic, public, private and third sectors.

Academics in the core field of ancient documentary artefacts, archaeology and engineering will benefit directly from this research through capture of new datasets, provision of new ways of analysis, and development of new digital processing technologies. Key stakeholders from representative institutions will be targeted for attendance at the project workshop. Research building from the creation of the RTI systems will be published. The software, hardware designs, and information to use them needed by other academics and any member of the general public to benefit directly from the technology will be freely and openly disseminated.

Academics with an interest in the surface properties of objects will benefit from this research. The RTI systems will be robust and high resolution, enabling potential applications from a wide range of specialists including materials scientists, engineers, computer graphics researchers, geologists and palaeontologists. Examples in the current RTI literature and from the PI's research prove both an interest from these groups and potential applications. Dissemination of the research across a wide academic portfolio of news and other channels will be supported by the project team and by their institutions. Together they have an excellent track record in expert dissemination.

Creative professionals will benefit from the RTI capture system. The PI has links to a number of art institutions which have expressed an interest in the technology as a representative device, and art/ archaeology collaborations are a feature of the PI's department. RTI offers a novel, engaging way of producing and interacting with works of art, as demonstrated by the Tate's Frank Auerbach - Variable Light online exhibition which used RTI. Similarly, management of art collections will benefit through the use of RTI in digital fingerprinting and imaging of artworks, and in conservation monitoring.

Museums will benefit from the project by access to the digitised contents of their collections. These will be freely accessible for new forms of display and interaction within galleries and online. Digitisation will also provide access to collections that are normally considered too fragile, valuable or otherwise difficult to display. The RTI format could enable digital repatriation of artefacts or facilitate physical repatriation. The project team have strong links with a number of museums many of whom have already expressed an interest in the technology.

Industry will benefit from a capture technology that is of potential use in materials science and also in sales. The RTI interactive approach could be of considerable benefit in enabling customers to interact with materials online. The PI and CI Martinez have existing industrial partnerships which will facilitate this project and the dissemination of its results.

The general public will benefit from access to materials normally reserved for experts, or indeed never made available. RTI means that this virtual access to materials will be through an intuitive interface which offers the chance for real personal scholarship. In the specifics of this research RTI will introduce the public to a variety of extremely important ancient written material that is under-represented in the public domain. Through access to the RTI capture and visualisation software produced by the project the public will be able to capture their own records of ancient and other materials.

Publications

10 25 50
 
Title Creative RTI collaborations with artists 
Description The RTI FoF project allowed us to significantly extend the reach of our RTI work. This included engagement with a range of cultural heritage and other partners, including a number of artists. In turn it stimulated the production of new artworks. Whilst the project itself did not directly create these works it (and the earlier RTISAD project) provided equipment, expertise and software that directly facilitated these artistic collaborations. 
Type Of Art Artwork 
Year Produced 2017 
Impact A range of "dirty RTI" artistic outcomes, particularly those by Ian Dawson and Louisa Minkin - the term itself was coined by a PhD student of the PI on RTISAD who developed novel RTI approaches, in part within the context of RTI FoF and RTISAD. 
URL https://www.southampton.ac.uk/amt/news/events/2017/01/pictures-not-homes-symposium.page
 
Description The project set out to develop novel imaging tools for ancient documents and artefacts, to disseminate knowledge about these technologies to a broad audience, and to establish hubs for imaging practice in Southampton and Oxford. The project achieved all of these goals, and developed a network of partners and case studies that far exceeded the plans for the project.

The project developed and trialled several Reflectance Transformation Imaging (RTI) systems - two domes, a miniaturised dome, microscope capture, highlight capture with multispectral capability, and a robotic gigapixel system. It explored underwater RTI capture techniques and high-speed interactive imaging in partnership with HP Labs. This led to further capture system design and on-going work to produce a turn-key RTI system suitable for non-specialists. The project examined all previous and current research areas surrounding RTI, led a number of these, and created a set of researchers and an infrastructure that continues to innovate and publish in the field. Software developments include annotation of RTI data, capture control systems and workflows for achieving other tasks such as contouring and metric RTI comparison. This is exemplified by the continuous requests for collaboration since the project was completed in May 2011.

Dissemination included data capture, collaboration and knowledge transfer activities with more than a dozen museums, many academic institutions, several commercial and non-profit partners such as Cultural Heritage Imaging, HP Labs, and public bodies such as National Archives of Scotland, English Heritage, the British School at Rome, the Serious Organised Crime Agency and the National Trust. In addition to local studies with bodies such as Southampton Museum Service and the Ashmolean the project has become involved in a series of high profile cultural heritage projects and sites including Catalhoyuk, Herculaneum, Pompeii, Portus and in diverse contexts, including rock art recording in Scotland and Libya. Much of this work was funded by the project solely in terms of staff and equipment, with all other costs gained through external sources. Collaborations continue, with recent examples being a knowledge transfer partnership between Traditional Owner Groups, University of Western Australia and University of Southampton funded by the World Universities Network, and an AHRC funding application to employ the RTI expertise and facilities funded by RTISAD to explore Neolithic art and artefacts.

The Oxford hub has led to new research activities focused on Roman and Greek epigraphy and a successful funding application to the Mellon foundation for further RTI recording and open publication of cuneiform documents. At Southampton the hub now includes four part-time data capture experts, many undergraduate, masters and PhD projects, and further innovation. An internal application has been submitted to explore commercial possibilities for this hub and there is a formal pricing structure in place that includes overheads for long term sustainability. Examples of this hub in action include recent consultancy projects at the National Archives, at the Fitzwilliam Museum. Above all the project has sedimented Southampton's position as a centre for imaging and metrology of cultural heritage artefacts., and Oxford's position as a centre for document imaging.
Exploitation Route The RTISAD project worked closely with experts in the third sector in order to ensure that the technologies developed were of benefit to museums and galleries. The project undertook public outreach activities, and outreach to schools which demonstrated interest in the use of the RTISAD technologies in cultural heritage. Community engagement has continued since the project completed with the project website providing access to details. The project also examined broader industrial potential for RTI, initially through discussions with engineering academics and more recently via an internal formal application for scoping commercial applications.
Sectors Digital/Communication/Information Technologies (including Software),Education,Electronics

URL http://acrg.soton.ac.uk/research/projects/rtisad/
 
Description Imaging of cultural artefacts Analysis of materials, including for conservation Education - free online, UG, postgraduate, school children
First Year Of Impact 2011
Sector Education,Culture, Heritage, Museums and Collections
Impact Types Cultural,Economic

 
Description Creating A Sustainable Cuneiform Digital Library
Amount £110,000 (GBP)
Funding ID Creating A Sustainable Cuneiform Digital Library 
Organisation Andrew W. Mellon Foundation 
Sector Private
Country United States
Start 06/2011 
End 06/2013
 
Description Creating A Sustainable Cuneiform Digital Library
Amount £110,000 (GBP)
Funding ID Creating A Sustainable Cuneiform Digital Library 
Organisation Andrew W. Mellon Foundation 
Sector Private
Country United States
Start 06/2011 
End 06/2013
 
Title RTI capture 
Description Created RTI data from the following collections: - Ashmolean Museum, cuneiform texts (c. 1000 objects) - Ashmolean Museum, Linear B tablets (c. 50 objects) - Ashmolean Museum, Aegean seals (c. 600 objects) - Ashmolean Museum, diverse objects (e.g., mummy masks etc.) - Manchester, John Rylands Library (c. 300 objects) - Louvre, cuneiform texts (c. 3000 objects) - Schøyen collection, Oslo (c. 2500 objects) - Philadelphia, University of Pennsylvania Museum (c. 600 objects) 
Type Of Material Database/Collection of data 
Year Produced 2014 
Provided To Others? Yes  
Impact C. 10 tb of data produced for CDLI. Very large numbers of tablets are now accessible online. 
URL http://cdli.ucla.edu/
 
Description British Museum 
Organisation British Museum
Country United Kingdom 
Sector Public 
PI Contribution Collaboration with British Museum in the area of archaeological object imaging - wide range of imaging projects have come about as a result of the initial RTISAD funding
Start Year 2010
 
Title New dome designs 
Description RTISAD and RTI FoF together stimulated new imaging equipment development that has continued beyond the lifetime of the grants and been supported by additional innovation. Most recently these activities formed the focus of a pitch for commercial investment, display at the Consumer Electronics Show and subsequent imaging dome refinement and deployment for institutions such as Yale, the University of York and the Louvre. 
Type Of Technology Systems, Materials & Instrumental Engineering 
Year Produced 2016 
Impact Requests to continue development and commissions for new equipment, including for a new project run by Jacob Dahl (Oxford, Co-I on the two RTI grants) 
 
Title Refinement of viewer 
Description The viewer was further enhanced and has now been trialled in a number of new applications. The viewer is also being used to inform related software efforts to create a version with more storytelling components, providing additional functionality. 
Type Of Technology Webtool/Application 
Year Produced 2017 
Impact There has been a proliferation of web-based RTI viewers and our work on this viewer is cited with respect to this. 
 
Description BBC World Service interview 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Graeme Earl was interviewed by the BBC World Service as part of a piece on the new Southampton Supercomputer Iridis3. He spoke about the potential of RTI for the capture and visualisation of archaeological data.
Year(s) Of Engagement Activity 2012
 
Description British Library Growing Knowledge Exhibition 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience
Results and Impact The RTISAD project featured as part of the growing knowledge exhibition at the British Library in Spring 2011.
Year(s) Of Engagement Activity 2010
 
Description Earliest Writing - media coverage 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience
Results and Impact An article covering the Mellon project that directly built on RTISAD was one of the biggest stories in the last few years in the press office at the University of Oxford. There were more than one million hits on day one on the BBC site. They had to close comments. It was translated to BBC in Brazil, and has been picked up by numerous foreign online news outlets (incl Huffington post). The Spanish newspaper El Mundo carried the story. The story is also being written up for Current Biology. Jacob Dahl did several radio interviews in the first 2 weeks (incl BBC 4 material worlds and Australian and Canadian radio). There is a possibility of a follow-up documentary.
Year(s) Of Engagement Activity 2012
 
Description Festival of British Archaeology 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? Yes
Primary Audience
Results and Impact Also in July but on the other side of the world members of the ACRG took part in the Festival of British Archaeology, and included RTI demos in this.
Year(s) Of Engagement Activity 2012
 
Description Gifted and Talented pupils learn RTI 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Primary Audience
Results and Impact Gareth and Nicole Beale delivered a workshop to Gifted and Talented pupils from schools across Southampton as part of the Learn with US programme. They introduced computational photography (including RTI) and how it is used by archaeologists. Year 9 pupils created RTIs and saw how they could use the results to investigate archaeological objects. http://www.southampton.ac.uk/schoolsandcolleges/
Year(s) Of Engagement Activity 2012