High definition X-ray microtomography and advanced visualisation techniques for information recovery from unopenable historical documents

Lead Research Organisation: Queen Mary University of London
Department Name: Sch of Medicine & Dentistry

Abstract

Several years ago, an exciting demonstration showed how text from a rolled papyrus sample could be read non-invasively, i.e., without unrolling it. This was performed using X-ray microtomography (XMT or micro-CT) with advanced visualisation and modelling techniques and held the promise to historians and archivists of gleaning information from hitherto inaccessible texts in delicate and damaged documents. But although it caused quite a stir at the time, against the harsh realities of X-ray photon statistics and the characteristics of real materials, that promise failed to deliver and today the promise has receded. The stumbling block, hindering progression beyond proof of concept, is the conceptually simple step of increasing the XMT scanner performance (particularly contrast ratio) beyond the reach of commercial or even research XMT systems. What is conceptually a small step actually requires a technological leap in imaging methodology, involving entirely new modalities in data acquisition, reconstruction and processing. With a unique track record in this specialist area of development, we have the capability of delivering the necessary imaging hardware and analysis software to revive this exciting application and make the dream of 'reading the unreadable' a reality.Just as the term high definition in television refers to the screen dimension in terms of pixel numbers rather than physical size, so in XMT we use this term to describe the imaged volume dimensions in voxels, irrespective of resolution. The problem is that as the definition increases, so the detector elements must become smaller and the contrast ratio in the projections must increase. The combination of these two requirements gives a fourth order relationship between definition and required X-ray exposure. Furthermore, increasing the definition increases the susceptibility to systematic errors that give rise to ring and other image artefacts, creating problems even for synchrotron XMT systems (limiting attainable contrast resolution even with ring artefact reduction techniques). The QMUL group is already leading the way with high definition XMT scanners which are currently the only ones to employ moving time-delay integration cameras for ring artefact elimination and field size extension. We thus already have the ability to resolve ink in historical parchment samples much larger than the test samples previously demonstrated.The Cardiff group have been analysing and imaging historical artefacts in conjunction with the major archives in the UK; building excellent collaborations /and trust- between fundamental scientists and experts in conservation and curation. Their research has focussed on the degradation of parchment, which leads to fragility and ultimately to the need for virtual unrolling with the proposed facility. The Cardiff team is already working with experts in high performance computing on code parallelisation for X-ray diffraction analysis. They will develop a suite of 3D image processing tools that can be used to extract information from a wide variety of document types with varying degrees of damage and deformation. This will cover anisotropic noise filtering to aid identification of the ink containing layer of the medium, surface identification, volume rendering (visualisation of the parchment surface and mapping to two dimensions) and 2D image processing to improve text clarity. As this software is being developed, the QMUL group will develop an advanced equiangular TDI XMT scanner with extended field size and ultra-high contrast resolution, capable of imaging whole documents. The archivists will work with us to identify historical documents amenable to this scanning method and at the culmination of this project, all the groups will work closely together to produce the first real world results. This will be a milestone in historical information recovery that will foster interest throughout the world.

Publications

10 25 50
 
Description The aim of this project was to be able to read historical scrolls that are too damaged to physically unroll. To date, March 2013, the most successful scan has been of a small rolled piece of parchment from the Norfolk Records Office. This was tightly wound and could not have been opened easily without causing damage. The scroll was successfully scanned and the iron in the ink was detected. The volumetric data was then successfully virtually unrolled at Cardiff University to produce text that could easily be read by a palaeographer. It appeared to be an old property related legal document. Following rehydration, the scroll was physically unrolled by a conservator, confirming the written test. This success has resulted in confidence in the project and we are now looking to get a larger scroll which is truly beyond conventional means of unrolling.



The new X-ray microtomography scanner was designed to employ equiangular time-delay integration (TDI) readout as a means of obtaining the most accurate scans possible using a laboratory X-ray source. This has proved to be much more difficult than anticipated because of the need to precisely control the orbital motion of the specimen about the source, which must be in exact synchronisation with the camera readout. Reconsideration of the fibre-optic faceplate shape has shown that no perfect surface can be defined that will allow for theoretically blur-free equiangular TDI images to be captured with a planar detector. However, an optimal shape has been calculated, where the blurring associated with conversion from equiangular to equidistant spacing is small in comparison with the blurring from light and X-ray scatter within the scintillator. Equiangular TDI images are free from the effects of detector array and X-ray field inhomogeneity in the horizontal direction.

In terms of determining possible damage to parchment when exposed to the X-ray dose required for high definition microtomography scanning, the following has been done:

We have used multiple techniques to assess if there is any evidence of change in parchment structure during scanning by XMT. Modern and historic parchment samples were exposed to X-rays using the high contrast XMT equipment.



Attenuated Total Reflection Fourier Transform Infra-red Analysis (ATR-FTIR FTIR spectra for the parchment samples showed little evidence for systematic changes with radiation, principal component analysis was used to see if small changes in signal differences between samples could be revealed. This showed that the variation between the samples was greater than any changes induced by the exposure to X-rays.



Biochemical analysis, SDS-polyacrylamide gel electrophoresis (SDS-PAGE) Results indicated that we could not detect any visual change in the separation of the peptides between control and irradiated samples.



Near-infrared Spectroscopy (NIR) Principal components analysis of the NIR spectra of modern parchment samples showed little in terms of differences between control samples and irradiation time.



X-ray diffraction (XRD) A visual inspection of the intensity distribution could not identify any systematic changes to the collagen diffraction signal or diffuse scatter contribution between the irradiated and corresponding control samples. Principle component analysis was used to examine if there were differences between samples; however, there is no systematic detectable change as a function of irradiation.



Our overall impression from the techniques used shows that we cannot detect a systematic change to the collagen chemistry or structure that is an effect of the simulations of XMT radiation we are using to read documents.
Exploitation Route The scanner itself has application is a wide variety of disciplines and is particularly useful where 3D information is to be recovered from objects with low X-ray contrast, such as fossils or historical artefacts. The use of linear time-delay integration in microtomography is already licensed by Queen Mary University of London to Nikon Metrology. We will seek to extend this to cover equiangular time-delay integration.
Sectors Communities and Social Services/Policy,Healthcare,Culture, Heritage, Museums and Collections,Pharmaceuticals and Medical Biotechnology

URL http://www.apocalypto.org.uk
 
Description We were able to read text from an early 15th century rolled parchment that was stuck together and could not be read by conventional means. This demonstrated to the cultural heritage community that we may be able to retrieve information from such damaged documents. We have since demonstrated the ability to recover images from damaged film and worked with the BBC to recover images from a badly decayed copy of The Morcambe and Wise show. This work was broadcast on BBC television ("Click") and published in the BBC R&D blog as well as BBC online news. Recent work by the team at Cardiff has allowed text to be revealed in a burnt scroll, as published in Scientific Reports. We were invited to join the Signed Sealed and Undelivered collaboration using techniques developed with this project to image the structure and content of sealed 17th Century letters held in the Postal Museum in The Hague.
First Year Of Impact 2014
Sector Healthcare,Culture, Heritage, Museums and Collections
Impact Types Cultural

 
Description Heritage Science subcommittee of the Royal Society of Chemistry
Geographic Reach National 
Policy Influence Type Participation in a guidance/advisory committee
Impact This subcommittee is in the process of arranging a parliamentary day to inform government of advances in cultural heritage science and to present the need for funding in this area. Target Audience: Government Department
 
Description Brienne Letters, signed, sealed and undelivered. 
Organisation Massachusetts Institute of Technology
Country United States 
Sector Academic/University 
PI Contribution The Brienne letters are a collection of 2600 "locked" letters sent from all over Europe, none of which were ever delivered. We have made an initial scan of a mock-up stack of letters and demonstrated that we are able to read the ink.
Collaborator Contribution The Signed, Sealed, & Undelivered Team have the letters and will bring them to us for scanning for which payment will be made.
Impact In progress.
Start Year 2014
 
Description Norfolk Records Office 
Organisation Norfolk Record Office
Country United Kingdom 
Sector Public 
PI Contribution The Norfolk Records office supplied us with a small "scroll", that is, a tightly wound piece of stiff parchment. This was too stiff to unwind without causing damage. We were able to scan this with the microtomography system and the scroll was then flattened using the software developed with the Cardiff University project partners to produce a readable image of the text. They later provided us with the Bressingham Roll which was the subject of a presentation on the BBC's The One Show.
Collaborator Contribution They were enthusiastic about our project; we were able to describe the capabilities of our system so that they could search their archive for appropriate material. This facilitated the demonstration of the successful virtual unrolling of an ancient document.
Impact BBC The One Show.
Start Year 2011
 
Description Recovery of black and white film with BBC 
Organisation British Broadcasting Corporation (BBC)
Country United Kingdom 
Sector Public 
PI Contribution The BBC has a film reel that is the only existing copy of a popular TV series from the 1960s. This film suffers from advanced vinegar syndrome and is well past the stage where it can be unreeled. We have been approached to scan it and recover images from it. At QMUL, we have cut the film into blocks and are scanning each block to recover film images.
Collaborator Contribution The BBC have provided the film and have paid an initial sum of £4000 for scanning. Their main contribution to the project will be publicity.
Impact In progress
Start Year 2014
 
Title MuCAT 3 equiangular TDI microtomography scanner 
Description As one of the objectives of the project, we developed a highly sensitive X-ray microtomography (XMT or micro-CT) scanner. This provides more accurate 3D mapping of the X-ray linear attenuation coefficient of a specimen, helping us to accurately identify ink in parchments. It has also been applied to dental research. 
Type Of Technology New/Improved Technique/Technology 
Year Produced 2013 
Impact In dentistry, we are obtaining a wealth of information revealed in subtle differences in local mineralisation levels in teeth. This information could not be obtained from commercially available scanners and is providing a means to study how teeth respond to assaults in the oral environment. It will also enable us to continue our research into revealing history from damaged scrolls. 
 
Description ARA Conference, Dublin 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact David Mills presented the work of the Apocalypto team on the Bressingham Roll and other objects.
Year(s) Of Engagement Activity 2015
URL http://www.archives.org.uk/ara-in-action/the-ara-conference.html
 
Description BBC "Click" presentation on television. 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact This presentation covered the recovery of images from a very damaged film copy of The Morecambe and Wise show. The film was laser-cut and scanned with X-ray Microtomography in order to recover the images. This is available on BBC iPlayer for 11 months (link below).
Year(s) Of Engagement Activity 2018
URL https://www.bbc.co.uk/iplayer/episode/b09scjrh/click-let-there-be-light
 
Description BBC History Magazine 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The article was entitled "17th-century tales of love, loss and delinquent husbands". This describes collaborative work with Yale University, Massachusetts Institute of Technology and the universities of Leiden, Groningen and Oxford. The 17th century letters in question were found in a trunk, having been undelivered and unopened. Breaking the seals on these letters would cause irreperable damage and we are using the system described in this grant to read the text without opening them.
Year(s) Of Engagement Activity 2015
URL http://brienne.org/
 
Description BBC Radio 5 Naked Science Podcast 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Using X rays to read the unreadable;

Following this, we received more requests for information and noted more hits on the project web site.
Year(s) Of Engagement Activity 2013
URL http://downloads.bbc.co.uk/podcasts/fivelive/drkarl/drkarl_20130520-1514a.mp3
 
Description BBC The One Show 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Following the EPSRC press release, the BBC extensively researched our project and filmed on-site here with our Cardiff team members and conservators from the Norfolk Records Office. We demonstrated how an early fifteenth century scroll could be read, even though it was stuck together and could not be unrolled.

Feedback from members of the public was very positive. There was particular interest in using advances in science to uncover secrets from the past. Following this, we had a request from the BBC to see if we could recover damaged film material.
Year(s) Of Engagement Activity 2014
URL https://www.youtube.com/watch?v=FXkQz9fOafU
 
Description BBC research and development blog 
Form Of Engagement Activity A magazine, newsletter or online publication
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This was a piece about our recovery of images from a damaged film copy of The Morecambe and Wise show. Images were recovered by X-ray microtomography without unreeling the film (which was impossible). Within a few days, the BBC told us that there had been over 32,000 views and in excess of 100,000 tweets about the post.
Year(s) Of Engagement Activity 2017
URL https://www.bbc.co.uk/rd/blog/2017-12-morecambe-wise-video-film-archive-restoration
 
Description Diamond Light Source Heritage Day 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Apocalypto, Reading the unreadable. David Mills presented an overview of the project and the successes to date. Tim Wess gave a presentation entitled "Beyond the written word, information from Historic parchment and bone" talking about how synchrotron X-ray diffraction studies, amongst other techniques, have been used to quantify the degree of degradation of parchment. No degradation was seen resulting from X-ray exposure.

Following this, we were contacted by the Textile Conservation Centre at the University of Leeds.
Year(s) Of Engagement Activity 2013
 
Description Dorkbot London 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact David Mills presented some of the work from the Apocalypto team as well as general results and images from the CT facility at QMUL
Year(s) Of Engagement Activity 2015
 
Description Gordon Research Conference on Scientific Methods in Cultural Heritage Research 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Following on from our work with historical scrolls, Davis described how the system is now being used to recover images from damaged monochrome movie film.
Year(s) Of Engagement Activity 2016
URL https://www.grc.org/programs.aspx?id=15101
 
Description Gordon Research Conference on Scientific Methods in Cultural Heritage Research 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Tim Wess gave an overview of the project for reading damaged historical scrolls with high contrast X-ray microtomography.

Public engagement
Year(s) Of Engagement Activity 2012
 
Description IADA Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact David Mills presented the work of the Apocalypto team on the imagining and virtual unrolling of the Bressingham roll.
Year(s) Of Engagement Activity 2015
URL http://www.iada-home.org/en/about-iada/history.html
 
Description London Convervation Forum 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Professional Practitioners
Results and Impact Presentation to the London Conservation Forum on the aims and results of the project.

Stimulating thinking about the technique amongst the target audience. Feedback on possible problems.
Year(s) Of Engagement Activity 2013
 
Description Presentation at Midlands conservator group 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Invited presentation at the Midlands conservator group, Birmingham UK.
Approximately 40 people, professional practitioners and general public attended the meeting to hear about advances in making inaccessible material accessible.
Year(s) Of Engagement Activity 2015
 
Description Reading the Unreadable - Wuthering Bytes 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact David Mills presented the work of the Apocalypto team as well as a general overview of CT imaging to a self-selecting, technology interested general public audience. There were many requests for further information and further speaking engagements.
Year(s) Of Engagement Activity 2015
URL http://wutheringbytes.com/days/festival/talks.html
 
Description Reading the Unreadable - EPSRC Press Release 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Media (as a channel to the public)
Results and Impact http://www.epsrc.ac.uk/newsevents/news/2013/Pages/readingtheunreadable.aspx.

Pioneering X-ray technology is making it possible to read fragile rolled-up historical documents for the first time in centuries.



Old parchment is often extremely dry and liable to crack and crumble if any attempt is made to physically unroll or unfold it. The new technology, however, eliminates the need to do so by enabling parchment to be unrolled or unfolded 'virtually' and the contents displayed on a computer sc

Following this, there were numerous contacts from interested parties, mostly journalists. Various printed and online articles appeared shortly afterwards. We were also contacted by the BBC and this led to filming for The One Show.
Year(s) Of Engagement Activity 2013
URL http://www.epsrc.ac.uk/newsevents/news/2013/Pages/readingtheunreadable.aspx
 
Description Recovering Historical Film Footage by Processing Microtomographic Images 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Presentation to cultural heritage researchers & practitioners
Year(s) Of Engagement Activity 2016
URL http://www.euromed2016.eu/
 
Description Science Showoff 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact David Mills presented a humorous overview of CT imaging and the work of Apocalypro team against the clock in a strictly 9 minute set. Several requests for more information after the presentation.
Year(s) Of Engagement Activity 2014
 
Description Signed, Sealed and Undelivered public event 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This was a meeting to complete the terms of the Signed Sealed and Undelivered grant, communicating findigs to the general public.
Year(s) Of Engagement Activity 2020
 
Description Talk at EMF [Electromagnetic Field] camp 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This was a talk on the use of X-ray microtomography for recovery of text from scrolls and letters and images from film. Electromagnetic Field is a non-profit UK camping festival for those with an inquisitive mind or an interest in making things: hackers, artists, geeks, crafters, scientists, and engineers.
Year(s) Of Engagement Activity 2018
URL http://www.emfcamp.org/
 
Description Web site/blog www.apocalypto.org.uk 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This web site records the progress of the project, named apocalypto from the greek word for reveal. It is written for a wide audience.

Stimulated discussions with other archives and brought the project the attention of archivists and conservators.
Year(s) Of Engagement Activity 2010,2011,2012,2013,2014
URL http://apocalypto.org.uk
 
Description seminar at Nankai University & Tianjin University 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact research seminar to computer vision lab members
Year(s) Of Engagement Activity 2016