High Dynamic Range for High Fidelity Image Synthesis of Real Scenes

Lead Research Organisation: University of Bristol
Department Name: Computer Science

Abstract

The computer graphics industry, and in particular those involved with films, games, simulation, virtual reality and military applications, continue to demand more realistic computer-generated images, that is computed images that more accurately match the real scene they are intended to represent. This is particularly challenging when considering images of the natural world, which presents our visual system with a wide range of colours and intensities. In most real scenes, for example, looking from inside a house towards a window, the ratio between the darkest areas (e.g. inside the room) and the brightest area (outside the window), the so-called contrast ratio, could be many thousands to one. A typical computer monitor only has a contrast ratio of about 100:1 and is thus incapable of accurately displaying such scenes.A number of appearance-preserving, or tone-mapping, operators (TMOs) have been developed in order to try achieve a perceptual match between the real-world scene and what is displayed on the computer monitor. However, it has not yet been possible to validate the fidelity of these TMOs thoroughly against the real scenes they are trying to portray. The recent development of novel, high dynamic range (HDR) displays, capable of 75,000:1 contrast ratio now provide the opportunity to compute and display computer-generated images that are perceptually much closer to the real world.This research proposal will use these novel HDR displays to evaluate existing TMOs to see how well they do preserve the appearance of the real scenes, and will use the insights gained to develop new, more accurate TMOs for existing computer monitors and HDR displays. A framework will also be produced that will provide a straightforward, objective way of comparing real and synthetic images. Two applications, which are critically dependent on the realism of computed images, are virtual archaeology and military simulations. When investigating past environments on a computer, failure to produce images that accurately match what the past environment may have looked like, may in fact lead to the archaeologists misinterpreting the past. Similarly, the incorrect display of a military vehicle attempting to camouflage in a certain terrain may lead to detection of the vehicle in the real battlefield scenario. We will use specific examples from archaeology and camouflage to test the results of our research.

Publications

10 25 50

publication icon
Banterle F (2009) A Psychophysical Evaluation of Inverse Tone Mapping Techniques in Computer Graphics Forum

publication icon
Banterle F (2007) A framework for inverse tone mapping in The Visual Computer

publication icon
Ruppertsberg A (2007) Displaying colourimetrically calibrated images on a high dynamic range display in Journal of Visual Communication and Image Representation

publication icon
Satylmys P (2017) A Machine-Learning-Driven Sky Model. in IEEE computer graphics and applications

publication icon
Selmanovic E (2014) Enabling stereoscopic high dynamic range video in Signal Processing: Image Communication

 
Description Bespoke high-fidelity visualsiation of tiling
Amount £137,357 (GBP)
Funding ID 101148 
Organisation Innovate UK 
Sector Public
Country United Kingdom
Start 06/2012 
End 06/2013
 
Description Royal Society Industrial Fellowship
Amount £198,187 (GBP)
Funding ID IF120030 
Organisation The Royal Society 
Sector Charity/Non Profit
Country United Kingdom
Start 09/2012 
End 08/2016
 
Description LMUK Insys Ltd 
Organisation Lockheed Martin
Country United States 
Sector Private 
Start Year 2007
 
Description Sunnybrook Technologies Inc 
Organisation Sunnybrook Technologies Inc
Country Canada 
Sector Private 
Start Year 2007
 
Title Apparatus and methods for boosting dynamic range in digital images 
Description  
IP Reference WO2008066840 
Protection Patent granted
Year Protection Granted
Licensed No
 
Title HDR video data compression devices and methods 
Description The invention relates to a method of compressing a stream of video frame data wherein tone mapping functions are determined for video frames of said stream, said tone mapping functions being different from one another for frames relating to different scenes and wherein it is suggested that the tone mapping functions will be altered for frames of the stream relating to the same scene. 
IP Reference EP2144444 
Protection Patent granted
Year Protection Granted 2010
Licensed Yes
Impact The patent is licensed to the spinout company goHDR and forms the basis for their current Beta product suite.
 
Company Name goHDR Ltd 
Description To provide compression/decompression solutions for HDR video 
Year Established 2009 
Impact Provides a world first complete HDR capture to display pipeline. Now offering Beta products for sale.
Website http://www.gohdr.com
 
Description Filming a rocket launch (Kennedy Space Centre) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I was invited by the Advanced Imaging Lab (AIL) at the Kennedy Space Centre to film a rocket launch with our HDR system to enable them to compare their system and current thinking with ours.

This is one of the first attempts to film a rocket launch with HDR video. The work has attracted a lot of attention and even let to the head of AIL requesting to do a PhD under my supervision at the University of Warwick.
Year(s) Of Engagement Activity 2013
 
Description Public engagement (IBC) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This is the largest broadcast show in Europe and attracts over 50,000 participants. I was invited to showcase my research in HDR imaging at the Emerging Technologies section of the show.

There was considerable interest - with a large number of requests for future demonstrations and for further information.
Year(s) Of Engagement Activity 2011,2013
URL http://www.ibc.org
 
Description Public engagement (NAB 2014) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Invited to participate in the Future Zone of NAB 2012 and 2014 to showcase my research in HDR imaging. This is the world's largest broadcast show attracting over 92,000 participants from over 150 countries.

Large scale interest in the work presented - followed up by request to visit my lab and for further information from a number of companies. I have been invited back to exhibit at NAB 2015 in April 2015.
Year(s) Of Engagement Activity 2012,2014
URL http://www.nabshow.com/