High Dynamic Range for High Fidelity Image Synthesis of Real Scenes
Lead Research Organisation:
University of Bristol
Department Name: Computer Science
Abstract
The computer graphics industry, and in particular those involved with films, games, simulation, virtual reality and military applications, continue to demand more realistic computer-generated images, that is computed images that more accurately match the real scene they are intended to represent. This is particularly challenging when considering images of the natural world, which presents our visual system with a wide range of colours and intensities. In most real scenes, for example, looking from inside a house towards a window, the ratio between the darkest areas (e.g. inside the room) and the brightest area (outside the window), the so-called contrast ratio, could be many thousands to one. A typical computer monitor only has a contrast ratio of about 100:1 and is thus incapable of accurately displaying such scenes.A number of appearance-preserving, or tone-mapping, operators (TMOs) have been developed in order to try achieve a perceptual match between the real-world scene and what is displayed on the computer monitor. However, it has not yet been possible to validate the fidelity of these TMOs thoroughly against the real scenes they are trying to portray. The recent development of novel, high dynamic range (HDR) displays, capable of 75,000:1 contrast ratio now provide the opportunity to compute and display computer-generated images that are perceptually much closer to the real world.This research proposal will use these novel HDR displays to evaluate existing TMOs to see how well they do preserve the appearance of the real scenes, and will use the insights gained to develop new, more accurate TMOs for existing computer monitors and HDR displays. A framework will also be produced that will provide a straightforward, objective way of comparing real and synthetic images. Two applications, which are critically dependent on the realism of computed images, are virtual archaeology and military simulations. When investigating past environments on a computer, failure to produce images that accurately match what the past environment may have looked like, may in fact lead to the archaeologists misinterpreting the past. Similarly, the incorrect display of a military vehicle attempting to camouflage in a certain terrain may lead to detection of the vehicle in the real battlefield scenario. We will use specific examples from archaeology and camouflage to test the results of our research.
People |
ORCID iD |
Alan Chalmers (Principal Investigator) | |
Mark Horton (Co-Investigator) |
Publications
Banterle F
(2007)
A framework for inverse tone mapping
in The Visual Computer
Satylmys P
(2017)
A Machine-Learning-Driven Sky Model.
in IEEE computer graphics and applications
Banterle F
(2009)
A Psychophysical Evaluation of Inverse Tone Mapping Techniques
in Computer Graphics Forum
Banterle F.
(2011)
Advanced High Dynamic Range Imaging
Ruppertsberg A
(2007)
Displaying colourimetrically calibrated images on a high dynamic range display
in Journal of Visual Communication and Image Representation
Selmanovic E
(2014)
Enabling stereoscopic high dynamic range video
in Signal Processing: Image Communication
F Banterle
(2009)
High dynamic range imaging and LDR expansion for generating HDR content
Banterle F
(2009)
High Dynamic Range Imaging and Low Dynamic Range Expansion for Generating HDR Content
in Computer Graphics Forum
Description | Bespoke high-fidelity visualsiation of tiling |
Amount | £137,357 (GBP) |
Funding ID | 101148 |
Organisation | Innovate UK |
Sector | Public |
Country | United Kingdom |
Start | 06/2012 |
End | 06/2013 |
Description | Royal Society Industrial Fellowship |
Amount | £198,187 (GBP) |
Funding ID | IF120030 |
Organisation | The Royal Society |
Sector | Charity/Non Profit |
Country | United Kingdom |
Start | 09/2012 |
End | 08/2016 |
Description | LMUK Insys Ltd |
Organisation | Lockheed Martin |
Country | United States |
Sector | Private |
Start Year | 2007 |
Description | Sunnybrook Technologies Inc |
Organisation | Sunnybrook Technologies Inc |
Country | Canada |
Sector | Private |
Start Year | 2007 |
Title | Apparatus and methods for boosting dynamic range in digital images |
Description | |
IP Reference | WO2008066840 |
Protection | Patent granted |
Year Protection Granted | |
Licensed | No |
Title | HDR video data compression devices and methods |
Description | The invention relates to a method of compressing a stream of video frame data wherein tone mapping functions are determined for video frames of said stream, said tone mapping functions being different from one another for frames relating to different scenes and wherein it is suggested that the tone mapping functions will be altered for frames of the stream relating to the same scene. |
IP Reference | EP2144444 |
Protection | Patent granted |
Year Protection Granted | 2010 |
Licensed | Yes |
Impact | The patent is licensed to the spinout company goHDR and forms the basis for their current Beta product suite. |
Company Name | goHDR Ltd |
Description | To provide compression/decompression solutions for HDR video |
Year Established | 2009 |
Impact | Provides a world first complete HDR capture to display pipeline. Now offering Beta products for sale. |
Website | http://www.gohdr.com |
Description | Filming a rocket launch (Kennedy Space Centre) |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | I was invited by the Advanced Imaging Lab (AIL) at the Kennedy Space Centre to film a rocket launch with our HDR system to enable them to compare their system and current thinking with ours. This is one of the first attempts to film a rocket launch with HDR video. The work has attracted a lot of attention and even let to the head of AIL requesting to do a PhD under my supervision at the University of Warwick. |
Year(s) Of Engagement Activity | 2013 |
Description | Public engagement (IBC) |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | This is the largest broadcast show in Europe and attracts over 50,000 participants. I was invited to showcase my research in HDR imaging at the Emerging Technologies section of the show. There was considerable interest - with a large number of requests for future demonstrations and for further information. |
Year(s) Of Engagement Activity | 2011,2013 |
URL | http://www.ibc.org |
Description | Public engagement (NAB 2014) |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Invited to participate in the Future Zone of NAB 2012 and 2014 to showcase my research in HDR imaging. This is the world's largest broadcast show attracting over 92,000 participants from over 150 countries. Large scale interest in the work presented - followed up by request to visit my lab and for further information from a number of companies. I have been invited back to exhibit at NAB 2015 in April 2015. |
Year(s) Of Engagement Activity | 2012,2014 |
URL | http://www.nabshow.com/ |