A spatio-chromatic colour appearance model for retargeting high dynamic range image appearance across viewing conditions

Lead Research Organisation: University of Liverpool
Department Name: Institute of Psychology Health & Society

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.
 
Description Our data demonstrate a previously unknown characteristic of the visual system at high luminance. Using the data, we developed a new, fundamental model of the human visual system (the spatio-chromatic sensitivity function) that can predict the visibility of black-and-white and colour patterns under very dim (0.02 cd/m^2) and very bright (10,000 cd/m^2) viewing conditions. We are currently investigating the application of the model in several problems, including high-dynamic-range video compression and modelling of colour appearance.
Updates, data and code are available on https://www.cl.cam.ac.uk/research/rainbow/projects/hdr-csf/
Exploitation Route Our work has implications for improving future HDR image and video coding standards. Our work can also help to design better colour spaces and metrics for high-dynamic-range content. One of such metrics was presented in a recently published SIGGRAPH paper: http://dx.doi.org/10.1145/3450626.3459831
Sectors Creative Economy,Digital/Communication/Information Technologies (including Software),Healthcare

URL https://pcwww.liv.ac.uk/~sophiew/spatio.htm
 
Description Since the publication of our CSF model and the data base, we had plenty of interest from industry and several requests to use our model for evaluation driver safety. We do not keep track of the number of downloads of the model and the software. Our new CSF function and the related research on models of banding have lead to the development of two important quality metrics, now widely used in the industry (video compression, method evaluation, display engineering, AR/VR modeling): * PU21: A novel perceptually uniform encoding for adapting existing quality metrics for HDR - http://dx.doi.org/10.1109/PCS50896.2021.9477471 - https://github.com/gfxdisp/pu21 * FovVideoVDP: A visible difference predictor for wide field-of-view video - http://dx.doi.org/10.1145/3450626.3459831 - https://www.cl.cam.ac.uk/research/rainbow/projects /fovvideovdp/ The work also raised the interest of the industrial partners, which are now funding follow-up research.
First Year Of Impact 2021
Sector Digital/Communication/Information Technologies (including Software),Electronics
Impact Types Economic

 
Description Human contrast sensitivity in the chromatic-temporal domain
Amount £45,339 (GBP)
Funding ID JXR30648 
Organisation Facebook 
Sector Private
Country United States
Start 01/2022 
End 12/2022
 
Description Inclusive rendering on additive displays
Amount $75,000 (USD)
Organisation Facebook 
Sector Private
Country United States
Start 06/2022 
 
Title Code CIC paper model 
Description The model predicts contrast sensitivity for any colour direction and was fitted to 5 independent datasets, as described in the CIC28 paper. 
Type Of Material Computer model/algorithm 
Year Produced 2020 
Provided To Others? Yes  
Impact New Colalboratoins 
URL https://github.com/gfxdisp/omni-csf
 
Title Code for the JoV paper model 
Description The model predicts contrast sensitivity for the three colour directions in the DKL colour space and was fitted to the data presented in the JoV paper. 
Type Of Material Computer model/algorithm 
Year Produced 2020 
Provided To Others? Yes  
Impact new collaborations 
URL https://github.com/MalihaAshraf/CSF_luminance_model
 
Title Data base for CSF measurements on an HDR display 
Description Contrast sensitivity data may be useful to test current models of human vision. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact testing current models of human vision; designing better displays. 
URL https://pcwww.liv.ac.uk/~sophiew/spatio.htm
 
Title Measurements of spatio-chromatic contrast sensitivity up to 7000 cd/m^2 
Description Measurements of spatio-chromatic contrast sensitivity up to 7000 cd/m^2 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
Impact Our published CSF data have been used in numerious image quality application. 
URL https://www.repository.cam.ac.uk/handle/1810/30422
 
Description New Collaboration with Prof Luo 
Organisation Zhejiang University
Department Department of Optical Engineering
Country China 
Sector Academic/University 
PI Contribution We have helped with modelling the data. Conference Proceedings: Luo, R., Westland, S, Wuerger, S, Mantiuk, R. (2020). Spatial Chromatic Contrast Sensitivity Band-pass or low-pass functions? Color and Imaging Conference, Chiba, Japan. Full paper in OSA is under review.
Collaborator Contribution Provided experimental data.
Impact Conference Proceedings: Luo, R., Westland, S, Wuerger, S, Mantiuk, R. (2020). Spatial Chromatic Contrast Sensitivity Band-pass or low-pass functions? Color and Imaging Conference, Chiba, Japan. Full paper in OSA is under review.
Start Year 2020
 
Description New collaboration with Facebok, USA 
Organisation Facebook
Country United States 
Sector Private 
PI Contribution The research attracted interes from Facebook, USA, which then made a donation to further fund the current RA, Maliha Ashraf. A second donation was made, also to Prof Sophie Wuerger, to further investigate inclusive rendering on additivie displays.
Collaborator Contribution The research attracted interes from Facebook, USA, which then made a donation to further fund the current RA, Maliha Ashraf. A second donation was made, also to Prof Sophie Wuerger, to further investigate inclusive rendering on additivie displays.
Impact no outcomes yet.
Start Year 2022
 
Description AVA 2020 Virtual Christmas Meeting 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact "Effect of ageing of optical elements of the human visual system on its contrast sensitivity" Ashraf, M., Mantiuk, R. K., Martinovic, J. & Wuerger, S. Published abstract: AVA 2020 Virtual Christmas Meeting December 21, 2020. Perception. 2021;50(6):573-592. doi10.1177/03010066211008:143
Year(s) Of Engagement Activity 2021
 
Description Colour Group GB January Vision Meeting 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Effect of ageing of optical elements of the human visual system on its
contrast sensitivity
Ashraf, M., Wuerger, S., Mantiuk, R. K. & Martinovic, J.
Year(s) Of Engagement Activity 2021
 
Description Focus Group for elderly display users 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact This focus group was held in Aberdeen and was run by Dr. Martinovic. Elderly users were asked to evaluate various displays with content that was enhanced using specialised software adapted to the elderly visual system. Participants could provide feedback on quality and usability of displays.
Year(s) Of Engagement Activity 2018
 
Description Invited talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Invited talk at the Applied Vision Association Meeting, held at Qinetic, Farnborough.
Received the Geoffrey-Burton-Lecturer for significant contributions to vision science;
Year(s) Of Engagement Activity 2019
URL http://www.theava.net/meetings.php?s=spring-meeting-2019-and-agm-at-farnborough
 
Description Invited talk 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Talk at the Colour Group Meeting, London, UK on "Luminance and chromatic sensitivity at high light levels".
The audience consists of scientists, artists, professionals from film and photography.
Year(s) Of Engagement Activity 2019
URL https://www.colour.org.uk/about/
 
Description Scottish Vision Group Meeting 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Takl on the "Effect of ageing of human visual system on suprathreshold contrast vision"
Ashraf, M., Wuerger, S., Martinovic, J. & Mantiuk, R. K.
Year(s) Of Engagement Activity 2021