SpectralEdge Image Visualisation

Lead Research Organisation: University of East Anglia
Department Name: Computing Sciences

Abstract

A number of important imaging applications capture images from multiple sources, or channels. For example, satellite imaging systems capture images in both the visible and infra-red parts of the electromagnetic spectrum: the infra-red channels help to mitigate the effect of haze in obscuring the scene content, and help discriminate between features that are otherwise confounded in the visible-spectrum. The key problem, however, with capturing multiple images is that the extra information increases the cognitive load on the user (or computational load on automated algorithms), and can often hinder, rather than help, rapid decision making. As a result, a significant amount of effort has been put into finding ways to fuse multiple images into a single, easy to understand, image.SpectralEdge Image Visualisation aims to deliver a step change in the ability to visualise information from multiple sources, or channels, in a single image. The technology maximises the information that is conveyed while, at the same time, guaranteeing artefact free outputs. The technology is a platform technology, and has a wide scope for potential application. In this proposal, however, we target a specific problem: fusing colour images with infra-red for applications in the security and defence sectors, where there is an immediate and direct need for this technology. A key objective of this project will be to develop prototype software that is tailored to the needs of these end-users.

Planned Impact

SpectralEdge image-fusion technology improves the observability of features within a single image that is constructed by fusing together several images of the same scene derived from a variety of sources. The algorithm is fast, robust to noise, and produces artefact free images, in addition to maximizing the amount of information that is conveyed in the fusion process. This means that features that exist in the separate images are retained in the SpectralEdge output. The present proposal aims to develop the technology in two principal ways: to allow the method to work at video rates, and to cope with a potential image-registration problem (when the images from different sources are misaligned). From a technical point of view this will lead to demonstrator software that can be evaluated by our project partners (who are key suppliers in the defence and security sectors) on a specific problem: fusing colour images with infra-red images. Post-completion of this project we will raise funds or investment to develop commercial software/products that could enter the market as an embedded solution in products sold by these companies. By this route, the impact of our technology will be transmitted to the end-user. The business development component of the proposal will focus on reacting to user feedback from our demonstrator software, on developing new contacts within the defence and security sectors, and creating a business plan to secure further investment. These activities will help us to understand more about the markets, and most importantly, increase the potential avenues through which our technology can be distributed in the future. The end users in the defence sector will be the UK Ministry of Defence, and potentially other allied forces. The specific users will range from the dismounted solidier (in the case of weapons mounted display users) to satellite analysts charged with identifying targets or potential threats. The potential benefits are, of course, felt beyond those actually using the technology, and on to those they are bound to protect. While the focus of our initial work is the defence/security sectors, significantly, SpectralEdge is a platform technology. Indeed, in the long term, the variety of possible applications of the technology mean that the benefits could potentially be wide ranging, from improved medical diagnosis, to better monitoring of oil spills, and even to an improved visual experience for colour blind computer users.

Publications

10 25 50

publication icon
Connah D (2015) Spectral edge: gradient-preserving spectral mapping for image fusion. in Journal of the Optical Society of America. A, Optics, image science, and vision

publication icon
Finlayson GD (2011) Lookup-table-based gradient field reconstruction. in IEEE transactions on image processing : a publication of the IEEE Signal Processing Society

 
Description A well founded method was engineered to allow fusion of multiple images to arrive at a fused image which conveys the information from all the individual component images.
Exploitation Route We are commercializing through spectraledge ltd
Sectors Aerospace, Defence and Marine,Agriculture, Food and Drink,Communities and Social Services/Policy,Creative Economy,Digital/Communication/Information Technologies (including Software),Education,Healthcare

URL http://www.spectraledge.co.uk
 
Description Our findings are the basis of the spin out company spectral Edge Ltd. The company is productizing the research in various domains. Current foci include helping colour blind observers see better and unsing Near Infra Red to improve digital photographs.
First Year Of Impact 2012
Sector Digital/Communication/Information Technologies (including Software)
Impact Types Economic

 
Title IMAGE PROCESSING METHOD AND SYSTEM 
Description An image processing method, system and device are disclosed. In the method, sensor responses for an input image are estimated, the sensor responses including sensor responses for cone sensors including a first cone sensor set and a second, different, cone sensor set. In dependence on the sensor responses, a transform mapping for application to a source image is determined to generate a modified image. 
IP Reference WO2015004437 
Protection Patent application published
Year Protection Granted 2015
Licensed Yes
Impact This patent is the foundation of 'eyeteq' a suite of platforms being developed to help colour blind people see better. This technology is close to commercial license and has been validated in an extensive third party study (by i2media)
 
Company Name Spectral Edge Ltd 
Description Spectral Edge Ltd is a company operating in the area of Image Fusion. Its aim is to develop and further extend the image fusion work developed in I028455 and E012248. While the technology developed can be applied to many domains (remote sensing, defense, medical imaging) the current and medium term focus of the company is in visual accessibility (see eyeteq.com), fusion for enhanced photography and surveillance. The company is based in Cambridge, has to date raised about £2 million in venture capital and has 6 FTE employees. 
Year Established 2012 
Impact The company is in an early technological development stage and we expect commercialization to begin in 2016. However, the visual accessibility s/w - for colour deficient observers - has been validated in a large third party trial (run by i2media).
Website http://www.spectraledge.co.uk