Dynamically Reconfigurable Hardware Architectures for Context-Based Statistical Compression of Visual and Data Content

Lead Research Organisation: University of Bristol
Department Name: Electrical and Electronic Engineering

Abstract

The purpose of this work is to investigate algorithms and hardware architectures for context-based statistical lossless compression of visual and data content using dynamically reconfigurable hardware to support optimal modelling strategies for each data and compression type. Entropy coding of the modelling output will be performed using a statically configured arithmetic coding engine. The current trend of network convergence where visual and data content are transmitted along the same physical channel suggests a technology capable of delivering optimal compression ratios and fast adaptation to the nature of the content will become increasingly important. These are the two key concepts that will drive this research effort. Context-based statistical compression differs fundamentally from dictionary-based compression as used in popular algorithms such as the ZIP family and it is recognised as being able to offer superior compression ratios to these. However, this has been only achieved with complex software algorithms that require considerable amounts of memory capacity and have very low throughputs in the range of thousands of CPU cycles per byte. This means that power-hungry Pentium 4 class microprocessors running at GHz rates are needed to provide the required computing power to run these advanced statistical algorithms and even these CPUs will find difficult to support applications such as telemedicine where still images, video and scientific data would require lossless real-time compression with high bandwidths. Other applications such as data, video and image transmission in space require the performance to be achieved in an energy and silicon efficient platform. To achieve the demands set by these applications we propose the first universal lossless compression hardware core combining context-based variable-order statistical modelling and arithmetic coding. At present, there are no practical hardware realisations of these techniques, since no satisfactory solutions have yet been proposed for a viable architecture.

Publications

10 25 50
 
Description The project demonstrated a hardware-amenable statistical modelling technique for lossless visual and data compression that combines predictive coding, context-based modelling and arithmetic coding. THe hardware included an universal arithmetic coding engine able to support probability data obtained from both visual and general data modelling engines.



A dynamic reconfigurable platform that supports both modelling engines and the common entropy coding module.

was developed. This allow the architecture to change as different data types were being compressed. The resulting system could deliver better compression than current algorithms at a lower energy and area profiles.
Exploitation Route Data compression is of interest to many commercial organizations. Exploitation routes are being explored. The research was proposed to the European Space Agency that funded farther development trough their innovation triangle initiative. A prototype was built that demonstrated the potential of the technology using standard FPGAs. The results were demonstrated to ESA. A currently ongoing project is using the data compression engines originally developed to demonstrate how the energy of a generic computing system can be lowered by transmitting data in compressed state. A collaboration is on-going with Sydney University exploring how to use this data compression technologies in financial computing applications.
Sectors Healthcare

URL http://seis.bris.ac.uk/~eejlny/reconf.htm
 
Description The data compression has been used by different entities such as Intel and the European Space Agency to evaluate the benefits of this new type of algorithms compared with the current versions. A high-speed version is currently being developed to be used in financial computing systems
First Year Of Impact 2010
Sector Digital/Communication/Information Technologies (including Software),Electronics,Financial Services, and Management Consultancy
Impact Types Cultural,Societal

 
Description Dynamically reconfigurable hardware for statistical loss1ess compression in Space applications
Amount £50,000 (GBP)
Organisation European Space Agency 
Sector Public
Country France
Start 04/2010 
End 11/2010
 
Description Dynamically reconfigurable hardware for statistical loss1ess compression in Space applications
Amount £50,000 (GBP)
Organisation European Space Agency 
Sector Public
Country France
Start 04/2010 
End 11/2010
 
Description ESA - ESTEC 
Organisation ESA - ESTEC
Country Netherlands 
Sector Public 
Start Year 2006
 
Description Sydney 
Organisation University of Sydney
Country Australia 
Sector Academic/University 
PI Contribution Development of data compression technology
Collaborator Contribution financial data analysis systems
Impact A phd is currently developing the ideas introduced in this collaboration further with the objective of creating a commecial product in the area of high-performance lossless data compression.
Start Year 2014