Optimization of Massively Parallel Stochastic Simulations

Lead Research Organisation: Imperial College London
Department Name: Electrical and Electronic Engineering

Abstract

Non-traditional architectures have shown massive energy savings and a significant boost on the performance of many applications across a range of domains. In order these high gains to be achieved, efficient use of silicon should be performed when such algorithms are mapped onto hardware. Even though this topic is well researched for the case of deterministic algorithms, no work has been done for algorithms of a stochastic nature. The fundamental problem that this proposal addresses is the efficiently use of silicon when a stochastic algorithm is mapped to hardware.This proposal is concerned with the design automation of hardware architectures for Monte Carlo based simulations of Stochastic Differential Equations (SDEs). Domains such as the stochastic modelling of chemical reactions and financial engineering are two examples where SDEs are widely used. Due to the non-existence or to high complexity in deriving an analytic solution for an SDE, numerical techniques based on computationally heavy Monte Carlo simulations are often employed. Hardware systems based on reconfigurable logic have demonstrated good potential for the acceleration and power consumption reduction of the above simulations. The main technique that is often employed and contributes to the realization of high performance gains and significant power consumption reduction is the use of a customized number representation system.This project aims to investigate two key issues related to the use Field Programmable Gate Arrays, a reconfigurable hardware device, for acceleration of Monte Carlo simulations for Stochastic Differential Equations. The first issue is the impact of the employed number representation on the quality of the SDE solution using Monte Carlo simulations, while the second key issue is to research and develop hardware architectures and word-length optimization techniques that target the minimization of power usage or the maximization of the performance of the system, without significant loss on the quality of the solution. By optimizing the computational part of the hardware system, efficient allocation of the available resources is performed, resulting in the acceleration of the overall simulation and improved energy consumption per computational operation.

Publications

10 25 50
 
Description Field-Programmable Gate Arrays (FPGAs) and specialised computing devices that can be programmed in the field and implement any type of computer architecture. Thus, in contrast to mainstream general processors that need to be able to perform a large variety of operations, FPGAs can be tuned to the specific application and deliver high computational power with low power consumption. The project investigated how real-time tuning of the number representation employed by a design can lead to enhanced performance when parallel stochastic simulations are targeted. The results of the project showed that by tuning online the precision of the computations a 35% improvement can be achieved for the above target domain.
Exploitation Route The idea of tuning the precision of the computations at real time by monitoring various metrics can be applied to many fields. As such, power consumption optimisations and latency/throughput targets can be met.
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software)

URL http://cas.ee.ic.ac.uk/people/ccb98/publications.php
 
Description One of the key findings of the project is that stochastic algorithms can hide errors in the computations, when special care has been taken in the design of the system/algorithm. This key idea has been applied to a body of work that focuses on the acceleration of stochastic algorithms and especially the acceleration of MCMC algorithms. In the proposed systems, where the outcomes of this project have been utilised, significant speed ups have been achieved, leading to system that can provide to the users the ability to analyse large amount of data in a fraction of the time.
First Year Of Impact 2013
Sector Healthcare
Impact Types Societal,Economic