Neural Rendering of object-based audio-visual scenes

This research will investigate the use of neural rendering methods to render general dynamic scenes from object-based representations with the realism of video. Learnt representations of natural spatial and temporal appearance will be exploited through deep network architectures (GAN, VAE etc.) for real time rendering of scenes. The goal is to enable the reproduction of highly-realistic content for natural scenes from object based scene representations derived from video capture.