Cognitive Systems Foresight: Human and computer face recognition from video sequences

This 3-year project is a collaboration between experts in computer vision techniques for recognising faces and experts in the psychology of how humans interpret faces. The aim is to produce a generative computational model of human facial processing, capable of both synthesizing and interpreting sequences of face images.This project will form the central part of an effort to build a computational model which will account for both familiar and unfamiliar moving face-recognition phenomena. This will draw from and contribute to the psychological knowledge in this area. It will have particular relevance to the effects of movement on recognition and its interaction with the process of facial learning. It is known that there are two separate psychological effects of movement, firstly representational enhancement'', which relates to the construction of 3D static representations of the face and is associated with relatively unfamiliar faces. The other, a dynamic signature'', is the characteristic motion pattern of an individual. This is associated with more familiar faces; previous relevant computational work has concentrated upon representational enhancement issues.The particular aim of this research will be to construct a generative computational model of human facial processing, able to cope with variations in familiarity. To achieve this, we need to (a) build a system capable of learning the static characteristics of faces from multiple frames and (b) build a description of behaviour and its variation. In addition, in humans, we need to (c) investigate the process of facial movement learning and (d) investigate the representation of dynamic signatures. To support this research, a cross-cultural database of moving faces suitable for human and computer experiments will be collected. The computational model will be used to generate data for psychological experiments investigating the effects of movement on recognition. The results of these experiments will inform development of automatic face interpretation algorithms.