Using perceptual learning to understand and influence face recognition

Lead Research Organisation: University of Exeter
Department Name: Psychology

Abstract

Perceptual learning is a fundamental cognitive skill. It can be defined as an enhancement in the ability to distinguish between similar stimuli (that otherwise would be very hard to tell apart) as a consequence of experience with them, or with stimuli similar to the target stimuli. The proposed project focuses on the development of this phenomenon as a key factor to our ability to recognise faces. Further, by using a range of neuroscience techniques (EEG/ERP, tDCS, fMRI, TMS) in conjunction with the behavioural designs I have developed, I will investigate methods to improve this perceptual skill and define specific brain structures responsible for the control and development of this phenomenon. So, basically, I aim to find out how we improve at telling things apart (discrimination) and to discover ways of enhancing this ability.

I will start by developing the case for perceptual learning as a key contributor to one of the most robust cognitive phenomenon in face recognition i.e. the composite face effect. This refers to individuals' decreased ability to recognise the top half of one face presented in composite with the bottom half of another face when the composite is upright and aligned than when the two halves are offset laterally (misalignment). By using novel categories of prototype-defined chequerboards which participants will be pre-exposed to during the study procedure, I would expect to show a similar composite effect for familiar chequerboards to that usually found with faces. This will be our index of perceptual learning.

The project will then continue by using different neurostimulation techniques (tDCS and TMS) to selectively increase and decrease the composite effect for chequerboards and that for faces. Through a combination of tDCS and EEG techniques, this project will also reveal how specific brain responses usually found for faces, can also be found for familiar chequerboards and be altered by neurostimulation. Finally, a combination of tDCS and fMRI will help to localise more precisely the brain structures involved in perceptual learning.

This project will provide us with insights into the mechanisms that characterise the development and control of perceptual learning and will extend perceptual learning to face recognition by showing how similar effects to those usually found for faces can be found for categories of stimuli that participants had never seen before entering the lab. It will also provide evidence for the neurocognitive basis of perceptual learning. We will use these results to devise methods of training that can enhance our discrimination abilities in various domains. It would allow us to tailor training programmes (e.g. involving stimuli such as faces, fingerprints, cervical smears, mammograms) to provide maximum benefit in terms of performance by the trainee. As an example, this research would be suitable for enhancing the face recognition skills of frontline and intelligence staff, and one might be able to selectively increase the effectiveness of this training through the use of mobile neuroscience techniques based on the Starstim EEG/tDCS system. It would also give us insights into how to design artificial systems for the detection and recognition of such stimuli, which would be of interest to companies specialised in computer software or apps for face recognition.

Planned Impact

This new approach for studying the mechanisms of perceptual learning using a combination of experimental psychology designs and neuroscience techniques will benefit several academic and non-academic organisations within and outside the UK.

It will create a database of advanced knowledge about perceptual learning that could serve several researchers as the basis for future research on human cognitive skills, neuroscience techniques, and the creation of computer software for discrimination and recognition of various stimuli (e.g. faces). This would, in turn, enable the PI and others to apply this body of knowledge to real-world problems such as face recognition both by humans (e.g. "super recognisers") and by machines. To this end, the PI and the Co-I already have initial links to Dr Josh Davis' lab at the University of Greenwich where they work with the Metropolitan Police Force on super recognisers, and links with Prof. Dominic Dwyer's lab at Cardiff where they are investigating the application of models of human perceptual learning to machine recognition of images in conjunction with a number of industrial partners.

Through the University of Exeter Impact Innovation & Business (IIB) service and ESRC Impact Accelerator Account, the PI will seek to establish new collaborations with public and private organisations so as to maximise the societal impact of the findings produced by the proposed research. This could benefit government agencies such as Defence (DSTL), Customs and Excise (screening for contraband) and some medical applications (e.g. radiography). One example, contributing to the work done by DSTL, would be training the military, in discriminating similar targets in combat situations. An application that could be developed as a consequence of this programme of research would be one that selectively increases the effectiveness of this training through the use of mobile neuroscience techniques based on the Starstim EEG/tDCS system. As another example, it could also benefit private organisations like IBM in developing new computer and phone apps to provide face and object recognition skills for medical testing (e.g. detecting early signs of neurodegenerative disorders affecting face or object recognition).

The PI will also attend the University of Exeter annual Research Focus Week event (2018-19-20) usually organised in May. Many of the sessions planned for this event, such as those on UK Government and Industry funding; EU funding, Engaged Research, Large Grants, Programme Grants and Centre Bids will allow the PI to discuss with the Exeter technical research staff and guest speakers further opportunities for him to use this research and so increase the impact of it within and outside the UK.

To engage with a wider public, the PI will present this research at the events organised by the University of Exeter that involve high-school students and their parents (National Science Week demonstrations and talks, School events). Also, he will present this research at research seminars within the Department of Psychology so that students from the different psychology domains within the department (social, clinical, cognitive and animal behaviour) can benefit from the research. The PI will also present this research at the Lecture and Research events organised by the University and open to the public.

Depositing the data and outputs from the proposed research on open access (through the Exeter ORE system) will ensure anybody from the public will be able to benefit from this research. The University Press Office will also help to extend my research findings to the public through the use of local, national and international newspapers, magazines, and online media.

Publications

10 25 50

publication icon
Civile C (2020) Directional cues and landmark configurations: The effect of rotating one set of landmarks relative to another. in Journal of experimental psychology. Animal learning and cognition

publication icon
Civile C (2019) Labelling faces as 'Autistic' reduces the inversion effect. in Autism : the international journal of research and practice

publication icon
Civile C (2022) Using transcranial direct current stimulation (tDCS) to influence decision criterion in a target detection paradigm. in ournal of Experimental Psychology: Animal Learning and Cognition

publication icon
Delamater AR (2021) Special issue on recent advances in perceptual learning. in Journal of experimental psychology. Animal learning and cognition

 
Description We have discovered how brain stimulation (tDCS) can influence perceptual learning and face recognition skills. Specifically, we are able to use the same tDCS procedure to systematically either decrease or INCREASE face recognition skills. We have also conducted a tDCS/EEG study to investigate the electrophysiological correlated of the tDCS-induced effects on face recognition skills. Importantly, we find that the tDCS procedure can modulate the ERPs N170 component associated to face recognition and perceptual learning. Moreover, we conducted a tDCS and fMRI combined study this time using chequerboard stimuli (we can fully control experience with the stimuli) that showed different brain activations in response to anodal vs sham conditions associated also with the effects found behaviourally. We conducted three large tDCS studies (n=280) that demonstrate how the same tDCS procedure is able, in certain circumstances, to selectively increase the face inversion effect by enhancing recognition for upright faces. Hence, we showed that the tDCS can improve performance in circumstances where generalisation is already making face recognition harder. An example of such circumstances is when "normal" faces are presented in the same experiment as manipulated faces like Thatcherised faces where the eyes and the mouth are turned upside down. Normal and Thatcherised faces share several common elements which allow us to predict for example the mouth in a face to be the right way up, not rotated. In the case of a Thatcherised face, this prediction would be incorrect making these manipulated elements look novel, and hence they are highly salient. As such, these elements would capture much of the learning which will also generalise to regular faces making recognition more difficult. We showed that the tDCS procedure was able to eliminate the harmful generalisation from the manipulated faces to other faces in the experiment, leading to an increased inversion effect in the anodal group compared to sham by means of an improvement in recognition performance for upright normal faces. Furthermore, we provided the first direct evidence in the literature that, within a single study, by using the same tDCS procedure, we are now able to both enhance performance when normal faces are presented with Thatcherised faces, and to reduce performance when normal faces are presented with other normal faces (male faces presented with female faces). Finally, we conducted two large tDCS studies showing that the specific procedure developed does not affect the composite face effect, but it does affect significantly recognition of upright faces. We are currently running some additional studies where we compare directly the effects of tDCS at Fp3 vs at PO8 site (this latter is often considered to be specific for faces) while participants perform a composite face effect study.

We conducted further studies tackling the effects of tDCS on face recognition. Specifically, we conducted a large (n=72) tDCS/EEG study using normal vs Thatcherised upright/inverted faces. The behavioural results confirmed the fact that our tDCS procedure can selectively increase face recognition performance when normal faces are presented with Thatcherised faces. We are currently analysing the EEG data.

We then conducted a large tDCS studies (n=96) involving two experiments running simultaneously. Experiment 1a had normal faces presented with Thatcherised. Experiment 1b had normal faces presented with checkerboards. We found that anodal stimulation increased the inversion effect for normal faces when presented with Thatcherised ones and reduced when with checkerboards.

Furthermore, we conducted two large tDCS studies (n=72) investigating the tDCS-induced effects on checkerboards and faces using a detection task.

Throughout the Covid-19 lockdowns, where access to labs is not permitted, we used this time to calibrate behavioural studies. Specifically, we conducted a few large studies on Gorilla investigating the composite effect for familiar and novel checkerboards (n=96).
Exploitation Route We have here a tDCS procedure that is capable to enahnce cognitive performance at face recognition and perhaps more in general in all those situations where generalization is key to perform well. This finding alone can have tremendous applications in society. Specifically, the same tDCS procedure could be used to train and improve performance of individuals who make difficult discriminations in their everyday life e.g. x-ray luggage screeners. Also, establishing that one theory of perceptual learning is able to explain and predict these results would help in the construction of agents or applications to perform several kinds of tasks for us (e.g. machine learning for fingerprints, etc.).
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Other