A neuropsychological approach to dissect face perception and perceptual expertise

Lead Research Organisation: Newcastle University
Department Name: Institute of Neuroscience

Abstract

The human face plays a critical role in successful social interactions. By adulthood, we are very adept at extracting identity, sex, race, emotions, and social signals from faces. Impairments to this fundamental ability may reduce our quality of life and well being. Our proficiency with faces seems to rely on holistic processing which integrates facial parts into a unified spatial configuration or perceptual whole. This holistic processing is generally not seen for other objects. Given the importance of the human face, we propose to investigate the brain mechanisms underlying our expert ability to process faces and the adaptability of these mechanisms to our experiences.

This research goal is strongly motivated by two opposing hypotheses. Importantly, these two hypotheses address the plasticity of the adult human brain. According to the face-specificity hypothesis, the proficiency for face recognition is due to a specialised network of brain regions developed by adulthood that processes only faces. Alternatively, people have extensive experience interacting with each other since birth. According to the expertise hypothesis, the putative face network might remain flexible even in adulthood so that it may be recruited to recognise other objects if one has extensive experience with examples of those objects. For example, dog judges have extensive experience with different breeds of dogs and show holistic processing of dogs.

To test these two competing hypotheses, we focus on individuals who have profoundly lost their ability to recognise faces through brain injury. These individual cannot visually recognise family members, close friends, or even themselves. In rare cases, the ability to recognise non-face objects is fully preserved. These individuals with acquired pure prosopagnosia can still identify people from the voice or other non-visual information, and their face recognition impairment cannot be explained by loss of visual acuity, memory and intelligence. These cases provide a unique and timely opportunity to test whether patients can acquire perceptual expertise with non-face objects, thereby directly testing the face-specificity and expertise hypotheses. We have access to several cases of acquired pure prosopagnosia, and will attempt to train them to become perceptual experts with novel objects and measure their recognition performance during the course of training on a series of perceptual tests that tap holistic processes. In contrast to previous work, we will use an intensive training program (at least 20 hours); we will emulate natural learning situations (e.g., learning the objects from different viewpoints and under different lighting conditions); and we will track the time course of expertise acquisition for patients.

The patients' performance with the novel objects will be compared to age-, sex- and education-matched neurologically intact volunteers and to a larger sample of younger volunteers. For the younger control volunteers, we further test a novel prediction of the expertise hypothesis: That objects of expertise will compete with faces for limited neural resources available. To test this prediction, we will use functional brain imaging to measure how responses from brain regions of the putative face network are affected as volunteers becomes experts with our novel objects. The results will complement those from the patients.

In sum, we combine a neuropsychological approach with intensive training and brain imaging to dissect the mechanisms of proficient face recognition. The results will have an impact on clinical populations which can result in face recognition deficits, such as Alzheimer's disease, stroke patients, and developmental disorders that affect social interactions (e.g., Autism). Although we focus on individual case studies, our approach will lead to definitive results which will have a broad impact on the neurologically-intact population and these clinical populations.

Planned Impact

Our proposed research has an impact for psychologists, neuropsychologists, social scientists, clinicians and therapists, and will have broad appeal to the public. Here we summarise the social and health impact of the proposed research.

Social and Public Impact
First and foremost, our proposed research will directly benefit the individuals with acquired pure prosopagnosia who volunteer their time and energy to participate in our study. They are acutely aware of their deficit and must cope with it on a daily basis. The findings will help them understand the deficit while at the same time allowing them to contribute to science. Our quantitative test batteries may also help to identify areas of strengths and weaknesses in their perceptual abilities. We can therefore target their weaknesses or capitalise on their strengths to individually help them cope with their face recognition deficits. Furthermore, our research will have a positive impact on family, friends and the general public, as they will also have a better understanding and awareness of perceptual face recognition deficit. For instance, our results will highlight that poor social interactions can be due to perceptual deficits rather than due to deficits in social and communication skills.

Second, our proposed research will have an impact on more common and potentially more devastating clinical conditions. Although cases of acquired prosopagnosia are relatively rare, the outcomes of our proposed research will help in other clinical domains. For example, strokes or dementia can lead to profound visual deficits in both face and object recognition. There is also growing evidence for a form of congenital or developmental prosopagnosia, which is a life-long impairment in face recognition that is not caused by brain damage. These cases of congenital prosopagnosia would be highly prevalent in the population (about 2%). Even though the two forms of prosopagnosia are likely to be qualitatively different, the outcomes of this proposed research can help develop better assessment tools and rehabilitation programs for these people. Lastly, there are also developmental disorders, such as Autism, that can lead to abnormal face recognition and social interaction skills.

Health Impact
Finally, our proposed research will have an impact on clinicians and therapists. Through them, our research outcomes can have an impact on national health in the long term. Our scientific objectives are to understand proficient face recognition at the theoretical, behavioural and neural level. The outcome of the proposed research may also show brain plasticity even for the damaged adult brain. Thus, this holistic understanding of proficient face recognition will allow clinicians and therapists to develop more effective therapies targeted for individual patients. Furthermore, our proposed research can help them develop better rehabilitative programs and better neuropsychological assessment tools.

Overall, by testing rare cases of acquired pure prosopagnosia, this collaborative grant is an excellent opportunity to put the UK in the forefront of a highly prominent and socially important topic in psychology, neuropsychology, and social/cognitive neuroscience.

Publications

10 25 50
 
Description The main aim of the research grant is to investigate the changes that occur in the adult human brain as they acquire expertise with artificial (i.e., unfamiliar) objects through extensive training. We planned to test healthy participants and those who have prosopagnosia, which is an inability to recognize faces.

Our main findings are as follows:

1. We created artificial objects in such a way that they can resemble faces (facelike) or not (nonfacelike). We have shown that facelikeness can influence how well healthy adult volunteers can recognize these objects. These volunteers have no prior experience with these objects. This finding suggests that volunteers are using a "face template" to help them recognize unfamiliar objects that resemble faces.

2. We trained adult volunteers to recognize a large number of the artificial objects and recorded their brain responses before and after training using electroencephalography (EEG). This method measures electrical activity on the scalp and can be used to measure the extent to which the brain rapidly and automatically recognizes objects. One group (N = 15) was trained with facelike objects and the other group (N = 15) was trained with nonfacelike objects. Both groups were able to quickly recognize the objects by the end of the 3-week training period. We found that for the facelike group, there were behavioural and neural changes following training. By comparison, the nonfacelike group showed some behavioural changes but did not show any neural changes. These findings suggest that volunteers use their "face template" to enhance the development of expertise for a new object category during visual learning.

3. We adapted our EEG paradigm for functional magnetic resonance imaging (fMRI). This imaging technology measures changes in the blood-oxygen level in different brain regions, which reflects changes in the brain activity of those regions. This is an important adaptation because our fMRI paradigm provides a much higher signal-to-noise ratio than standard fMRI paradigms, and fMRI allows us to find which parts of the brain respond to our objects or which parts change following training. We have been able to replicate some of the EEG results with faces using fMRI with a large number of adult volunteers (N = 25). We also tested a participant with prosopagnosia (PS) with the fMRI paradigm. PS suffered a closed-head injury which damaged the parts of her brain that is used for processing the identity of faces. We replicated previous results using standard fMRI methods and helped to clarify which brain regions are important for discriminating between face and other objects (cars, houses, cats, etc.) and which regions are important for identifying individual faces. We have piloted our training paradigm (N = 6), and currently analyzing the data. Through our collaborations, we are also testing different variations of the fMRI paradigms (York University, Canada; University of Maastricht).

4. We tested a prosopagnosic patient PS using our new fMRI method. PS had a traumatic brain injury which impaired her ability to visually recognize faces, even of people she is very familiar with like her family. Surprisingly, she still shows activation in the fusiform face area (FFA) when presented with pictures of faces even though she cannot recognize faces. The FFFA is region that is suppose to be involved in face recognition. Because the new method is more sensitive, we were able to better character the FFA in PS, and other regions of a face network not damaged in PS. Our findings help to better understand what information is processed by the different regions of the face network.

Our main development are as follows:

5. We created a new set of artificial objects in a 3D modelling software that allows researchers to create a very large number of objects in a very systematic way. Importantly, researchers can systematically change a number of objects features that may be important for visual recognition (e.g., the number of parts, the shape of these parts, etc.). We provide programs to facilitate stimulus generations and to measure different aspects of the final set of objects created (e.g., how visually similar objects in the set are to each other). The 3D models and program will be made freely available to the research community. This is an important development because this is the first 3D object set that allows researchers to efficiently create a large number of objects in a systematic way to test different theories of face and object recognition.

6. We developed a new training program that builds on and extends previous programs. For example, our program uses a larger variety of training tasks to engage the volunteers, we show objects from many different viewpoints, and we test for a much longer period (3-weeks, ~24-28 hours). Our EEG results demonstrates that this training program is effective. This development is important because we wanted to create a laboratory-based training program that was more similar to real-world learning.

7. We developed new frequency analyses of the data collected with our fMRI paradigm. We will make these new analysis techniques freely available to the research community.
Exploitation Route Our EEG results with healthy participants provide strong justification to test prosopagnosic volunteers who may not be able to develop expertise for any new object domain due to their brain damage.

Our new artificial object set can be used to address what are the important features for face and object recognition.

Our new fMRI paradigm can be used to test different issues in visual face and object recognition.
Sectors Communities and Social Services/Policy,Education,Other

 
Description Given the social importance of the human face, there is a strong need to reach the public communities and communicate our findings. 1. I have shared my findings about how visual learning changes the brain with the BBC. They made programs related to how different types of learning can ameliorate the decline in cognition with ageing ("Trust me I'm a doctor", 2015; and "How to stay young" 2017). 2. I discussed face recognition as part of a Holmes lecture series at Newcastle University (January, 2018). The lecture series present results to children between the age of 6 and 10 years of age. There were about 200 people (children, teachers, parents) in the audience. 3. We are developing a website to share our scientific results with the public.
First Year Of Impact 2015
Sector Communities and Social Services/Policy,Education,Other
Impact Types Cultural,Societal

 
Title Perceptually validated similarity measures 
Description We have implemented two physical measures of similarity both of which show a high correlation with human similarity ratings. These measures are implemented in Matlab as part Vuong et al. (2016; see URL and DOI). 
Type Of Material Model of mechanisms or symptoms - human 
Year Produced 2016 
Provided To Others? Yes  
Impact N/A 
URL http://reshare.ukdataservice.ac.uk/852397/
 
Title EEG data 
Description This database provides the EEG data for any further analyses. 
Type Of Material Database/Collection of data 
Year Produced 2018 
Provided To Others? Yes  
Impact N/A 
URL http://reshare.ukdataservice.ac.uk/852404/
 
Title Novel parametric 3D objects 
Description We have developed and validated a new 3D stimulus set of novel objects. We can systematically manipulate the overall 3D shape of each object, its part and its surface texture so that the similarity of the set of these novel objects can be precisely controlled. This stimulus set will allow researchers to easily create a large set objects in a systematic and controlled manner to test different theories of face and object recognition, and different theories of visual learning. We have been using the stimulus set in our learning study to see how volunteers, including those with brain lesions, can learn to individuate each stimulus (e.g., by learning its unique name). As part of this data set, we have included scripts to facilitate and automate some of the stimulus generation process (in Studio Max and in Matlab). The database is also on Reshare (see URL below). Part of this work has been presented in abstract form (Willenbockel V, Lochy A, Laguesse R, Dryden A R, Rossion B, Vuong Q C, 2014, A parametric three-dimensional stimulus set controlled for perceptual similarity Perception 43 ECVP Abstract Supplement, page 167). The paper is now accepted: Vuong QC, Willenbockel V, Zimmermann FGS, Lochy A, Laguesse R, Dryden A, Rossion R (2017). Facelikeness matters: A parametric multipart object set to understand the role of spatial configuration in visual recognition. Visual Cognition. 
Type Of Material Database/Collection of data 
Year Produced 2014 
Provided To Others? Yes  
Impact N/A 
URL http://reshare.ukdataservice.ac.uk/852397/
 
Title Training program and behavioural data 
Description This database provides information about the training program and provides the behavioural data for any further reanalyses. 
Type Of Material Database/Collection of data 
Year Produced 2016 
Provided To Others? Yes  
Impact N/A 
URL http://reshare.ukdataservice.ac.uk/852396/
 
Title fMRI data 
Description This database provides the fMRI data for any further analyses. 
Type Of Material Database/Collection of data 
Year Produced 2018 
Provided To Others? Yes  
Impact N/A 
URL http://reshare.ukdataservice.ac.uk/852398/