Segmentation in 4D visual search

Lead Research Organisation: University of Birmingham
Department Name: School of Psychology

Abstract

The ability to select objects that are relevant to our behavioural goals is critical for guiding action in complex environments - as when we want to find a friend in a crowd or reach to an object across a cluttered table. This ability depends on processes that can segment visual scenes rapidly into appropriate figure and ground regions, defined in 4D space and time. Prior work has used visual search to explore this issue, with the efficiency of search used as a measure of the ease with which segmentation takes place. This work has shown that segmentation operates efficiently using depth, motion and temporal cues, but we still know little about (i) how some of these forms of segmentation operate, and (ii) how these different cues interact to guide attention to relevant stimuli. This project will combine behavioural and functional imaging methods to provide detailed information on how the different forms of segmentation operate and interact. A first set of behavioural studies will evaluate the evidence for excitatory processes, that guide search to targets, and inhibitory processes that suppress distractors, when displays segment by depth, motion and time. Subsequently we will detail the relations between these process, varying the expectations that participants have about the depth and motion properties of targets. These behavioural experiments will be complemented by functional imaging studies which examine the neural basis of the different forms of segmentation and whether there are common neural mechanisms that are invariant to cue-type. Finally, the necessary role of the neural regions in processing will be assessed by altering activity in targeted areas using trans-cranial magnetic stimulation (TMS). Through the TMS work, and by constructing explicit models of the interactions between neural regions, we will gain new information about how networks of brain regions co-operate to facilitate the selection of visual targets. The work provides the first detailed analysis of the relations between the different forms of segmentation, and their neural basis, using visual search.

Technical Summary

Human attention operates efficiently in time and space to select targets that are relevant to our behavioural goals. Currently we have sparse knowledge about how some critical properties of scenes are used to guide selection (notably how depth information is used) and we also know little about how different cues combine to optimise behaviour. We will provide detailed information about how depth, motion and temporal cues are used to segment displays and to select visual targets. Behavioural experiments will assess evidence for the roles of excitatory processes that guide search to targets and inhibitory processes that suppress distractors, when depth, motion and temporal cues are present in isolation or combination. The nature of these different processes, and how they interact, will then be characterised. The behavioural studies will be complemented by brain imaging experiments that assess the neural basis of spatial and temporal segmentation in search. We will isolate brain regions that respond in a cue-specific manner from areas that are cue-invariant. We will also test the necessary role of these regions by altering activity through trans-cranial magnetic stimulation (TMS). The TMS procedures will be used alongside explicit modelling of neural connectivity (through Dynamic Causal Modelling) to provide novel information on how different brain regions interact to guide search through space and time.

Publications

10 25 50
 
Description The project has generated several key findings:



1. It has shown for the first time the necessary role of parietal cortex in efficient search with moving stimuli

2. It has revealed common brain regions for efficient search by time and motion, which are linked to spatially parallel segmentation of targets and distractors,

3. It has reveal a specific role for distractor suppression in efficient visual search.
Exploitation Route Potential use in computer vision and in neuropsychological assessment The work is basic science but it provides guidance on the way that visual segmentation could be implemented in computer vision and how tests of temporal and motion-based search could be developed to understand deficits in these processes.
Sectors Healthcare

 
Description To inform scientific models of visual selective attention.
First Year Of Impact 2011
Sector Other