Segmentation in 4D visual search
Lead Research Organisation:
University of Birmingham
Department Name: School of Psychology
Abstract
The ability to select objects that are relevant to our behavioural goals is critical for guiding action in complex environments - as when we want to find a friend in a crowd or reach to an object across a cluttered table. This ability depends on processes that can segment visual scenes rapidly into appropriate figure and ground regions, defined in 4D space and time. Prior work has used visual search to explore this issue, with the efficiency of search used as a measure of the ease with which segmentation takes place. This work has shown that segmentation operates efficiently using depth, motion and temporal cues, but we still know little about (i) how some of these forms of segmentation operate, and (ii) how these different cues interact to guide attention to relevant stimuli. This project will combine behavioural and functional imaging methods to provide detailed information on how the different forms of segmentation operate and interact. A first set of behavioural studies will evaluate the evidence for excitatory processes, that guide search to targets, and inhibitory processes that suppress distractors, when displays segment by depth, motion and time. Subsequently we will detail the relations between these process, varying the expectations that participants have about the depth and motion properties of targets. These behavioural experiments will be complemented by functional imaging studies which examine the neural basis of the different forms of segmentation and whether there are common neural mechanisms that are invariant to cue-type. Finally, the necessary role of the neural regions in processing will be assessed by altering activity in targeted areas using trans-cranial magnetic stimulation (TMS). Through the TMS work, and by constructing explicit models of the interactions between neural regions, we will gain new information about how networks of brain regions co-operate to facilitate the selection of visual targets. The work provides the first detailed analysis of the relations between the different forms of segmentation, and their neural basis, using visual search.
Technical Summary
Human attention operates efficiently in time and space to select targets that are relevant to our behavioural goals. Currently we have sparse knowledge about how some critical properties of scenes are used to guide selection (notably how depth information is used) and we also know little about how different cues combine to optimise behaviour. We will provide detailed information about how depth, motion and temporal cues are used to segment displays and to select visual targets. Behavioural experiments will assess evidence for the roles of excitatory processes that guide search to targets and inhibitory processes that suppress distractors, when depth, motion and temporal cues are present in isolation or combination. The nature of these different processes, and how they interact, will then be characterised. The behavioural studies will be complemented by brain imaging experiments that assess the neural basis of spatial and temporal segmentation in search. We will isolate brain regions that respond in a cue-specific manner from areas that are cue-invariant. We will also test the necessary role of these regions by altering activity through trans-cranial magnetic stimulation (TMS). The TMS procedures will be used alongside explicit modelling of neural connectivity (through Dynamic Causal Modelling) to provide novel information on how different brain regions interact to guide search through space and time.
Organisations
Publications
Dent K
(2010)
Deficits in visual search for conjunctions of motion and form after parietal damage but with spared hMT+/V5.
in Cognitive neuropsychology
Dent K
(2011)
Neuropsychological evidence for a competitive bias against contracting stimuli.
in Neurocase
Dent K
(2011)
Comparing segmentation by time and by motion in visual search: an FMRI investigation.
in Journal of cognitive neuroscience
Dent K
(2011)
Spreading suppression and the guidance of search by movement: evidence from negative color carry-over effects.
in Psychonomic bulletin & review
Dent K
(2012)
Inhibitory guidance in visual search: the case of movement-form conjunctions.
in Attention, perception & psychophysics
Dent K
(2012)
Integrating space and time in visual search: how the preview benefit is modulated by stereoscopic depth.
in Vision research
Roberts KL
(2012)
Spatial and temporal attention deficits following brain injury: a neuroanatomical decomposition of the temporal order judgement task.
in Cognitive neuropsychology
Dent K
(2012)
Parallel distractor rejection as a binding mechanism in search.
in Frontiers in psychology
Dent K
(2014)
Surface-based constraints on target selection and distractor rejection: evidence from preview search.
in Vision research
Roberts KL
(2015)
Visual search in depth: The neural correlates of segmenting a display into relevant and irrelevant three-dimensional regions.
in NeuroImage
Description | The project has generated several key findings: 1. It has shown for the first time the necessary role of parietal cortex in efficient search with moving stimuli 2. It has revealed common brain regions for efficient search by time and motion, which are linked to spatially parallel segmentation of targets and distractors, 3. It has reveal a specific role for distractor suppression in efficient visual search. |
Exploitation Route | Potential use in computer vision and in neuropsychological assessment The work is basic science but it provides guidance on the way that visual segmentation could be implemented in computer vision and how tests of temporal and motion-based search could be developed to understand deficits in these processes. |
Sectors | Healthcare |
Description | To inform scientific models of visual selective attention. |
First Year Of Impact | 2011 |
Sector | Other |