Top-down and bottom-up selective mechanisms in attention: subcortical convergence in visual thalamus?

Lead Research Organisation: University College London
Department Name: Institute of Ophthalmology

Abstract

If a lime gets amongst the lemons at a supermarket fruit stall, it's easily spotted. But a rogue satsuma nestling amidst the clementines is less easily detected, and a novice stock-keeper might need it to be physically pointed out, before he can see it. These are simple examples of two converse ways in which we select an item deserving of attention, referred to by psychologists as 'bottom-up and 'top-down', respectively. In the first example the conspicuous quality of the misplaced lime is termed 'salience'. No property (e.g. 'green' or 'oval shaped') is inherently salient , it all depends on context. In Piccadilly Circus, where everything is designed to be salient, nothing really dominates - giving the sensation of being visually overwhelmed, and not knowing where to look first. In this situation, a 'top-down' instruction - a pointing cue, or a verbal command, can be rather helpful. Redirecting gaze is the typical expression of visual attention, but is not automatic. The focus of attention - the mind's eye - may rove about whilst gaze is frozen (as in social groupings, to avoid eye contact). Attention thus precedes an eye movement, and our aim is to study exactly what happens in the brain at this formative stage. We propose to do this by recording neural activity in the thalamus, a brainstem organ generally responsible for regulating the traffic of sensory information amongst different areas of the cerebral cortex (the brain's top level of information processing). As a strategy, this could be likened to studying the operation of a TV broadcast controlroom, as it covers, say, a Formula 1 Grand Prix. The controlroom receives multiple feeds from all over the racecourse, and the TV-director selects the most dramatic action for transmission to the viewing public. In the terms of this analogy, the thalamus (and in particular a component known as the 'pulvinar') assesses feeds from multiple areas of cerebral cortex - some describing events as they occur, others predicting such events. However, the pulvinar's 'viewing public' is nothing other than the set of cortical areas that provide its input. In other words, the pulvinar is in two-way communication with the cerebral cortex, and acts as a device enabling cortical areas to vote amongst themselves which visible item is the most attention-worthy. Attention is absent under anaesthesia, so we plan to record thalamic activity from an alert, nonhuman primate (NHP). The animal is confronted with an array of items and trained to select the salient item, or a non-descript one that has been pointed out by a suitable visual cue. A neuron in the thalamus, like other visual centres, has a restricted 'receptive field' (RF) - it scrutinises a certain window in the field of view. We locate the RF of a neuron under study, and arrange that it contains the salient, or cued item. Next trial, the target item may be elsewhere. We seek to find neural activity that corresponds to the behavioural significance of the item within the RF, independent of its particular visual features. The timing of activity may vary between the experimentally arranged bottom-up and top-down circumstances and especially, also, between thalamic subdivisions that are differentially connected to bottom-up and top-down cortical pathways. There is another twist to the strategy. We adjust the level of difficulty of the task and monitor how well the NHP performs. It may take longer to reach a decision, or begin to make mistakes. Changes in activity are calibrated against accuracy of performance, to index the dependency of behaviour on specific neural activity. Finally, we can also apply artificial pharmacological stimulation or inhibition to the test site to see if we can influence the selection of the item in its RF - will these artificial manipulations change behavior in line with predictions furnished by neural recordings?

Technical Summary

The LGN may differentially amplify selective features of the visual image. In the pulvinar, a 2nd-order thalamic nucleus, cortical inputs replace retinal ones. A signature characteristic - the 'replication principle' - is that reciprocally linked pairs of cortical areas are also enabled to connect indirectly via the pulvinar. If direct intercortical links are adept at feature information transfer, the pulvinar may act to regulate transcortical traffic. Neural models of attention posit a competitive process between rival visible items. Since each item is represented across multiple areas of cortex, a mechanism is inferred to ensure that the dominant activation in each area does not derive from different items - to avert a fragmented, rather than focused state of attention. The project asks if the pulvinar and LGN together are instrumental in so coordinating cortical activity. Automatic bottom-up mechanisms of spatial selection will be contrasted with top-down selection mediated by a symbolic cue. NHPs will be trained to select a salient item, or a cued item from an array of distractors, and we shall look for a neuro-behavioural correlate between psychophysical task performance over a range of difficulty, and concurrently recorded thalamic activity. We shall also apply pharmacologically mediated stimulation and inhibition to the test site, to test the predicted effects upon task performance. We also aim to distinguish the functions of the dorsal and ventral pulvinar subdivisions (DP and VP). DP is directly linked to a fronto-parietal attention control network, VP to the ventral pathway for object analysis - associating DP and VP with cued or salience driven mechanisms respectively. DP and VP do not communicate directly, but indirect circuits exist to transfer salience and cue information between them. The nature of the circuitry thus predicts the relative timing of top-down and bottom-up attentional mechanisms within DP and VP, and between pulvinar and LGN.

Publications

10 25 50
publication icon
Andolina, I.M. (2013) Spike stochastics during figure-ground discrimination in primate LGN in Neuroscience Meeting Planner. San Diego, CA: Society for Neuroscience, 2013. Online

publication icon
Jones HE (2015) Figure-ground modulation in awake primate thalamus. in Proceedings of the National Academy of Sciences of the United States of America

publication icon
Jones, H.E. (2013) Figure-ground modulation in primate LGN in Neuroscience Meeting Planner. San Diego, CA: Society for Neuroscience, 2013. Online

 
Description The global objective of our work was to advance our understanding of the way the central visual system reconstructs the visual world from the retinal input with particular emphasis on the role of the looped feedback circuits involving the lateral geniculate (LGN) and pulvinar thalamic components of the visual system, and their role in attentional mechanisms.

Perceptually, our visual system reconstructs objects from the diverse components of early distributed processing by grouping image elements and segregating them from the background as a figure. Detection of a salient target is a standard means of investigating bottom-up attentional mechanisms and our primary task was based on the use of a figure ground pop-out paradigm.

Figure-ground discrimination refers to the perception of an object, the figure, against a nondescript background. Neural mechanisms of figure-ground detection are commonly linked to feedback interactions between higher centers and primary visual cortex, and held to index the impact of global analysis upon local feature encoding. In the current work, in recordings from visual thalamus of alert primates, we demonstrated a robust enhancement of neuronal firing when the figure, as opposed to the ground, component of a motion-defined figure-ground stimulus was located over the receptive field. Stochastically, visual stimulation of the receptive field and its near environs was identical across both conditions, suggesting that the response enhancement reflects higher integrative mechanisms. It thus appears that cortical activity generating the higher order percept of the figure is simultaneously re-entered into the lowest level that is anatomically possible - the thalamus - so to govern the dynamics of the evolving featural representations in the cortex. This suggests that the signature of a higher order percept is fed back into the thalamus in a re-entrant manner, thus changing the information relayed to the cortex. It argues for a re-evaluation of some of the iterative neural mechanisms that represent and extract salient features of the visual world.

Overall, this work has provided a significant advance in our understanding of the contribution of thalamic processes to the mechanisms of visual perception and attention. The surprising complexity of the responses in the LGN added an extra dimension to the way we originally conceived the work and the results have delivered new insight into the way the LGN is linked into these brain mechanisms.
Exploitation Route Our data have contributed in an original way to the understanding of the processes of vision by probing higher order visual processes standing in the interface between cortex and thalamus. As the thalamo-cortico-thalamic circuitry is broadly common to all mammalian sensory systems, the recognition of what happens in the visual system should generalize across other modalities. By adding to knowledge of how the brain musters finite resources to tackle very complex problems the results may also guide strategies driving computational approaches to vision and contribute to ways of optimising system performance with finite resources in the development of artificial visual systems for computational, industrial and medical systems. The work has also advanced knowledge of a key brain mechanism with relevance to health and disease. Our data suggest that the visual input from the thalamus to the cortex is constantly rephrased in terms of the priors reflecting the interpretation extracted by higher levels and the attentional focus. This may have major consequences for our understanding of filling in mechanisms operating in retinal disease and the way in which cortical feedback projections may generate hallucinations in AMD patients with denervated thalamus and in schizophrenia.
Sectors Healthcare,Pharmaceuticals and Medical Biotechnology

 
Description This work has contributed in an original way to the understanding of the processes of vision by probing higher order visual processes standing in the interface between cortex and thalamus. By adding to knowledge of how the brain musters finite resources to tackle very complex problems, the results are highly relevant in guiding strategies driving computational approaches to vision and the development of artificial visual systems for computational, industrial and medical systems. The work has also advanced knowledge of a key brain mechanism with relevance to health and disease.
First Year Of Impact 2014
Sector Healthcare,Other
Impact Types Societal,Economic

 
Description Cudeiro BBSRC 
Organisation University of A Coruña
Country Spain 
Sector Academic/University 
PI Contribution Our laboratories have complementary expertise and research programmes - we have developed a new visual display/acquisition program to enable us to gather data for the project and the programming for this has been made available to them. The results from the work carried out here have also driven a new project in Spain, where they have access to certain techniques that we do not.
Collaborator Contribution Team members have visited their laboratory to acquire complementary expertise necessary for this project and have participated in experiments there as well.
Impact New Software - Opticka Manuscripts currently under review and in preparation.
Start Year 2010
 
Title Opticka visual stimulation presentation and experimental control and analysis software 
Description Opticka Stimulus Generator is an object oriented framework with optional GUI for the Psychophysics toolbox (PTB), allowing randomised interleaved presentation of complex stimuli. It is designed to work on OS X, Windows (currently no digital I/O) or Linux, and interfaces via strobed words (using either a DataPixx [15bit] or a LabJack [11bit]) and ethernet with a Plexon Omniplex for recording neurophysiological data. Behavioural control uses the Eyelink eye tracker and a full behavioural repertoire is available by using a state-machine logic. Opticka uses the ethernet interface to the Eyelink thus affording much better control and reliability over using the analog voltages alone. The various classes can be used without the need to run the GUI and stimuli provide a unified interface (setup, animate, draw, update, reset) to integrate into standard PTB routines. The various object methods take care of all the background geometry and normalization, meaning stimuli are much easier to use than "raw" PTB. Analysis routines are also present for taking the raw Plexon files (.PLX or .PL2) and Eyelink files (.EDF) and parsing them into a consistent trials and variable structure, for analysis in matlab, or interfacing directly with Fieldtrip for further spike and LFP analysis. 
Type Of Technology Software 
Year Produced 2012 
Open Source License? Yes  
Impact This visual display and experimental control software has underpinned our ability to generate the necessary visual stimuli and control paradigms to gather the experimental data in our acute and behaving primate work. The software is now also being used by one of our collaborators on the project. 
URL https://github.com/iandol/opticka/tree/v1.004