High-resolution multimodal imaging for multisensory interactions
Lead Research Organisation:
University of Birmingham
Department Name: School of Psychology
Abstract
Recent developments in functional magnetic resonance imaging (fMRI) have transformed our understanding of the human brain, its sensory processing and cognitive functions by providing a means of localising the cortical regions that are involved in a wide variety of tasks. Despite this progress, the link between brain structure, function and behaviour that guides human actions and interactions remains a key unresolved issue in cognitive neuroscience. To address this issue we propose multimodal imaging methods (high resolution fMRI combined with EEG) that have complementary high spatial and temporal resolution and will allow us to study the human brain in real time action. In particular, the proposed research has the following main objectives. First, we will take advantage of the capabilities of the state-of-the-art MR scanner in our imaging centre (3T Phillips, Achieve) and develop high resolution fMRI protocols using a surface coil that will allow us to study the human brain at a higher spatial resolution, that is, at a finer scale of neural ensembles within cortical areas. Second, we will combine these high spatial resolution fMRI measurements with EEG recordings in the scanner that have high temporal resolution critical for studying the fast cognitive processes that guide our actions and interactions. Third, we will use these combined high resolution imaging methods (EEG-fMRI) to study the human brain in real time action. Our aim is to understand how the human brain integrates multiple sources of information from different sensory modalities (vision, audition, touch) and translates them to fast and successful actions. The existing MR compatible equipment allows visual and tactile stimulation and recordings of eye and limb movements. We will integrate these devices with the proposed equipment for auditory and heat stimulation to investigate the neural circuits that mediate the integration of sensory, proprioceptive and motor signals in the human brain that guide our categorical perception, attention, learning and actions in the complex environments we inhabit. Finally, we will extend the application of these methods and protocols to the study of multisensory and motor integration across the life span and in the adverse event of brain damage. We aim to examine the mechanisms that lead to rapid cognitive decline in some older adults while others maintain high levels of cognitive performance using sensitive tools for the measurement and analysis of age-related changes in behaviour, brain structure and neural function. Further, we will conduct high resolution imaging studies in patients with neuropsychological deficits that offer the potential of determining which areas are necessary for behaviour. We will examine the effects of brain lesions on activation in structurally intact regions of cortex, in order to gain new information about the functional connectivity between brain areas and potential cortical reorganisation that may support recovery of function in the impaired brain. As such this work has the potential to provide novel methods and findings that advance our understanding of the link between brain and behaviour and thus contribute to the general health and wealth as well the development of interdisciplinary and internationally competitive research in the UK.
Technical Summary
Understanding the link between brain structure, function and behaviour is a key question in cognitive neuroscience. Recent advances in functional magnetic resonance imaging (fMRI) provide powerful tools for studying this question in a non-invasive manner in the human brain. However, the nature of the BOLD signal measured by fMRI imposes limitations in the spatial and temporal resolution of this technique. To overcome these limitations, we propose multimodal imaging methods (high spatial resolution fMRI combined with high temporal resolution EEG) that allow us to characterise the neural dynamics and function of fine neural ensembles within cortical areas. In particular we aim to study the neural circuits that mediate multisensory (vision, audition, touch) and motor interactions in the normal, ageing and impaired human brain. First, we will develop high resolution fMRI methods using a flexible surface coil that will allow us to zoom into their neural processing of cortical regions of interest and characterise the distribution and function of different neural populations within these regions. Second, we will develop protocols for combined EEG-fMRI recordings in the scanner that allow the electrical and haemodynamic responses to be recorded simultaneously during the same session. Third, we will exploit and advance analysis methods for combined EEG-fMRI measurements based on statistical learning approaches and single trial analyses. Fourth, we will combine these high resolution imaging methods (EEG-fMRI) with multimodal stimulation (visual, auditory, tactile) for examining the link between multisensory perception and action in the human brain in real time. These combined high resolution EEG-fMRI methods provide a unique tool for studying neurovascular coupling non-invasively in the human brain and monitoring neural changes due to learning-based plasticity or cortical reorganisation in the intact or neuropsychologically impaired brain across the life span.
Publications
Chang DH
(2014)
Training transfers the limits on perception from parietal to ventral cortex.
in Current biology : CB
Chen D
(2010)
Behavior-constrained support vector machines for fMRI data analysis.
in IEEE transactions on neural networks
Chua SYP
(2022)
Cultural differences in visual perceptual learning.
in International journal of psychology : Journal international de psychologie
Duncan KK
(2010)
Identifying spatially overlapping local cortical networks with MEG.
in Human brain mapping
Frangou P
(2019)
Learning to optimize perceptual decisions through suppressive interactions in the human brain.
in Nature communications
Gerardin P
(2010)
Prior knowledge of illumination for 3D perception in the human brain.
in Proceedings of the National Academy of Sciences of the United States of America
Jia K
(2022)
Neurochemical and functional interactions for improved perceptual decisions through training.
in Journal of neurophysiology
Jia K
(2021)
A protocol for ultra-high field laminar fMRI in the human brain.
in STAR protocols
Karlaftis V
(2021)
Functional Interactions between Sensory and Memory Networks for Adaptive Behavior
in Cerebral Cortex
Description | During the duration of the grant we established the following methodologies that have been implemented in the proposed research projects. 1. We developed high resolution functional imaging methods (EPI data collected at 1x1x1mm resolution and 1.5 x1.5x 1.5 mm that extend beyond the standard resolution used for fMRI data collection (3x3x5mm). This high resolution imaging allows us to study the human brain at the level of increasingly finer neural populations within large cortical areas. 2. We developed state-of-the-art statistical learning analysis methods that extend beyond the resolution of conventional fMRI analysis methods. In combination with high resolution imaging these methods allow us to discern different neural populations within cortical areas and their representations. 3. We developed protocols for combined EEG (MR-compatible 64 channel EEG system) and fMRI recordings at the BUIC scanner that allow the electrical and haemodynamic responses to be recorded simultaneously during the same session. 4. We have successfully interfaced MR-compatible equipment at BUIC for visual, tactile stimulation and movement recordings (eye, limbs) with the proposed equipment for auditory and noxious heat stimulation. 5. We have successfully piloted procedures to create "offset analgesia" in and out of the scanner using CHEPS and this work has been accepted for publication. 6. We developed EEG procedures using CHEPS and this work has been submitted for publication. We are now able to begin combined EEG/fMRI projects. 7. We successfully piloted signal detection studies using CHEPS and this work has been accepted for publication. We are now able to move this work into the scanner for combined EEG/fMRI studies. |
Exploitation Route | All methods developed during the duration of these award are now available to all users of the facilities at the Birmingham University Imaging Centre. Further, these methods are made available to the wider scientific community through interactions and collaborations with other imaging centres in the UK and abroad |
Sectors | Healthcare |
Description | All methods developed during the duration of these award are now available to all users of the facilities at the Birmingham University Imaging Centre. Further, these methods are made available to the wider scientific community through interactions and collaborations with other imaging centres in the UK and abroad |
First Year Of Impact | 2008 |
Sector | Manufacturing, including Industrial Biotechology |
Impact Types | Economic |
Description | ABC: Adaptive Brain Computations |
Amount | £2,923,000 (GBP) |
Funding ID | FP7-PEOPLE-2011-1-1-ITN 290011 |
Organisation | European Commission |
Sector | Public |
Country | European Union (EU) |
Start | 05/2012 |
End | 05/2016 |
Description | Attentional demands of state transitions in posture and balance |
Amount | £449,843 (GBP) |
Funding ID | BB/F010087/1 |
Organisation | Biotechnology and Biological Sciences Research Council (BBSRC) |
Sector | Public |
Country | United Kingdom |
Start | 01/2008 |
End | 12/2011 |
Description | Classification decisions in machines and human brains |
Amount | £1,170,116 (GBP) |
Funding ID | BB/E017436/1 |
Organisation | Biotechnology and Biological Sciences Research Council (BBSRC) |
Sector | Public |
Country | United Kingdom |
Start | 03/2007 |
End | 10/2010 |
Description | Co-ordination for optimal decisions in dynamic environments |
Amount | £2,438,000 (GBP) |
Funding ID | FP7-PEOPLE-2007-1-1-ITN 214728 |
Organisation | European Commission |
Sector | Public |
Country | European Union (EU) |
Start | 01/2008 |
End | 12/2012 |
Description | Learning and brain plasticity: understanding individual variability across the lifespan. |
Amount | £44,637 (GBP) |
Funding ID | RF-2011-378 |
Organisation | The Leverhulme Trust |
Sector | Charity/Non Profit |
Country | United Kingdom |
Start | 04/2011 |
End | 10/2013 |
Description | Lifelong learning and cortical plasticity in the human brain |
Amount | £3,000 (GBP) |
Organisation | Biotechnology and Biological Sciences Research Council (BBSRC) |
Sector | Public |
Country | United Kingdom |
Start | 08/2008 |
End | 09/2011 |
Description | Unified probabilistic modeling of adaptive spatio-temporal structures in the human brain |
Amount | £767,105 (GBP) |
Funding ID | BB/H012508/1 |
Organisation | Biotechnology and Biological Sciences Research Council (BBSRC) |
Sector | Public |
Country | United Kingdom |
Start | 08/2010 |
End | 08/2013 |
Description | Visual-spatiotemporal integration for recognition |
Amount | £133,000 (GBP) |
Funding ID | FP7-PEOPLE-2009-IIF 255577 |
Organisation | European Commission |
Sector | Public |
Country | European Union (EU) |
Start | 08/2010 |
End | 08/2012 |