Dynamic modulation of brain states using brain stimulation and neuroadaptive Bayesian optimization

Lead Research Organisation: University of Surrey
Department Name: Psychology

Abstract

Like an orchestra that relies on the coordinated efforts of its members, the brain depends on its many regions working together to perform the multitude of cognitive functions that makes us human. These functions allow us to solve problems, retrieve relevant information from memory and select the responses necessary to perform a particular task. In order to do this, the brain must coordinate the interactions between regions located far apart.

One of the greatest challenges of modern neuroscience is to understand how these interactions occur, and how their occurrence gives rise to efficient behaviour. A tool capable of influencing the interactions between brain regions could help scientists understand better how a particular pattern of brain activity is associated to efficient behaviour, such as being able to retain information in memory or solve a problem. Such a tool could then be applied to neurological and psychiatric conditions, where the interactions between brain regions might be malfunctioning.

The objective of this project is to develop this tool. In order to do this, we will combine functional magnetic resonance imaging (fMRI), non-invasive electrical brain stimulation and machine learning. Each of these techniques brings a critical element to this tool.
FMRI is a technique widely used by neuroscientists to provide images with information about brain function. Non-invasive electrical brain stimulation is a technique that applies low-voltage current through the scalp and can change the activity of neurons without requiring surgery to implant electrodes. This technique has been shown to influence brain function and the interactions between brain regions. Electrical brain stimulation, however, can be applied in many different ways, thereby making it difficult to know what would work for to influence a particular interaction between a set of brain regions. In addition, the results of brain stimulation can vary depending on factors such as a person's age, sex, brain anatomy and genetics. This makes creating a tool capable of identifying the stimulation parameters for each individual like 'finding a needle in a haystack'. This is why machine learning is necessary, where a computer program "learns" to identify which brain stimulation parameters optimally engage brain regions involved in cognitive functions in a time frame that would not be possible using conventional methodologies.

In essence, our tool will use brain stimulation to influence how brain regions interact, fMRI data analysed while the participant is receiving a certain type of stimulation to inform on how the brain reacts to it, and machine learning to select the next stimulation that should be investigated. By the end of the experiment we will obtain a map with the brain's responses to different stimulation conditions, and a prediction of what the optimal stimulation condition to elicit a brain response is.

This tool could then be used in many clinical conditions where inefficient communication between brain regions has been observed, such as psychiatric conditions and during rehabilitation after brain injury.

Technical Summary

In order to support cognitive functions, the brain must coordinate the interactions among large-scale networks that cooperate and compete to allow for efficient transitions between brain states. Understanding how these operate, giving rise to different behaviours is one of the greatest challenges facing modern neuroscience.
The overarching aim of this project is to develop a framework capable of shaping the interactions between brain networks. In order to do this, we will combine transcranial alternating current stimulation (tACS) with a novel approach, neuroadaptive Bayesian optimization.
TACS is a promising tool to modulate brain function. The oscillatory electrical activity imposed by tACS has been shown to result in neural modulations that spread along brain networks. However, there are two main limitations to the application of tACS to modulate brain function: 1) the brain networks targeted by stimulation cannot be verified in the absence of brain imaging; 2) the stimulation parameters vary across individuals, due to a multitude of variables, such as age, sex and genetic factors. Thus, identifying the optimal stimulation protocol that drives a particular brain state in a given individual is like 'finding a needle in a haystack'. To address these fundamental challenges, we propose to use neuroadaptive Bayesian optimization, which uses a close-loop search combining real-time fMRI with machine learning. This approach conducts an automatic and intelligent search across the multitude of tACS parameters in order to identify those that optimally elicit a particular target state.
This framework has translational potential, as several psychiatric and neurological conditions are associated with impaired function of large-scale brain networks. The results of this project can lead to the development of therapeutic interventions that harness the potential of brain stimulation.

Planned Impact

The research proposed in this application has the potential to generate results with substantial scope to have a wider societal and economic impact.

Societal Impact:
The health and wellbeing of the general public will benefit from this research. Several of the most common psychiatric and neurological conditions, including depression, obsessive-compulsive disorder, schizophrenia, stroke and traumatic brain injury, are associated with impaired function of large-scale brain networks. The treatment of such conditions depends on understanding the network organization of the brain. The application of brain stimulation in patient populations is currently largely agnostic to its impact in the function of brain networks and this can result in inefficient and costly treatment programmes. This research will provide important insights into the integration of non-invasive brain stimulation and modulation of the function of brain networks, allowing for more precise and cost-effective definition of treatment programmes. The PI has directly worked with clinical partners and has links to clinicians, hospitals and health providers (Imperial College Healthcare NHS Trust, King's College Hospital NHS Foundation Trust and Royal Surrey County Hospital) that can support the translation of findings into diagnostic and therapeutic interventions.

Economic Impact:
Direct and indirect costs associated with mental health and cognitive impairment after brain injury have a significant impact on the UK economy. These costs constitute an enormous problem for patients and extend to their families, the NHS and society, as they contribute to job loss, impact caregivers' productivity, can lead to family breakdown and recidivism. Unfortunately, there are limited treatment options for these conditions. The results of this project can lead to the development of therapeutic interventions that can harness the potential of brain stimulation. This project will contribute to enhance UK scientific excellence and competitiveness in brain research, which would lead to welfare benefits for patients and cost-benefits for the health-care system.

Commercial Impact:
The neurotechnology developed in this proposal could create strong links between academia and industry due to the potential to develop products associated with medical imaging and non-invasive brain stimulation interventions. Neurotechnologies for neuroenhancement using non-invasive brain stimulation devices constitute a rapidly growing industry, with more than a dozen companies selling non-invasive brain stimulation products (e.g. Foc.us, Halo Neuroscience, Caputron, etc.). According to SharpBrain, the brain fitness market is expected to grow to $6 billion by 2020 (Fortune, November 2015). However, there is currently a large gap between the understanding of the effects of these products in brain dynamics and behavior. Our research could contribute to the development of more evidence-informed neuroenhancement technologies which can tap into this market.

Public Engagement:
The PI has an excellent track record in initiating and organizing public engagement events with patients, in schools and participating in science festivals. We will disseminate the results of our research through public engagement events. These will aim at increasing the knowledge about brain research in humans, the use of neurotechnology and to improve awareness about the use of non-invasive brain stimulation devices for neuroenhancement, which interests a growing, often misinformed, DIY community (Scientific American, 2017).

Publications

10 25 50
 
Description Our brains coordinate interactions between multiple regions to support our cognitive functions. However, we still do not understand how this coordination takes place and how to improve it when affected by disease. Techniques that use non-invasive electrical stimulation (NIBS) have shown the ability to influence brain function and some are being used for therapeutic applications, for example in the treatment of depression. But NIBS can be applied with many parameters, and it is not clear whether / how they influence brain activity differently and how to select the best set of parameters for each individual.
In this project, we combined functional magnetic resonance imaging (fMRI) and NIBS to understand how different stimulation parameters (e.g. the frequency of a weak alternating current) affect brain activity and the connectivity between brain regions while participants perform a memory task. By performing this research, we achieved the following:
1. We contributed to open access data analysis tools to enhance researchers' capability of analysing brain function in parallel with data acquisition (OpenNFT).
2. We contributed to the development of an open access framework for data analysis in neuroimaging and expanded it to be able to integrate several open-source tools into flexible, reproducible, and scalable pipelines for data analysis (automatic analysis - aa).
3. We contributed to the development of a guideline/checklist to report concurrent tES-fMRI studies, such as ours, to support methodological rigor, transparency and reproducibility (ContES checklist).
4. We iteratively refined the protocols that will allow us to determine the best NIBS parameters to influence brain function.
5. We discovered that we can use machine learning approaches to identify patterns of brain function associated to different NIBS parameters.
6. We discovered that different patterns of brain function are more easily identified when exploring changes in connectivity between brain networks, instead of changes in the bulk of brain activity.
In this project we created a new framework that uses multivariate pattern analysis and machine learning tools to identify how different stimulation parameters affect brain function most reliably. These findings are important for brain stimulation interventions, both using invasive and non-invasive electrical stimulation, as they indicate sensitive approaches to investigate changes in brain function caused by short stimulation durations. These short durations are important to define useful stimulation parameters to modulate brain function. Future studies can investigate how longer stimulation durations affect brain and cognitive function.
In addition to scientific outputs and participation in conferences, we delivered four sessions discussing brain stimulation and imaging to students from years 10 to 12.
Exploitation Route The outcomes of the project can be taken forward and put to use by others in a number of ways:
1. Researchers can use the algorithms and pipelines developed in this project in their own research.
2. Researchers can take advantage of the findings of this project to implement multivariate pattern analysis and machine learning tools as a more sensitive way to explore the effects of brain stimulation on brain function.
3. Researchers can use the tools developed here to define stimulation parameters to be used in future stimulation studies.
Sectors Pharmaceuticals and Medical Biotechnology

 
Description Vice-Chancellor's Studentship Award
Amount £48,027 (GBP)
Organisation University of Surrey 
Sector Academic/University
Country United Kingdom
Start 10/2019 
End 09/2022
 
Title Neuroimaging evidence for a network sampling theory of human intelligence 
Description This zip file represents the data to support our paper in Nature communication titled "Neuroimaging evidence for a network sampling theory of human intelligence" 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
URL https://figshare.com/articles/dataset/Neuroimaging_evidence_for_a_network_sampling_theory_of_human_i...
 
Title Neuroimaging evidence for a network sampling theory of human intelligence 
Description This zip file represents the data to support our paper in Nature communication titled "Neuroimaging evidence for a network sampling theory of human intelligence" 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? Yes  
URL https://figshare.com/articles/dataset/Neuroimaging_evidence_for_a_network_sampling_theory_of_human_i...
 
Description INTF - International tES-fMRI network 
Organisation Laureate Institute for Brain Research
Country United States 
Sector Learned Society 
PI Contribution The INTF is a network of researchers that is working together to develop a checklit with reporting standards to evaluate the methodology of concurrent brain stimulation and functional magnetic resonance imaging studies in terms of quality and reproducibility. The steering committee is formed by 13 researchers from Institutions around the world. I am one of the members of the steering committee. This is a multi-disciplinary collaboration involving researchers in physics, medicine, neuroscience and psychology.
Collaborator Contribution Dr Hamed Ekhtiari from the Laureate Institute for Brain Research is leading the INTF initiave.
Impact As part of the INTF we have organized six webinars, which can be viewed here https://www.youtube.com/channel/UCKcEYDmyqTipDW7OzuoVSlg We have also created a consensus-based checklist of reporting standards for concurrent tES-fMRI studies to support methodological rigor, transparency, and reproducibility (ContES Checklist), which is currently available as a pre-print in here https://www.medrxiv.org/content/10.1101/2020.12.23.20248579v1
Start Year 2019
 
Description tACS challenge 
Organisation Carl von Ossietzky University of Oldenburg
Country Germany 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation Imperial College London
Country United Kingdom 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation National Center for Scientific Research (Centre National de la Recherche Scientifique CNRS)
Country France 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation Technical University of Denmark
Country Denmark 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation University Medical Center of the Johannes Gutenberg University Mainz
Country Germany 
Sector Hospitals 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation University of Glasgow
Country United Kingdom 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation University of Göttingen
Country Germany 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Description tACS challenge 
Organisation University of Trento
Country Italy 
Sector Academic/University 
PI Contribution We have contributed to the development of the research design to be implemented in the tACS challenge.
Collaborator Contribution Development of equipment for behavioural testing; development of equipment for brain stimulation; development of research design and data analyses pipelines.
Impact This is a multi-centre initiative to test for online effects of TACS on behaviour that result from phasic current modulation in the brain and not from sensory confounds. 50 labs across the world have enrolled in this initiative.
Start Year 2018
 
Title Automatic analysis 
Description We have developed pipelines for real-time and post-processing data analyses. We focused on the development and application of a pipeline system for neuroimaging written in MATLAB, aa (https://github.com/automaticanalysis/automaticanalysis.github.io, https://zenodo.org/record/6047630), which support multimodal data, is configurable, reproducible and scalable. 
Type Of Technology New/Improved Technique/Technology 
Year Produced 2021 
Open Source License? Yes  
Impact automatic analysis supports tha analysis of multimodal data, is configurable, reproducible and scalable. 
 
Title Online task switching tool 
Description The task switching game was built to be easily configured to the demands of different experiments. It was built to reduce visual confounds, and can be played during in-lab experiments, from an MR scanner, or remotely, as a web-based game. 
Type Of Technology Webtool/Application 
Year Produced 2021 
Open Source License? Yes  
Impact This task exemplifies how researchers can make use of web resources to collect behavioural data for their studies 
URL https://www%2Etask-switching-game@surrey.ac.uk/
 
Description Checklist for Assessing the Methodological Quality of Concurrent tES-fMRI Studies (ContES Checklist) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact We have taken part and organised webinars that involved about 60 participants under the topic of combining brain stimulation with imaging. These webinars provided researchers with a platform to showcase their work and implement best-practices on their research. We have also created a checklist for reporting standards for concurrent tES-fMRI studies to support methodological rigour, transparency, and reproducibility
Year(s) Of Engagement Activity 2020,2021
URL https://www.youtube.com/channel/UCKcEYDmyqTipDW7OzuoVSlg