Uncovering the neural basis of movement transitions
Lead Research Organisation:
University of Nottingham
Department Name: Sch of Psychology
Abstract
You're feeling thirsty. Your arm moves outwards, reaching for the cup of coffee on your desk, grasps the handle, and moves the cup smoothly back to your waiting lips.
You're walking to the bus stop, on your way to an important interview. Legs swinging, left then right, left then right, when the bus unexpectedly turns the corner ahead of you. Panicked, you break into a run, legs pumping, feet leaving the floor with each stride.
Both are transitions between movements, between the discrete movements of the arm - out, then stop, then back - and between the rhythmic movements of walking to running. But while we know much about how the brain represents and controls single movements, we know little about how it controls the transitions between them. Understanding this would help us build better intelligent prosthetics for the paralysed and disabled; and build better, more natural controllers for moving robots.
The challenge is that different movements are controlled by the same set of neurons in the brain. There are a set of neurons in your motor cortex that control arm movement. Elsewhere there are a set of neurons that create the rhythms of leg movement. Somehow, the activity of those same neurons changes from representing one movement to another, and does so smoothly, so that you do not freeze in place.
Our proposed work thus aims to tackle the intriguing problem of how a single group of neurons changes between patterns of activity so different that they each generate different movements, yet does so smoothly. To tackle this problem for discrete movements, we will study neural activity in the motor cortex of monkeys moving their arms to control a joystick. The monkey's goal is to move the joystick to hit each of four targets in a row, each movement between targets thus creating a discrete arm movement. To tackle this problem for rhythmic movements, we will study neural activity in the crawling circuit of sea-slugs escaping, changing from being still, to galloping, to crawling normally. Studying rhythmic transitions in sea-slugs has the unique advantages that we can reliably cause this escape response in the lab, and at the same time can record every output from about ten percent of all the essential neurons.
These data will let us answer some deep questions about how brains control transitions between movements. The first is to work out which pattern of neural activity creates which movement. We will develop methods to find when and how the patterns change, and compare these changes to the movements in monkeys and sea-slugs. This will reveal the basic neural "code" for transitions in movements.
The second is to understand if single neurons are important for transitions. The pattern of activity that is responsible for, say, galloping is shared among a set of neurons; and approximately the same pattern can be created by different combinations of those neurons. So it may be that only the pattern is consistently created, and not the activity of individual neurons. Knowing this will help us better understand how to decode movements from brain activity.
The third is to discover what physical changes to the circuit create the changes in activity pattern. We will use models of circuits to pick apart whether the timing and type of changes between movements are caused by changes to the inputs to the circuit, changes to the wiring between neurons, or something else. These insights this will help us design better ways to control changes between movements by controlling changes in brain activity.
By revealing how brains successfully and smoothly move bodies between movements, our results could provide a wealth of new options for the control of artificial or robotic limbs by patients, and for designing controllers for movement in robots.
You're walking to the bus stop, on your way to an important interview. Legs swinging, left then right, left then right, when the bus unexpectedly turns the corner ahead of you. Panicked, you break into a run, legs pumping, feet leaving the floor with each stride.
Both are transitions between movements, between the discrete movements of the arm - out, then stop, then back - and between the rhythmic movements of walking to running. But while we know much about how the brain represents and controls single movements, we know little about how it controls the transitions between them. Understanding this would help us build better intelligent prosthetics for the paralysed and disabled; and build better, more natural controllers for moving robots.
The challenge is that different movements are controlled by the same set of neurons in the brain. There are a set of neurons in your motor cortex that control arm movement. Elsewhere there are a set of neurons that create the rhythms of leg movement. Somehow, the activity of those same neurons changes from representing one movement to another, and does so smoothly, so that you do not freeze in place.
Our proposed work thus aims to tackle the intriguing problem of how a single group of neurons changes between patterns of activity so different that they each generate different movements, yet does so smoothly. To tackle this problem for discrete movements, we will study neural activity in the motor cortex of monkeys moving their arms to control a joystick. The monkey's goal is to move the joystick to hit each of four targets in a row, each movement between targets thus creating a discrete arm movement. To tackle this problem for rhythmic movements, we will study neural activity in the crawling circuit of sea-slugs escaping, changing from being still, to galloping, to crawling normally. Studying rhythmic transitions in sea-slugs has the unique advantages that we can reliably cause this escape response in the lab, and at the same time can record every output from about ten percent of all the essential neurons.
These data will let us answer some deep questions about how brains control transitions between movements. The first is to work out which pattern of neural activity creates which movement. We will develop methods to find when and how the patterns change, and compare these changes to the movements in monkeys and sea-slugs. This will reveal the basic neural "code" for transitions in movements.
The second is to understand if single neurons are important for transitions. The pattern of activity that is responsible for, say, galloping is shared among a set of neurons; and approximately the same pattern can be created by different combinations of those neurons. So it may be that only the pattern is consistently created, and not the activity of individual neurons. Knowing this will help us better understand how to decode movements from brain activity.
The third is to discover what physical changes to the circuit create the changes in activity pattern. We will use models of circuits to pick apart whether the timing and type of changes between movements are caused by changes to the inputs to the circuit, changes to the wiring between neurons, or something else. These insights this will help us design better ways to control changes between movements by controlling changes in brain activity.
By revealing how brains successfully and smoothly move bodies between movements, our results could provide a wealth of new options for the control of artificial or robotic limbs by patients, and for designing controllers for movement in robots.
Technical Summary
Animals naturally perform movements as a continuous sequence, smoothly transitioning from one to the next. We know much about the neural correlates of isolated movements, about how the periodicity of population activity in motor centres encodes rhythmic movements, and about how cortical population activity encodes discrete movements like reaching. But we know little about the neural correlates of transitions between rhythmic or discrete movements.
In this project, we will take advantage of newly available datasets of population activity during transitions in rhythmic and discrete movements to determine how a neural population reconfigures its dynamics to support multiple end-goal movements. For rhythmic movements, we have dense single-neuron, single-spike resolution imaging data from the motor circuits of the marine mollusc Aplysia during their transitions from quiescence, to an escape gallop to exploratory crawling. For discrete movements, we have microelectrode array recordings from the motor cortex of monkeys performing a task with multiple, sequential arm movements.
Our proposed work will determine if distinctly observable movements map onto distinct dynamics of the neural population. We will use a dynamical systems framework to compare hypotheses for how transitions between discrete and rhythmic movements are encoded by the population. And we will define the contribution of single neurons to test the hypothesis that movement transitions are encoded by the joint activity of a population, and not by individual neurons. Finally, we will fit network models to the recorded population activity to infer how the underlying circuits change to create the transition in movement. Collectively, our findings will place strong constraints on theories for the neural control of movement, and on future designs of invasive brain-machine interfaces.
In this project, we will take advantage of newly available datasets of population activity during transitions in rhythmic and discrete movements to determine how a neural population reconfigures its dynamics to support multiple end-goal movements. For rhythmic movements, we have dense single-neuron, single-spike resolution imaging data from the motor circuits of the marine mollusc Aplysia during their transitions from quiescence, to an escape gallop to exploratory crawling. For discrete movements, we have microelectrode array recordings from the motor cortex of monkeys performing a task with multiple, sequential arm movements.
Our proposed work will determine if distinctly observable movements map onto distinct dynamics of the neural population. We will use a dynamical systems framework to compare hypotheses for how transitions between discrete and rhythmic movements are encoded by the population. And we will define the contribution of single neurons to test the hypothesis that movement transitions are encoded by the joint activity of a population, and not by individual neurons. Finally, we will fit network models to the recorded population activity to infer how the underlying circuits change to create the transition in movement. Collectively, our findings will place strong constraints on theories for the neural control of movement, and on future designs of invasive brain-machine interfaces.
Planned Impact
Economic & societal impact:
1. Brain-Computer Interfaces
A potential medium-term impact is in the design of invasive Brain Computer Interfaces. In human patients and primate test subjects, accurate control of robot arms and prosthetic devices is achieved by decoding invasively recorded activity of small neural populations, typically from cortex. These decoders assume a single, discrete behaviour. Our results will show how neural populations control the transition between behaviours, and will suggest the most relevant level of description for accessing the encoded information. They will thus likely inform the design of better decoders for Brain-Computer Interfaces, and extend them to handling smooth transitions between behaviours. Such advances would be applicable to any brain-computer interface that is dependent on neural population activity.
2. Robot controllers.
A further medium-term impact is potentially on the design of robot controllers. A broad swathe of robotics researchers have drawn on inspiration from neuroscience when designing control architectures for mobile robots for both rhythmic (e.g. walking and swimming) and discrete (e.g. reaching) movements. But these are largely limited to the control of single behaviours, with disjoint transitions between them. Our results will provide insight into how single neural circuits can control and move between multiple behaviours by transitioning between multiple different dynamical states. Moreover, they will give insight into the how these transitions are controlled within the circuit. Thus our work has the potential to provide a plethora of new options for the design of controllers for mobile robots.
3. Neural-inspired artificial intelligence (AI)
Neural-inspired AI, including deep learning and recurrent neural networks, is being harnessed by both the public and private sector to drive innovations in technology and healthcare. As one example, the UK-based DeepMind company recently demonstrated neural-inspired AI that could self-learn to outperform skilled human players on a range of video games, and to beat expert human players at Go. But a major bottleneck in advancing neural-inspired AI is understanding what even these relatively simple networks are learning, thus limiting attempts to improve performance or design to blind trial-and-error. This bottleneck has led to the idea of AI Neuroscience, of using the analysis tools of neuroscience on artificial neural networks in order to understand them. The techniques we develop here will be specifically designed to open the black box of the dynamics of large-scale networks of neurons. They will thus be equally applicable in AI Neuroscience, and long-term could potentially inform new advances in cutting-edge, commercial AI.
Researcher career development:
Our proposed work programme contains a number of specific elements for the career development of the postdoctoral researcher. The cross-disciplinary training will create a valuable skill set transferable within and outside academia, especially coding in industry standard MATLAB and Python languages, use of high-performance computing, development of machine learning techniques, and application of advanced statistics. The researcher will also gain experience in project management, event co-ordination, and the supervision of students, enhancing future fellowship and tenured position applications.
1. Brain-Computer Interfaces
A potential medium-term impact is in the design of invasive Brain Computer Interfaces. In human patients and primate test subjects, accurate control of robot arms and prosthetic devices is achieved by decoding invasively recorded activity of small neural populations, typically from cortex. These decoders assume a single, discrete behaviour. Our results will show how neural populations control the transition between behaviours, and will suggest the most relevant level of description for accessing the encoded information. They will thus likely inform the design of better decoders for Brain-Computer Interfaces, and extend them to handling smooth transitions between behaviours. Such advances would be applicable to any brain-computer interface that is dependent on neural population activity.
2. Robot controllers.
A further medium-term impact is potentially on the design of robot controllers. A broad swathe of robotics researchers have drawn on inspiration from neuroscience when designing control architectures for mobile robots for both rhythmic (e.g. walking and swimming) and discrete (e.g. reaching) movements. But these are largely limited to the control of single behaviours, with disjoint transitions between them. Our results will provide insight into how single neural circuits can control and move between multiple behaviours by transitioning between multiple different dynamical states. Moreover, they will give insight into the how these transitions are controlled within the circuit. Thus our work has the potential to provide a plethora of new options for the design of controllers for mobile robots.
3. Neural-inspired artificial intelligence (AI)
Neural-inspired AI, including deep learning and recurrent neural networks, is being harnessed by both the public and private sector to drive innovations in technology and healthcare. As one example, the UK-based DeepMind company recently demonstrated neural-inspired AI that could self-learn to outperform skilled human players on a range of video games, and to beat expert human players at Go. But a major bottleneck in advancing neural-inspired AI is understanding what even these relatively simple networks are learning, thus limiting attempts to improve performance or design to blind trial-and-error. This bottleneck has led to the idea of AI Neuroscience, of using the analysis tools of neuroscience on artificial neural networks in order to understand them. The techniques we develop here will be specifically designed to open the black box of the dynamics of large-scale networks of neurons. They will thus be equally applicable in AI Neuroscience, and long-term could potentially inform new advances in cutting-edge, commercial AI.
Researcher career development:
Our proposed work programme contains a number of specific elements for the career development of the postdoctoral researcher. The cross-disciplinary training will create a valuable skill set transferable within and outside academia, especially coding in industry standard MATLAB and Python languages, use of high-performance computing, development of machine learning techniques, and application of advanced statistics. The researcher will also gain experience in project management, event co-ordination, and the supervision of students, enhancing future fellowship and tenured position applications.
Publications
Cinotti F
(2022)
Bayesian Mapping of the Striatal Microcircuit Reveals Robust Asymmetries in the Probabilities and Distances of Connections.
in The Journal of neuroscience : the official journal of the Society for Neuroscience
Colins Rodriguez A
(2023)
Motor cortex latent dynamics encode arm movement direction and urgency independently.
in bioRxiv : the preprint server for biology
Humphries M
(2021)
Strong and weak principles of neural dimension reduction
in Neurons, Behavior, Data analysis, and Theory
Humphries Mark
(2021)
The Spike: An Epic Journey Through the Brain in 2.1 Seconds
Humphries MD
(2021)
Spectral estimation for detecting low-dimensional structure in networks using arbitrary null models.
in PloS one
Maggi S
(2024)
Tracking subjects' strategies in behavioural choice experiments at trial resolution
in eLife
Maggi S
(2022)
Activity Subspaces in Medial Prefrontal Cortex Distinguish States of the World
in The Journal of Neuroscience
Title | Trial resolution inference of strategies - Python |
Description | A Python toolbox that implements our strategy analysis algorithm |
Type Of Material | Computer model/algorithm |
Year Produced | 2022 |
Provided To Others? | Yes |
Impact | Trained lab intern and PI on Python to do this |
URL | https://github.com/Humphries-Lab/Bayesian_Strategy_Analysis_Python |
Title | Trial-resolution inference for subjects' strategies on behavioural choice tasks |
Description | We developed a new Bayesian algorithm that tracks the probability a subject is using a range of behavioural strategies on choice tasks. It is powerful enough to track per-subject, per-trial probabilities, yet is computationally cheap so can be easily implemented and run in real-time. |
Type Of Material | Data analysis technique |
Year Produced | 2022 |
Provided To Others? | Yes |
Impact | This analysis is being used by Abhi Banarjee's lab at Newcastle University to study the different behaviours between wild-type and autism-model mice on choice tasks. |
URL | https://github.com/Humphries-Lab/Bayesian_Strategy_Analysis_MATLAB |
Description | Chicago - Aplysia |
Organisation | Rosalin Franklin University |
Department | School of Medicine Rosalin Franklin |
Country | United States |
Sector | Academic/University |
PI Contribution | Development and application of analysis tools for (i) neural population activity encoding locomotion and (ii) physical organisation of neural circuit. Automated methods for identifying separable classes of neurons based on patterns of output. |
Collaborator Contribution | Development of semi-intact sea slug (Aplysia) preparation with simultaneous voltage-sensitive dye imaging. Recording of neural population activity during fictive locomotion |
Impact | Challenges of decomposing the contribution of 100+ simultaneously recorded neurons to the locomotion motor program has driven rapid development of powerful analyses tools applicable to any large-scale neural recording project (cf USA BRAIN initiative and the EU Human Brain Project). Paper on correspondence between functional and physical organisation of locomotion circuit, published 2015. PMID: 25819612 Paper on low-dimensional attractors in neural circuits posted to bioRxiv pre-print server, 2017: DOI: 10.1101/104562 Multi-disciplinary collaboration: electrophysiological recording (Chicago); network theory (us); time-series analysis (us) |
Start Year | 2011 |
Description | Lee Miller and Matt Perich |
Organisation | Northwestern University |
Country | United States |
Sector | Academic/University |
PI Contribution | We are analysing motor cortex data collected by Matt Perich in Lee Miller's lab, and discussing our results with both. Our analyses are testing how arm movement is encoded by the activity of neural populations in the motor cortex of primates. We are also modelling the activity with recurrent neural networks. |
Collaborator Contribution | Perich has supplied unpublished data from experiments done in Lee Miller's lab. We have discussed our results in virtual meeting and over email. |
Impact | Miller is named as a collaborator on the MRC grant "Uncovering the neural basis of movement transitions" |
Start Year | 2021 |
Description | Bold Conjecture podcast |
Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Public/other audiences |
Results and Impact | Podcast interview on our work on how neuron populations compute, and on my book The Spike |
Year(s) Of Engagement Activity | 2022 |
URL | https://youtu.be/20gLokdz-BA |
Description | Brain-Inspired podcast on The Spike |
Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Interview for Brain-Inspired podcast on how the brain uses spikes to communicate, and what they mean. 1.5 hours |
Year(s) Of Engagement Activity | 2021 |
URL | https://braininspired.co/podcast/102/ |
Description | Continued writing: Popular (systems) neuroscience blog: The Spike |
Form Of Engagement Activity | Engagement focused website, blog or social media channel |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Public/other audiences |
Results and Impact | I started a popular blog "The Spike" to bring systems neuroscience - the study of neural circuits and their functions - to a wider audience. At the time of writing (16/2/2021), the blog has: - more than 45,000 followers - averaged ~230 visitors per day over the last 3 months - had more than 750,000 unique reads of its stories |
Year(s) Of Engagement Activity | 2018,2019,2020,2021 |
URL | https://medium.com/the-spike |
Description | NewsTalk Interview 2021 |
Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Public/other audiences |
Results and Impact | Recorded 20 minutes interview with NewsTalk's (Ireland) FutureProof programme and podcast, broadcast July 2021 |
Year(s) Of Engagement Activity | 2021 |
URL | https://www.newstalk.com/podcasts/futureproof-with-jonathan-mccrea/what-happens-when-our-neurons-fir... |
Description | Nottingham Public Science Lecture |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Public/other audiences |
Results and Impact | Public talk about our work on how groups of neurons work together to make things happen - moving, deciding, thinking. Part of an evening Public Lecture Series run by Nottingham University |
Year(s) Of Engagement Activity | 2022 |
Description | Royal Institution Evening Lecture March 2021 |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Public/other audiences |
Results and Impact | Talk as part of the Royal Institution's online Evening Lecture series, March 16th 2022, 7-8:30pm. Talk was released on RI's YouTube channel |
Year(s) Of Engagement Activity | 2021 |
URL | https://youtu.be/ZACJnu0XWZs |
Description | SciComm panels at Neuromatch 3.0 |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Postgraduate students |
Results and Impact | A panel discussion of how science communication works and routes into it, for the online Neuromatch 3.0 conference |
Year(s) Of Engagement Activity | 2020 |
Description | Sense of Mind podcast |
Form Of Engagement Activity | A broadcast e.g. TV/radio/film/podcast (other than news/press) |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Public/other audiences |
Results and Impact | Podcast interview about my book The Spike and our work on how neural populations encode and compute |
Year(s) Of Engagement Activity | 2022 |
URL | https://youtu.be/bbsyYThAjCY |
Description | Slate FutureTense article |
Form Of Engagement Activity | A magazine, newsletter or online publication |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Public/other audiences |
Results and Impact | Op-ed in Slate's FutureTense online magazine titled "Our Quest to Understand the Human Brain Is Limited by Ethics, Not Science". Published April 21st 2021 |
Year(s) Of Engagement Activity | 2021 |
URL | https://slate.com/technology/2021/04/neuroscience-recording-brain-spikes-ethics.html |
Description | Talk at York Festival of Ideas |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Regional |
Primary Audience | Public/other audiences |
Results and Impact | Online talk on systems neuroscience and our research at York Festival of Ideas. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.youtube.com/watch?v=Mo8VTqHS1sk |