Neural circuits for learning under perceptual uncertainty
Lead Research Organisation:
University of Oxford
Department Name: Physiology Anatomy and Genetics
Abstract
How does the brain learn to make efficient decisions in an uncertain world? A hallmark of biological learning is strategy discovery: over long periods of time, animals can transition through a range of behaviors on their way from naïve to expert performance. Decades of research have highlighted the role of midbrain dopamine (DA) neurons as well as major DA-receiving brain regions, striatum and frontal cortex, in learning. However, previous studies did not probe these neural circuits from the very first trial of the task, while animals test and select among possible strategies for gaining reward under perceptual uncertainty. Moreover, past studies often examined these neural circuits at a small scale and in isolation, and could not systematically investigate how neural signals across these brain regions underlie learning. A large gap thus remains between our understanding of neural computations and the long-term process of strategy discovery under uncertainty. This proposal will combine novel behavioral tasks and advanced neural circuit tools to fill this gap. We will longitudinally measure and manipulate neural signals from naïve to expert performance in mice learning a visual decision task that admits multiple behavioral strategies, and will use computational tools to formalize the relation between neural activity and learning dynamics. The work will address these questions:
1. How do DA neural signals develop during learning under uncertainty, and how do they relate to behavioral strategies?
2. What does DA release across striatum and frontal cortex encode during learning, and does DA in different brain regions play distinct causal roles in learning?
3. How do neural signals across striatum and frontal cortex develop and relate to behavioral strategies during learning?
This work will rectify the paucity of data on the neural bases of learning, generating a step change in our understanding of neural circuits regulating learning under perceptual uncertainty.
1. How do DA neural signals develop during learning under uncertainty, and how do they relate to behavioral strategies?
2. What does DA release across striatum and frontal cortex encode during learning, and does DA in different brain regions play distinct causal roles in learning?
3. How do neural signals across striatum and frontal cortex develop and relate to behavioral strategies during learning?
This work will rectify the paucity of data on the neural bases of learning, generating a step change in our understanding of neural circuits regulating learning under perceptual uncertainty.
Publications
Didenko O
(2024)
GCaMP8 transgenic mice learn to make visual decisions
Liebana Garcia S
(2023)
Striatal dopamine reflects individual long-term learning trajectories
| Title | Behaviorual tasks for a new GM mouse line |
| Description | behavioural procedure for a new GM mouse line used in neuroscience |
| Type Of Material | Model of mechanisms or symptoms - mammalian in vivo |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | This has been particularly useful because initial papers failed to train these mice in behavioural tasks. Also this has been used many times for home office licence applications across the UK |
| URL | https://osf.io/preprints/psyarxiv/vc7a6_v1 |
| Title | New methods to study long-term learning from naive to expert |
| Description | behavioural assay and analytical tools to study learning a visual task from naive to expert in mice |
| Type Of Material | Technology assay or reagent |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | several reseachers are using the method |
| URL | https://www.biorxiv.org/content/10.1101/2023.12.14.571653v1 |
| Title | Dataset and code related to our paper: https://www.nature.com/articles/s41467-024-51393-8 |
| Description | Dataset and code related to our paper : Temporal regularities shape perceptual decisions and striatal dopamine signals |
| Type Of Material | Database/Collection of data |
| Year Produced | 2024 |
| Provided To Others? | Yes |
| Impact | downloaded and used by more than 200 reseacherse |
| URL | https://figshare.com/articles/dataset/_b_Temporal_regularities_shape_perceptual_decisions_and_striat... |
| Description | Dopamine signals during long-term learning: physiology and computation |
| Organisation | University College London |
| Department | Gatsby Computational Neuroscience Unit |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | We performed experiments, data analysis and modelling to examine dopamine signals from naive to expert |
| Collaborator Contribution | Partner contributed to computational modelling |
| Impact | Liebana S,..., Lak A. Striatal dopamine encodes deep network teaching signals for long-term learning. Cell, In press |
| Start Year | 2020 |
| Description | Dopamine signals during long-term learning: physiology and computation |
| Organisation | University of Oxford |
| Department | Department of Physiology, Anatomy and Genetics |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | We performed experiments, data analysis and modelling to examine dopamine signals from naive to expert |
| Collaborator Contribution | Partner contributed to computational modelling |
| Impact | Liebana S,..., Lak A. Striatal dopamine encodes deep network teaching signals for long-term learning. Cell, In press |
| Start Year | 2020 |
