Changing strengths of learned associations: neuronal ensemble mechanism

Lead Research Organisation: University of Sussex
Department Name: Sch of Psychology

Abstract

The ability to learn and remember the changing meanings about learned associations of biologically significant experiences and sensory stimuli is crucial for survival. For example, animals respond to external cues that predict the availability of natural rewards (e.g. food). However, they will learn to inhibit responding to these cues if the same cues fail to predict their availability. For many decades, a major goal of neuroscience has been to reveal the precise location and physiological nature of representations about these associations in the brain. Recent studies implicate the role of a minority of sparsely distributed, activated neurons called 'neuronal ensembles' in forming mental representations about learned associations about salient experiences and associated environmental cues. Although it is established that these ensembles play a causal role in mediating these associations, we do not fully understand the mechanisms that are involved in their formation. Also, little is known about what happens to these neurons once the original meaning of the learned associations change, such as when a cue no longer predicts food availability. A likely site where these changes occur to encode the meaning of these associations at neuronal ensembles is at the synapse, the key sites of neuronal communication. It is thought that enduring changes at the synapse akin to 'neuronal rewiring' underlie the formation of new associative representations. However, the precise nature of this rewiring process, especially with regards to how neuronal ensembles establish and maintain these associations, is largely unknown due to the technical challenges in identifying and recording from activated neurons.

The aim of this grant is to elucidate the mechanisms that modulate the strength of learned associations between natural rewards and associated environmental cues at the synaptic and local circuit level in neuronal ensembles. We will accomplish this by using an animal model of associative learning, where a mouse learns how to associate a tone cue with sucrose delivery. Once this association forms, a tone cue elicits a conditioned approach response towards the sucrose delivery receptacle. Conversely, this response is inhibited following a procedure called 'extinction learning' when the animal learns that the cue does not predict sucrose delivery. It is widely believed for this type of learning that the original associative memory is not erased but rather suppressed, since exposure to sucrose can re-trigger the approach response. At the neuronal level, a sucrose predictive cue elicits activation of a minority of neurons in the prefrontal cortex. This brain area is important for motivated behaviours, such as securing food sources, and these activated neurons are believed to encode information about sucrose and its associated cues. We will selectively record from these neurons using transgenic mice in which these activated neurons can be identified and physiologically characterised. We will examine structural alterations at their synapses to reveal the changes in neuronal wiring, after mice have learned that the cue predicts or no longer predicts sucrose delivery. We will also examine changes in 'connectivity' or the ability of one ensemble member to communicate with another, a process that may facilitate activation of the entire ensemble representation. Finally, we will characterize the behavioural role of these neurons that undergo rewiring by silencing their activity and testing this effect on conditioned approach responses, and whether the mice can relearn the original conditioning task.

Understanding these neuronal mechanisms will shed light on basic associative learning processes that are integral to healthy cognitive functioning. Moreover, it will reveal specific alterations at synapses on behaviourally relevant neurons and could potentially reveal new therapeutic targets.

Technical Summary

A minority of sparsely distributed, activated neurons called 'neuronal ensembles' mediate learned associations about biologically significant experiences and associated environmental cues in the prefrontal cortex. During Pavlovian conditioning, animals learn how to associate a cue (e.g. tone) with a reward (e.g. sucrose). We recently observed that following this procedure, the presentation of a sucrose-associated cue eliicts neuronal ensemble activity in this area, as indicated by increased expression of the neural activity marker, c-Fos. The aim of this grant is to elucidate the mechanisms that establish and maintain learned associations at the synaptic and local circuit level in prefrontal cortex neuronal ensembles during acquisition of a Pavlovian association (i.e. cue predicts sucrose) and extinction (i.e. cue no longer predicts sucrose). Also, we will determine the behavioural role of these neurons. These goals will be accomplished using innovative transgenic approaches that selectively characterise and silence activated neurons that express c-Fos. These techniques differ from conventional techniques that characterise or manipulate neurons regardless of neuronal activity history, and hence do not directly examine learning relevant changes. First, we will selectively record from the sucrose cue activated neurons during acquisition to reveal the synaptic and local connectivity properties that establish appetitive associations. Next, we will record from these neurons following extinction learning to determine the dynamic nature of these appetitive representations when these associations are thought to be suppressed, but not erased. Finally, we will determine if these neuronal ensembles are necessary for eliciting conditioned reponses and for reconditioning. Many neuroscientists will expoit these findings by determining whether similar neuronal rewiring mechanisms occur in other brain areas or in other forms of associative learning (e.g. addiction, fear).

Planned Impact

Who will benefit from this research?
This project will reveal key neuronal wiring processes at the synapse that help establish and maintain mental representations about natural rewards (e.g. sucrose) and the stimuli that surround them. These wiring processes are important to understand mechanisms of memory storage and retrieval, which tend to go awry in old age. The findings from this fundamental research will have widespread appeal and benefit the following groups that have a vested interest in learning more about the mechanisms of associative learning and memory, and appetitive behaviours: 1) Academics, including researchers in psychology, pharmacology, and neuroscience; and the post-doctoral researcher and technician who will compose my research team 2) The pharmaceutical industry that are looking for new drug targets and PET tracers. 3) The general public, including the elderly that suffer from memory decline (e.g. Alzheimer's), and those who suffer from excessive food cravings when exposed to food-associated stimuli. 4) Non-profit research promotion groups, such as the European Association for the Study of Obesity (EASO), which use scientific evidence for effective anti-obesity educational campaigns.

How will they benefit from this research?
1) Academics: In terms of capacity-building impact, the post-doctoral research fellow and research technician will greatly benefit from learning the advanced, multi-disciplinary research approaches utilised here (e.g. neuronal ensemble inactivation, neuronal ensemble recordings using a confocal-imaging capable electrophysiology rig) and will be highly sought after in the in both academia (e.g. neuroscience research) and industry (e.g. pharmaceutical companies, neurophysiology/imaging companies). 2) The pharmaceutical industry: Our research may reveal novel excitatory and inhibitory receptors that are expressed on neurons activated by associative representations that play a role in appetitive behaviours. Thus, data from this research will help devise more targeted therapeutic approaches that selectively restore normal function in associative learning and appetitive behaviour relevant neurons instead of treating neurons as a uniform cluster. It may also generate novel ligands used in PET imaging to detect brain areas in humans that contain similar receptors. Such ligands may be used to detect the vulnerable brain areas for conditions such as excessive food cravings and maladaptive eating, and confirm the relevance of our pre-clinical findings. I plan to communicate my findings to these companies via medicinal chemistry researchers at Sussex with industry contacts that are capable of evaluating the translational value of my findings. Although it is a goal that may take many years to achieve, this selective approach may one day generate therapies that improve quality of life with lower side effects, such as restoring associative memories or reducing unwanted cue-induced eating while leaving normal cognitive functions intact. 3) The general public: Newly devised therapeutics could benefit the elderly who have a problem remembering information associated with important events or dieters who are trying to control their food cravings. The general public will benefit as a result since less money is spent on health care costs associated with medical conditions caused by cognitive decline or excessive eating. 4) Research promotion groups (EASO), may effectively campaign to the public about the neurobiological effects of increased sucrose consumption that contributes to obesity, by utilising our data on how neuronal representations of sucrose and associated stimuli persistently linger in the brain. They may also use these findings to inform public health policy makers. I have already contacted EASO and we plan to have regular meetings to discuss my research findings.

Publications

10 25 50

publication icon
Brebner LS (2020) The Emergence of a Stable Neuronal Ensemble from a Wider Pool of Activated Neurons in the Dorsal Medial Prefrontal Cortex during Appetitive Learning in Mice. in The Journal of neuroscience : the official journal of the Society for Neuroscience

publication icon
Koya E (2018) Sound of silent synapses from the addicted hippocampus. in Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology

publication icon
Koya E (2016) Daun02 Inactivation of Behaviorally Activated Fos-Expressing Neuronal Ensembles in Current Protocols in Neuroscience

publication icon
Ziminski JJ (2018) Reversing Cocaine-Induced Adaptations and Reducing Relapse: An Opportunity for Repurposing Riluzole. in Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology

publication icon
Ziminski JJ (2017) Changes in Appetitive Associative Strength Modulates Nucleus Accumbens, But Not Orbitofrontal Cortex Neuronal Ensemble Excitability. in The Journal of neuroscience : the official journal of the Society for Neuroscience

 
Description Animals use signals or 'cues' associated with food to search for nutrient sources. For example, mice use sweet smells to look for fruit. Thus, learning these 'food-cue' associations using a procedure called 'conditioning' and retrieving them are critical for survival. These associations are represented in the brain by a subset of sparsely activated neurons called 'neuronal ensembles' and physiological modifications in these neurons are thought to play a role in learning and memory. These modifications happen at the levels of 'neuronal excitability' and at the 'synapse'. The former provides an indication regarding how likely a neuron will fire upon stimulation, and the latter is examined because they are the critical sites for neuronal communication. Together, they shed light on how neurons interpret information about cues and food. When these factors change as a result of learning, it is called 'plasticity' and they will affect how neural networks in the brain function. In turn, this controls how information about food and cues are interpreted and modulate behaviours such as food-seeking. The prefrontal cortex and nucleus accumbens play an important role in food-cue learning since they are involved in motivation and reward, two processes that help survival. Here, we revealed new forms of physiological modifications in these neurons during 1) learning of a food-cue association; 2) recall of this association following food (sucrose) cue exposure; 3) and following reduced attractiveness of a food reward.

1. We found that conditioning recruited a minority of excitatory neurons called 'pyramidal cells' in the prefrontal cortex that were reliably activated each time mice were learning a food-cue association. These neurons were also activated when mice were exposed to only the food cue and retrieved a memory about food. Thus, these 'ensemble' of pyramidal cells interpret and store a food-cue association in the brain. We also found that some neurons were very excitable when mice were initially learning this association, but not later on when mice firmly learned a food-cue association. We found that the ensemble of neurons may have formed from this hyper-excitable pool of neurons and that this hyper-excitability likely helped motivate the animal to learn this association. Interestingly, we did not find any synaptic alterations on learning-activated neurons, indicating that food-cue learning may involve dynamic changes in excitability, but not synaptic physiology in neuronal ensembles. We also characterised changes in the 'connectivity' of these learning-activated neurons to determine whether learning the relationship between sucrose and cues can strengthen local circuits within a neuronal ensemble. However, learning a food-cue association did not change connectivity. We also examined an inhibitory form of learning called 'extinction' learning in which the cue no longer predicts food. Interestingly, and in contrast to conditioning we found that inhibitory neurons called 'interneurons' that slow down the activity of pyramidal cells were recruited during this learning.

2. We found that cue exposure did not recruit prefrontal cortex neuronal ensembles with altered excitability and synaptic physiology following conditioning and extinction. However, food cues following conditioning recruited a hyper-excitable neuronal ensemble in the nucleus accumbens when animals showed food-seeking. Moreover, once mice underwent extinction learning and the cues no longer triggered food-seeking, this hyper-excitability was no longer observed in a cue-activated ensemble. Synaptic alterations on these ensembles were not observed.

3. Similar to following extinction learning, when food reward became less attractive, food-seeking triggered by food cues was dampened and we did not see differences in hyper-excitability between ensemble and non-ensemble neurons.

Taken together, our study sheds novel light on how modulating associations about food and cues could dynamically modulate the activation of a small subset of neurons in the prefrontal cortex and nucleus accumbens. Moreover, modulating the strength of these associations dynamically alters the excitability, but not synaptic properties on these activated neurons. The excitability changes may adjust the sensitivity of these neurons to help process information about food and cues. The lack of changes in synaptic physiology are interesting findings because changes in synaptic strength are thought to play an important role in learning and memory related to navigation and fear. Our findings have implications for cue-evoked behaviours such as food cravings and excessive eating since these learned associations play a pivotal role in the emergence of these behaviours. Thus, changes in neuronal excitability might control these behaviours, and compounds that modulate neural excitability may hold therapeutic value for eating-related disorders.
Exploitation Route Fundamental researchers that are interested in studying motivational systems may wish to further biochemically and physiologically characterise the nucleus accumbens neurons activated by food-associated cues. For example, they may wish to study what kind of receptors or ion channels are expressed in these neurons. If receptors are uniquely expressed on these sucrose cue activated neurons, then researchers in drug discovery may try to identify a compound that selectively acts on these neurons.
Sectors Healthcare,Pharmaceuticals and Medical Biotechnology

 
Description I was invited by Dr. Walter Kaye to give a talk at the Eating Disorders Centre (UC San Diego) in October 2017. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I presented my pre-clinical findings at the Eating Disorders Center, University of California at San Diego. Approximately 20 people attended this event ranging from postgraduate students to PIs, which consisted of psychiatrists and neuropscyhologists who were interested in examining cue and food reactivity in recovered anorexic patients. There was a very stimulating discussion that followed regarding how animal studies could help inform human conditions of maladaptive and/or normal eating. For example, we discussed how findings from my BBSRC-led study might inform why certain individuals experience strong food cravings. The audience members were very pleased with learning more about how the brain could store learned associations about food and environmental signals associated with food availability. They were particularly impressed with how this type of learning could modify a small minority of neurons in the brain's reward system.
Year(s) Of Engagement Activity 2017
 
Description I was invited to give a talk at Universities of Kyoto and Tokyo (Japan; November 2017) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This talk was attended by approximately 40 persons. The audience members included in vivo imaging researchers and neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2017
 
Description I was invited to give a talk at University of Bristol (via Prof. Clea Warburton; April 2017) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact This talk was attended by approximately 40 persons. The audience members included experimental psychologists and neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2017
 
Description I was invited to give a talk at University of California at Los Angeles, San Diego, and Irvine (June 2017) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This talk was attended by approximately 40 persons. The audience members included experimental psychologists and neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2017
 
Description I was invited to give a talk at the Department of Experimental Psychology (via Mark Walton, Oxford University; February 2018) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact This talk was attended by approximately 40 persons. The audience members included experimental psychologists and neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2018
 
Description Japan Neuroscience Meeting Symposium, Kobe, Japan 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact I was the co-organiser of this symposium in which I gave a talk. This talk was attended by over 100 persons. The audience members included experimental psychologists and neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2018
URL http://www.neuroscience2018.jnss.org/en/information.html
 
Description Lecture at Obesity Research Group (invitation via Dr. Clare Llewyllyn), University College London (November 2017) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact I presented my pre-clinical findings at the Obesity Research Group at UCL. Approximately 20 people attended this event ranging from postgraduate students to PIs, which consisted of a diverse group of people with expertise in nutrition and dietetics, epidemiology, clinical trials, public health, genetics, etc. There was a very stimulating discussion that followed regarding how animal studies could help inform human conditions of maladaptive eating. For example, we discussed how findings from my BBSRC-led study might inform why certain individuals experience strong food cravings. The audience members were very pleased with learning more about how the brain could store learned associations about food and environmental signals associated with food availability.
Year(s) Of Engagement Activity 2017
 
Description Presentation at the International Conference on Learning and Memory, USA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Over 100 people attended my lecture on the role of neuronal ensembles in encoding food-associated cues. The audience members included notable experimental psychologists and neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2018
URL http://learnmem2018.org
 
Description Talk at lab of Dr. Teruhiro Okuyama, University of Tokyo, Japan 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact I gave a talk at Dr. Teruhiro Okuyama's lab at the University of Tokyo. This talk was attended by approximately 20 persons. The audience members included e neurophysiologists who were interested in the neural mechanisms of motivation, reward, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability. I also had talks with Dr. Okuyama regarding future collaborations.
Year(s) Of Engagement Activity 2018
 
Description Talk at lab of Dr. Tom McHugh, Riken BSI, Japan 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This talk was attended by approximately 40 persons. The audience members included molecular neurobiologists and neurophysiologists who were interested in the neural mechanisms of motivation, reward, spatial navigation, neuronal encoding, and episodic memories. A stimulating discussion followed afterwards regarding how a small group of neurons in the brain's reward system could undergo physiological alterations in order to encode learned associations about food and cues that predict food availability.
Year(s) Of Engagement Activity 2018
 
Description Talk at the Heidelberg Neuronal Ensembles meeting 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I gave a talk at the Heidelberg Neuronal Ensembles meeting in Heidelberg, Germany. This was attended by over 100 persons and the audience members were composed of students, post-doctoral researchers, and principal investigators.
Year(s) Of Engagement Activity 2019