How does the Drosophila brain compute and see visual motion?

Lead Research Organisation: University of Sheffield
Department Name: Biomedical Science

Abstract

Animals have neural mechanisms for detecting visual motion, enabling them to infer the speed and direction of objects that move in visual scenes. With its perceptual advantages the ability to detect motion has shaped the organisation and function of visual systems. However, the way in which the visual systems process and route motion information has proven to be a difficult problem to decipher. This proposal aims to elucidate the functional organisation of neural networks responsible for encoding visual motion in the brain of the fruit fly, Drosophila. We have recently developed an extremely versatile Drosophila preparation that enables us to visualise in real time how a specialised web of motion sensitive neurones (LPTCs) in the brains of transgenic flies translate moving images in the scene into neural activity patterns (calcium and voltage signals). These flies have genetically engineered eyes that are sensitive to ultraviolet (UV) light and brains that express green-sensitive fluorescence proteins (optical reporters) that react to changes in the neural activity (here calcium changes) in LPTCs. Since the spectral sensitivities of the eye and optical reporters do not overlap, we can visualise neural activity in the LPTCs when such a fly looks at moving objects, being oblivious of us simultaneously scanning its brain. In order to fully utilise this novel preparation requires the generation of a unique hybrid experimental apparatus that can visualise calcium signals and measure voltage responses with sharp microelectrodes simultaneously. For live imaging the flies will be placed in this apparatus in which they are presented with moving UV-light patterns while calcium and voltage signals are monitored from the LPTCs. Using this system, together with further genetic modifications in the eyes and the brain of the flies, we wish to investigate how visual motion signals are routed and processed by the fly's visual system. Here we plan to find answers to two important open questions. What is the contribution of different photoreceptor types in routing visual information to the brain so that the speed and direction of objects moving in the scene can be inferred? and what is the contribution of attentional signals from the brain in the visual motion processing? These questions will be studied by monitoring changes in calcium and voltage signals of LPTCs in transgenic flies in which selective neural pathways from the eyes or from the brain can be turned on and off, using temperature-sensitive genetic switches. Furthermore, the visual behaviour of the same flies will be characterised in a flight simulator system running in our laboratory. In this way we shall be able to correlate the genetically targeted changes in the routing and processing of visual motion information to the animal behaviour and cognitive phenomena. In a parallel approach, the results from these experiments will be analysed and modelled mathematically to find answers to the open question of how moving visual objects in the scene are encoded into moving neural images, as represented by activity patterns of networks of interconnected neurones in the brain.

Technical Summary

We wish to study how motion-sensitive neurones (LPTCs) in the Drosophila visual ganglia perform visual motion computations. The relative simplicity and the genetically malleable connections to LPTCs from the eyes and the brain can help us to make sense of the coding strategies of these neurones. We have recently generated transgenic flies that are predominantly UV-sensitive and in which a sub-group of LPTCs express Ca2+-reporters, and with these flies established a way to record intracellular voltage and Ca2+ signals in LTPCs to moving patterns in vivo. By genetically shifting the sensitivity of photoreceptors to UV-range their excitation spectra do not overlap with the fluorescence of the genetic reporters; live-imaging of Ca2+ signalling in LPTCs does not influence the visual functions of these flies. Building on these efforts, we wish to now dissect the bottom-up and top-down connections to LPTCs, and their respective roles in computing neural representations of motion signals. This we plan to do by recording changes in voltage and Ca2+ signals of LPTCs to moving UV-stimuli while switching on/off different synaptic inputs to them, using temperature-sensitive GAL4-UASshiTS1 system. A central requirement for this project is the ability to simultaneously monitor and correlate changes in Ca2+ and voltage signals of individual LPTCs with changes in the network environment. This cannot be sufficiently achieved with current instrumental set-ups, hence, we propose to construct a hybrid instrument that combines 2-photon scanning microscopy and electrophysiology, capable of simultaneous measurements of voltage and Ca2+ signals in the tissue depths and spatial resolution that are required here. Furthermore, to correlate the changes in the network activity to the fly's optomotor behaviour, the same flies will be tested in a flight simulator system. The results and analysis of these experiments will be used for making realistic mathematical models of motion detection

Publications

10 25 50
 
Description The three most ground-breaking publications/discoveries from this BBSRC grant:

1. Kemppainen, J., Scales, B., Razban Haghighi, K., Takalo, J., Mansour, N., Leko, G., Saari, P., Hurcomb, J., Antohi, A., Suuronen, J.P., Song, Z., Blanchard, F., Hardie, R.C, Hampton, M., Eckermann, M., Westermeier, F., Frohn, J., Hoekstra, H., Salditt, T., Huttula, M., Mokso, R. & Juusola, M. Binocular photoreceptor microsaccades give fruit fly hyperacute 3D-vision (in preparation). [We showed previously (Juusola et al., ELife 2017) that ultrafast photomechanical photoreceptor contractions enable Drosophila to see the world in finer detail than their compound eyes' optical resolution by translating spatial information into phasic time series responses. We are now extending this theory by showing how synchronous mirror-symmetric photomechanical contractions in the frontal forward-facing left and right eye photoreceptors give Drosophila super-resolution 3D-vision. By combining in vivo 100-nm-resolution x-ray imaging (in ESRF and DESY) with electrophysiology and fly genetics, in vivo high-speed optical imaging, mathematical modelling and behavioural paradigms, we reveal how these photoreceptor microsaccades - by verging and narrowing the eyes' overlapping receptive fields - can channel depth information to hyperacute stereovision. These results have the potential to change our understanding of how insect compound eyes work, highlight the importance of fast mirror-symmetric photoreceptor motion for 3D perception, and suggest coding strategies to improve man-made sensors.]

2. Juusola, M., Dau, A., Song, Z., Solanki, N., Rien, D., Jaciuch, D., Dongre, S., Blanchard, F., de Polavieja, G.G., Hardie, R.C. & Takalo, J. (2017). Microsaccadic sampling of moving image information provides Drosophila hyperacute vision. [P] ELIFE 6:e26117 (149 pp) [Demonstrates how the fly compound eyes exploit image motion to see hyperacute spatial details, over >4-times finer than their optical limit, elucidating how acuity depends upon photoreceptor function and eye movements. These results transform our understanding of how animals see by showing an important relationship between eye movements and visual acuity]

3. 1. Li, X., Abou Tayoun, A., Song, Z., Dau, A., Rien, D., Jaciuch, D., Dongre, S., Blanchard, F., Nikolaev, A., Zheng, L., Bollepalli, M.K., Chu, B., Hardie, R.C., Dolph, P.J.* & Juusola, M.* (2019). Ca2+-activated K+ channels reduce network excitability, improving adaptability and energetics for transmitting and perceiving sensory information. J. NEUROSCI. 39: 7132-7154. [Links in vivo and ex vivo experiments with detailed stochastically operating biophysical models to extract new mechanistic knowledge of how Drosophila photoreceptor-interneuron-photoreceptor circuitry homeostatically retains its information sampling and transmission capacity against chronic perturbations in its ion-channel composition, and what is the cost of this compensation and its impact on optomotor behaviour.]
Exploitation Route The mathematical (stochastic) framework/models about early fruit fly vision that we have produced (based on our experimental findings) are now used in large scale models to emulate the fruit fly brain: http://neurokernel.github.io/ and photoreceptors: https://github.com/JuusolaLab/Microsaccadic_Sampling_Paper.

We have devised/constructed novel visual stimulation/recording methods, and with them obtained exciting new data/discoveries about the compound eye spatiotemporal information processing capacity. We are currently working on a new theory/mathematical simulation to test and explain compound eye stereovision.
Sectors Aerospace, Defence and Marine,Digital/Communication/Information Technologies (including Software),Education,Manufacturing, including Industrial Biotechology,Pharmaceuticals and Medical Biotechnology,Other

URL https://github.com/JuusolaLab/Microsaccadic_Sampling_Paper
 
Description Our recent findings (data and simulations) about neural mechanisms of visual information processing in the Drosophila eyes are now used in a new open source platform (NeuroKernel) for emulating the fruit fly brain (Columbia University, New York, USA): http://neurokernel.github.io/ In General, discoveries from my laboratory are taught in relevant University courses worldwide; integrated into undergraduate lectures in Sheffield and likely in other institutions internationally.
Sector Digital/Communication/Information Technologies (including Software),Education,Other
Impact Types Cultural

 
Description Beamtime at DESY Photon Science at PETRA III beamline P10 from 28-MAY-2018 to 30-MAY-2018; DESY Drosophila experiments 28-30 May (grant I-20170823 EC)
Amount € 0 (EUR)
Organisation Deutsches Electronen-Synchrotron (DESY) 
Sector Academic/University
Country Germany
Start 05/2018 
End 05/2018
 
Description DESY Beamline P10: I-20190808 EC 'Do all invertebrate photoreceptors contract photomechanically to enhance their visual capacities? ? an in vivo evolutionary study'
Amount € 0 (EUR)
Funding ID I-20190808 EC 
Organisation Deutsches Electronen-Synchrotron (DESY) 
Sector Academic/University
Country Germany
Start 05/2020 
End 05/2020
 
Description Project research grant with international collaboration
Amount ¥900,000 (CNY)
Organisation National Science Foundation China 
Sector Public
Country China
Start 01/2009 
End 12/2014
 
Title A new high-speed camera/microscope system for measuring in vivo photomechanical photoreceptors contractions across the Drosophila compound eyes 
Description We designed and built a new instrument that allows one to measure in vivo photomechanical photoreceptors contractions across the Drosophila compound eyes. The system uses stepping motor-based two-axis goniometers to rotate a fly along the centre of its head under IR-illumination while stimulating selected photoreceptors through the compound eye lens systems and recording the resulting photomechanical movements. 
Type Of Material Improvements to research infrastructure 
Year Produced 2019 
Provided To Others? No  
Impact This system is now used to produce data about how compound eyes enable stereovision that we intend to publish shortly. 
 
Title Software toolkits for building stochastically operating photoreceptor models and for analysing neural information processing. 
Description Software toolkits, as used in Juusola et al. eLife 2017, for building stochastically operating photoreceptor models and for analysing neural information processing. 
Type Of Material Model of mechanisms or symptoms - non-mammalian in vivo 
Year Produced 2018 
Provided To Others? Yes  
Impact These software tools allow scientists to construct accurate biophysical models of photoreceptor cells, and to predict and analyse their information processing at different light stimulus conditions. 
URL https://github.com/JuusolaLab/Microsaccadic_Sampling_Paper
 
Title Electrophysiological and modelling data for Juusola et al, eLIfe 2017 paper 
Description Data from: Microsaccadic sampling of moving image information provides Drosophila hyperacute vision. Juusola M, Dau A, Song Z, Solanki N, Rien D, Jaciuch D, Dongre SA, Blanchard F, de Polavieja GG, Hardie RC, Takalo J. Elife 2017; stored in the Dryad Digital Repository 
Type Of Material Database/Collection of data 
Year Produced 2017 
Provided To Others? Yes  
Impact This data allows other scientists to verify our findings about hyperacute insect vision. 
URL http://datadryad.org/resource/doi:10.5061/dryad.12751
 
Title Photoreceptor-LMC synaptic feedback: information transmission and energy usage models 
Description These software link in vivo and ex vivo experiments with detailed stochastically operating biophysical models to extract new mechanistic knowledge of how Drosophila photoreceptor-interneuron-photoreceptor circuitry homeostatically retains its information sampling and transmission capacity against chronic perturbations in its ion-channel composition, and what is the cost of this compensation and its impact on optomotor behaviour. 
Type Of Material Computer model/algorithm 
Year Produced 2019 
Provided To Others? Yes  
Impact Enables accurate simulations of photoreceptor-LMC voltage output to any light intensity time series (visual) stimuli. 
URL https://github.com/JuusolaLab/SK_Slo_Paper
 
Title Software code for Juusola et al 2017 eLife paper 
Description Github repository for the key software code used in Juusola et al 2017 eLife paper 
Type Of Material Computer model/algorithm 
Year Produced 2017 
Provided To Others? Yes  
Impact The given software code allows other scientists to replicate and test our models and analyses as described in Juusola et al 2017 eLife paper. 
URL https://github.com/JuusolaLab/Microsaccadic_Sampling_Paper
 
Description PI of a research laboratory in National Key Laboratory of Cognitive Neuroscience and Learning, Beijing, China 
Organisation National Key Laboratory of Cognitive Neuroscience and Learning, Beijing, China
Country China 
Sector Public 
PI Contribution Minimum of 2 months/year to work on information processing in Drosophila visual system and in the mammalian cortex in BNU, China. National Key Laboratory of Cognitive Neuroscience and Learning has provided me with a fully-equipped research laboratory, including fly facilities; three experimental rooms, two of which are electrically shielded for behavioural and electrophysiological studies; and office rooms for workers (currently funding 2 Ph.D. students and a lab manager). Their total investment into my BNU laboratory already amounts to ~£1,400,000.
Collaborator Contribution Basic research infrastructure and funding including studentships, totaling £1,400,000 so far.
Impact In 2015, I was selected as a High-End Foreign Expert by the Chinese National Recruitment Program of High-End Foreign Experts (2015). This was 3-year fellowship (ending on 31 Dec 2017). National Key Laboratory of Cognitive Neuroscience and Learning has since extended my BNU professorship for further 3 years, with the same level of base funding.
Start Year 2008
 
Title Software code for modelling and analyses as described in Juusola et al 2017 eLife paper. 
Description The given software code allows other scientists to replicate and test our models and analyses as described in Juusola et al 2017 eLife paper. 
Type Of Technology Software 
Year Produced 2017 
Open Source License? Yes  
Impact This software package provides the toolkits for building stochastically operating photoreceptor models and for analysing neural information processing. 
URL https://github.com/JuusolaLab/Microsaccadic_Sampling_Paper
 
Title Software code used in Li et al (2019) Ca2+-activated K+ channels reduce network excitability, improving adaptability and energetics for transmitting and perceiving sensory information. Journal of Neuroscience 
Description Code to reproduce the model simulations in Li et al (2019) Ca2+-activated K+ channels reduce network excitability, improving adaptability and energetics for transmitting and perceiving sensory information. Journal of Neuroscience. 
Type Of Technology Software 
Year Produced 2019 
Open Source License? Yes  
Impact Code to reproduce the model simulations in Li et al (2019) Ca2+-activated K+ channels reduce network excitability, improving adaptability and energetics for transmitting and perceiving sensory information. Journal of Neuroscience. The software can be easily adapted to other invertebrate photoreceptor models. 
URL https://www.jneurosci.org/content/39/36/7132
 
Description Bottom-up and top-town processing of information in the Drosophila visual system. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Participants in your research or patient groups
Results and Impact Invited talk: 30.07.2008. National Science Foundation of China, Changhun, China.

no actual impacts realised to date
Year(s) Of Engagement Activity 2008
 
Description Foster Talk: How form shapes function; from sensory neurones to the organisation of the primate cortex 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach International
Primary Audience Participants in your research or patient groups
Results and Impact Invited established seminar series talk: 03.02.2011. Physiology, Development and Neuroscience, University of Cambridge, UK.

no actual impacts realised to date
Year(s) Of Engagement Activity 2011
 
Description I was an invited lecturer in The National Cognitive Neuroscience Summer in Beijing Normal University, Beijing China and gave a research talk and demonstrations. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact I was an invited lecturer in The National Cognitive Neuroscience Summer in Beijing Normal University, Beijing China and gave a research talk and demonstrations: "Using Drosophila as a model system for cognitive neuroscience research: "Using Drosophila as a model system for cognitive neuroscience research". 17.07.2018.
Year(s) Of Engagement Activity 2018
 
Description Invited talk in a research symposium: "Information Processing in Sensory Systems", Organisation for Computational Neurosciences (CNS), Quebec City, Canada. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk sparked questions and discussion afterwards

Reinforced excisting international collaborations
Year(s) Of Engagement Activity 2014
URL http://www.bionet.ee.columbia.edu/workshops/cns/methods/2014/identification
 
Description Invited research talk in Department of Neurobiology. University of Bielefeld, Germany. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talk sparked questions and discussion afterwards

Initiating international collaborations
Year(s) Of Engagement Activity 2014
 
Description Invited talk: "How photomechanical photoreceptor microsaccades improve insect vision" 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact I gave an invited research talk for over 500 researchers at Neurofly (the 17th European Drosophila Neurobiology Conference), Krakow, Poland. (05.09.2018). The audience was excited about my research findings, and the discussions carried on long after my talk.
Year(s) Of Engagement Activity 2018
URL http://neurofly2018.pl/gb/
 
Description Invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 16.03.2019. Technical University of Hefei, China. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 25 Scientists attended my invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 16.03.2019. Technical University of Hefei, China. This lead to lively discussions and planned collaborations.
Year(s) Of Engagement Activity 2019
 
Description Invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 19.12.2019. Harbin University of Technology, Harbin, China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact About 200 people attended my talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 19.12.2019. Harbin University of Technology, Harbin, China. This led to a lively discussion and plans to collaborate.
Year(s) Of Engagement Activity 2019
URL http://rwxy.hit.edu.cn/2019/1217/c6938a234766/page.htm
 
Description Invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 23.05.2019. Fudan University (Engineering), Shanghai, China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact About 150 people attended my invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 23.05.2019. Fudan University, Shanghai, China. This led to lively discussions and plans for future collaborations.
Year(s) Of Engagement Activity 2019
 
Description Invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 27.09.2019. Fudan University (Biology), Shanghai, China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact About 50 scientists attended my talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 27.09.2019. Fudan University (Biology), Shanghai, China. THis led to lively discussions and plans to collaborate.
Year(s) Of Engagement Activity 2019
 
Description Invited talk: "Hyperacute stereovision in fruit fly, Drosophila melanogaster." 09.08.2019. International Conference on Invertebrate Vision, Bäckaskog Castle, Lund, Sweden 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact ~350 scientists attended my talk "Hyperacute stereovision in fruit fly, Drosophila melanogaster." 09.08.2019. International Conference on Invertebrate Vision, Bäckaskog Castle, Lund, Sweden. The talk sparked questions and discussion afterwards.
Year(s) Of Engagement Activity 2019
URL https://www.iciv.se/
 
Description Invited talk: How to sample a reliable neural estimate of the variable world? 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact About 70 scientists attended for "Multimodal sensory transduction in insect neurons symposium" at the Physiological Society, London, which sparked questions and discussion afterwards, and the participants reported changing their viewpoints about insect vision/perception as stimulated by my new research findings.
Year(s) Of Engagement Activity 2017
 
Description Invited talk: Hyperacute stereovision in Fruit fly, Drosophila melangaster. 25.09.2019. Institute of Zoology, Chinese Academy of Sciences, Beijing, China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact About 25 people attended my invited talk: "Hyperacute stereovision in Fruit fly, Drosophila melangaster." 25.09.2019. Institute of Zoology, Chinese Academy of Sciences, Beijing, China. This led to lively discussions and plans for collaboration.
Year(s) Of Engagement Activity 2019
 
Description Neural computations behind early visual invariance 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? Yes
Geographic Reach international
Primary Audience Participants in your research or patient groups
Results and Impact Invited conference talk: 14.03.2011. JFRC Conference: Vision in Flies (by invitation only for 20 leading scientists in the field). Howard Hughes Medical Research Institute, Janelia Farm, USA.

no actual impacts realised to date
Year(s) Of Engagement Activity 2011
 
Description Seeing through moving eyes - microsaccadic information sampling provides Drosophila hyperacute vision 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I gave an invited research talk for 20-30 researchers at the University of Ljubljana, Slovenia (06.10.2017). The audience was excited about my research findings, and the discussions carried on long after my talk.
Year(s) Of Engagement Activity 2017
 
Description Seeing through moving eyes - microsaccadic information sampling provides Drosophila hyperacute vision. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact I gave an invited research talk for 30-40 researchers in the Department of Biomedical Science at the University of Sheffield, UK. (23.10.2017). The audience was excited about my research findings, and the discussions carried on long after my talk.
Year(s) Of Engagement Activity 2017
 
Description Seeing through moving eyes - microsaccadic information sampling provides Drosophila hyperacute vision. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact About 60 leading international scientists in my field attended my talk in the Kavli Workshop on Neural Circuits and Behavior of Drosophila, Crete in July 2017. My talk sparked questions and discussion afterwards, with many participants informing me that my research efforts were now changing the general understanding of how insect compound eyes work.
Year(s) Of Engagement Activity 2017
 
Description Seeing through moving eyes - microsaccadic information sampling provides Drosophila hyperacute vision. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact I was an invited lecturer at the National Cognitive Neuroscience Summer School in Beijing Normal University (BNU), Beijing, China in July 2017. About 200 Chinese undergraduate students attended my talks, and four students selected me as their lab demonstrator for neuroscience research techniques.
Year(s) Of Engagement Activity 2017
 
Description Seeing through moving eyes - microsaccadic information sampling provides Drosophila hyperacute vision. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact I gave an invited research talk for 30-40 researchers at the University of Helsinki, Finland (22.06.2017). The audience was excited about my research findings, and the discussions carried on long after my talk.
Year(s) Of Engagement Activity 2017