When does perceptual organization happen?

Lead Research Organisation: University of Liverpool
Department Name: Institute of Psychology Health & Society

Abstract

Whenever our eyelids are open, an image is projected onto the retina at the back of the eyeball. But this can happen when we are unconscious. To see anything, the visual brain must organize and interpret the retinal image. Among other things, the visual brain must work out what features belong to the same object, how surfaces are arranged in depth, which surface features are caused by illumination and which by pigmentation. The visual parts of the brain are full of mechanisms which mediate perceptual organization. Our project will test WHEN the visual brain goes to the trouble of organizing and interpreting the retinal image.

At one extreme, our perceptual organization systems could be 'on red alert' whenever we are awake. Perhaps complete perceptual organization always happens, whether it is task-relevant or not? At the other extreme, perceptual organization systems might frequently default to 'stand by mode'. Perhaps perceptual organization is only undertaken when necessary, and the retinal image is often left uninterpreted?

Furthermore, perceptual organization might be robust or sensitive to changes in mental state. For instance, perceptual organization mechanisms might be disrupted by acute or chronic to alcohol consumption.

Visual symmetry is the perfect stimulus to answer these questions. First, we can precisely define and control the formal properties of abstract symmetrical patterns. Second, symmetrical patterns generate an Event Related Potential (ERP) called the Sustained Posterior Negativity (SPN). This neural signal has been well characterized, and it can be cheaply measured with scalp electrodes. The SPN is generated by known brain regions (V4 and LOC), and it can be used as a bio-marker of perceptual organization. If there is an SPN on the scalp, then perceptual organization has happened in the visual brain. Work package 1 will the discover the conditions for SPN generation: For instance, the SPN might be reduced when participants are attending to color or sound rather than symmetry.

Work package 2 will use functional Magnetic Resonance Imaging (fMRI) and advanced multi-voxel pattern analysis (MVPA) to assess changes to the visual symmetry code when participants attend to symmetry, color or sound. This can tell us how the symmetry representations in the visual cortex deteriorate when attention is directed elsewhere. Next, WP3, will use Transcranial Magnetic Stimulation (TMS) to assess the causal necessity of the different brain areas in automatic perceptual organization.

Finally our Work package 4 has an applied dimension. We want to discover how perceptual organization is altered by alcohol. Although alcohol is the most widely used an abused recreational drug in the UK, little is known about acute and chronic effects on perceptual organization. We will test the theory that alcohol reduces the speed of neural communication between the left and right visual hemispheres. We predict that the SPN response to vertical symmetry will be selectively delayed by mild intoxication, and in currently sober heavy drinkers. This has the potential to contribute to evidence based drink awareness campaigns, but it is only possible by building in the basic research in WP1-3. Ultimately, we will develop new research tool which anybody can download and use to measure alcohol-induced brain changes. This is important because the translation from basic to applied research in this area is often blocked by practical obstacles.

Our research team for this project is carefully chosen. Makin, Bertamini and Rampone are experts in symmetry perception, EEG recording and analysis. Prof Morland has extensive experience using fMRI to map the visual cortex. Silvanto is an expert on studying symmetry perception with TMS. Jones is a leading alcohol/EEG researcher at Liverpool, who is well placed to push the applied dimension of the project.

Planned Impact

Approximately 30% of adults in the UK regularly drink more than government recommendations, and alcohol costs the economy around £21bn per year. Importantly, most the attributable cost comes from heavy drinkers, rather than those with clinical dependence. Although drinking poses risks to their health in the future, these individuals are basically healthy (Alcohol Concern, 2013). We know that alcohol-related cues grab visual attention and are associated with craving and consumption. However there is still no consensus about how alcohol alters human vision.

This proposal includes both basic and applied research to fill this gap. The basic research is about the automatic nature of perceptual organization (Concentrated in Work Packages 1-3). Work package 4 will then build on these findings to examine the brain changes associated with acute and chronic alcohol use. This research is important because policy is often informed by claims about the safe limits of alcohol. For instance, over 2000 road deaths caused by alcohol happen every decade in the UK, and the legal blood alcohol limit was reduced to 50mg/ml in December 2014 (www.drinkaware.co.uk). However, even mild doses of alcohol could have consequential effects on vision.

Some research in this area has been rather descriptive and atheoretical, mainly documenting minor changes caused by mild intoxication. We will go beyond this and test the theory that alcohol reduces speed of neural transmission between the hemispheres, and thus slows integration of perceptual information across the corpus callosum (Kahn & Tmney, 2007). WP4 will examine the effects of 0.4g/Kg and 0.8g/Kg body weight doses on inter hemispheric communication speed.

We will take three concrete steps to maximize this impact.

First, we will develop an easy to use research tool for measuring alcohol induced disruption of inter-hemispheric communication. Once validated, this tool will be available on Open Science Framework, and promoted to likely user groups. We reasoned that the translational pathway from basic to applied alcohol research is often blocked because it is difficult for to measure alcohol induced brain changes without specialist equipment and analysis protocols. Our research tool will remedy this.

Second, we will run our usual visual properties driving visual preference workshop in 2020 and 2021, but with a special focus on alcohol and vision. This will foster links between both research camps, and allow us to showcase the downloadable research tool.

Third, this research will contribute public engagement and healthy drinking campaigns. We will communicate the results via the University of Liverpool press office. Furthermore, festivals such as Green Man and Cheltenham Science Festival allow alcohol consumption on site, so we will use these opportunities to highlight the way alcohol disrupts visual function. In the recent past we have had excellent success with similar projects in terms of academic impact (Journal Articles and Conference Presentations), media impact (both festivals are national and have substantial media presence) and individual impact (participants report awareness of drinking harms and increased motivation to reduce their consumption during feedback sessions).

Publications

10 25 50
 
Description We are approaching the end of this award. COVID has significantly disrupted data collection so we are behind schedule with the original objectives. We are applying for a one year no-cost extension that will allow us to achieve these objectives.

Work package 1 (Liverpool)

Covid stopped many original plans, but also provided new opportunities. Our main achievement has been to compile a curated database of all previous EEG datasets at the University of Liverpool (2215 participants, 6674 participant-level ERPs from 850312 single trials). The 'Complete Liverpool SPN catalogue' is now publicly available on open science framework (at https://osf.io/2sncj/). A major publication about the catalogue has reached the second round of peer review at eLife, and a pre-registered report paper is under review at Cortex. These two ambitious papers were not directly planned in the original proposal, but meet our objectives in an alternative way.

We can also provide an answer to our overarching research question: When does perceptual organization happen? It depends on whether we are talking about 'retinal' and 'extraretinal' forms of perceptual organization. Retinal perceptual organization is automatic, but extra-retinal perceptual organization is selective. These conclusions are supported by new experiments and by meta analysis of the catalogue.

Since Covid restrictions eased we have collected 150 participants

Work package 2 (York)

We have completed the first fMRI - brain scanning experiment at York. We have discovered that reflectional symmetry is processed automatically, but rotational symmetry is more selective.

Since Covid restrictions eased we have collected ~25 participants on this.

Work package 3 (Surrey)

This is behind schedule at the moment - Covid stopped recruitment on this project. A new experiment has been designed and will be completed during the extension year.

Work package 4 (Liverpool)

We have discovered that alcohol consumption enhances the brain response to symmetry. This is the opposite of what we expected. We are now trying to replicate and expand on this interesting preliminary result.
Exploitation Route Others will be able to add to the complete SPN catalogue, or conduct their own secondary analysis. This kind of big data approach is essential for the future of cognitive neuroscience. The meta scientific lessons are essential for all evidence based policy making
Sectors Other

 
Description Complete SPN catalogue and open science promotion
Geographic Reach National 
Policy Influence Type Contribution to new or improved professional practice
 
Description Investigating scene processing in the human brain
Amount £242,134 (GBP)
Funding ID BB/V003917/1 
Organisation Biotechnology and Biological Sciences Research Council (BBSRC) 
Sector Public
Country United Kingdom
Start 12/2021 
End 11/2024
 
Title Standardized pipelines for measuring brain response to symmetry 
Description One of the main activities arising from this award is the development of the complete Liverpool SPN catalogue. This a a large database of brain recordings. There are many useful tools for data analysis of visualization which can be exploited by others. 
Type Of Material Physiological assessment or outcome measure 
Year Produced 2021 
Provided To Others? Yes  
Impact So far this catalogue has had a huge impact on our own research. It has been a highlight of several open science and reproducibility talks around Europe. I hope this has help move the needle on open science and post-replication crisis approaches to cognitive neuroscience. 
URL https://osf.io/2sncj/
 
Title All brain reseponses to symmetry 
Description This is still under construction at the moment. Given that COVID has caused significant disruption of EEG data collection, we have decided to extract more value from existing EEG data. We have started cataloguing all brain responses to symmetry every recorded in our lab at University of Liverpool (published and unpublished). These will be accessible on Open Science Framework with user friendly meta analysis code. There are rarely 'big data sets' available for EEG research, and we hope this will be seen as a positive pioneering approach. We have learned more about the neural response to symmetry from this exercise than we could have from a single experiment. It also helps address issues to do with replication and publication bias. 
Type Of Material Database/Collection of data 
Year Produced 2020 
Provided To Others? No  
Impact This is currently under construction. We will update when it is ready. We have included this preliminary mention to give an indicator of award related activity underway (while data collection is restricted) 
 
Title We have developed an app for visualizing aspects of our database. 
Description This grant is all about the brain response to visual symmetry. We have develop a public database with over 1TB of EEG data. We have developed a downloadable app for data visualization. A GUI allows uses to enter datasets, electrodes and timewindows. This is a far more complete way to archive humanities scientific record. 
Type Of Technology Webtool/Application 
Year Produced 2021 
Impact This was used as a good example at various open science workshops and conference talks. 
 
Description Drugs NW 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Other audiences
Results and Impact The drugs North West Working group was a good opportunity to discuss the alcohol related research in our Work package 4. This one day event was organized by John Moores University, and had diverse contributions from researchers interested in public policy, to those interested in brain mechanisms.

My talk was about our first study, that found a selective effect of alcohol on changing symmetry perception, but not early visual mechanisms. I also elaborated on our failed attempts to replicate this, and the importance of taking replication seriously before rushing publication.
Year(s) Of Engagement Activity 2022
 
Description Presented open research work at open research week 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact One result of the covid pandemic is our lab really embraced open science, and developed the complete Liverpool 'SPN catalogue' on open science framework (https://osf.io/2sncj/). This is a complete data base of all the EEG recordings from this grant and before.

This has signficance beyond our field, which I have been promoting in the open research eco system. I am now involved in the UK reproducibility network as a local lead, and with initiatives in the University. It is great to be able to show how we have embraced open research in our lab. This is interesting for audiences who are not so interested in the research itself.
Year(s) Of Engagement Activity 2022,2023
URL https://www.liverpool.ac.uk/open-research/open-research-week-2022/
 
Description Public engagement activity pint of science 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact New ESRC funded PhD student Elena Karakashevska presented some preliminary results from Work Package 4 at the pint of science conference at a public venue
Year(s) Of Engagement Activity 2022
URL https://pintofscience.co.uk/
 
Description Visual properties driving visual preference conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The visual properties driving visual prefernece workshop is a recurring event that began in 2015. Makin, Rampone and Bertamini have been organising this annually. Each year the theme changes slightly, but we reach artists and commercial psychologists as well as our usual visual neuroscience audience. Recordings from all the talks are included availabe https://www.bertamini.org/lab/vpdvp.html

The complete Liverpool SPN catalogue was presented on Zoom at VPDVP 2021
The research from Work package 4, on alchol and symmetry percpetion, was presented in Padova VDPVP 2022 (see URL below)
Year(s) Of Engagement Activity 2020,2021,2022,2023
URL https://www.bertamini.org/lab/vpdvp.html