Dimension-selective attention and second language acquisition

Lead Research Organisation: Birkbeck, University of London
Department Name: Psychological Sciences

Abstract

In a globalized world, a growing number of adults are moving to a new country and attempting to learn a second language (L2). Unfortunately, many L2 learners end up producing heavily accented speech and struggling to comprehend speech. Understanding the sources of L2 learning difficulties could lead to remedial approaches designed to boost L2 skills in struggling learners.

Language structure is conveyed by a complex set of acoustic cues, including changes in duration, amplitude, and frequency. Individuals who are better able to detect these acoustic cues may be able to more rapidly absorb the structure of a new language. However, detecting the acoustic cues of an L2 can be difficult, due to differences across languages in how sound patterns convey language structure. For example, in tone languages such as Mandarin, pitch is a vital cue to the meaning of words, but it plays a more secondary role in non-tonal languages such as English. As a result, pitch may be an "attentional magnet" for Mandarin speakers: they may have difficulty learning to ignore pitch and attend to other, more relevant features when learning to perceive English speech. Individuals who are better able to direct their attention to individual acoustic dimensions may be better able to focus on the acoustic cues which provide the most reliable information in an L2.

We propose to test the hypothesis that Mandarin speakers, compared to native English speakers, have difficulty directing attention away from pitch and towards other acoustic dimensions, and thus place undue importance on pitch during English speech perception and production. We will use EEG to examine the extent to which participants' neural responses encode changes in pitch versus timbre when participants listen passively to complex tone streams or are asked to attend to one dimension. We will also examine neural entrainment to pitch contour versus amplitude envelope while participants listen to naturalistic spoken narratives. We predict that Mandarin speakers will show greater pitch tracking compared to native English speakers not only in the passive and naturalistic listening conditions, but also when asked to attend to timbre. Moreover, we predict that Mandarin participants who are better able to resist attending to pitch and successfully attend to timbre will also demonstrate more native-like English speech production. Finally, using fMRI, we will investigate the neural networks underlying attention to acoustic dimensions during speech perception; we predict that Mandarin speakers categorizing speech in the scanner will show stronger connections between pre-frontal cortex and regions in auditory cortex linked to pitch perception.

We further propose to train Mandarin speakers to resist the attentional magnet, directing attention towards other useful sources of information during speech perception. Participants will complete nine sessions of training over several months in which they will categorize speech features (such as stress or word meaning) on the basis of various cues besides pitch. A control group will complete a series of vocabulary boosting exercises. We predict that over the course of the following months, the experimental training group will achieve more native-like speech perception strategies and more accurate pronunciation. Furthermore, we predict that the experimental training will improve participants' ability to direct attention to sound dimensions in speech, as measured using EEG.

This project will lead to a better understanding of why some people struggle to learn a second language more than others. This could lead to the development of second language aptitude tests which more accurately predict who will most readily acquire a new language in adulthood. Moreover, this project could also lead to the development of interventions designed to boost poor second language learning by teaching learners to attend to the most relevant aspects of speech.

Publications

10 25 50
 
Description Research Innovation Fund Development Grant
Amount £4,400 (GBP)
Organisation Birkbeck, University of London 
Sector Academic/University
Country United Kingdom
Start 07/2022 
End 08/2023
 
Title English Prosody Training and Test Materials 
Description An open-source set of English prosody training and test materials has been made publicly available to researchers through Gorilla Open Materials. Training materials include adaptive training tasks that target prosody perception abilities or vocabulary knowledge. Test materials include a prosody perception test that can be used as an outcome measure to assess the efficacy of prosody perception training. 
Type Of Material Model of mechanisms or symptoms - human 
Year Produced 2023 
Provided To Others? Yes  
Impact The English prosody training and test materials have been recently developed and are now publicly available to researchers interested in improving second language acquisition. Ongoing work using these tools aims to assess whether training tonal language speakers to rely less on pitch when hearing English speech can improve prosody perception. 
URL https://app.gorilla.sc/openmaterials/580460
 
Title Length of Residence and L2 Prosodic Cue Weighting Dataset 
Description This dataset contains research data investigating the effects of length of residency on second language learning. This dataset includes data form two dimension-selective attention tasks, a prosody perception task, and a music perception task. Code to reproduce the analyses and figures from the paper "Extensive residence in a second language environment modifies perceptual strategies for suprasegmental categorization", by Katya Petrova, Kyle Jasmin, Kazuya Saito, and Adam Tierney (in press at Journal of Experimental Psychology: Learning, Memory, and Cognition) is also included. 
Type Of Material Database/Collection of data 
Year Produced 2023 
Provided To Others? Yes  
Impact A manuscript based on this dataset has been written up by members of our group and accepted for publication in at Journal of Experimental Psychology: Learning, Memory, and Cognition. 
URL https://osf.io/zq7sc/
 
Description ESRC-JSLARF Applied Linguistics Youtube Channel 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Our team has been releasing a range of talks by both education and psychology researchers who are interested in second language acquisition (including Dr Adam Tierney and Dr Kazuya Saito). The aim of these talks is to disseminate our work with general public and stimulate their interest in our research.
Year(s) Of Engagement Activity 2022
URL https://www.youtube.com/channel/UCEhP1hOYad-eYWiGrZTmByg/featured
 
Description Tools for L2 Speech 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Our team's Tools for L2 Speech (http://sla-speech-tools.com/) is now officially registered as an open science research repository (DOI: 10.17616/R31NJNAX). This website contains several validated measures of auditory processing developed by our team, which can now be used by other research teams investigating second language learning. In addition, this resource contains a wide range of validated L2 speech tools for teaching (explicit, fonf, TBPT), assessment (rater rubrics), and individual differences (aptitude, motivation, emotion). Educational resources include the latest research-based pronunciation teaching materials that are ready to be used in the classroom (a range of language- vs. meaning-focused activities, a list of pronunciation features important for comprehensibility).
Year(s) Of Engagement Activity 2022
URL http://sla-speech-tools.com/