The role of learning mechanisms in understanding spoken language

Lead Research Organisation: University College London
Department Name: Division of PALS

Abstract

In recent years there have been several notable demonstrations that the ability to learn about words and their meanings continues to be important throughout our adult life (1). Not only do learning mechanisms allow us to acquire entirely new information (e.g., the social-networking meaning of the word "twitter" (2), see associated studentship), but they can also modify our existing knowledge about words that we already know in order to enhance their subsequent processing. One case where such a learning mechanism would be of clear benefit is to facilitate the processing of words like "bark" that have multiple meanings. This form of ambiguity is ubiquitous in language, with over 80% of words having more than one dictionary definition (3). Learning mechanisms could make an important contribution to our ability to understand these tricky words by adjusting the availability of their meanings on the basis of experience. For example the word "spade" can refer to either a "digging tool" or "card suit", and our preferred interpretation of this word could be influenced by whether we had recently taken up gardening or card-playing as a hobby. By learning from our recent experience with such words, we can make better predictions about which meaning is more likely to be encountered in the future.

There are several reasons to believe that such learning mechanisms do indeed make an important contribution to understanding ambiguous words. First, numerous studies have shown a strong processing benefit for the meaning that is most frequent in the language as a whole (4), such that the word "pen" is easier to understand in a phrase like "the blue pen", which uses its dominant meaning compared a with the phrase like "the pig pen" where its low frequency meaning is used. These findings suggest, indirectly, that that we are sensitive to the overall frequency with which we encounter alternative word meanings across our life-time. In addition, we have recently provided the first direct evidence that listeners' preferences for word meanings are strongly influenced by a single recent encounter with one of its meanings, such that the low-frequency meaning of "pen" would become more readily available after hearing a sentence like "the farmer put the sheep in the pen"(5).

Despite this evidence that learning mechanisms play a key role in our ability to understand ambiguous words, current models of ambiguity resolution are remarkably inadequate when it comes to explaining these mechanisms. The primary aim of the proposed research is to obtain comprehensive empirical evidence about how and when listeners can use their experience to adjust their preferences for individual word meanings. First we will establish whether listeners learn from all encounters with an ambiguous word or if particular conditions necessary for learning to occur (Experiment 1, 6). Second, we will measure the relative contributions of listeners' recent and longer-term experience with ambiguous words to determine how we integrate information acquired across our lifespan (Experiments 2-5, 9). Finally we will explore whether meaning preferences can be modulated by factors such as the identity or accent of the speaker (Experiments 7, 8). These data will guide the development of a new model of ambiguity resolution which specifies the nature of these learning mechanisms. This novel line of research offers an opportunity to make rapid progress on this important topic, and may lead to a radically different understanding of this critical aspect of language comprehension.

By understanding how these processes operate within healthy adults we will also provide the empirical evidence that will allow future research to assess the contributions of both processing and learning deficits in those individuals who are known to have difficulties understanding sentences that contain ambiguous words (see Impact Summary).

Planned Impact

(i) User Groups
Understanding the meaning of ambiguous words within sentence contexts is a pre-requisite for all verbal communication: over 80% of common English words have more than one dictionary definition. Difficulties in understanding ambiguous words will necessarily have a marked impact on the ability of any individual to understand spoken and written language. Difficulties of this sort have already been identified in a wide range of clinical and non-clinical populations including adults with reading comprehension difficulties (10), children with language impairments (11) and aphasic patients (12). The primary non-academic user groups that we will target will thus be professionals involved in assessing and remediating individuals with language processing difficulties, within both educational and clinical settings. Our work will contribute to the long-term development of an effective and scientifically-informed strategy for (i) assessing the nature of the difficulties of these individuals and (ii) designing and evaluating appropriate interventions that are aimed at improving their comprehension abilities.
The second non-academic user group will be professionals involved in second language teaching. Our discoveries about the factors that influence the likelihood that information about words and their meanings will be consolidated into long term memory will have clear relevance to professionals interested in improving outcomes for students who are learning English (and other languages) as an additional language.

(ii) Plan for Engagement
We anticipate that the impact of our research for these users to occur in the relatively long term, but we propose the following activities to (i) facilitate networking with these communities, (ii) disseminate our results, and (iii) obtain input from these users concerning future research :
a) "How do we understand language" - a website
We will build on our existing experience in setting up a website to promote research (jennirodd.com) to set up a new website with the explicit aim of promoting interaction between academic researchers and educational/clinical practitioners on the topic of language comprehension. In Phase I (year 1 of the grant) we will focus on presenting current psycholinguistic research (from both within and outside our lab) on how healthy adults and children understand language. The focus will be presenting relatively short summaries of key findings in an accessible manner. In Phase II (years 2-3 of the grant) we will solicit additional contributions from educational/clinical practitioners (see Impact Plan).
b) "Language Comprehension: From Theory to Practice" - a workshop
This workshop will take place in the second year of the grant and will be based at UCL. The invited speakers will include researchers studying adult and child sentence comprehension within academic settings, as well as education and clinical practitioners with an interest in developing and evaluating interventions aimed at improving language comprehension (see Impact Plan).

(iii) Additional Public Engagement
Our team has considerable experience in disseminating research to the wider public (e.g., Cheltenham Science Festival, Cambridge Science Festival, Science Museum). With the support of UCL's Public Engagement Unit (http://www.ucl.ac.uk /public-engagement/) we will continue to develop innovative methods to improve understanding of how people understand language within the wider population. For example, following on from our recent publication looking at how ambiguous words are processed within puns (13) and Dr Davis' recent debut performance at the Bright Club (www.brightclub.org), Dr Davis and Dr Rodd are currently planning a public communication of science event to be hosted at the Dana Centre at the Science Museum (http://www.danacentre.org.uk) combining comedy and the psycholinguistics of how ambiguous words are processed in both puns and normal speech.
 
Description This research aimed to determine how listeners use their experience with language to improve their ability to understand speech. More specifically, we investigated how listeners use past encounters with words with multiple meanings (ambiguous words, e.g., BARK of the tree/dog) in different contexts to make it easier to understand these words in the future.

1) Listeners use knowledge about a speaker's accents to guide comprehension
Five experiments using three experimental methods (word association, semantic relatedness, sentence comprehension) showed that listeners keep track of systematic differences in how different groups of speakers use ambiguous words. For example, British participants are more likely to retrieve the fuel-related meaning of "gas" that is more common in the US if the word was spoken in an American accent. Responses to words with a neutral accent (created by morphing British- and American-accented recordings) showed that listeners determine the dialectic identity of a speaker and then use this knowledge to guide meaning access for all subsequent words spoken by that person, regardless of the strength of the accent in each individual word. These results support a model of word-meaning access in which listeners determine key characteristics of a speaker and use this knowledge to guide word-meaning access.

2) Listeners update their meaning representations based on their final interpretation of words
Listeners' preferences for word meanings can be strongly influenced by recent experience: the low-frequency meaning of "pen"; becomes more readily available after hearing a sentence like "the farmer put the sheep in the pen". We compared the magnitude of this 'word-meaning priming' effect for sentences where the ambiguous word occurs early in the sentence and is thus highly likely to be initially misinterpreted (e.g., the PEN that the man wanted was for the SHEEP) with sentences where the listener can immediately be confident about its intended meaning (e.g., the sheep PEN was the one that the man wanted). Experiments using two different methods (word association, semantic relatedness) showed equivalent priming in the two cases indicating that it is the final interpretation of the word that drives learning, and that learning is not reduced by transient activation of the 'wrong' meaning.

3) Word-Meaning Priming can occur across modalities
Two experiments (word association, semantic relatedness) showed that participants generalise from their experience with ambiguous words in one modality (e.g., text) to another modality (e.g., speech). These cross-modal priming effects were not significantly reduced compared with within-modality priming, indicating that the lexical representations that are being changed as a consequence of experience are shared between the reading and listening.

4) Word-meaning Priming decays rapidly with time
Four web-based and lab-based experiments showed that encounters with ambiguous words has a large impact on how that word is interpreted after a 2-minute delay, but this effect is substantially reduced after 20 minutes, indicating the presence of a transient component that does not permanently change lexical representations. In contrast, priming remains relatively stable between 20-40 minutes reflecting an additional, stable component that enhances comprehension within relatively long conversations (Rodd et al., 2016).
Exploitation Route It is well established that comprehension difficulties are evident in a wide range of clinical and non-clinical populations including both children and adults, and that these difficulties can have a life-long negative impact. Our findings confirm that ability to learn from experience is a key factor in fluent, skilled comprehension. Additional research is needed to determine the extent to which these difficulties might be caused (or exacerbated) by underlying deficits in language learning mechanisms in different groups of individuals with comprehension difficulties. If such deficits are indeed critical to explaining the comprehension difficulties of groups (or individuals), then these findings provide important insights into the nature of these learning mechanisms that will be key to developing effective and scientifically-informed interventions.
Sectors Education,Healthcare

 
Description Experimental Psychology Society, Small Grant
Amount £2,500 (GBP)
Organisation Experimental Psychology Society (EPS) 
Sector Charity/Non Profit
Country United Kingdom
Start 05/2016 
End 05/2017
 
Description Individual Differences in Comprehension across the Lifespan
Amount £580,977 (GBP)
Funding ID ES/S009752/1 
Organisation Economic and Social Research Council 
Sector Public
Country United Kingdom
Start 05/2020 
End 08/2024
 
Description Interviewed as part of podcast produced for the "Allusionist" series 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Podcast entitled "This is your brain on language" produced by HELEN ZALTZMAN
Year(s) Of Engagement Activity 2016
URL http://www.theallusionist.org/brain
 
Description Lunch Hour Lecture 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Public Lecture entitled "Barking up the right tree: how do we understand what words mean?" given as part of the UCL Lunch Hour Lecture Programme:
Year(s) Of Engagement Activity 2016
URL http://events.ucl.ac.uk/event/event:s2n-is5uz5in-rn5qji/lunch-hour-lectures-barking-up-the-right-tre...
 
Description Presentation at "Science Showoff" Event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Presentation at "Science Showoff" Science Cabaret Event on how we study how people access word meanings
Year(s) Of Engagement Activity 2016
URL http://www.neurolang.org/science-showoff-brains-and-language-special/
 
Description Workshop on Social Communication 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Presented at Social Communication Workshop. This two-day workshop brought together leading scholars with the express aims of achieving consensus about the nature and assessment of social communication and pragmatic language disorder, setting the future research agenda, facilitating collaboration between researchers and practitioners, inspiring early-career researchers, and communicating these issues to practitioners and the general public.
Year(s) Of Engagement Activity 2016
URL http://www.socialcommunicationworkshop.com/