From icon to abstraction in sign language: how iconicity shapes the lexicon in the visual modality

Lead Research Organisation: University of Birmingham
Department Name: English Drama American and Canadian Stu

Abstract

Language is a unique human ability, yet the forces shaping vocabulary are little understood. A central tenet of linguistic theory is that the lexicon is arbitrary, with word and meaning related by convention alone1. However, recent research gives a more nuanced view: arbitrary form-meaning relationships co-exist with and complement iconic and systematic relationships2,3. Iconicity, the direct relationship between form and meaning, has been shown to play an important role in language learning and processing, offering a concrete grounding to our experience in the world3-6. As a result, iconicity has been characterised as having a limited capacity to refer to abstract concepts and thus as remaining limited in its scope within the lexicon of spoken languages7. Compared to the spoken modality, the visual modality of sign languages affords a high degree of iconicity. In this project, we explore how iconicity constrains form-meaning mappings in the visual modality and shapes a lexicon for both concrete and abstract concepts.

We capitalise on the notion that words develop abstract meaning through the figurative use of concrete concepts while maintaining links to their origin, e.g. the concrete and abstract meaning of anchor share a core meaning of "preventing something from moving"8. We investigate sign languages, the natural languages of deaf communities. These are full-fledged languages on all levels of linguistic organisation and which exhibit a high prevalence of iconicity in their lexicon. Iconicity patterns in systematic ways across semantic domains9,10, and very often signs converge in the way concepts are expressed (e.g. the sign TO-WRITE). Importantly, sign languages exhibit instances of abstract concepts arising from concrete, iconic referents. E.g., in German Sign Language (DGS), the sign SCHOOL shares an iconic base with the sign TO-WRITE (Fig. 1). This suggests that groups of iconic signs share elements that are exploited as a springboard for meaning diversification while retaining some degree of semantic relatedness (i.e. process of colexification11). The iconic base of signs may be shared across sign languages (e.g. DGS and British Sign Language (BSL)), and the gestures produced by speaking communities may also have similar iconic forms (Fig. 1) due to shared conceptual representations and the shared modality. By comparing the form and meaning of signs across semantic domains in two unrelated sign languages (DGS and BSL), it will be possible to understand the underlying mechanisms by which iconicity shapes and constrains a lexicon. Comparing signs with silent gestures produced for the same concepts by non-signers in Germany and the UK will reveal the extent of shared cognitive and/or cultural bases and how these may diversify lexical forms and meanings for concrete and abstract concepts.

Publications

10 25 50
 
Description The preliminary findings of the data collection thus far shows that British Sign Language (BSL) and German Sign Language (DGS) have significant overlap because some signs have almost the same form. For example, the sign TABLE in both sign languages is produced by tracing a flat surface. However, there are some other signs (mainly abstract concepts) that do not have the same degree of overlap. For instance, the signs CULTURE in both sign languages have very distinct forms. This is an important finding because BSL and DGS are unrelated sign languages so there is not genealogical relationship. After we quantify and carry out the next stage of the analysis we will be able to confirm our original hypothesis. Namely, that sign languages have similar forms for concrete concepts (e.g., table) but quite distinct when it comes to abstract concepts (e.g., culture). Once we can continue with data collection from deaf signers we will be able to continue with the next stage of the study (gestures from hearing people in Germany and UK).
Exploitation Route These findings are important because the data generated in this study will help us make accurate estimations about language emergence and evolution. Scientists specialised in evolution can use the data and make approximations about the timescale and trajectory of the origins of sign languages.

Also, by understanding how signs and their multiple meanings (polysemy) it will be possible to device interventions for deaf children learning a sign language as first language.

It will also be possible to create a cognitive map of deaf people and their vocabulary to develop assessment tools needed to explore conditions such as Alzheimer and dementia.
Sectors Education,Healthcare,Culture, Heritage, Museums and Collections

 
Description Iconicity in sign and gesture in Germany and UK 
Organisation University of Cologne
Country Germany 
Sector Academic/University 
PI Contribution Dr Gerardo Ortega (PI in the UK) - hold weekly meetings to manage the binational project - daily supervision of British team - providing training sessions on linguistic analysis - teaching lessons on the use of the linguistic annotation software ELAN - budget allocation - supervision during data collection - ethical application of the study and overviewing good scientific practice Carla Pol and Rachel England (research assistants in the UK) - creation of COVID-safe protocols for data collection - purchase of equipment - creation of coding scheme for linguistic analysis - recruitment of deaf participants - implementation of software for presentation of stimulus materials
Collaborator Contribution Prof. Pamela Perniss - hold weekly meetings to manage the binational project - daily supervision of German team - setting up the digital archive and shared folders - coordination of interpreters across sites (British Sign Language/ German Sign Language) - providing training sessions on data collection and linguistic analysis - leading journal clubs Nia Lazarus (PhD student), Annika Schiefner (PhD student) - data collection from deaf signers - annotation of data - programming the code on PsychoPy (psycholinguistic software) - coordination of sign language interpreters - archiving of resources for all studies
Impact The current grant was awarded as part of the binational scheme between the AHRC-DFG where two partners (one in the UK and one in Germany) collaborate in a joint research project. The PI in Germany is Prof. Pamela Perniss who has hired two PhD students (Nia Lazarus, Annika Schiefner) and both Prof. Perniss and myself give joint supervision. Due to the current COVID restrictions, both PhD students had to start their contracts in autumn. In addition, Miss Lazarus is an American citizen and she experienced several delays in her arrival to Europe because of frequent cancellations of her flights. For these reasons, both PhD students couldn't start data collection until September. However, we've been in constant communication remotely and they have been analysing videos of German Sign Language. I am certain that they will generate some concrete results in 2021.
Start Year 2020
 
Description Talk at the UK Cognitive Linguistics Conference 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact I was invited to give a talk about iconicity in sign languages and gesture. I was the sole presenter and I gave the theoretical framework of our study (we hadn't carried out data collection by then). This workshop consisted of 5 talks from international speakers who specialise on the topic of iconicity. The workshop was organised by Mutsumi Imai (Keio University) and Marcus Perlman (University of Birmingham). This was a very important event because the most notable academics on the topic discussed their most recent findings.
Year(s) Of Engagement Activity 2020
URL https://www.ukclc2020.com/pre-conference