Speech Therapy Animation and imaging Resource (STAR)

Lead Research Organisation: Queen Margaret University
Department Name: Speech and Hearing Sciences

Abstract

Speech and Language Therapy training and practice is dominated by approaches involving listening to sounds, feeling the movements of the speech organs and verbal descriptions of how speech sounds are produced. However, recent research involving use of visual information about hidden speech organ movement in particular (e.g. tongue movement) has shown that visual approaches to speech therapy can be game changing, providing breakthroughs after years of conventional therapy. One of the main advantages of visual approaches is that viewing dynamic imaging of the hidden speech organs has been shown to be a more intuitive method of demonstrating target speech articulations, particularly for children, avoiding complex, abstract descriptions of how speech organs move.

Several technologies can be used to reveal the hidden speech organs. Ultrasound Tongue Imaging (UTI), using standard medical ultrasound machines, has emerged as a promising therapy tool, allowing users to view target tongue movements and compare them to their own. Magnetic Resonance Imaging provides a more comprehensive view, showing all parts of the vocal tract, but is not suitable for use in day-to-day therapy. Costs, training and accessibility prevent the general use of these technologies in Speech Therapy clinics; however, clinical and phonetic researchers have collected a large number of UTI and MRI video recordings of both disordered and non-disordered speech. These represent a valuable training/therapeutic resource, but cannot be accessed in their current form, as most UTI/MRI datasets can be viewed only using expensive and technically-sophisticated specialist software. UTI and MRI reveal a greater variety of strategies for speech-sound production than are generally considered, and therefore provide a greater number of strategies for Clients to try. The benefit for Speech Therapy Clients is a better understanding of tongue movement and placement in speech-sound production, a more intuitive means of understanding vocal-organ movement and visual input, which can be particularly useful for those who learn more effectively through visual demonstration.

This project will create bespoke resources for Speech Therapists' training and use in Clinic; the Speech Therapy Animation and imaging Resource (STAR). Existing vocal-tract-imaging recordings from six different clinical and non-clinical speech-research projects will be made available online, in the most accessible formats and user-friendly interfaces. Additionally, MRI recordings of speech will be used to create accurate, simplified vocal-tract animations for use by paediatric Speech Therapy Clients, in Clinic and at home. These animations will show how the vocal organs move in the production of speech sounds. STAR will consist of two Web sites; one for Speech Therapists' training, reference and continuing professional development, and the other for use by paediatric Clients and their families, in Clinic, and at home.

The training site will contain vocal-tract animations and explanations of UTI and MRI technology and recording processes. It will contain much needed databases of UTI videos of disordered and non-disordered speech, showing a variety of speech-errors and disorders, as well as normative speech-sound production in a variety of English accents.

The clinical site will contain clear and informative animations explaining how the vocal tract works and showing speech-sound production in different syllable positions. It will also contain interactive animated homework exercises to facilitate aspects of practise homework set by Therapists in Clinic.

STAR will make available these resources at a time when the need for remote quality clinical teaching has never been greater. The research strand of our project will be to work with the SLT community and Clients, to assess how best to deliver remote and/or blended training and therapy, which meets the challenges of the current and post-COVID-19 environment

Publications

10 25 50
 
Description Edinburgh MRI modelled-speech corpus
Amount £4,450 (GBP)
Funding ID RSE 2063 
Organisation Royal Society of Edinburgh (RSE) 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2022 
End 02/2023
 
Title Teangannan na Gàidhlig/ Gaelic Tongues 
Description A filterable ultrasound tongue imaging database of Gaelic and Scottish English speech. Two speakers, 140 individual recordings 
Type Of Material Database/Collection of data 
Year Produced 2022 
Provided To Others? No  
Impact Press engagement: 26/07/2022 - The National (newspaper) https://www.thenational.scot/news/20522043.ultrasound-sheds-light-people-can-speak-gaelic/ 26/07/2022 - Interview of Claire Nance (University of Lancaster) on the BBC Scotland Good Morning show. 26/07/2022 - The Press and Journal (newspaper) https://www.pressandjournal.co.uk/fp/news/highlands-islands/4585963/gaelic-speakers-research/ 26/07/2022 - Interview of Claire Nance (University of Lancaster) on The Nine news show, BBC Scotland. 
URL https://www.seeingspeech.ac.uk/gaelic-tongues/
 
Description CASL lab invited talk 10/03/2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Undergraduate students
Results and Impact I gave an online talk on the work carried out by myself and team on providing vocal tract imaging resources over the past 11 years, including an introduction to the current clinical resource.
Year(s) Of Engagement Activity 2022
 
Description Engage with Strathclyde: a speech and language therapy conversation (Zoom event 13/05/2022) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Professional Practitioners
Results and Impact Eleanor Lawson gave a 15 minute presentation on the Speech Therapy Animation and imaging Resource (STAR) and demoed the content in place on the web sites so far (preliminary normative adult ultrasound database; preliminary disordered paediatric ultrasound database; preliminary MRI and animation extIPA chart). She asked participants for feedback on priorities for animation of MRI data, on items for collection during upcoming MRI recording sessions, for feedback on preliminary STAR logos, for general feedback on the resource.
Year(s) Of Engagement Activity 2022
URL https://www.engage.strath.ac.uk/event/927
 
Description Oral presentation at the online CLARIN_DELAD Workshop: Sharing corpora of speech of individuals with communication disorders (CSD) 22nd September 2022 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact An oral presentation at the online CLARIN_DELAD Workshop on the creation of the www.speechstar.ac.uk resources for speech and language therapy training and continuing professional development, and for use in clinic. Also a discussion with delegates on data sharing of clinical speech and language material, participant permissions and child voice anonymity.
Year(s) Of Engagement Activity 2022
URL https://www.clarin.eu/event/2022/delad-workshop-2022
 
Description Poster presentation in "Innovation in Health" serssion at the 2022 Lister Memorial Lecture: "Government and Industry: from Covid to Climate" 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact On the 22nd of November, 2022, I presented a poster on the Speech Therapy Animation and imaging Resource (STAR) website, and provided an ultrasound tongue imaging demonstration at a public engagement at the Royal Society of Edinburgh, run by the Society of Chemical Industry and the Royal Society of Edinburgh. The poster session concerned "Innovation in Health" and the main event was the Lister Memorial Lecture: "Government and Industry: from Covid to Climate" by Sir Patrick Vallance.
Year(s) Of Engagement Activity 2022
URL https://www.soci.org/news/2022/10/sir-patrick-vallance-to-deliver-2022-sci-lister-memorial-lecture
 
Description Public engagement with families at the Riverside Museum in Glasgow. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Public/other audiences
Results and Impact On the 12th November 2022, we carried out a public engagement activities with children and their families at the Riverside Museum in Glasgow. We showed over 100 children and their families how their tongue is involved in the production of speech and how the ultrasound can be used for assessment and therapy of speech. We collected ultrasound recordings from children at the event in order to study consonant variability in the production normative child speech.
Year(s) Of Engagement Activity 2022
 
Description TV news interview on accent change (BBC Alba) 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Media (as a channel to the public)
Results and Impact I took part in an interview with BBC Alba in Dec 2021, explaining the social-indexical function of accent, along with why and how accent change occurs. The interview was broadcast in an evening news segment on BBC Alba on Jan. 10th 2022.
Year(s) Of Engagement Activity 2021,2022