Speech Therapy Animation and imaging Resource (STAR)
Lead Research Organisation:
University of Strathclyde
Department Name: Speech and Language Therapy
Abstract
Speech and Language Therapy training and practice is dominated by approaches involving listening to sounds, feeling the movements of the speech organs and verbal descriptions of how speech sounds are produced. However, recent research involving use of visual information about hidden speech organ movement in particular (e.g. tongue movement) has shown that visual approaches to speech therapy can be game changing, providing breakthroughs after years of conventional therapy. One of the main advantages of visual approaches is that viewing dynamic imaging of the hidden speech organs has been shown to be a more intuitive method of demonstrating target speech articulations, particularly for children, avoiding complex, abstract descriptions of how speech organs move.
Several technologies can be used to reveal the hidden speech organs. Ultrasound Tongue Imaging (UTI), using standard medical ultrasound machines, has emerged as a promising therapy tool, allowing users to view target tongue movements and compare them to their own. Magnetic Resonance Imaging provides a more comprehensive view, showing all parts of the vocal tract, but is not suitable for use in day-to-day therapy. Costs, training and accessibility prevent the general use of these technologies in Speech Therapy clinics; however, clinical and phonetic researchers have collected a large number of UTI and MRI video recordings of both disordered and non-disordered speech. These represent a valuable training/therapeutic resource, but cannot be accessed in their current form, as most UTI/MRI datasets can be viewed only using expensive and technically-sophisticated specialist software. UTI and MRI reveal a greater variety of strategies for speech-sound production than are generally considered, and therefore provide a greater number of strategies for Clients to try. The benefit for Speech Therapy Clients is a better understanding of tongue movement and placement in speech-sound production, a more intuitive means of understanding vocal-organ movement and visual input, which can be particularly useful for those who learn more effectively through visual demonstration.
This project will create bespoke resources for Speech Therapists' training and use in Clinic; the Speech Therapy Animation and imaging Resource (STAR). Existing vocal-tract-imaging recordings from six different clinical and non-clinical speech-research projects will be made available online, in the most accessible formats and user-friendly interfaces. Additionally, MRI recordings of speech will be used to create accurate, simplified vocal-tract animations for use by paediatric Speech Therapy Clients, in Clinic and at home. These animations will show how the vocal organs move in the production of speech sounds. STAR will consist of two Web sites; one for Speech Therapists' training, reference and continuing professional development, and the other for use by paediatric Clients and their families, in Clinic, and at home.
The training site will contain vocal-tract animations and explanations of UTI and MRI technology and recording processes. It will contain much needed databases of UTI videos of disordered and non-disordered speech, showing a variety of speech-errors and disorders, as well as normative speech-sound production in a variety of English accents.
The clinical site will contain clear and informative animations explaining how the vocal tract works and showing speech-sound production in different syllable positions. It will also contain interactive animated homework exercises to facilitate aspects of practise homework set by Therapists in Clinic.
STAR will make available these resources at a time when the need for remote quality clinical teaching has never been greater. The research strand of our project will be to work with the SLT community and Clients, to assess how best to deliver remote and/or blended training and therapy, which meets the challenges of the current and post-COVID-19 environment
Several technologies can be used to reveal the hidden speech organs. Ultrasound Tongue Imaging (UTI), using standard medical ultrasound machines, has emerged as a promising therapy tool, allowing users to view target tongue movements and compare them to their own. Magnetic Resonance Imaging provides a more comprehensive view, showing all parts of the vocal tract, but is not suitable for use in day-to-day therapy. Costs, training and accessibility prevent the general use of these technologies in Speech Therapy clinics; however, clinical and phonetic researchers have collected a large number of UTI and MRI video recordings of both disordered and non-disordered speech. These represent a valuable training/therapeutic resource, but cannot be accessed in their current form, as most UTI/MRI datasets can be viewed only using expensive and technically-sophisticated specialist software. UTI and MRI reveal a greater variety of strategies for speech-sound production than are generally considered, and therefore provide a greater number of strategies for Clients to try. The benefit for Speech Therapy Clients is a better understanding of tongue movement and placement in speech-sound production, a more intuitive means of understanding vocal-organ movement and visual input, which can be particularly useful for those who learn more effectively through visual demonstration.
This project will create bespoke resources for Speech Therapists' training and use in Clinic; the Speech Therapy Animation and imaging Resource (STAR). Existing vocal-tract-imaging recordings from six different clinical and non-clinical speech-research projects will be made available online, in the most accessible formats and user-friendly interfaces. Additionally, MRI recordings of speech will be used to create accurate, simplified vocal-tract animations for use by paediatric Speech Therapy Clients, in Clinic and at home. These animations will show how the vocal organs move in the production of speech sounds. STAR will consist of two Web sites; one for Speech Therapists' training, reference and continuing professional development, and the other for use by paediatric Clients and their families, in Clinic, and at home.
The training site will contain vocal-tract animations and explanations of UTI and MRI technology and recording processes. It will contain much needed databases of UTI videos of disordered and non-disordered speech, showing a variety of speech-errors and disorders, as well as normative speech-sound production in a variety of English accents.
The clinical site will contain clear and informative animations explaining how the vocal tract works and showing speech-sound production in different syllable positions. It will also contain interactive animated homework exercises to facilitate aspects of practise homework set by Therapists in Clinic.
STAR will make available these resources at a time when the need for remote quality clinical teaching has never been greater. The research strand of our project will be to work with the SLT community and Clients, to assess how best to deliver remote and/or blended training and therapy, which meets the challenges of the current and post-COVID-19 environment
Publications
Allen JE
(2023)
An initial framework for use of ultrasound by speech and language therapists in the UK: Scope of practice, education and governance.
in Ultrasound (Leeds, England)
Lawson, E.
(2025)
Approximants
Lawson, E.
(2023)
A Speech Therapy Animation and imaging Resource (STAR)
Related Projects
| Project Reference | Relationship | Related To | Start | End | Award Value |
|---|---|---|---|---|---|
| ES/V012401/1 | 30/06/2021 | 28/09/2022 | £242,037 | ||
| ES/V012401/2 | Transfer | ES/V012401/1 | 29/09/2022 | 20/05/2024 | £124,437 |
| Description | (1) What were the most significant achievements from the award? Two Web-based resources for (a) Speech and Language Therapy training and (b) for use in clinic: (a) The STAR teaching and training site www.seeingspeech.ac.uk/speechstar/ (Containing 1,699 speech videos, this Web site contains a set of audio-visual resources for Speech and Language Therapists (SLTs); SLT teachers and students, to help improve understanding of (hidden) vocal-organ movement in speech production, and in disordered child speech. Ultrasound Tongue Imaging (UTI) and Magnetic Resonance Imaging (MRI) were used to reveal the real-time movements of the hidden vocal organs in midsagittal slice. 2-D MRI-based animations of the vocal tract were also created to maximise the audiovisual clarity while providing accurate representations of vocal-organ movements. (b) SpeechSTAR - Speech Therapy Animation Resource; in-clinic resource for Speech and Language Therapists, children with Speech Sound Disorders and their families (www.speechstar.ac.uk). Containing 204 midsagittal speech animations and 8 information videos. This resource was designed for use in Speech and Language Therapy sessions with children and to aid practise at home. SpeechSTAR contains clear MRI-based animated videos of speech sound production in midsagittal slice, allowing users to view the vocal organ movements for each consonant of English and to view production of consonants side-by-side to help improve speech sound discrimination. SpeechSTAR also contains concatenated sets of sound types, e.g. "fricative sounds of English" and "lip sounds of English", to allow users to see the similarities between sets of speech sounds. SpeechSTAR aims to promote understanding and use of UTI in Speech and Language Therapy for speech sound disorder, and contains videos explaining what ultrasound tongue imaging is, comparing the (moving) images obtained through UTI, with those obtained through MRI, and showing how UTI can be used in Speech and Language Therapy. To what extent were the award objectives met? If you can, briefly explain why any key objectives were not met. The STAR project has been successfully completed. Our main objectives have been met: 1. To create clinically focussed, online vocal-tract-imaging and animated resources to allow users to view the movements of both the hidden and visible speech organs. Using existing ultrasound tongue imaging (UTI), and magnetic resonance imaging (MRI) vocal-tract research datasets of child and adult speech, we will create resources housed on two connected Websites; one for SLT training and CPD, the other for use in Clinic with paediatric Clients, or for Clients' use at home. This aim has been achieved with the launch of the STAR teaching and training site www.seeingspeech.ac.uk/speechstar/ in April 2023, and the launch of the SpeechSTAR in-clinic website www.speechstar.ac.uk in June 2024. 2. To extend the reach of audio-visual therapies for remediation of speech delay/disorder to children outside face-to-face clinic sessions, by providing accessible online resources for independent home practice. This aim has been achieved. Preliminary feedback we have gathered from SLTs, SLT teachers and students using our online pop-up questionnaire and from spontaneous email feedback from users shows that these users are making use of the new audio-visual resources in therapy sessions, or plan to in the future. 3. To promote understanding, familiarity and use of articulatory imaging in (motor-based) Speech and Language Therapy. Our site will provide introductory explanations and comparison of imaging techniques, demonstrations of use, and links to literature. This aim has been achieved. Our websites contain introductory content, including: • A guide to UTI recording https://www.seeingspeech.ac.uk/speechstar/ultrasound-speech-recording/ • A guide to MRI recording https://www.seeingspeech.ac.uk/speechstar/mri-speech-recording/ • Comparison of UTI and MRI imaging modalities for speech https://www.seeingspeech.ac.uk/speechstar/comparing-mri-and-uti/ • Videos explaining how UTI works https://speechstar.ac.uk/ultrasound-therapy-videos/#location=60 • Videos comparing UTI and MRI imaging techniques https://speechstar.ac.uk/ultrasound-therapy-videos/#location=64 • Videos showing UTI use in speech sound disorder therapy https://speechstar.ac.uk/ultrasound-therapy-videos/#location=59 and https://speechstar.ac.uk/ultrasound-therapy-videos/#location=58 4. To augment the audio-visual resources currently available to train and support Speech and Language Therapists (SLTs). SLTs will be able to better explain the movements of the hidden, as well as the visible, speech articulators and articulatory movement to clients with the material on the paediatric clinical Site. This aim has been met. Preliminary feedback from SLTs, SLT teachers and students shows that these user groups are using the audio-visual resources on STAR to aid therapy for speech sound disorders. |
| Exploitation Route | How might the findings be taken forward and by whom? SpeechSTAR and STAR are extensions of the Seeing Speech suite of resources (www.seeingspeech.ac.uk), building on work that was begun in 2011. ESRC impact accelerator account funding c£13k has been obtained to build teaching resources that show how to use STAR in Speech and Language Therapy Training, and for speech therapy. We will also make how-to use videos to show the resources available on the STAR and SpeechSTAR sites and how to use them. The current project team plan to augment these sites in several ways: adding training materials for voice disorder; adding speech and language therapy materials for adults; building a language teaching website. |
| Sectors | Education Healthcare |
| URL | https://www.seeingspeech.ac.uk/speechstar/ |
| Description | The STAR project has ended up much more substantial than the project team envisaged. Obtaining further funding from the Royal Society of Edinburgh (RSE) to collect a corpus of midsagittal Magnetic Resonance Imaging (MRI) speech recordings changed the scope of the project, which initially aimed to make use of mostly Ultrasound Tongue Imaging (UTI) secondary data. The RSE funding allowed us to add key English consonant sounds that we did not already have in MRI format, which we were subsequently able to have animated to complete our set of English consonants. The RSE funding also allowed us to collect the full set of extended International Phonetic Association chart sounds for disordered speech. We were also able to make more MRI recordings than we envisaged. Funding obtained from the EPSRC impact accelerator fund enabled us to create two videos showing ultrasound tongue imaging in use as a biofeedback therapy for speech sound disorder therapy. A popup questionnaire on the www.seeingspeech.ac.uk/speechstar/ site has yielded 109 responses to date (March 2025), mostly from Speech and Language Therapists/Pathologists, but also from Speech and Language Therapy students and Phonetics/Linguistics students from countries around the world. 99% of respondents stated that they would visit the site again, with most saying they would use it weekly or monthly. Respondents felt that the resources would be useful to use with clients in clinic and for training Speech and Language Therapy students. Respondents asked for more resources in other varieties of English and other languages and examples of other types of speech disorder. STAR has been officially listed as a resource in the Royal College of Speech and Language Therapists (RCSLT) clinical guidelines on Speech Sound Disorder (https://www.rcslt.org/members/clinical-guidance/speech-sound-disorders/speech-sound-disorders-resources/) Animations and MRI vocal-tract videos from STAR will be used in a Phonetics text book, published by Cambridge University Press. Animations from STAR have been licenced by the makers of the top-rated language teaching app, Mango Languages. |
| First Year Of Impact | 2023 |
| Sector | Education,Healthcare |
| Impact Types | Societal Policy & public services |
| Description | RCSLT clinical guidelines on Speech Sound Disorder (https://www.rcslt.org/members/clinical-guidance/speech-sound-disorders/speech-sound-disorders-resources/) |
| Geographic Reach | National |
| Policy Influence Type | Influenced training of practitioners or researchers |
| Description | BletherNet: Neural Networks for Understanding Tongue Shapes in Disordered [?] |
| Amount | £3,865 (GBP) |
| Organisation | University of Strathclyde |
| Sector | Academic/University |
| Country | United Kingdom |
| Start | 07/2023 |
| End | 07/2024 |
| Description | Edinburgh MRI modelled-speech corpus |
| Amount | £4,450 (GBP) |
| Funding ID | RSE 2063 |
| Organisation | Royal Society of Edinburgh (RSE) |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 03/2022 |
| End | 02/2023 |
| Description | STAR-gate: a user evaluation and co-production project for the Speech Therapy Animation and imaging Resource (STAR) web resource. |
| Amount | £12,960 (GBP) |
| Funding ID | NA |
| Organisation | Economic and Social Research Council |
| Sector | Public |
| Country | United Kingdom |
| Start | 03/2025 |
| End | 09/2026 |
| Description | Translating ultrasound speech technology into clinical practice |
| Amount | £2,389 (GBP) |
| Organisation | Engineering and Physical Sciences Research Council (EPSRC) |
| Sector | Public |
| Country | United Kingdom |
| Start | 03/2023 |
| End | 03/2024 |
| Title | Edinburgh MRI modelled speech corpus |
| Description | 373 audio-visual, midsagittal MRI recordings of the vocal tract of a single talker, producing modelled disordered and non-disordered speech. MRI recordings were made in DICOM format and converted to MP4. Audio was recorded in situ using an optical microphone with post-hoc noise cancelling. Noise-cancelled audio was manually added to the MP4 videos. |
| Type Of Material | Database/Collection of data |
| Year Produced | 2023 |
| Provided To Others? | Yes |
| Impact | Some of these MRI recordings were used as the basis of accurate animated vocal tract videos that are housed on www.speechstar.ac.uk for the use of children with speech sound disorder and their families, in clinic and at home. |
| URL | https://www.seeingspeech.ac.uk/speechstar/edinburgh-mri-modelled-speech-corpus/ |
| Description | Mother Tongues |
| Organisation | University of Lausanne |
| Country | Switzerland |
| Sector | Academic/University |
| PI Contribution | EL is an advisory panel member to the Spark-funded Mother Tongues pilot project. |
| Collaborator Contribution | EL will advise on ultrasound tongue imaging data collection with bilingual children |
| Impact | This project has just begun. |
| Start Year | 2024 |
| Description | Speech animations and MRI for Cambridge University Press publication: Phonetics textbook by Leendert Plug |
| Organisation | Cambridge University Press |
| Country | United Kingdom |
| Sector | Private |
| PI Contribution | Cambridge University Press will licence 11 speech animations and 8 MRI recordings from the Seeing Speech/SpeechSTAR websites for a Phonetics teaching ebook, author, Dr Leendert Plug, University of Leeds. |
| Collaborator Contribution | CUP will pay for a licence in order to use animations and MRI vocal-tract recordings made during the Dynamic Dialects and STAR projects. |
| Impact | This collaboration will contibute to a Phonetics teaching e-book with animated speech examples and MRI video of consonant and vowel productions. |
| Start Year | 2022 |
| Description | Speech animations and MRI for Cambridge University Press publication: Phonetics textbook by Leendert Plug |
| Organisation | University of Leeds |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | Cambridge University Press will licence 11 speech animations and 8 MRI recordings from the Seeing Speech/SpeechSTAR websites for a Phonetics teaching ebook, author, Dr Leendert Plug, University of Leeds. |
| Collaborator Contribution | CUP will pay for a licence in order to use animations and MRI vocal-tract recordings made during the Dynamic Dialects and STAR projects. |
| Impact | This collaboration will contibute to a Phonetics teaching e-book with animated speech examples and MRI video of consonant and vowel productions. |
| Start Year | 2022 |
| Description | Engage with Strathclyde, STAR Beta launch and UTI training workshop hybrid event, University of Strathclyde 09/05/2023 |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Professional Practitioners |
| Results and Impact | A beta launch and tour of the www.seeingspeech.ac.uk/speechstar/ website with an introductory workshop on the use of ultrasound tongue imaging in speech research and speech therapy practice. |
| Year(s) Of Engagement Activity | 2023 |
| URL | http://www.seeingspeech.ac.uk/speechstar/ |
| Description | Introduction to STAR, Speech and Language Therapy UTI training "Dabble Day", Sandwell Hospital, West Bromwich. |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Professional Practitioners |
| Results and Impact | Introduction to STAR, SLT UTI training "Dabble Day", Sandwell Hospital, West Bromwich. An event for practicing Speech and Language Therapists to demonstrate the use of ultrasound in diagnosis and therapy for speech sound disorder, swallowing and muscular issues. |
| Year(s) Of Engagement Activity | 2023 |
| Description | Participation in a video for Altinfinity Youtube channel |
| Form Of Engagement Activity | Engagement focused website, blog or social media channel |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | I featured in a Youtube video for the Altinfinity channel entitled "I got hate comments because of my Indian Accent". The video discusses accent prejudice. I discussed how different accents arise and the social implications of accent, while also demonstrating ultrasound tongue imaging and provided representations of the differences between Indian and other English accents. The video is currently (Jan 2025) the most popular of the channel and has 174k views, and 2,334 comments. I was able to make use of ultrasound tongue imaging materials collected across multiple research projects. |
| Year(s) Of Engagement Activity | 2024 |
| URL | https://www.youtube.com/watch?v=Jir8mdZwoRk |
| Description | Training event and introduction to STAR to researchers, lecturers and SLTs at Cardiff Metropolitan University. |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Professional Practitioners |
| Results and Impact | A training day to show use of Ultrasound Tongue Imaging in speech therapy research and practice. Including an introduction to the STAR website. |
| Year(s) Of Engagement Activity | 2023 |