Augmented feedback to enhance motor and artistic learning during social distancing
Lead Research Organisation:
Queen Mary University of London
Department Name: Sch of Biological & Behavioural Sciences
Abstract
Social distancing has produced an indefinite shift to remote teaching. This shift poses unaddressed challenges in delivering classes and providing feedback remotely for physical activities such as performing arts or rehabilitation. Digital technologies can facilitate or enhance learning but little is known about remote motor skills teaching, hence there is an urgent need to identify the best practices for remote teaching of physical and artistic disciplines. The lessons learnt in this project will be transferable to any motor skills teaching, such as rehabilitative exercise or practical skills.
We will build on (a) Queen Mary University of London facilities and expertise including an online teaching platform, experts in psychology, dance medicine, physiotherapy, cognition and learning, artificial intelligence and multimedial signal processing, and (b) a collaboration with established dance partners (e.g. English National Ballet school, Laban Conservatory, FloorBarreTM) and Barts Health NHS Trust.
We will validate the efficacy of different remote teaching methods and tools on physical and artistic training including artificial intelligence augmented feedback. By focusing on remote training for dance we will not only shed light not on a specific popular discipline but on the remote training of a broad range of traits that include physical skills (from flexibility, muscular endurance and power, joint range of motion), psychological state (mental health, concentration, motivation and their relation to this pandemic), artistic development (presence, rhythm, creativity). Human expert assessment will provide immediate results useful to plan teaching, training data for machine learning for behavioural tracking for personalised feedback. Project outcomes include best practice identification and new tools to mitigate social distancing effects on physical, psychological, artistic, and cognitive outcomes. This will be applicable to performing artists, patients with injury, and ultimately the general public.
We will build on (a) Queen Mary University of London facilities and expertise including an online teaching platform, experts in psychology, dance medicine, physiotherapy, cognition and learning, artificial intelligence and multimedial signal processing, and (b) a collaboration with established dance partners (e.g. English National Ballet school, Laban Conservatory, FloorBarreTM) and Barts Health NHS Trust.
We will validate the efficacy of different remote teaching methods and tools on physical and artistic training including artificial intelligence augmented feedback. By focusing on remote training for dance we will not only shed light not on a specific popular discipline but on the remote training of a broad range of traits that include physical skills (from flexibility, muscular endurance and power, joint range of motion), psychological state (mental health, concentration, motivation and their relation to this pandemic), artistic development (presence, rhythm, creativity). Human expert assessment will provide immediate results useful to plan teaching, training data for machine learning for behavioural tracking for personalised feedback. Project outcomes include best practice identification and new tools to mitigate social distancing effects on physical, psychological, artistic, and cognitive outcomes. This will be applicable to performing artists, patients with injury, and ultimately the general public.
Publications
Alsaleh S
(2021)
Local neuromuscular characteristics associated with patellofemoral pain: A systematic review and meta-analysis
in Clinical Biomechanics
Lowe C
(2021)
Validation of a Musculoskeletal Digital Assessment Routing Tool: Protocol for a Pilot Randomized Crossover Noninferiority Trial.
in JMIR research protocols
Tayfur B
(2021)
Neuromuscular Function of the Knee Joint Following Knee Injuries: Does It Ever Get Back to Normal? A Systematic Review with Meta-Analyses.
in Sports medicine (Auckland, N.Z.)
Gulle H
(2021)
Online questionnaire, clinical and biomechanical measurements for outcome prediction of plantar heel pain: feasibility for a cohort study.
in Journal of foot and ankle research
Morrissey D
(2021)
Management of plantar heel pain: a best practice guide informed by a systematic review, expert clinical reasoning and patient values.
in British journal of sports medicine
Lowe C
(2021)
Usability Testing of a Digital Assessment Routing Tool: Protocol for an Iterative Convergent Mixed Methods Study.
in JMIR research protocols
Färnqvist K
(2021)
Factors associated with outcome following exercise interventions for Achilles tendinopathy: A systematic review.
in Physiotherapy research international : the journal for researchers and clinicians in physical therapy
Padhiar N
(2021)
The effectiveness of PROLOTHERAPY for recalcitrant Medial TIBIAL Stress Syndrome: a prospective consecutive CASE series.
in Journal of foot and ankle research
Akehurst H
(2021)
Whole-body vibration decreases delayed onset muscle soreness following eccentric exercise in elite hockey players: a randomised controlled trial.
in Journal of orthopaedic surgery and research
Hill A
(2021)
A Bayesian Network Decision Support Tool for Low Back Pain Using a RAND Appropriateness Procedure: Proposal and Internal Pilot Study
in JMIR Research Protocols
Lowe C
(2022)
Usability Testing of a Digital Assessment Routing Tool for Musculoskeletal Disorders: Iterative, Convergent Mixed Methods Study.
in Journal of medical Internet research
Curran A
(2022)
Clinicians' experience of the diagnosis and management of patellofemoral pain: A qualitative exploration
in Musculoskeletal Science and Practice
Tayfur A
(2022)
Are Landing Patterns in Jumping Athletes Associated with Patellar Tendinopathy? A Systematic Review with Evidence Gap Map and Meta-analysis.
in Sports medicine (Auckland, N.Z.)
Gallo V
(2022)
MotionPerfection: An agile tool for the visualisation, analysis, annotation, and record of motor practice
in SoftwareX
Tayfur B
(2023)
Neuromuscular joint function in knee osteoarthritis: A systematic review and meta-analysis.
in Annals of physical and rehabilitation medicine
Hebda-Boon A
(2023)
The impact of instrumented gait analysis on decision-making in the interprofessional management of cerebral palsy: A scoping review.
in European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society
| Title | Enhanced: a dance-enahnced project |
| Description | Enhanced: A dance-enhanced project", a Prepared Minds Lab production, directed by Elisabetta Versace (Queen Mary University of London): @PreparedLab. The movie is inspired by the ESRC research project "Augmented Feedback to Enhance Motor and Artistic Learning During Social Distancing" awarded to Dr Elisabetta Versace and co-investigators, in collaboration with The English National Ballet School, The Royal Ballet School, The Trinity Laban Conservatoire for Music and Dance, and the composer Philip Glass. In this project, researchers from different disciplines, dancers, choreographers, teachers, physiotherapists and coaches teamed up to provide answers to the need of artists at a difficult time for arts. The artistic outcome s the first choreography danced collaboratively by artists from different vocational dance schools: The English National Ballet School, The Royal Ballet School, The Trinity Laban Conservatoire for Music and Dance. Research outcomes include open source tools that can be used for perfecting dance training in person and remotely, such as MotionPerfection https://www.sciencedirect.com/science/article/pii/S2352711022001650 . More tools are under development by PreparedMindsLab https://www.preparedmindslab.org/ Stay tuned and enjoy this first production! |
| Type Of Art | Artistic/Creative Exhibition |
| Year Produced | 2022 |
| Impact | the trailers have been released in 2022, the previous has been displayed at the Festival of communities 2022, the documentary will be released in 2023 to the general public. Teh trailers and documentary contribute to the dissemination of project outcomes, including the closer connection between researchers and artists in their route of research. |
| URL | https://www.youtube.com/watch?v=86d0z9EsFvI |
| Description | We have developed tools for the remote asssessment and feedback of motion-based activities such as dance, sports, rehabilitation. We have collaborated with dancers, dance teachers, physiotherapists and embedded their feedback in the development of our tools. |
| Exploitation Route | to further develop assessment of motor activities and feedback |
| Sectors | Digital/Communication/Information Technologies (including Software),Education,Healthcare,Culture, Heritage, Museums and Collections |
| Description | We have started to solve a fundamental challenge in the standardisation of assessment of motor artistic activities. We have worked closely with dance institutions (and NHS), identifying mutual needs for development that will be addressed in future projects focused on best practice for motor learning/teaching and mental health for adolescents. This will in turn support outcomes of motor teaching/learning and mental health in adolescents. |
| First Year Of Impact | 2022 |
| Sector | Creative Economy,Digital/Communication/Information Technologies (including Software),Education |
| Impact Types | Cultural,Societal |
| Description | Royal Society Leverhulme Trust fellowship SRF\R1\21000155 |
| Amount | £65,000 (GBP) |
| Funding ID | SRF\R1\21000155 |
| Organisation | The Royal Society |
| Sector | Charity/Non Profit |
| Country | United Kingdom |
| Start | 09/2021 |
| End | 10/2023 |
| Title | MotionPerfection |
| Description | Instructional experts and practitioners in sports, dance and rehabilitation need to assess and provide feedback on motor practice. To visualise, analyse and annotate motor practice, we have developed the user-friendly application MotionPerfection. Using just a single camera video recordings and a computer, MotionPerfection enables users to compare a focal user with a model reference, to assess and annotate the performance. We illustrate the software structure and functionality from video acquisition to feedback annotation. Researchers, instructors, clinicians and practitioners can use MotionPerfection to simplify, automate and standardise the analysis and feedback of motor routines in remote and face-to-face settings, in the laboratory and in the field, without the need of specialised equipment. |
| Type Of Material | Computer model/algorithm |
| Year Produced | 2022 |
| Provided To Others? | Yes |
| Impact | dancers and dance teachers and dance schools, as well as physotehrapists and sports specialists can use this model for their practice |
| URL | https://www.sciencedirect.com/science/article/pii/S2352711022001650 |
| Description | Collaboration with English National Ballet School |
| Organisation | Royal Ballet School |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | we have provided expertise in psychology, dance science, dance medicine, digital technologies, AI experts in ballet |
| Collaborator Contribution | experts in ballet, helped with recruitment, provided feedback |
| Impact | recruitment of participants, feedback |
| Start Year | 2021 |
| Description | Collaboration with Royal Ballet School |
| Organisation | Royal Ballet School |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | dance science, psychology, digital technologies, AI |
| Collaborator Contribution | expertise in ballet, help with recruitment, feedback |
| Impact | participant recruitment, feedback |
| Start Year | 2021 |
| Description | Collaboration with Trinity Laban Conservatoire for music and dance |
| Organisation | Trinity Laban Conservatoire of Music and Dance |
| Country | United Kingdom |
| Sector | Academic/University |
| PI Contribution | expertise in dance science, dance medicine, psychology, gitial technology, AI |
| Collaborator Contribution | expertise in dance and dance teaching, feedback , help with recruitment |
| Impact | recruitment, app development |
| Start Year | 2021 |
| Title | MotionPerfection |
| Description | Instructional experts and practitioners in sports, dance and rehabilitation need to assess and provide feedback on motor practice. To visualise, analyse and annotate motor practice, we have developed the user-friendly application MotionPerfection. Using just a single camera video recordings and a computer, MotionPerfection enables users to compare a focal user with a model reference, to assess and annotate the performance. We illustrate the software structure and functionality from video acquisition to feedback annotation. Researchers, instructors, clinicians and practitioners can use MotionPerfection to simplify, automate and standardise the analysis and feedback of motor routines in remote and face-to-face settings, in the laboratory and in the field, without the need of specialised equipment. |
| Type Of Technology | Software |
| Year Produced | 2022 |
| Open Source License? | Yes |
| Impact | use for motion assessment in dance, sports, rehabilitation |
| URL | https://www.sciencedirect.com/science/article/pii/S2352711022001650 |
| Description | Conversations event |
| Form Of Engagement Activity | A talk or presentation |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Public/other audiences |
| Results and Impact | Conversation between scientists and choreographer |
| Year(s) Of Engagement Activity | 2021 |
| URL | https://conversations.qmul.ac.uk/conversations-week/conversing-bodies-in-motion/ |
| Description | Festival communities |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | Regional |
| Primary Audience | Public/other audiences |
| Results and Impact | Festival of communities with a workshop to use digital tools for dance learning and teaching |
| Year(s) Of Engagement Activity | 2022 |
| Description | Workshop warmup |
| Form Of Engagement Activity | Participation in an activity, workshop or similar |
| Part Of Official Scheme? | No |
| Geographic Reach | International |
| Primary Audience | Schools |
| Results and Impact | Workshop with dancers related to best èractice in warmup and our project |
| Year(s) Of Engagement Activity | 2021 |