📣 Help Shape the Future of UKRI's Gateway to Research (GtR)

We're improving UKRI's Gateway to Research and are seeking your input! If you would be interested in being interviewed about the improvements we're making and to have your say about how we can make GtR more user-friendly, impactful, and effective for the Research and Innovation community, please email gateway@ukri.org.

Music and HCI Network (CHIME)

Lead Research Organisation: The Open University
Department Name: Faculty of Sci, Tech, Eng & Maths (STEM)

Abstract

Music is a central part of human life, and a major contributor to the UK economy.
Computing is changing how music is created, performed, distributed, stored, navigated, adapted, appropriated, consumed and manipulated. These transformations are creating new opportunities and challenges for research in Music and Human Computer Interaction, research that covers: interactive music systems; digital and virtual musical instruments; innovative approaches to existing musical activities; and tools that make new kinds of musical activity possible. These new developments will affect performers, composers, audiences, educators, learners, musicologists, app builders, assistive technologists, businesses and charities.

UK researchers carry out internationally excellent research in this area, but many are isolated, scattered across the country, and housed in diverse disciplines, leading to missed opportunities to collaborate across disciplines with potential academic and industrial partners. The CHIME network (Computer Human Interaction and Music nEtwork) is designed to address and overcome this problem.

The CHIME network will connect academics, researchers, SMEs, charities and industrial partners in order to pool and expand ideas, drive new research, and develop collaborative projects around emerging issues in the field.

Research in music and human computer interaction is useful not only to musical activities and relevant industries, but also in finding ways to make computers easy to control and understand. Music and human computer interaction has inspired numerous innovations in human computer interaction, for example in gestural interfaces, data gloves and touch interaction.

Research in music and human computer interaction is also useful in areas where one's whole body plays a key role in the interaction. This is because many musical activities involve coordinating the whole body, in real-time, often collaborating with other people, while dealing with significant perceptual and cognitive demands. Techniques for wearable motion capture originally developed for musicians are now being used in clinical applications. For example, a system developed to help drummers co-ordinate arm and leg movement has found application in managing physical rehabilitation after stroke.

Because of this recognised synergy between music and HCI, a network that brings together researchers in music and HCI along with interested parties from industry and charities will have the capacity to create new theories, products, approaches and services not only for musicians, the music industry and audiences, but may also contribute to how we interact with computers generally.

The network will meet formally twice a year to support new collaborative ventures. Key international keynote speakers will be invited to provide insights from overseas research labs, and to engage with network activities. Training will be provided for members and new researchers in domains such as: interactive machine learning, expressive haptics complementing audio, accessible instruments, methodologies for design and evaluation in music interaction, gesture sensing, direct brain interaction, real-time biosensing, live coding and liveness, digital arts, culture 3.0 and diversity. In addition to direct training workshops, suitable topics will be explored in publicly accessible panel discussions, talks and online workshops, to be live streamed and archived.
 
Description Music is a major contributor to the UK economy and an omnipresent part of human life. Technology is altering how music is composed, performed, discovered, accessed, improvised and manipulated. This is creating a flood of new opportunities for research Music and Human Computer Interaction, also known as Music Interaction. The UK is historically strong in this area worldwide, but must invest to keep and exploit this lead: researchers and potential recipients of research are scattered both by geography and discipline, limiting synergy and collaboration.
The primary achievement of this network has been to create a new community comprising university and independent researchers from diverse disciplines; SMEs; charities; composers; performers; makers; educators; technologists; and disparate communities of users, all with a common interest, creating rich new research opportunities and collaborations in Music Interaction.
This new community is maintained through regular online public seminars and discussions, online and physical workshops around the country, physical participative demonstrations of research prototypes, training sessions in new technologies, research techniques and methodologies, an active mailing list, a regularly updated website, a busy YouTube channel, and an annual physical conference. We have plans in place to continue all of these activities well beyond the life of the grant.
These activities have sparked new collaborations between otherwise isolated groups - researchers from different disciplines around the UK, ,SMEs, charities, artists, practitioners and people whose opportunities were impacted by covid period.
Exploitation Route • Improved understanding of Music Interaction prototyping techniques (e.g. embedded machine learning) by researchers around the country, leading to more effective research prototypes.
• Improved awareness of relevant design and evaluation methodologies (e.g. Soma Design) leading to improved designs and evidence of effectiveness.
• Improved awareness of medical applications of Music Interaction leading to new collaborations with medical researchers and candidate new treatments (e.g. physical rehabilitation, dementia).
• New collaborations by postgraduate researchers contributing resources to charities (e.g. One-Handed Musical Instrument Trust, Drake Music England, Scotland and Northern Ireland, SENSE UK, the Amber Trust).
• New forms of engagement for museums and leisure organisations
Sectors Creative Economy

Digital/Communication/Information Technologies (including Software)

Education

Healthcare

Leisure Activities

including Sports

Recreation and Tourism

Manufacturing

including Industrial Biotechology

Culture

Heritage

Museums and Collections

URL https://www.chime.ac.uk
 
Description • Research on harmony and music interaction enriched by CHIME network activities and collaborations was at the centre of a three-day workshop organised by the Music Computing Lab at the Open University with around twenty-four 11-13 year-old children at the italian secondary school I. C. Eleonora Pimentel Fonseca in Pontecagnano Faiano (near Salerno, Southern Italy) 16th - 18th October 2023. The aim of the workshop was to investigate how the school could integrate innovative music interaction technology with music education practices at the school, and how this could be used for composition, performance, improvisation and music theory, while improving accessibility and inclusion. The teachers are keen to continue with further use of these technologies and approaches. • Research on haptics and rhythm influenced by CHIME network activities and collaborations was at the centre of workshop entitled 'Putting the rhythm in Algorithm' at the Milton Keynes International Festival on 22 July 2023 in Campbell Park, Milton Keynes.The Music Computing Lab at the Open University, in collaboration with the Stables Music Theatre and master drummer Raz Jayasuriya, devised, organised and led this public event on technologically assisted engagement in musical rhythm. Haptics-assisted Brazilian and Cuban samba drumming activities enhanced by motion tracking, haptics and low-latency networking were used to explore new ways of learning rhythms and ways to enhance inclusion and engagement in music for the d/Deaf and blind. • Research on one-handed musical instruments at the Music Computing Lab at the Open University stimulated by CHIME network activities and collaborations came to the attention of a non-academic amateur musician Brian Condon, who lost use of a hand in a sailing accident, who contacted the Lab and came to visit on 14th June 2024 specifically to try the prototype system in a participative system. This allowed him in a matter of minutes to perform jazz chord sequences for the first time after his accident, to borrow the instrument for several months and led to a collaboration with Brian and OHMI to develop the instrument further. The instrument has been lent to the One--handed Musical Trust to allow other clients of the charity and members of the public to freely use the system. • Research on technologically-mediated accessibility and inclusion in music making for d/Deaf people influenced by CHIME network activities and collaborations was at the centre of workshop at the Stables Theatre in Music Milton Keynes on Monday 25th July with celebrated profoundly d/Deaf music educator Sean Chandler Sean who gave an expert evaluation of technology developed by Music Computing Lab of the Open University. Sean was of a firm judgement that this technology can allow deaf people to participate as first class citizens in musical activities alongside hearing people. • Research on accessibility and inclusion in music technology influenced by CHIME network activities and collaboration formed the basis for a workshop at Drake Music Scotland in Edinburgh on 22nd June 2024. Collaboration between Drake Scotland, the Music Computing Lab at the Open University, and a physically disabled Scottish singer led to the devising of an approach that enabled the singer to compose her own chord sequences autonomously with full control for the first time. • Research on rhythm perception and production influenced by CHIME network activities and collaboration led to a workshop for amateur and non-musicians at the Open University In Milton Keynes on 6th September 2022 led by international level session drummer and music educator Noam Lederman. Participants were invited to improvise drum patterns using various hand drums in musical conversations with a real time drumming agent designed and programmed by Noam as part of his research at the Music Computing Lab. Although the agent is designed for, and is favourably rated by, high-level professional session drummers, the workshop demonstrated that the same technology is highly engaging for musical beginners - with clear applications outside academia.
First Year Of Impact 2022
Sector Creative Economy,Healthcare
Impact Types Societal

 
Description Soma Interaction Design in Music collaboration with the Mixed Reality Laboratory, University of Nottingham 
Organisation University of Nottingham
Department Mixed Reality Laboratory
Country United Kingdom 
Sector Academic/University 
PI Contribution The EPSRC CHIME Network worked with researchers based at the University of Nottingham Mixed Reality Lab in organising the a three-day participative workshop on Soma Interaction Design in Music, on 6-8 Feb 2024. The CHIME network wrote the call for the event, co-facilitated the event, liaised with participants, and are co-cordinating subsequent research publications. (See also the KTH partnership described below in a subsequent Collaborations & Partnerships entry.
Collaborator Contribution The Mixed Reality Lab hosted and co-facilitated the workshop, and are currently co-cordinating subsequent collaborative publications.
Impact The workshop itself was a multi-disciplinary outcome: The 2024 Soma Interaction Design in Music Workshop Collaborative papers are forthcoming to be submitted to relevant conferences (e.g. International Conference on Tangible Embedded and Embodied Interaction, and the New Interfaces for Musical Expression conference), and to relevant journals. All outputs are strongly multi-disciplinary, firstly as the network itself is multi-disciplinary (Music and HCI), but also as the the collaborators have different areas of focus - CHIME is rooted in music and HCI - the Mixed Reality Lab has a long history of designing and studying artistic and entertainment applications of computing more generally: spanning theatre, music, museums, and games. The studio works with diverse technologies from immersive virtual and augmented reality through to embedded, tangible, and wearable interfaces. The key disciplines involved are: - Design and particularly soma design - HCI - Music and creative practice
Start Year 2023
 
Description With DRAKE Music England: Music composition and performance skills for people with physical disabilities 
Organisation Drake Music
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Design of new tools facilitating music composition and performance skills for people with physical disabilities.
Collaborator Contribution Feedback on new tools facilitating music composition and performance skills for people with physical disabilities.
Impact New tools facilitating music composition and performance skills for people with physical disabilities, and new ways for people with disabilities to make use of then.
Start Year 2024
 
Description With OHMI and their clients: New one handed musical instruments 
Organisation One-Handed Musical Instrument Trust
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Implement, design and test prototype one-handed musical instrument
Collaborator Contribution Co production with one-handed people. User feedback on prototype designs.
Impact Implementation, design and user feedback on prototype one-handed musical instrument, whose creation and design was strongly influenced by the network
Start Year 2024
 
Description With SENSE UK: Musical haptics for the deaf 
Organisation Sense
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Design and implement prototype haptics for rhythm for d/Deaf People
Collaborator Contribution Feedback on designs for haptics for rhythm for d/Deaf People
Impact Improved design of prototype haptics for rhythm for d/Deaf People
Start Year 2024
 
Description With: Drake Music Scotland DIGITAL ORCHESTRA 
Organisation Drake Music
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution (Note: This collaboration is with Drake Music Scotland, as distinct from our collaboration with Drake Music England. These are two separate and independent organisations. Unfortunately the UKRI automated lookup tool for identifying collaborators for the purpose of this form inaccurately conflates them.) Simon Holland and Nicholas Canny visited Drake Music Scotland and Summerhall Arts Complex in Edinburgh in June 2023 to work variously with: musicians with physical disabilities; director Pete Sparkes; and Drake technical staff. The focus was an extended practical exploration of how Harmony Space can be used to support musicians with physical disabilities, however severe, as first-class citizens in composing and performing music on an equal footing with the non-disabled. Working with a physically disabled Scottish musician led to the devising of an approach that enabled her to compose her own finely detail chord sequences for the first time. As a result, details of collaboration with Drake to further develop Harmony Space for this purpose have been agreed going beyond 2025
Collaborator Contribution Drake recruited musicians with disabilities and gave us a supportive and well-equipped environment where we could work together .
Impact New techniques and systems allowing people with disabilities to compose chord sequences autonomously.
Start Year 2024
 
Description Creation and maintenance CHIME NETWORK WEBSITE (with over 5000 unique visitors) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The website connects and assist researchers from diverse disciplines, whether just starting or established, whose interests span any combination of Music and Human Computer Interaction. The website hosts documents, media, a bulletin board and information about past and future events .
Year(s) Of Engagement Activity 2022,2023,2024,2025
URL https://www.chime.ac.uk
 
Description Creation and maintenance of CHIME JISC MAILING LIST 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The CHIME JISC mailing list regularly shares information about research in music and human computer interaction with over 150 subscribers from the UK, US, Canada, China, Italy, Austria, Australia, Turkey, the Netherlands, Spain, Iceland, Norway, Switzerland, Sweden, Japan and New Zealand.
Year(s) Of Engagement Activity 2022,2023,2024,2025
URL http://www.jiscmail.ac.uk/chime
 
Description Creation and maintenance of CHIME YouTube Channel (43 videos to date) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Created 43 videos of CHIME seminars, presentations and panels with some 1981 views
Year(s) Of Engagement Activity 2022,2023,2024,2025
URL https://www.youtube.com/channel/UCBOtu4lBNXiCkT_93DNux3Q
 
Description ORGANISATION OF FIRST ANNUAL international CHIME conference with industry and charity participants 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The network organized the inaugural EPSRC CHIME Network on Music and Human Computer Interaction annual 1-day workshop, held in Milton Keynes at the Open University on 4 Dec 2023. The workshop was organised to maximise opportunities for all participants to have hands-on interactions with research prototypes. The workshop included 14 hands-on participative demos, 9 research talks, 3 posters, a keynote Sam Aaron, and a distinguished industry panel. There was also an afternoon specialised sub-workshop from Chris Nash on Teaching Coding through Music. Some 42 participants attendedattended.
Year(s) Of Engagement Activity 2023,2024
URL https://www.chime.ac.uk/chime-annual-workshop
 
Description ORGANISATION OF WORKSHOP on creating Two-player Entangled Instruments 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This workshop offers a practical exploration of theories of entanglement and HCI, applied to the experience of playing and designing two person entangled instruments for close mutual participation. There will be an emphasis on playing and reflecting so software knowledge is not necessary. However, if you have experience in PureData, MAX/MSP, VCV Rack2, Supercollider or Ableton live then you will be able to make your own sound engines for given interface data. Headphones are essential and numbers are limited to 12 participants.
Year(s) Of Engagement Activity 2024
URL https://static1.squarespace.com/static/6227c31a43daf21135453605/t/673b20f2463a12240523acbe/173192831...
 
Description ORGANISATION OF WORKSHOP IN Musically Embedded Machine Learning 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This workshop invites everyone to investigate Musically Embedded Machine Learning (MEML), the use of machine learning to build musical instruments with tuneable models, that musicians can train using the instrument as the interface. It is an occasion to reflect on how we present machine learning models to end users, and experiment with new musical ways to interact with creative machine learning. Show up with and join us for this half-day session; you're welcome to bring your instrument of choice. This workshop is open to participants from all backgrounds, no prerequisite skills required. Numbers are limited to 8 participant
Year(s) Of Engagement Activity 2024
URL https://static1.squarespace.com/static/6227c31a43daf21135453605/t/6723af17d5a2ce1e889a8d6a/173039183...
 
Description ORGANISATION OF WORKSHOP in Digital Pedagogy for Teaching Coding through Music 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This mini workshop used exercises to explore the intersection of coding and music from the perspective of younger audiences and non-programmers - including secondary schools, college students and adult learners. Using Manhattan, a hybrid sequencer/DAW and programming language, a series of card-based exercises presented challenges across different levels of difficulty, each focusing on specific concepts in music and programming. Each exercise required about 10-20 minutes, and was designed around the completion of a piece of an often familiar piece of music using code. Following an introduction to the project and presentation on the declining state of digital literacy, workshop participants worked through selected exercises, as a means of fostering discussion on usability and accessibility issues in early programming experiences.
Year(s) Of Engagement Activity 2023
URL https://oro.open.ac.uk/97572/1/CHIME_Proceedings_2023.pdf
 
Description ORGANISED THE SECOND ANNUAL CHIME Workshop on Music and Human Computer Interaction 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The network organized the second EPSRC CHIME Network on Music and Human Computer Interaction annual conference at Milton Keynes, 1-2 Dec 2024, this time as a 2-day conference. The conference was again organised to maximise opportunities for all participants to have hands-on interactions with research prototypes, with two half-day workshops, 12 hands-on participative demos, 13 research presentations, 14 posters, keynotes by Nick Bryan- Kinns and Artemi-Maria Gioti and a panel on accessibility and inclusion. Some 49 participants attended. A Proceedings in is preparation.
Year(s) Of Engagement Activity 2024
URL https://www.chime.ac.uk/chime-annual-conference-2024
 
Description ORGANISED the MONTHLY CHIME PUBLIC SEMINARS (to date 30 speakers) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact CHIME Seminars: a monthly seminar series with invited speakers (to date 30 speakers ) presenting on a range of relevant topics. Speakers are a deliberate mix of senior researchers, newer PhD or early career researchers, and relevant SME/charity representatives. The seminars have been recorded and made available through the CHIME website as outlined in the original network proposal. We have had over 100 unique attendees at these sessions to date. Presentations are focused on research, but presenters are also systematically drawn from Charities (e.g. Drake) SMEs (e.g. Ableton) and Artists (e.g. Lia Mice). The numbers of male and female speakers are almost exactly balances. Speakers to date have been drawn from the UK, Australia, France, Austria, Iceland. Attendees are drawn from the UK, US, Canada, China, Italy, Austria, Australia, Turkey, the Netherlands, Spain, Iceland, Norway, Switzerland, Sweden, Japan and New Zealand. Audiences of between 30 and 70 members of the public typically attend any given talk and contribute to the hour-long open discussion afterwards.
Year(s) Of Engagement Activity 2022,2023,2024
URL https://www.chime.ac.uk/events
 
Description Organised the Soma Interaction Design in Music Three Day Workshop 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact 20 participants took part in a 3 day Soma Design workshop hosted by the Mixed Reality Lab, University of Nottingham and facilitated by researchers at KTH, Stockholm. The event was aimed in particular at doctoral researchers in music interaction who were interested in the kinds of in-depth design-informed explorations of the body, and included hands-on activities and projects alongside reflection and discussion. We had excellent feedback from the doctoral participants about how useful this should be for their own research. The group are currently working towards a series of co-authored papers and articles developing themes from the workshop.
Year(s) Of Engagement Activity 2024
URL https://www.chime.ac.uk/soma-design-workshop
 
Description Organised the Workshop on Liberating Methods for Music Interaction 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Researchers on interfaces for music are situated in a wide range of academic disciplines, including music, computer science, human computer interaction and psychology, and often work in relative isolation from other researchers with similar interests. Historically this has sometimes led to new (and more experienced) researchers perceiving themselves to be constrained to use only methodologies well-trodden within their host discipline, even when these may be ill-matched to the real questions of interest, leading to less relevant research questions being addressed.

This practical problem-solving workshop will look at how to find and adapt methodologies that fit whatever questions a researcher in music interaction may actually want to ask, and, importantly, how to justify such methodologies clearly to supervisors, students, examiners, funding bodies and referees who may be unfamiliar both with music and less well known approaches.

Following brief introductory presentations from the invited speakers, each attendee who wants to will present their issue to the group as a 3-5min lightning talk. The group will then be split into subgroups to explore methodological approaches to their specific problems, either choosing a single issue from the group to discuss, or rotating to consider each member's issue in turn. Towards the end of the session, the subgroups will report back to the main group, for wider discussion and critique with the invited speakers. Finally, the invited speakers and workshop organisers will present reflections on the session.

This practical workshop is aimed at NIME researchers interested in thinking more widely about methods. NIME researchers have historically drawn on a very broad range of methods from diverse fields. This can make things difficult for PhD students and early career researchers attempting to orient themselves in the field, and to find relevant and rigorous methods of inquiry relevant to their research questions.

The workshop will be facilitated by a group of experienced PhD supervisors, referees and successful bid writers in areas related to NIME, including representatives from a range of host disciplines including Music, HCI, Psychology, AI and Computer Science.

The three invited speakers between them have a breadth of experience across NIME and beyond into the wider domains of HCI, or practice/artistic-based research, and interaction design.

Length of Workshop: Half day
Year(s) Of Engagement Activity 2022
URL https://doi.org/10.21428/92fbeb44.5a661805
 
Description Organised the Workshop on Music Interaction and Physical Disability 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact Event on Music Interaction and Physical Disability May 19th, St Cecilia's Hall, Edinburgh. This event brought together researchers; performers and composers with disabilities, SMEs; and representatives from charities focused on music and disability including Drake Music Scotland and The Amber Trust.

This meeting led to discussions to set up an international special interest group on disability and led to an ongoing partnership between Drake Music and the Music Computing Lab at Open University to develop tools for people with physical disabilities.
Year(s) Of Engagement Activity 2023
URL https://www.chime.ac.uk/music-interaction-and-disability