Fusing Semantic and Audio Technologies for Intelligent Music Production and Consumption

Lead Research Organisation: Queen Mary University of London
Department Name: Sch of Electronic Eng & Computer Science

Abstract

Music is probably the most pervasive of the performing arts, and perhaps, the most abused (think of your recent shopping trips!). It has tremendous power to influence our emotions, often subliminally. The advent of recording in the 19th Century made it possible to enjoy music at a time, and in a place, different from the performance. Compression, broadband and the ever increasing capacity to aggregate large collections mean that the issues confronting music consumers have totally changed in nature: equally so for professionals, such as broadcasters (playlists for radio, music for documentaries, etc.) and those at the creative heart of the process: musicians, sound engineers and producers. The recorded music industry has grappled unsuccessfully with digital technology and the rate of adoption of new technologies has been slow, ironically, mostly in fear of piracy and loss of revenue. Given the social and economic importance of music, it is vital that the industry's crisis is averted and its decline reversed. Simple semantics and metadata are already helping (for example in recommendation and sharing services) but this is just the beginning. The next generation semantic technologies that are the focus of this proposal have the power to exact the turnaround that music (and other content industries) needs but this should be established via a fundamental and principled exploration of how semantic technologies underpin music throughout the value chain.

The proposal brings the very latest technologies to bear on the complete industry, end-to-end, producer to consumer, making the production process more fruitful, the consumption process more engaging, and the delivery and intermediation more automated and robust. In this project we will address 3 premises: (i) that Semantic Web technologies should be deployed throughout the content value chain from producer to consumer; (ii) that advanced signal processing should be employed in the content production phases to extract "pure" features of perceptual significance and represent these in standard vocabularies; (iii) that this combination of semantic technologies and content-derived metadata leads to advantages (and new products and services) at many points in the value chain, from recording studio to end-user (listener) devices and applications.

The project will work with partners from industry - BBC R&D, Microsoft Research Cambridge and Omnifone) as well as internationally - the International Audio Labs, a joint initiative of the Fraunhofer Institute in Erlangan and the local university, and the Internet Archive, one of the world's major on-line libraries. We will engage with other universities in the UK supported by a partnership fund and via the BBC Audio Research Partnership.

This long term project will foster new ways for professionals to work with music in the studio and for consumers to engage in their homes. It will support new business models that emphasise the whole experience of musical involvement, and discover ways to monetise the metadata as well as the essential content. The technologies to be researched support new ways of learning (about and to play) music as well as new ways of teaching and performing. And because the project will encompass vast quantities of music data and metadata, from heterogeneous sources, and will stress test emerging principles of big data, distributed intelligence and future generation web, it also addresses key questions of wide significance to EPSRC's ICT Programme, particularly relating to Intelligent Information Systems and Working Together.

Planned Impact

By employing a 0.5 fte Outreach and Impact Officer (OIO), we expect to deliver significant impact throughout the project, by making impact part of the process from the start, rather than added in as an afterthought. Working closely with all the investigators, researchers and the programme manager, the OIO will help us capitalise on our industrial partnerships to develop specialised marketing, publicity and media strategies.

The project will deliver impact to academic beneficiaries in conventional ways, including papers in both journals and conferences, but will enhance this with more focussed provision in the form of special sessions, workshops and tutorials at selected important conferences including AES, ACM SIGGRAPH, CHI & Multimedia, and many others.

Because media/content metadata is vital to the broadcast industry, we will continue to engage with the MPEG and EBU standardisation processes, as well as that of AES. Partners at Oxford are able to promote potential standards within W3C. This industrial engagement and impact is enhanced through our partners, BBC, Microsoft and Omnifone and, in turn, their partners reaching deep into the music industry eco-system. For industry we will also offer online training materials (free) and specialist on-site courses (charged) and we will organise concerts highlighting live use of semantic technologies.

We will provide Open Source software including building on the successful VAMP, Sonic Visualiser and Sonic Annotator products from Queen Mary, and the SoundSoftware project, that offers open code repositories as well as advice and training. Also with the assistance of the SoundSofware project, we will promote best practice in reproducible research. We will continue to enhance the Music Ontology, and its family of ontologies all of which are offered under Creative Commons licenses, and to grow the offering of Open Linked Data hosted from our servers, including dbTune and others that have been provided since the early days of the Semantic Web.

Other avenues for outreach include to schools, via cs4fn, audio! (two paper & online magazine offerings from QML) and TeenTech, an organisation coordinated by Maggie Philbin for STEM outreach into schools with which QML has undertaken several successful activities. It is highly likely that spin-outs will arise from this project, supported by the 3 universities' technology transfer teams.
 
Title "The Gift of the Algorithm: Beyond Autonomy and Control", Audio Mostly 2017 Concert, Oxford House Theatre, Bethnal Green, 25 August 2017. 
Description This was a performance by Alan Chamberlain and David De Roure, "The Gift of the Algorithm: Beyond Autonomy and Control" at the Audio Mostly 2017 Concert, Oxford House Theatre, Bethnal Green, 25 August 2017. Recording available at: https://soundcloud.com/alain_du_norde/the-gift-the-algorithm-beyond-autonomy-and-control Programme notes: https://eprints.nottingham.ac.uk/45615/ 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2017 
Impact None known. 
 
Title 'Ada sketches' performance at RNCM, using Numbers into Notes software, July 2016. 
Description The performance 'Ada sketches' at the Royal Northern College of Music took place on 27 July 2016. Pioneering 'Numbers Into Notes' software written by Centre Director Professor David De Roure was used in a performance of Dr Emily Howard's 'Ada Sketches' short operatic work in Manchester on the 27 July. The performance, which celebrates the life of the first computer programmer and pioneering mathematician, Ada Lovelace, was part of the EuroScience Open Forum (ESOF), the biennial, pan-European science conference focused on the latest advancements and discoveries in the sciences, humanities and social sciences. The software is an interactive web application tool which generates a number sequence. This is then reduced using clock arithmetic and mapped to notes, and the music explored by selecting fragments to play. OeRC news piece: https://www.oerc.ox.ac.uk/news/new-software-be-used-performance-celebrating-ada-lovelace RNCM piece on page 4 of RNCM Research Bulletin Issue 13, Jul 2016, on https://issuu.com/rncm/docs/research_bulletin_issue_13 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2016 
Impact Pioneering 'Numbers Into Notes' software written by Centre Director Professor David De Roure was used in a performance of Dr Emily Howard's 'Ada Sketches' short operatic work. The software is an interactive web application tool which generates a number sequence. This is then reduced using clock arithmetic and mapped to notes, and the music explored by selecting fragments to play. 
URL https://issuu.com/rncm/docs/research_bulletin_issue_13
 
Title 'Ada sketches', Mathematical Institute, University of Oxford. November 2015 
Description The performance 'Ada sketches' by composer Emily Howard, a short operatic work about the pioneering mathematician Ada Lovelace, was performed by students from the Royal Northern College of Music on the 30 November 2015 at the Mathematical Institute in Oxford. As well as the performance and presentation of the work given by composer Emily Howard (with mathematician Lasse Rempe-Gillen), audience members were able to participate in the composition of mathematical music by working with the musicians to turn numbers into notes. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2015 
Impact None known. 
URL http://blogs.bodleian.ox.ac.uk/adalovelace/music/
 
Title Ada Lovelace "Numbers into Notes" (Team: Oxford) 
Description "Ada Lovelace Numbers Into Notes" is an exercise in digital content capture and repurposing through a series of performances, as a case study in workflow and Digital Music Objects. It was conducted in collaboration with the AHRC Transforming Musicology project. The events were a performance of "Ada Sketches" by composer Emily Howard at the Science Museum, which was then performed in the Mathematical Institute in Oxford and captured together with audience data and front of house materials; this was then presented at the Ada Lovelace Symposium together additionally with music generated by a simulator of the Analytical Engine, and the combined efforts presented at the Digital Music Research network (December 2015) and the Centre for Digital Scholarship at the Bodleian Library (January 2016). The demonstration software is publicly available online. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2015 
Impact The event allowed for a number of engagement activities with both musicians and the general public to take place. It also led to the the generation of a variety of digital content that can be used to further develop the research and put similar events together in the future. 
URL https://dl.dropboxusercontent.com/u/15772302/NumbersIntoNotes/index.html
 
Title Ada into Notes - A Sketch (Alan Chamberlain) 
Description Engaging experience The soundtrack 'Ada into Notes - A Sketch' for the film; 'Into the Looking Glass - how selfie culture is preparing us to meet our future selves' was created by Dr Alan Chamberlain who worked with Dr Greg Bevan and Dr Glen Creeber at the Department of Theatre Film and Television, Aberystwyth University, who wrote and directed the film. The film asks the viewer to re-think their evolving relationship with the media, encouraging them to consider a future where agency will be enhanced by the spectator's gradual movement towards the screen. Rather than simply illustrate the script, the selected audio-visual materials attempt to offer a more engaging experience for the viewer by responding to and entering into dialogue with the spoken text. Alan Chamberlain (Mixed Reality Lab, Nottingham) has worked with David De Roure (e-Oxford Research Centre) to develop a software to experiment the area of digital humanities that allows people to explore computer algorithms in a creative way. The tools developed were called "Numbers into Notes" and was a software-based interpretation of Ada Lovelace's theorizing on the properties of Charles Babbage's Analytical Engine, she writes "the engine might compose elaborate and scientific pieces of music". The research explores the use of autonomous systems for composing music, an idea that stemmed from self-driving cars, Alan Chamberlain said: "I'd read a lot about self-driving cars and wanted to explore this in terms of music creation. I've been working with David to understand and develop ways that people can explore, re-use and experiment with materials from the humanities in creative ways." Using the Numbers into Notes interface the composer is able to create a musical algorithm (set of notes) by experimenting with the different mathematical formulae. The musical sequences can then be used for inspiration, or used directly in compositions. See blog post: https://blogs.nottingham.ac.uk/newsroom/2018/03/12/science-music-brought-big-screen/ 
Type Of Art Composition/Score 
Year Produced 2018 
Impact None known. 
 
Title Alter 
Description Alter is an ensemble work written about, and utilising, artificial intelligence. Through three phases, it traces the development of an artificial mind: from hazy, unformed conception to a complex and creative self. Between each phase this curious and perfectionist mind dives into its own code to retrain and develop itself. It was a commission by the Barbican to composer Robert Laidlow (RNCM) and was the outcome of a collaboration between RNCM and the FAST project (David De Roure, Pip Willcox). It exists as a score and a video of the Barbican performance on 2 November 2019. It was performed a second time in 2019, at the Hollywell Music Room in Oxford. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2019 
Impact This piece is significant as a Contemporary Classical work which is composed with and about AI. 
URL https://www.barbican.org.uk/whats-on/2019/event/ada-lovelace-imagining-the-analytical-engine
 
Title Audible Artefacts 
Description Creative and research based collaboration between MRL, Department of Culture and visual studies (UoN) and Nation Science and Media Museum (The Science Museum Group). This collaboration contributed to the research and development of an Audio Augmented Reality Mobile Application, a related visitor focus group study, a public sited sound installation, and a technical demonstration and presentation. 
Type Of Art Artefact (including digital) 
Year Produced 2019 
Impact The Science Museum Group supported the public engagement activities by hosting the related public engagement events, providing access to museum artefacts and curatorial and collections staff. UoN Department of Culture also provided assistance with public engagement activities. Science Museum Listening Session, Public and professional engagement/focus group demonstration, 22nd June, 2019, at National Science & Media Museum, Bradford UK Public sound installation. 18hJuly, 2019, at National Science & Media Museum, Lates event, Bradford UK Public sound installation at National Science & Media Museum, Bradford on 18hJuly, 2019. Experienced by 45 members of the public within the context of a free, open invitation, late night museum event. 
 
Title Climb! 
Description Climb! is a gamified virtuoso composition of Disklavier and Muzimeld integrator. It is an artistic collaboration between the composer Maria Kalionpaa and the project teams from Nottingham and Oxford. The Oxford team have contributed a dynamic semantic notation system implementing our Music Encoding and Linked Data (MELD) framework. The Nottingham team have contributed the Muzicodes music pattern recognition and event triggering software. Muzicodes and our MELD semantic score system have been integrated in order to drive performances of Climb!, a gamified virtuoso composition by Maria Kallionpää. For further information, see the FAST blog post: http://www.semanticaudio.ac.uk/blog/maria-kallionpaa-climb-a-virtuoso-piece-for-live-pianist-disklavier-and-interactive-system-2017/ 
Type Of Art Composition/Score 
Year Produced 2016 
Impact Publication and talk at the international conference New Interfaces for Musical Expression (NIME 2017). Disciplines: computer science (semantic web), digital signal processing, music composition, music performance. This is an ongoing project, so other Climb! performances have either already happened or are being planned. 
URL https://www.youtube.com/watch?v=idR75oEdQrQ
 
Title Climb! @ All Your Bass Videogame Music Festival (Oxford, D. Weigl) 
Description Public performance of Climb!, for the first time featuring pianists who came "new" to the piece (i.e., were not the composer and were not involved in the creation of the piece and supporting technology). 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2018 
Impact Public performance in front of a crowd of Videogame Music Festival attendees. See reports from Nottingham partners for further details. 
URL http://www.semanticaudio.ac.uk/news/fast-presenting-at-the-all-your-bass-videogame-music-festival-in...
 
Title Climb! Performance at the Iitallia Music Festival Iitallia, Finland, June 2018, (Adrian Hazzard). 
Description Climb! is a classical composition that uses a self-playing Disklavier piano duetting alongside the pianist. This is controlled by software (Muzicodes and MELD) connected to the piano, which responds to phrases that the pianist plays. Projected visuals and a mobile app give more clues about what is happening.Composer and pianist Maria Kallionpää performed Climb!. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2018 
Impact Maria Kallionpää, researcher Adrian Hazzard and Hans-Peter Gasselsider presented a live performance and talk about the FAST project "Climb!" at the Iittala Music Festival, Finland. 
 
Title Climb! Performance at the Reflective Conservatoire Conference, February 2018, Barbican, London (Adrian Hazzard, Glenn McGarry). 
Description Climb! is a classical composition that uses a self-playing Disklavier piano duetting alongside the pianist. This is controlled by software (Muzicodes and MELD) connected to the piano, which responds to phrases that the pianist plays. Projected visuals and a mobile app give more clues about what is happening. Composer and pianist Maria Kallionpää performed Climb!. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2018 
Impact Maria Kallionpää, Adrian Hazzard and Glenn McGary presented a live performance and talk about the FAST project "Climb!". The conference placed a focus on musicology and contemporary classical performance, thus presenting "Climb!" to a new audience. 
URL http://music-mrl.nott.ac.uk/1/archive/explore/Climb
 
Title Collaboration with guitarist Patrick Shaw: Artcodes 
Description Working with Patrick Shaw, a very active guitarist and performer, enabled the FAST IMPACt Nottingham team to have some insight into how the Artcodes technology and the concept of Accountable Artefacts are understood by a practicing musician. Part of Patrick Shaw's rationale for having scannable Artcodes embedded into his guitar was so that he could promote broader awareness and discussion around this work with the musicians he plays with in the future. 
Type Of Art Artefact (including digital) 
Year Produced 2016 
Impact The adoption of the accountable artefacts concept by a performance practioner. 
URL https://carolanguitar.com/
 
Title Commissioned Dynamic Audio Experiences (Adrian Hazzard) 
Description Negotiating and supporting three music / sound artists / composers to produce a dynamic audio listening experience in collaboration with Adrian Hazzard (MRL). Commissions completed in summer 2018. Artists were Robert Thomas (Dizzy Banjo), Yuri Levtov (Reactify) and Tracy Redhead. 
Type Of Art Composition/Score 
Year Produced 2018 
Impact Creation and realisation of prototype dynamic / contextual music experiences. Multi-disciplinary: music composition, production and Human Computer Interaction. 
 
Title Exhibition Play it Again! Use it Together at Victoria Gallery and Museum Liverpool, with Open Music Archive feat. 51 architecture (Florian Thalmann & Thomas Wilmering) 
Description FAST Semantic Web technologies integrated into automatic analysis and archiving system used in the exhibition. Web-based infinite composition created using FAST dynamic music objects and streamed in the exhibition space and online. 
Type Of Art Artistic/Creative Exhibition 
Year Produced 2018 
Impact Engagement with museum goers, musicians, community. 
URL https://www.playitagainuseittogether.com/
 
Title FAST LP 
Description We produced a FAST 12 inch vinyl record showcasing some of the most exciting FAST technologies and with music created by the artists Maria Callionpaa and Tracy Redhead using those technologies. The LP was conceived as a 'concept' LP. Side A includes four songs created by Tracy Redhead using the Semantic Machine, a contextual listening experience. The Semantic Machine is a project developed by Florian Thalmann and Tracy Redhead that uses the Semantic Player technology to create a song that changes based on the weather, time of day and location of the listener. These versions demonstrate how the song might sound. They have been specifically produced for the Vinyl medium so that each track will work when played in unison with another or all versions of the song. Track 4 'Semantic Machine - All Tracks' is the first 3 tracks played together in unison demonstrating the result of 3 turntables playing each version cued together. Side B includes a demonstration of Climb!. Climb! is a virtuoso piece composed for pianist, a self-playing Disklavier piano, interactive system and visuals which combines contemporary piano repertoire with elements of computer games to create a nonlinear musical journey in which the pianist negotiates an ascent of a mountain. Along the way the performer encounters musical challenges that determine their route through a number of branching movements that starts at Basecamp and finishes at The Summit. This recording covers just one of the many possible routes as compiled from four separate performances of Climb! given by three pianists. The non-musical content of the LP includes: 1) a short description of some of the FAST demonstrators (showcasing our technologies). Each demonstrator is accompanied by an image or 'artcode', a new interaction technology developped by the University of Nottingham. More details about the arcodes technology used is given seperately under this heading (Artistic & Creative Products). 2) a short description of the project. It is planned that the LP will be uploaded into Soundcloud in the near future. 
Type Of Art Artefact (including digital) 
Year Produced 2018 
Impact None known. 
 
Title Fib 12 Ada Lovelace Day 2018 
Description This is a demo piece, a small contribution to Ada Lovelace Day 2018, based on a Fibonacci sequence and arranged for a harp - an instrument which Lovelace played with great dedication. The Fib 12 sequence was generated using numbersintonotes.net (Fibonacci mod 12 i.e. 0 1 1 2 3 5 8 1 9 10 7 5 0 5 5 10 3 1 4 5 9 2 11 1, mapped to C major) to create a fragment which is assembled with itself at different times, tempos, and retrograde. This arrangement is designed to illustrate various kinds of fragment assembly - like a machine or automaton which reveals the melody of the maths. See musical piece on https://soundcloud.com/david-de-roure/fib12-ada-lovelace-day-2018 
Type Of Art Composition/Score 
Year Produced 2018 
Impact Composition Fib 12 Ada Lovelace Day 2018: As well as a programmer and mathematician, Ada Lovelace was a keen musician. And amidst the many great minds of the 19th century, it was Lovelace who saw the potential of the computer beyond calculation, and contemplated its relationship with human creativity. In 1843 she wrote of Babbage's proposed Analytical Engine: "Supposing, for instance, that the fundamental relations of pitched sounds in the science of harmony and of musical composition were susceptible of such expression and adaptations, the engine might compose elaborate and scientific pieces of music of any degree of complexity or extent." Since the symposium "Celebrating 200 years of a Computer Visionary" in December 2015, we have been generating music using nineteenth century mathematics and simulations of the Analytical Engine. This is a demo piece, a small contribution to Ada Lovelace Day 2018, based on a Fibonacci sequence and arranged for a harp - an instrument which Lovelace played with great dedication. The Fib 12 sequence was generated using numbersintonotes.net (Fibonacci mod 12 i.e. 0 1 1 2 3 5 8 1 9 10 7 5 0 5 5 10 3 1 4 5 9 2 11 1, mapped to C major) to create a fragment which is assembled with itself at different times, tempos, and retrograde. This arrangement is designed to illustrate various kinds of fragment assembly - like a machine or automaton which reveals the melody of the maths. The score is available here www.dropbox.com/s/91e6ipxk3meuhaqvelaceDay2018.pdf See also our 2016 live performance using algorithmically generated fragments Alain_du_norde - The-gift-the-algorithm-beyond-autonomy-and-control Fancy some Fibonacci jazz? This is the Fib 35 piece we played at the Symposium in 2015 David-de-roure - Fib35 With special thanks to composer Emily Howard for the "Numbers into Notes" idea, originally presented in performances of "Ada sketches". Fib 12 by David De Roure is licensed under a Creative Commons Attribution 4.0 International License. This work was funded by the EPSRC FAST Project EP/L019981/1 and released 9th October 2018. 
 
Title Live performance New Space (A. Chamberlain) 
Description Alan Chamberlain (2017) New Space. Performed at: Noise Projection/Taflwn Sain, March 3rd - Experimental Electronic Sound event, Aberystwyth. This was a performance based on algorithmically generated midi, partially from Numbers into Notes (De Roure) and used as a compositional resource. The performance also included Roli Blocks that were passed into the audience. Post performance we were able to support other artists in understanding how the piece was composed and how the tools used worked. Unrecorded, but exists as an Albeton Live Set. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2017 
Impact No notable impact. 
 
Title Live performance on R. Fludd at the National Library of Wales 2017 (A. Chamberlain) 
Description Alan Chamberlain (2017) Robert Fludd. In: Listen to the Voice of Fire: Alchemy in Sound Art, 3rd March 2017, National Library of Wales, Aberystwyth. This was a performance and demonstration of a sound-work based on the 16th century Natural Philosopher Robert Fludd. It used an image of Fludd as an mechanism to create midi, that was then processed live and projected. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2017 
Impact The Nottingham team have been asked to run a workshop at the School of Art (Aberystwyth) to explore images as musical and metadata. A small video exists that shows the system working. See URL un the next section. 
URL https://www.youtube.com/watch?v=KM_McZi0iJ8
 
Title Lohengrin TimeMachine Digital Companion 
Description The Lohengrin TimeMachine Digital Companion is a touch-based tablet app for exploration and visualisation of the motives in Wagner's opera Lohengrin, based upon an analysis by Prof. Laurence Dreyfus in his essay "Asking a Forbidden Question: A new view of musical themes in Wagner's Lohengrin". The Digital Companion was created by the Unlocking Musicology project (AH/R004803/1), and includes an enriched version of the essay alongside novel interactive explorations of score (notation), libretto, orchestration, and audio. The app also includes a 30 minute video "Rethinking Wagner's 'Leitmotifs': An introduction to the Lohengrin TimeMachine". The Digital Companion was built using technology in the MELD framework (Music Encoding and Linked Data), which was developed by a team at the University of Oxford through the EPSRC-funded FAST project (EP/L019981/1). 
Type Of Art Artefact (including digital) 
Year Produced 2019 
Impact The application is intended to be accessible to enthusiastic amateurs as well as scholars, and concerns Wagner's use of motives in his early opera, Lohengrin, arguing for a more sophisticated understanding than 'Leitmotif' guides often communicate. 
URL https://um.web.ox.ac.uk/lohengrin
 
Title Losing her voice - Opera project (Chris Greenhalgh, Adrian Hazzard) 
Description Adrian Hazzard and Chris Greenhalgh are working with Elizabeth Kelly (University of Nottingham Department of Music) in the composition and performance of a new opera called Losing Her Voice. They are developing technologies to support audience engagement and the 're-animation' of archival media within the performance of the opera. Elizabeth Kelly is composing the work and writing the Liberetto. 
Type Of Art Composition/Score 
Year Produced 2018 
Impact Two main outcomes: 1. Workshop (November 17th 2018, Nottingham). Workshop 1 was with a group of invited musicologists from UK universities, to discuss the theme of the opera. 2. Public performance of Losing her Voice : select scene from the opera were performed at the Nottingham Theatre Royal and Royal centre Concert hall, Nottingham, as part of the national Being Human Festival. 
 
Title MELD supports "Climb!" virtuoso piano piece (see description also under "collaborations and partnerships) 
Description Performance integrator (Climb!) is a collaboration between David Weigl, Kevin Page (Oxford), Adrian Hazzard, Chris Greenhalgh, Steve Benford (Nottingham) and Maria Kallionpää (visiting scholar at Nottingham). The collaboration supports the performance of Climb!, a gamified piece for virtuoso pianists composed by Maria. The collaboration involves the technical integration of the MELD dynamic semantic notation system developed at Oxford with Muzicodes, a music pattern recognition and interaction system developed at Nottingham. 
Type Of Art Composition/Score 
Year Produced 2016 
Impact The collaboration is still active; the ongoing composition of the piece interacting with ongoing technical developments. The collaborators have submitted a paper and performance notes for the project to NIME 2017, and further outputs are planned for the future, both in terms of submissions to academic conferences, and in performances of the piece. The collaboration is multi-disciplinary, drawing on aspects of music composition, music performance, audio engineering, computer science, and web science. 
 
Title Music performance at Audio Mostly 2017: "Climb!" for Disklavier and Electronics 
Description This performance presented the interactive work "Climb!" to a new audience, who attended the Audio Moatly 2017 conference at Queen Mary University of London. The performance tested a number of new technical evolutions in this projects work, including an interactive audience app. 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2017 
Impact About 60 people (international; professional practitioners, academics) attended the performance. Our own colleagues reported a change in views. 
 
Title Music performance at Audio Mostly 2017: The Gift of the Algorithm: Beyond Autonomy and Control 
Description Music performance at Audio Mostly 2017: The Gift of the Algorithm: Beyond Autonomy and Control: Alan Chamberlain and David De Roure. This performance presented the "The Gift of the Algorithm" to a new audience, who attended the Audio Mostly 2017 conference at Queen Mary University of London. The performance tested a number of new technical evolutions in this projects work, including an interactive audience app 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2017 
Impact 60 people (international; professional practitioners and academics) attended the performance. No notable impacts noted. 
 
Title Muzicodes: composing and performing musical codes (in progress) 
Description The project's goal is the development of a browser based system that enable composers and musicians to identify and perform musical phrases that acts as codes to trigger media interactions within their performance practice, such as: instance lighting cues, visuals, backing tracks, samples etc. Alongside development of this technical system, the research project aims to capture a deep understanding of the issues at play when using this system. Development (on-going) of a contemporary composition intended for performance in international concert halls. 
Type Of Art Composition/Score 
Year Produced 2016 
Impact Not applicable at this time. The project is ongoing. The completed composition, as supported by the developing Muzicodes and MELD technologies, intends for a series of high profile international performances. These include seeking out concert hall venues and performances connected to research engagements such as conferences and workshops. 
 
Title Open Symphony (Team: QMUL) 
Description Western performing arts practices have traditionally restricted audience interaction with performers. What if this were revisited - not to replace - but to create novel types of musical experiences? Open Symphony reimagines the music experience for a digital age, fostering alliances between performer and audience and our digital selves. The project investigates how to embrace digital technology in the live music environment to engage both audience and performers and develop new platforms for music composition, performance and listening.Open Symphony is an immersive performance system which explores the creativity and spontaneity of reactive interactions through an ensemble of performers and an audience using mobile technology and data visualisation. Open Symphony performances will be held at the workshop 'A Mind of Music' (March 2016, QMUL) and at the International conference on Computer Human Interaction (May 2016, USA). 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2015 
Impact The Open Symphony project has been selected as one of six UK projects to join the Sound and Music organization's Audience Labs programme funded by Arts Council England", which is an audience development programme designed to test new ways of communicating and presenting new music to audiences. 
URL http://isophonics.net/content/opensymphony
 
Title Pen Dinas in Voice 
Description 1) Composition: Pen Dinas in Voice was composed by Alan chamberlain (member of the Nottingham FAST team). It was first performed by the Swansea Laptop Orchestra, Bangor Music Festival, 2019. Attended by 90 people. Link: https://soundcloud.com/alain_du_norde/pen-dinas-in-voice Festival Link - http://www.bangormusicfestival.org.uk/2019-programme/codi-electronics-swansea-lapto p-orchestra/ Performances: Bangor Music Festival - Pontio, Bangor, 8th of February Living with the Internet of Things - Tate Modern, London 9th of February (see below). 2) Film including composition: Pen Dians in Voice was played at the Tate, London as part of the Everyday Internet of Things. It is estimated that around 1200 people passed through on the day. Video: https://www.youtube.com/watch?v=Pl3KrfYc3r8 3) Blog piece: Dr Chamberlain is based in the Mixed Reality Lab at the University, and leads the Culture, Creativity and Technology Group said, "The performers work with the piece using 'new' electronic instruments called tethers, which allow them to manipulate and work with sounds in a more choreographed manner. It's amazing to see and really brings the work to life." The piece has also been used in a short film, which was played at an event held at the Tate modern on the 9th of Feb, called "Living with the Internet of Things". This brought together 'reactive' visual elements and images to create a narrative of the work that has been done this far. As part of the event Prof De Roure (Oxford FAST team) discussed a new instrument that is being developed. Dr Chamberlain continued: "We are currently designing an artistic installation that will further enable people to engage with the technology. The beauty of this approach is that it could be installed in multiple sites." Impact from Research to Culture: Dr Chamberlain recently wrote a soundtrack for the award-winning film, "Into the Looking Glass - how selfie culture is preparing us to meet our future selves". Since then he has been awarded a place on the Ty Cerdd's CODI Composer programme, and an award from the University's EPSRC Impact Acceleration Account to further the impact that his research will have. Dr Chamberlain said; "It's vitally important to engage the public in research and by bringing music and computer science together we are able to demonstrate the creative potential of our research. The university of Nottingham has a strong culture of interdisciplinary research, which is both beneficial to the economy and to culture - our research in the School of Computer Science, and the Music Department is world-leading." Dr Alan Chamberlain is a Composer in Residence at the Computational Foundry, Swansea University. See blog: http://blogs.nottingham.ac.uk/newsroom/2019/02/08/musical-composition-and-its-impacton-culture-and-research/ 
Type Of Art Composition/Score 
Year Produced 2019 
Impact Impact from Research to Culture: In 2019k, Dr Chamberlain wrote a soundtrack for the award-winning film, "Into the Looking Glass - how selfie culture is preparing us to meet our future selves". Since then he has been awarded a place on the Ty Cerdd's CODI Composer programme, and an award from the University's EPSRC Impact Acceleration Account to further the impact that his research will have. Dr Chamberlain said; "It's vitally important to engage the public in research and by bringing music and computer science together we are able to demonstrate the creative potential of our research. The university of Nottingham has a strong culture of interdisciplinary research, which is both beneficial to the economy and to culture - our research in the School of Computer Science, and the Music Department is world-leading." Dr Alan Chamberlain is a Composer in Residence at the Computational Foundry, Swansea University. 
URL http://blogs.nottingham.ac.uk/newsroom/2019/02/08/musical-composition-and-its-impact-on-culture-and-...
 
Title Performance at the Mad Scientist festival in Bern, Switzerland, 9. September 2016 
Description Performance at the Mad Scientist festival in Bern, Switzerland, 9. September 2016, with acoustic musicians, using Audio Dream, a web-based performance software that uses clustering algorithms and recurrent neural networks to reorganize recorded audio from the performers. https://github.com/florianthalmann/audio-dream 
Type Of Art Performance (Music, Dance, Drama, etc) 
Year Produced 2016 
Impact Not known. 
URL https://github.com/florianthalmann/audio-dream
 
Title SoundScaper App 
Description A smartphone mobile application to situate virtual sound sources within physical space, through which participants can interact within an Audio Augmented Reality (AAR) experience, and with which curatorial and artistic practitioners can also author their own experiences. 
Type Of Art Artefact (including digital) 
Year Produced 2019 
Impact It was used in two public engagement experiences at Nation Science & Media Museum, Bradford. Research collaboration between MRL and Department of Music. This collaboration contributed to the research and development of an Audio Augmented Reality Mobile Application. 
 
Title The B076 audio experience 
Description This is part of the FAST IMPACt research collaboration between Nottingham and Queen Mary that has pushed forward the ongoing development of the Semantic Player. The Nottingham and Queen Mary partners worked to extend and hone the existing functionality of the Semantic Player to enable the development, authoring and deployment of the B076 experience, which used iBeacons for indoor positioning. The B076 audio experience engaged with 12 members of the public who signed up to take part. They were recruited via the Primary Arts Space and distributed flyers. It was hosted in the Primary Arts Space, Nottingham. It was an indoor interactive installation where visitors walked around an empty exhibition space. iBeacons were distributed around the room which tracked the proximity of visitors, thus determining their location in the room. Their position triggered playback of different audio streams which culminate in a continuous soundscape narrative. 
Type Of Art Artistic/Creative Exhibition 
Year Produced 2016 
Impact The most significant outcome from this creative project was extending the sensor functionality of the Semantic Player. 
 
Title The Carolan Guitar (Team: Nottingham) 
Description The Carolan guitar is an augmented acoustic guitar that has been constructed and deployed as a technology probe to explore the broad nature of and potential uses for the digital record of a music instrument. Carolan is an unusual instrument in that its digital record can be inspected by scanning its decorative inlay using a mobile phone. The guitar is called Carolan in honour of the legendary composer Turlough O'Carolan, the last of the great blind Irish harpers, and an itinerant musician who roamed Ireland at the turn of the 18th century, composing and playing beautiful celtic tunes. Like it's namesake, Carolan is a roving bard; a performer that passes from place to place, learning tunes, songs and stories as it goes and sharing them with the people it encounters along the way. This is possible because of a unique technology that hides digital codes within the decorative patterns adorning the instrument. These act somewhat like QR codes in that you can point a phone or tablet at them in order to read their codes (see below) which in turn accesses information on the Internet. Unlike QR codes, however, they are aesthetically beautiful and form a natural part of instrument's decoration. Scanning the different patterns on the Carolan guitar takes you to different information such as the history of how it was made, details of who has played it, videos of their performances and also the instrument's user guide and full technical specification. As a result, this unusual and new technology enables the Carolan guitar to share a growing 'digital footprint' throughout its lifetime, but in a way that resonates with both the aesthetic of an acoustic guitar and the craft of traditional luthiery. 
Type Of Art Artefact (including digital) 
Year Produced 2015 
Impact The FAST Nottingham team have documented over forty encounters with players in homes, studios, gigs, workshops and lessons (see www.carolanguitar.com). 
URL http://www.carolanguitar.com
 
Title The Rough Mile audio experience 
Description The Rough Mile experience engaged with 22 members of the public, who signed up to take part. They were recruited via Rough Trade records, posters and flyers distributed around Nottingham City. It consisted of two locative audio walks that took place on different days, for paris of friends to come and experience together. The first walk was a pre-defined narrative performance that in part captured information from the friends about music tracks choices they would like to gift to each other. The second walk then consisted of this gifted experience, where they listened to these music tracks as between pairs of friends. The experience was a research exercise, but also a standalone 'artistic engagement' in its own right. 
Type Of Art Artefact (including digital) 
Year Produced 2016 
Impact Anecdotal evidence was captured from participants discussing their enjoyment and subsequent desire to seek out and engage with other similar experiences. Successful deployment of a detailed locative audio experience with a universally positive reception was noted. 
 
Description There have been many discoveries in this project, which spanned 5.5 years and generated well over 200 papers. There are therefore too many to describe briefly here. However, the main objective of exploring the value of metadata in the music industry (broadly defined) has been confirmed, especially when this metadata conforms to Ontologies and is captured using RDF. The representational power of this approach has enabled many diverse 'demonstrators' with the project, and enables them to conform to a common engineering approach, thereby enhancing inter-operability.
Many new collaborations were enabled. This includes with professional musicians and composers as well as research teams that were only encountered as a direct result of the visibility of this project, and the resources at its disposal. Many of the papers include international collaborators.
Also important was research that proved the value of bridging the divide between the physical and digital worlds with several artefacts and design practices that were developed and explored. This includes a custom built guitar, and a 2-sided LP recorded with double-fold sleeve, both decorated with "Art Codes" that can be scanned with a smart phone app to take the consumer/viewer to appropriate web-based information.
Exploitation Route There are several technological approaches to generating new musical experiences that were trialled in the project. Some of these are being offered as starting points for new researchers, especially on the UKRI CDT in AI and Music. There are also applications to EPSRC Impact Acceleration Accounts to explore deeper societal and economic impacts from the research: one is funded at QMUL and others are in preparation. Discussions are on-going with several companies, and at least one new EPSRC Research Grant is in preparation.
Sectors Creative Economy,Digital/Communication/Information Technologies (including Software),Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections

URL http://www.semanticaudio.ac.uk
 
Description There has been a welter of impacts from this project, as are listed separately. A larger than average proportion of these have been in direct musical and cultural interventions, some of them centred on Ada Lovelace and the predictions she made about having computers involved in music. This has led to several interactions with composers, with a singer-songwriter and with many more amateur musicians, as well as large scale public engagement, for example at the Barbican. A particularly significant event was an Industry Day, held at Abbey Road Studios on 25/10/2018. About 150 guests came during the day, including representation from the House of Lords, the Office for AI and across the music industry. Experiments with adaptive music (which plays differently dependent on context such as weather, time of day, heart-rate, ...) will be exposed to a wider audience at some point in 2020, in the form of an Android App. This is the result of a collaboration with Australian singer-songwriter, Tracy Redhead.
First Year Of Impact 2015
Sector Creative Economy,Leisure Activities, including Sports, Recreation and Tourism,Culture, Heritage, Museums and Collections
Impact Types Cultural,Societal

 
Description Advisory Board member for Andrew W. Mellon Foundation project (K Page)
Geographic Reach Multiple continents/international 
Policy Influence Type Participation in a guidance/advisory committee
 
Description MPEG activity regarding ontology
Geographic Reach Multiple continents/international 
Policy Influence Type Membership of a guideline committee
URL https://code.soundsoftware.ac.uk/projects/mpegdevelopments/
 
Description AHRC UK-China Creative Industries Partnership Development Grant
Amount £20,970 (GBP)
Funding ID AH/T001259/1 
Organisation Arts & Humanities Research Council (AHRC) 
Sector Public
Country United Kingdom
Start 02/2019 
End 08/2019
 
Description AI for Music in the Creative Industries of China and the UK
Amount £20,970 (GBP)
Funding ID AH/T001259/1 
Organisation Arts & Humanities Research Council (AHRC) 
Sector Public
Country United Kingdom
Start 02/2019 
End 08/2019
 
Description Beethoven in the House: Digital Studies of Domestic Music Arrangements
Amount £283,560 (GBP)
Funding ID AH/T01279X/1 
Organisation Arts & Humanities Research Council (AHRC) 
Sector Public
Country United Kingdom
Start 02/2020 
End 10/2022
 
Description Co-Investigator on EU Marie Curie ITN, PhD Scheme (Mark Sandler)
Amount € 1 (EUR)
Organisation Marie Curie 
Sector Charity/Non Profit
Country United Kingdom
Start  
 
Description EPSRC
Amount £50,000 (GBP)
Funding ID EP/T51729X/1 - Disruptive Beats - Music - AI - Creativity - Composition and Performance (Digital Catapult RiR) 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 06/2019 
End 05/2021
 
Description Expanding Excellence in England (E3) Fund: Practice and Research in Science and Music (RNCM)
Amount £914,000 (GBP)
Organisation United Kingdom Research and Innovation 
Department Research England
Sector Public
Country United Kingdom
Start 10/2019 
End 09/2022
 
Description Horizon 2020 (H2020-ICT-2015)
Amount € 676,850 (EUR)
Funding ID Proposal number 688382 
Organisation European Commission 
Sector Public
Country European Union (EU)
Start 02/2016 
End 01/2019
 
Description ICASE Studentship with the BBC (Mark Sandler)
Amount £27,500 (GBP)
Organisation British Broadcasting Corporation (BBC) 
Sector Public
Country United Kingdom
Start 10/2017 
End 10/2021
 
Description The Royal Society Wolfson Research Merit Award
Amount £25,000 (GBP)
Funding ID to be confirmed. 
Organisation The Royal Society 
Sector Charity/Non Profit
Country United Kingdom
Start 03/2015 
End 03/2020
 
Description Turing Project
Amount £26,680 (GBP)
Organisation Alan Turing Institute 
Sector Academic/University
Country United Kingdom
Start 10/2018 
End 09/2020
 
Title Grateful Dead project 
Description New ontological model for the representation of aligned recorded fragments of the same performance, based on the music ontology and timeline ontology. Other ontologies fail to describe different recordings of the same event in comparably detailed ways. -Computer model/ algorithm -used internally, yet unpublished 
Type Of Material Computer model/algorithm 
Provided To Others? No  
Impact N/A 
 
Title ILM10K dataset 
Description ILM10K dataset is a mood annotated music dataset of 10,000 tracks using the method developed in Pasi Saari, György Fazekas, Tuomas Eerola, Mathieu Barthet, Olivier Lartillot, Mark B. Sandler: (2016) Genre-Adaptive Semantic Computing and Audio-Based Modelling for Music Mood Annotation. IEEE Trans. Affective Computing 7(2): 122-135 (2016) 
Type Of Material Database/Collection of data 
Year Produced 2016 
Provided To Others? Yes  
Impact Not applicable at this time. 
URL https://www.computer.org/csdl/trans/ta/2016/02/07173419-abs.html
 
Title Multitrack Testbed (Team: QMUL) 
Description The goal of this project is to populate the recently developed Open Multitrack Testbed (multitrack.eecs.qmul.ac.uk), an online platform for storing, searching and browsing multitrack audio and mixtures thereof. It is a resource intended for but not limited to users such as researchers in MIR and intelligent music production, as well as sound engineering students and audio software developers. The researchers' aim is to realise the testbed's potential impact by including the most popular multitrack datasets around, complemented with extensive metadata. The idea of publishing a multi-track database has been raised several times and a few prior attempts have been made within the Queen Mary researchers' group. The project is led by Brecht De Man, who collected audio files for a number of multi-track recordings. György Fazekas (FAST IMPACt) advised on semantic technologies, having developed the Studio Ontology Framework which is being used in the testbed. Mariano Mora-Mcginity (also a FAST IMPACt team member) finished developing the testbed (barring solving any issues that may arise during the annotation) to a state in which it 1. shows all content for the user to browse through; 2. has a search interface to search and filter using any of the metadata fields; 3. allows an authorised user (password protected with customisable permission) to enter new metadata associated with audio on the testbed server (c4dm.eecs.qmul.ac.uk/ multitrack) or elsewhere on the web. The C4DM team has annotated over 600 multitracks have been annotated, comprising over 3000 individual tracks. Full details have been maintained about the instrumentation, genre, recording process, artifacts, attribution.... This is a sufficient number for this data to now be used in machine learning and data mining applications. It is contributing to research on music mixing practices and multitrack audio processing. 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Several researchers have referenced the testbed in their papers since its inception, and it was well received during a session on multitrack audio datasets of the Unconference at 15th Conference of the International Society for Music Information Retrieval in Taipei, Taiwan, November 2014. Furthermore, within C4DM the local multitrack repository is extensively used for research, but as the licenses are not open - or unclear - disseminating data and results is less than straightforward. This is especially a problem when funding bodies, journals or conferences require open data for sustainability and reproducibility purposes. The research team is positive that this resource, the first of its kind, has the potential of becoming the main resource for any researcher, student or developer who needs multitrack audio and mixtures thereof, provided it has the critical mass to become appealing as a go-to platform. It is evident that there is already a strong support base for this idea, and already extensive usage of the still limited dataset. Multitrack audio is a valuable resource for a wide range of audio professionals, educators, students, developers, and researchers. Many of these communities are not that aware of C4DM and its activities. Notably, this project is expected to have significant impact with music technology students and educators, who will use the content in learning and teaching music production skills. R&D areas in which large and diverse sets of high quality, multi-stream audio are essential in music information retrieval (MIR) research, development of improved music production tools, and tasks like audio source separation, audio segmentation and research in auditory perception. 
URL http://multitrack.eecs.qmul.ac.uk
 
Title Musical Mood Dataset 
Description Musical Mood Dataset: a Semantic Web dataset combining publication metadata of over 10,000 commercial tracks with crowd-sourced mood tags and arousal-valence coordinates. The musical mood dataset is a linked data verison of the ILM10K dataset that consists of samples from 10,199 commercial tracks from iLikeMusic1 (ILM). It combines audio recordings used in the Moodplay interactive experience with track metadata derived from MusicBrainz music encyclopedia and social tag data collected from Last.fm. The collection includes tracks from over 5,600 unique artists. The database also includes automatically annotated arousal and valence mood ratings for each track using the Affective Circumplex Transformation (ACT). This method ensures that coordinates obtained by applying Multi-dimensional Scaling (MDS) to crowd-sourced tags conform to locations of mood adjectives validated in human Psychological experiments. (See: P. Saari, G. Fazekas, et al.: Genre-Adaptive Semantic Computing and Audio-Based Modelling for Music Mood Annotation. IEEE Trans. Affective Computing 7(2): 122-135, 2016) 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Not applicable at this time. 
 
Title The Semantic Audio Feature Extraction Dataset SAFE-DB 
Description The Semantic Audio Feature Extraction Dataset (SAFE-DB) is a continually updating database of semantically annotated music production metadata, taken from an international user group of sound engineers. The data is taken from 4 audio effects: a dynamic range compressor, an overdrive distortion, a parametric equaliser and an algorithmic reverb. 
Type Of Material Database/Collection of data 
Provided To Others? No  
Impact Not applicable at this time. 
URL http://www.semanticaudio.co.uk/datasets/data/
 
Description Audio Feature Ontology (ongoing) 
Organisation Pompeu Fabra University
Department Music Technology Group (MTG)
Country Spain 
Sector Academic/University 
PI Contribution There is an ongoing collaboration with the Music Technology Group (MTG), UPF, Barcelona, Spain, to enhance the message response format of the AcousticBrainz project. AcousticBrainz hosts crowed-sourced acoustic features for research and retrieval purposes. The collaboration aims to facilitate the inclusion of a Linked-Data mechanism into AcousticBrainz so the data provided may be used in the context of the Semantic Web.
Collaborator Contribution There is an ongoing collaboration with the Music Technology Group (MTG), UPF, Barcelona, Spain, to enhance the message response format of the AcousticBrainz project. AcousticBrainz hosts crowed-sourced acoustic features for research and retrieval purposes. The collaboration aims to facilitate the inclusion of a Linked-Data mechanism into AcousticBrainz so the data provided may be used in the context of the Semantic Web.
Impact Prior work related to this activity has led to European Funding (H2020): Audio Commons (grant no 688382, running between 2016-2019) to build an ecosystem that supports the reuse of Creative Commons licensed audio content in the creative industries. The project includes work that uses the ontology developed by this activity.
Start Year 2015
 
Description CALMA (Computational Analysis of the Live Music Archive) 
Organisation Internet Archive
Country United States 
Sector Charity/Non Profit 
PI Contribution This is a collaboration between QMUL, U. of Manchester, Oxford, and the Internet Archive. Built data analysis framework using Vamp audio analysis plugins. Designed ontology to describe provenance of data processing. Built and published CALMA dataset containing audio features extracted from live sound recordings.
Collaborator Contribution Oxford contributed to ontology design and built data analytics framework in R and analysed key typicality over a large collection of recordings. IA provided access to Live Music Archive audio and metadata, Manchester contributed to publishing analysis and provenance data as linked data.
Impact Publications (there are reported under the FAST Publications Outcome), published datasets on the Semantic Web, completed data analysis. The project is multi-disciplinary involving, computer science, digital signal processing and musicology.
Start Year 2016
 
Description CALMA (Computational Analysis of the Live Music Archive) 
Organisation University of Manchester
Country United Kingdom 
Sector Academic/University 
PI Contribution This is a collaboration between QMUL, U. of Manchester, Oxford, and the Internet Archive. Built data analysis framework using Vamp audio analysis plugins. Designed ontology to describe provenance of data processing. Built and published CALMA dataset containing audio features extracted from live sound recordings.
Collaborator Contribution Oxford contributed to ontology design and built data analytics framework in R and analysed key typicality over a large collection of recordings. IA provided access to Live Music Archive audio and metadata, Manchester contributed to publishing analysis and provenance data as linked data.
Impact Publications (there are reported under the FAST Publications Outcome), published datasets on the Semantic Web, completed data analysis. The project is multi-disciplinary involving, computer science, digital signal processing and musicology.
Start Year 2016
 
Description CALMA (Computational Analysis of the Live Music Archive) 
Organisation University of Oxford
Department Department of Biochemistry
Country United Kingdom 
Sector Academic/University 
PI Contribution This is a collaboration between QMUL, U. of Manchester, Oxford, and the Internet Archive. Built data analysis framework using Vamp audio analysis plugins. Designed ontology to describe provenance of data processing. Built and published CALMA dataset containing audio features extracted from live sound recordings.
Collaborator Contribution Oxford contributed to ontology design and built data analytics framework in R and analysed key typicality over a large collection of recordings. IA provided access to Live Music Archive audio and metadata, Manchester contributed to publishing analysis and provenance data as linked data.
Impact Publications (there are reported under the FAST Publications Outcome), published datasets on the Semantic Web, completed data analysis. The project is multi-disciplinary involving, computer science, digital signal processing and musicology.
Start Year 2016
 
Description Collaboration on classification and phylogenetic tree construction of yodal tunes 
Organisation Lucerne University of Applied Sciences and Arts
Country Switzerland 
Sector Academic/University 
PI Contribution Cornelia Metzig (C4DM, QMUL) collaborated with Yannick Wey (Lucerbe) on classification and phylogenetic tree construction of yodel tunes. The paper is to be submitted to: Special Issue of Analytical Approaches to World Music.
Collaborator Contribution As above.
Impact No current update on paper publication. To be updated in due course.
Start Year 2019
 
Description Collaboration with BBC R&D with EP/L019981/1 
Organisation British Broadcasting Corporation (BBC)
Department BBC Research & Development
Country United Kingdom 
Sector Public 
PI Contribution BBC R&D is a partner on EP/L019981/1. Lead participant, Dr Frank Melchior attends our 6 monthly major meetings and guides lines of research within the project while we assist in their research around IP in the studio.
Collaborator Contribution BBC R&D is a partner on EP/L019981/1. Lead participant, Dr Frank Melchior attends our 6 monthly major meetings and guides lines of research within the project while we assist in their research around IP in the studio. Dr Melchior contributed to the writing of the proposal, especially at the early formation stages. Some principles they have been adopting within their technological development have been adopted within the project.
Impact To be completed.
Start Year 2014
 
Description Collaboration with Digital Delius project 
Organisation University of Oxford
Department Faculty of Music
Country United Kingdom 
Sector Academic/University 
PI Contribution Through participation in the Digital Delius project, we extended beyond our initially expected involvement to use a MELD annotation tool developed in Unlocking Musicology during a string quartet masterclass study in February 2018. This work then became part of a public event for Digital Delius at the British Library. The underlying MELD software framework used in this work was developed during the FAST project by the team at the University of Oxford e-Research Centre.
Collaborator Contribution The University of Oxford Faculty of Music organised and ran the string quartet masterclass, and the Digital Delius project.
Impact An informational video of the string quartet masterclass was produced and published by the Faculty of Music. The masterclass annotation experiment was included during presentations at a public event held at the British Library. The masterclass annotation experiment formed an element of the work reported in our paper reported elsewhere in this submission (doi:10.1145/3273024.3273038) The masterclass annotation experiment formed an element of our presentation at the "Scores of Scores" event reported elsewhere in this submission. This was a multi-disciplinary digital musicology collaboration, brining together aspects of computer science, information engineering, and musicology.
Start Year 2018
 
Description Collaboration with ISS Lab, Sofia Antipolis 
Organisation Laboratoire d'Informatique, Signaux et Systèmes de Sophia Antipolis
Country France 
Sector Public 
PI Contribution Dr Johan Pauwels started interacting with the team at ISS in 2019 and that collaboration continues still. We contributes expertise in signal analysis of musical audio and its linkage to Linked Data
Collaborator Contribution Partners contribute expertise in semantic linked data, especially as applied to music and contribute a data set known as WASABI
Impact One paper already published at the Web Audio Conference 2019 and one paper accepted for the ESWC 2021 conference. The former can be found here: https://webaudioconf.com/posts/2019_31/ and is listed as a publication from FAST programme grant. The latter is not yet published. Its title is "The WASABI dataset: cultural, lyrics and audio analysis metadata about 2 million popular commercially released songs" with full details and a pdf pre-print available here: https://openreview.net/forum?id=bGHPKFD6fM
Start Year 2019
 
Description Collaboration with Internet Archive: Exploration Tool for Grateful Dead Live Performances 
Organisation Internet Archive
Country United States 
Sector Charity/Non Profit 
PI Contribution 1. production of low-level and high-level audio feature data of the complete Grateful Dead collection of the Live Music Archive; 2. development of tools for the aggregation and analysis of topic-related information from a variety of sources on the conventional Web. This information can be in text, image, or video form; 3. development of a suitable data model for the representation of the data (including the audio feature data) on the Semantic Web; 4. Development of a Web App using the aforementioned data with a suitable GUI and data visualisation.
Collaborator Contribution 1. access to the audio material of the archive - this includes non-public lossless audio material, that is otherwise only available in streaming lossy format; 2. a virtual machine located at the Internet Archive for the processing of non-public audio material which should not be copied to outside servers.
Impact A Web application specifically developed for the exploration of Grateful Dead concerts will be the outcome. The project aims to demonstrate how Semantic Audio and Linked Data technologies can produce an improved user experience for browsing and exploring music collections. It is motivated by the ongoing interest in detailed descriptions of Grateful Dead performances, evidenced by the large amount of information available on the Web detailing various aspects of those events. The application links the large number of concert recordings by the Grateful Dead available in the Internet Archive with audio analysis data and retrieves additional information and artefacts (e.g. band lineup, photos, scans of tickets and posters, reviews) from existing Web sources, to explore and visualise the collection. Conversations with Bob George from the Archive of Contemporary Music (ARC) and Brewster Kahle from the Internet Archive have taken place. Both Bob George and Brewster Kahle are quite interested in this project. Bob George might be able to provide us with additional resources from archives about the Grateful Dead.
Start Year 2015
 
Description Collaboration with NYU for the creation of a guitar dataset with seperate string recordings (Johan Pauwels) 
Organisation New York University
Country United States 
Sector Academic/University 
PI Contribution Collaboration with NYU for the creation of a guitar dataset with separate string recordings. An acoustic guitar has been recorded and annotated with notes at NYU, for which Johan has created chord annotations, automatically derived from the annotated notes and sheet music. A writeup of the process has been submitted to the ISMIR conference and the dataset released upon its acceptance. The same procedure will be applied to future recordings at QMUL.
Collaborator Contribution Collaboration with NYU for the creation of a guitar dataset with separate string recordings. An acoustic guitar has been recorded and annotated with notes at NYU, for which Johan has created chord annotations, automatically derived from the annotated notes and sheet music. A writeup of the process has been submitted to the ISMIR conference and the dataset released upon its acceptance. The same procedure will be applied to future recordings at QMUL.
Impact A writeup of the process has been submitted to the ISMIR conference and the dataset released upon its acceptance. The same procedure will be applied to future recordings at QMUL.
Start Year 2018
 
Description Collaboration with Omnifone 
Organisation Omnifone
Country United Kingdom 
Sector Private 
PI Contribution Omnifone have installed QMUL audio feature extraction software into their audio signal processing workflow. They use our Sonic Annotator with VAMP plugins to extract features from the audio to assist with providing APIs to let third party companies create new music services. This is covered in an agreement. The company will provide QMUL with these features, which we will publish on the semantic web via SPARQL query point. This will enable researchers around the world, but especially at QMUL to do research on Big Music Data and Metadata.
Collaborator Contribution see above
Impact To be completed.
Start Year 2015
 
Description Collaboration with SUSTRANS: Musically accompanied walking experiences to motivate behaviour change in commuters 
Organisation Sustrans
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution Following initial discussions with Sustrans the research team at the MRL devised and undertook a mobile musically accompanied walking study. This prelimanary activity intends to inform and drive forward a larger scale research activity with Sustrans.
Collaborator Contribution To date Sustains have engaged in a series of preliminary discussions and a design workshop focused on devising a collaborative project around adaptive musical walking experiences to promote behaviour change in commuters who currently use car and public transport. Currently in stasis due to changes in Sustains staff, I.e., the primary contact has left their post. Some Sustains staff participated in the musically accompanied walking study listed above.
Impact There are as yet no formalised outcomes. The proposed project is interdisciplinary in nature (HCI, music theory, music production).
Start Year 2015
 
Description Collaboration with Tracy Readhead: prototype of a dynamic song app based on the Semantic Player Framework (in progress) 
Organisation University of Newcastle
Country Australia 
Sector Academic/University 
PI Contribution -Further development of the Semantic Player Framework to suit the ideas emerged from the collaboration (performance optimization) -implementation of an algorithm that automatically generates the dynamic music objects and mappings necessary for the experience -packaging the experience as an app for android
Collaborator Contribution -Composition and compilation of the audio material -design of the sensor mappings -Testing the app at various stages of iteration
Impact -Prototype of the app -Paper about the composition process submitted to NIME 2017
Start Year 2016
 
Description Collaboration with the B3 Media TalentLab programme (Mixed Reality Lab, Nottingham) 
Organisation B3 Media
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution The B3 Media partnership with Mixed Reality Lab, Nottingham, is now in its third year. The Mixed Reality Lab provide residency opportunities for establishing artists and practitioners to develop and realise project ideas. A number of participants have gone through this programme, the three stated here represent those who have worked within the FAST remit of audio/music: 1. Richard Ramchurn (2014/5) 2. Grant Smith (2016) 3. Lula Mebrahtu (2017) The following contributions are being offered by the MRL team: 1. Mentoring: Talent Lab participants are paired with MRL researchers who can offer advice and collaborative engagement with the participants area of interested. 2. Workshop and Lab space: as part of the residency, the MRL provides space and resources to support realisation of participant's project. 3. Technical support: Many of these participants are engaging with new novel technologies, the MRL provides access and expertise with these. Post programme support and opportunities: if appropriate for all parties, the MRL is open to further engagement with a Talent Lab artists.
Collaborator Contribution The B3 Media Talent Lab artists enable the MRL researchers to engage and collaborate with working practitioners. This in turn provides opportunities to situate, test out and extend existing research into the field, thus providing a deeper understanding of the implications of our research.
Impact Richard Ramchurn's successful Talent Lab residency concluded with him being offered a PhD studentship on the University of Nottingham's Centre for Doctoral Training, where he is placed in the Mixed Reality Lab. Grant Smith completed his Talent Lab residency and in doing so made new relationships with a range of other practitioners: for example Rachel Jacobs working in the field of streaming and performing data; Anthony Brown, who assisted in the development of solutions for networking remote microphones; and Alan Chamberlain and Patrick Brundell who have engaged with Grants deployable environmental microphones.
Start Year 2015
 
Description Deezer (with Mark Sandler) 
Organisation Deezer
Country France 
Sector Private 
PI Contribution Under this agreement, the company Deezer analyses its 50M track music collection using our music feature extractors and sends the feature data to QMUL. This has enabled QMUL to start new activities in Music Data Science.
Collaborator Contribution The company contributes access to its valuable music collection, its CPU time and then donates the features to QMUL.
Impact Outputs cannot be shared due to the IP value of the data. It is being used in current research.
Start Year 2017
 
Description FAST residency at QMUL with Tracy Redhead (Oct 2017) 
Organisation University of Newcastle
Country Australia 
Sector Academic/University 
PI Contribution A FAST Residency at QMUL took place on the 17 to the 24 October 2017 with Tracy Redhead, composer. A member of the Queen Mary team, Florian Thalmann, undertook work on dynamic music experiences, including small examples and a larger composition to be released next year. A joint specification of additional requirements for the Semantic Player FAST demonstrator was produced, both on a compositional and technical level. Tracy Redhead produced and provided musical material in the form of loops, our team provided the framework and mobile application. Tracy Redhead produced and provided musical material in the form of loops, the FAST Queen Mary team provided the framework and mobile application.
Collaborator Contribution Tracy Redhead produced and provided musical material in the form of loops, the FAST Queen Mary team provided the framework and mobile application.
Impact No known outputs or outcomes to date.
Start Year 2015
 
Description Goldsmiths (with C4DM) 
Organisation Goldsmiths, University of London
Country United Kingdom 
Sector Academic/University 
PI Contribution The collaboratiion with Goldsmiths may lead to collaborating on technology to use in our explorations in festivals.
Collaborator Contribution The collaboratiion with Goldsmiths may lead to collaborating on technology to use in our explorations in festivals.
Impact No outputs or outcomes to date.
Start Year 2017
 
Description Guitar dataset informal collaboration with NYU 
Organisation New York University
Country United States 
Sector Academic/University 
PI Contribution Two team members from Queen Mary (Sebastian Ewert and Johan Pauwels) started informal talks with NYU to exchange experiences with recording hexaphonic guitars. The collaboration started in 2017 and is still ongoing. So far this has led to a joint Late-breaking demo paper at ISMIR 2017 and will potentially lead to a larger collaborative publication in the future.
Collaborator Contribution Two team members from Queen Mary (Sebastian Ewert and Johan Pauwels) started informal talks with NYU to exchange experiences with recording hexaphonic guitars. The collaboration started in 2017 and is still ongoing. So far this has led to a joint Late-breaking demo paper at ISMIR 2017 and will potentially lead to a larger collaborative publication in the future.
Impact No outputs or outcomes known to date.
Start Year 2017
 
Description Intelligent Mixing Systems 
Organisation Luleå University of Technology
Country Sweden 
Sector Academic/University 
PI Contribution David Moffat's (C4DM, QMUL) collaboration with Nyssim Lefford (Lulea University of Technology) and Gary Bromham (C4DM, QMUL). Conducting research with aim of writing a paper in design and practice; discussion from Journal paper, that is being developed further with particular focus on certain work. Aim to submit paper by Jan 5, 2020.
Collaborator Contribution As above.
Impact The aim was to submit paper by Jan 5, 2020. No new updates so far.
Start Year 2019
 
Description Knowledge Representation and Reasoning Group of the Vrije Universiteit Amsterdam 
Organisation Free University of Amsterdam
Country Netherlands 
Sector Academic/University 
PI Contribution MIDI Linked Data Cloud
Collaborator Contribution MIDI Linked Data Cloud
Impact Data model to link MIDI files to the music Linked Data cloud
Start Year 2017
 
Description Locative Audio Experiences: The Rough Mile & B076 
Organisation Rough Trade Records
Country United Kingdom 
Sector Private 
PI Contribution Main research questions: to explore interactive (locative) audio experiences, to inform the requirements and subsequent developments of bespoke software for such experiences, and capture a deep understanding of the nature of them. The FAST IMPACT Nottingham team at the Mixed Reality Lab (MRL) supported Jocelyn Spence in designing and realising 'The Rough Mile' and B076 experiences. Specifically, this included the ongoing development and authoring of a bespoke software tool for interactive locative audio experiences entitled the DaoPlayer, which was used for 'The Rough Mile', and the collaboration with Florian Thalmann in extending the Semantic Player used for the B076 experience. The MRL provided complementary skills and experience in staging and studying the deployment of such experiences, alongside other resources and infrastructures required to support the process. The B076 experience is a collaboration and partnership with FAST IMPACt member, Florian Thalmann, C4DM, Queen Mary University of London and Jocelyn Spence. The Nottingham team worked with Florian Thalmann to extend and hone the existing functionality of the Semantic Player to enable the development, authoring and deployment of the B076 experience, which used iBeacons for indoor positioning.
Collaborator Contribution Jocelyn Spence led the design of 'The Rough Mile', a two-part locative experience for friends to engage with. The experience found participants undertaking an interactive audio narrative on the streets of Nottingham, which encouraged them to think about their friend and choose music for them to listen to in part two. Part two repeated the walk but re-authored around the music chosen in part one. Jocelyn brough a specific set of skills in designing and deploying interactive, novel performance work. This enabled her to lead the design of the Rough Mile experience. Jocelyn, also contributed to the design and development of the B076 audio experience. A second collaboration to 'The Rough Mile' project was 'Rough Trade Records', Nottingham. Rough Trade Records is a legendary independent record label that was at the epicentre of the punk explosion in 1976, who continue to champion high quality, imaginative, musically diverse and innovative independent music to this present day. Rough Trade Records hosted The Rough Mile experience (the walk commenced and finished at Rough Trade shop in Nottingham). They support the project with publicity and promotion, thus recruiting participants to undertake the experience. Florian Thalmann responded to the requirements of the B076 audio experiences as set out by the MRL team and Jocelyn Spence.
Impact The collaboration with Rough Trade Records and Jocelyn Spence was multi-disciplinary, bringing together the academic disciplines of Human Computer Interaction and Performance Studies alongside the commercial focus of Rough Trade Records. The main (hard) outcome was the realisation and deployment of the Rough Mile experience. Softer outcomes are found in the establishment of a relationship between Rough Trade Records and the Mixed Reality Lab, University of Nottingham. The collaboration with Jocelyn Spence is still active; the collaboration with Rough Trade Records ended in August 2016. The collaboration with Florian Thalmann, alongside other colleagues at Queen Mary University of London, has pushed forward the ongoing development of the Semantic Player. Parallel to this activity an ontology for Interactive Composition is being developed in collaboration, which will aims to inform and support composers working in this area with tools such as the Semantic Player and DaoPlayer.
Start Year 2016
 
Description Losing her Voice Opera 
Organisation University of Nottingham
Country United Kingdom 
Sector Academic/University 
PI Contribution Alan Chamberlain from the Nottingham FAST team collaborated with composer Elizabeth Kelly (Assistant Professor in Music Composition at the University of Nottingham in the UK) and her production team in the conceptualisation, design and preparation for the premiere performances of a new opera called Losing her Voice, with a particular focus on the integration of interactive technologies. "Losing Her Voice" brings to life in music and film the story of the early 20th-century American opera diva Geraldine Farrar who became a silent film star and performed Carmen silently in an acclaimed 1915 Cecil B. Demille film. Alongside celebrating Farrar's achievements, the opera explores ideas surrounding the cult of celebrity and the impact of social media. It was performed by professional soloists and musicians alongside University of Nottingham's talented student musicians. The production experimented with interactive technologies and encouraged audience engagement through a specially designed app. Audience interaction was encouraged (mobile devices were welcome). Composer Elizabeth Kelly Musical Director Calum Fraser Artistic Director Martin Berry This show took place at Djanogly Theatre, Nottingham Lakeside Arts at the following times and will last 2 hours including the interval. Saturday 6 April, 2.30pm Sunday 7 April, 7pm Website: https://www.nottingham.ac.uk/home/featureevents/2019/losing-her-voice.aspx
Collaborator Contribution Composition of a new opera (Composer) - design and creation of visual assets for performance (Digital Designer).
Impact None identified.
Start Year 2018
 
Description Muzimeld / Climb! 
Organisation Aalborg University
Country Denmark 
Sector Academic/University 
PI Contribution The FAST Oxford team have contributed a dynamic semantic notation system implementing our Music Encoding and Linked Data (MELD) framework.
Collaborator Contribution The Nottingham team have contributed the Muzicodes music pattern recognition and event triggering software. Muzicodes and the MELD semantic score system have been integrated in order to drive performances of Climb!, a gamified virtuoso composition by Maria Kallionpää, composer in residence, Aalburg University, Denmark.
Impact Publication and talk at the international conference New Interfaces for Musical Expression (NIME 2017). Disciplines: computer science (semantic web), digital signal processing, music composition, music performance.
Start Year 2016
 
Description NMC (with C4DM) 
Organisation Nursing and Midwifery Council
Country United Kingdom 
Sector Charity/Non Profit 
PI Contribution NMC is a contemporary music label. NMC could be relevant to MusicLynx, one of our demonstrator projects. Also might provide access to content. To be explored further.
Collaborator Contribution NMC is a contemporary music label. NMC could be relevant to MusicLynx, one of our demonstrator projects. Also might provide access to content. To be explored further.
Impact No outputs or outcomes to date.
Start Year 2017
 
Description New York Philharmonic Digital Archives 
Organisation New York Philharmonic
Country United States 
Sector Charity/Non Profit 
PI Contribution The New York Philharmonic orchestra were a partner in the Unlocking Musicology project. Specifically, we worked with the Archives team to use our semantic technologies, tools, and methods to create new methods for discovering and exploring content within the unique digital archives of the NY Phil.
Collaborator Contribution The New York Philharmonic Digital Archive team have provided expertise, motivation, and guidance in our development of novel tools for exploring archive content.
Impact This is a multi-disciplinary collaboration combining elements of computer science, information engineering, musicology, and the professional cataloguing and archiving activities of the NY Phil Archive. We used the MELD technology framework, originally developed in the FAST project, to create an interactive exploration of digital materials around the NY Phil Archive's interviews with current and past orchestra members - "Listening through Time".
Start Year 2018
 
Description Nottingham Game Music Festival (working title) 
Organisation Theatre Royal and Royal Concert Hall
Country United Kingdom 
Sector Private 
PI Contribution The Game Music Festival provides the Nottingham FAST team with an opportunity to contribute to a series of public events focused on the theme of Game and Film Music which is due to take place in January, 2018, Nottingham. The Nottingham team are planning to contribute two public experiences: (1) performance(s) of Climb! For Disklavier and Electronics and (2) a Dynamic locative audio soundtrack to be experienced on the streets of Nottingham City Centre. The former is an extension of the work described in June and August progress reports. Contribution to partnership has principally centred around discussions on the content and planning of events.
Collaborator Contribution The other partners (Nottingham Royal Centre: Concert Hall and Theatre Royal and Nottingham Video Game Arcade) have contributed to the development of their events, and discussions on the content and planning of Nottingham FAST team events.
Impact None as yet.
Start Year 2017
 
Description Outgoing visiting research to New York University (K Choi) 
Organisation New York University
Department Center for Data Science
Country United States 
Sector Academic/University 
PI Contribution Mark Sandler, George Fazekas, and Keunwoo Choi collaborated with Kyunghyun Cho for their research. They had regular Skype meetings to discuss research details and co-write the paper submitted to the 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
Collaborator Contribution Kyunghyun Cho supervised Keunwoo Choi for deep learning knowledge and implementations. In addition, CDS provided K Choi high-performance GPU servers. His work benefited from those facilities as it involves computationally extensive experiments.
Impact The most visible outcome of this collaboration is the conference paper by K. Choi, M. Sandler, G. Fazekas and K. Cho that has been accepted to the 42nd IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). The visiting enabled Choui to collaborate closely with researchers outside Queen Mary and gain knowledge of areas other than signal processing side of music information retrieval. He mainly worked with Dr. Brian McFee and Prof. Kyunghyun Cho from the Center for Data Science (CDS), New York University. He discussed many implementation details of his work with Dr. McFee who has deep knowledge and intensive experience of MIR and Python. As a result, Choi reported he improved his programming techniques. Working with Prof. Cho and other students who are doing their research on deep learning and natural language processing deepened his understanding on deep learning in general.
Start Year 2016
 
Description Oxford Illinois Digital Libraries Placement Programme 
Organisation University of Illinois
Country United States 
Sector Academic/University 
PI Contribution The Oxford FAST IMPACt team hosted a student studying for their Masters in Library and Information Science at the University of Illinois.
Collaborator Contribution The student worked with the Oxford team on the SALT software in June-August 2016. The Semantic Alignment and Linking Tool (SALT) enables the creation of bridging structures supporting unified access to music datasets.
Impact Not applicable at this time.
Start Year 2016
 
Description PRiSM Perception App Team 
Organisation Royal Northern College of Music
Country United Kingdom 
Sector Academic/University 
PI Contribution The FAST team in Oxford produced a mobile app (See also the software and technical products entry) for use during performances.
Collaborator Contribution The RNCM PRiSM team including Dr Michelle Phillips and Dr Emily Howard both gave feedback and tested the App. They also organised October's performance for the initial use of the App.
Impact PRiSM Perception App.
Start Year 2017
 
Description Semantic Audio Feature Extraction (SAFE) 
Organisation University of Birmingham
Country United Kingdom 
Sector Academic/University 
PI Contribution This project is a collaboration between the Digital Media Technologies (DMT) lab at Birmingham City University and QMUL. Designed SAFE plugin architecture for collecting metadata in music production. Designed SAFE ontology for describing the collected data.
Collaborator Contribution Built and released SAFE plugins in various formats compatible with several digital audio workstations. Set up data collection architecture.
Impact -A set of software plug-ins deployed. -Data collected and published about the application of audio effects -Papers published about the architecture and the analysis of the collected data.
Start Year 2015
 
Description Software Sustainability Instittute: Best practice for testing in DH software development 
Organisation Software Sustainability Institute
Country United Kingdom 
Sector Public 
PI Contribution As a project for the Software Sustainability Institute, team member Graham Klyne is assessing the most effective ways to implement software testing methodologies in the context of Digital Humanities projects. As a case study, Graham is implementing a test framework for the MELD software (Music Encoding and Linked Data, developed during the FAST project) as it has been deployed by the Unlocking Musicology project.
Collaborator Contribution The Software Sustainability Institute facilitates the advancement of software in research by cultivating better, more sustainable, research software to enable world-class research ("Better software, better research").
Impact Published code for software development testing (see repository link). Project report and recommendations.
Start Year 2020
 
Description TROMPA (EU Horizon 2020) 
Organisation Pompeu Fabra University
Country Spain 
Sector Academic/University 
PI Contribution In September 2018 Kevin Page participated in a project meeting of the EU Horizon 2020 project "TROMPA: Towards Richer Online Music Public-domain Archives". Following this collaboration, the TROMPA project have adopted the Music Encoding and Linked Data framework (MELD), developed at the University of Oxford during FAST, as a component within their emergent software architecture.
Collaborator Contribution The TROMPA project will use the MELD framework in the research and deliverables, contributing modifications and extensions back into the open source MELD code repository.
Impact None identified yet.
Start Year 2018
 
Description The Internet Archive (Live Music Archive) 
Organisation Internet Archive
Country United States 
Sector Charity/Non Profit 
PI Contribution This was a three-way collaboration between the AHRC-funded Unlocking Musicology project, the Internet Archive, and the EPSRC-funded FAST project. In earlier work, researchers from the FAST project at the University of Oxford and Queen Mary University of London had created a dataset (CALMA - Computational Analysis of the Live Music Archive), layering Linked Data metadata and computationally extracted features over audio recordings held in the Internet Archive's Live Music Archive. The University of Oxford team then created investigatory and analytic software tools (rCALMA) through which to empirically explore this data. In the Unlocking Musicology project, researchers at the University of Oxford e-Research Centre used the rCALMA tools to undertake a musicological investigation within the Live Music Archive, via the CALMA dataset. These investigations focussed on the music of the bands The Smashing Pumpkins and The Grateful Dead. For the latter, this was combined with archival research in the Grateful Dead Archives, part of the University of California Santa Cruz Libraries Special Collections.
Collaborator Contribution The Internet Archive contributed support, guidance, advice and expertise in accessing the Live Music Archive data. This was crucial for our initial musicological surveys of such a large-scale resource, both in terms of computational access, and identifying a fertile scope for beginning our studies.
Impact This is a multi-disciplinary collaboration combining elements of computer science, information engineering, musicology, and the cataloguing and archiving activities of the Internet Archive. Reflections on our initial musicological findings have been published as a 'microsite' on the Unlocking Musicology website.
Start Year 2018
 
Description Unimedia (with Mark Sandler) 
Organisation UNIMEDIA
Country Moldova, Republic of 
Sector Private 
PI Contribution Unimedia is a B2B music supplier (eg in retail stores)
Collaborator Contribution The partnership is at a preliminary stage. The company is concerned with processing large scale audio resources and calculating lots of features to use in research.
Impact No outputs or outcomes to date. The company has an agreement with C4DM, Queen Mary, that is in negotiation
Start Year 2017
 
Title Annalist 
Description Annalist is a "linked data notebook" for quickly creating semantic linked data on the web and experimenting with semantic web data models. 
Type Of Technology Webtool/Application 
Year Produced 2014 
Impact 1. Work with sound artist to capture and formalize a model of the creative process (2015) which has informed FAST work (e.g. plans and performances paper) 2. Use in FAST project to capture the Carolan Guitar's story as linked data (DMO prototyping experiment) 3. Use in FAST project to capture information about musical performance as linked data (DMO prototyping experiment) 
URL http://annalist.net
 
Title Grateful Dead project 
Description Prototype of a website that links data, music, and artifacts from concerts of the Grateful Dead, from various sources, and presents them to the user in a flexible way. Audio feature data and analytical information can be visualized in various ways and the audio from the Live Music Archive can be streamed directly on the site. 2016, not publicly released. 
Type Of Technology Software 
Year Produced 2016 
Impact Not applicable at this time. 
URL https://github.com/florianthalmann/grateful-dead
 
Title Harmonic Visualiser 
Description This software application analyses audio signals into component sinusoidal tracks (aka partials). It is capable of inferring where missing partials should be in the spectrum and annotating them in the representation. Additionally it is capable of measuring certain features in the collection of partials, such as vibrato. From there it can parameterise these and perform complex signal processing on them, such as removing the vibrato in a note or pasting in a different vibrato pattern. It has been developed over several years under a variety of funding. 
Type Of Technology Webtool/Application 
Year Produced 2015 
Impact This has been used is several projects local to Queen Mary and within Goldsmiths. It is not yet released for general usage, but is planned to be for late 2017. 
 
Title MusicWeb 
Description MusicWeb: a web platform that provides users a browsing, searching and linking platform of music artist and group information by integrating open linked semantic metadata from various Semantic Web, music recommendation and social media data sources. Artists are linked by various commonalities such as style, geographical location, instrumentation, record label as well as more obscure categories, for instance, artists who have received the same award, have shared the same fate, or belonged to the same organi- sation. These connections are further enhanced by thematic analysis of journal articles, blog posts and content-based similarity measures focussing on high level musical cate- gories. Realised in 2015/2016 
Type Of Technology Webtool/Application 
Year Produced 2016 
Impact Ongoing. 
URL http://musicweb.eecs.qmul.ac.uk
 
Title Musical Encoding and Linked Data (MELD) 
Description Semantic framework and technical architecture for distributed, real-time annotation of music 
Type Of Technology Webtool/Application 
Year Produced 2017 
Impact Development of this webtool / application is still ongoing. Demonstrators implementing and building on MELD were presented to international audiences at New Interfaces for Musical Expression (NIME 2017, Copenhagen), the International Musicological Society 20th Quinquennial Congress (Tokyo), and at the Music Encoding Conference (MEC 2017, Tours), with associated publications in proceedings. Climb!, a composition building on MELD and other technologies, was performed in Nottingham on July 8th, 2017. 
 
Title Muzicodes 
Description Muzicodes is a browser based application for incorporating machine-readable 'codes' into music that allows the performer and/or composer to flexibly define what constitutes a code, and to perform around it. These codes can then act as triggers, for example to control an accompaniment or visuals during a performance. The codes can form an integral part of the music (composition and/or performance), and may be more or less obviously present. 
Type Of Technology Webtool/Application 
Year Produced 2017 
Impact It was used to support the composition and performance of "Climb!" for Disklavier and Electronics. The software provides the basis of three academic publications to date. 
 
Title Numbers into Notes software 
Description Software: David De Roure, Numbers into Notes. Github Repository, https://github.com/davidderoure/NumbersIntoNotes 
Type Of Technology Software 
Year Produced 2016 
Open Source License? Yes  
Impact None known. 
URL https://github.com/davidderoure/NumbersIntoNotes
 
Title Numbers into Notes web application 
Description "Supposing, for instance, that the fundamental relations of pitched sounds in the science of harmony and of musical composition were susceptible of such expression and adaptations, the engine might compose elaborate and scientific pieces of music of any degree of complexity or extent." Ada Lovelace, 1843 The Numbers into Notes software is available on github; https://github.com/davidderoure/NumbersIntoNotes 
Type Of Technology Webtool/Application 
Year Produced 2016 
Impact The application has been used to support a variety of engagement events. 
URL http://demeter.oerc.ox.ac.uk/NumbersIntoNotes/
 
Title PRiSM Perception App 
Description A generic Android and iOS mobile app for recording feedback during a performance. 
Type Of Technology Software 
Year Produced 2017 
Impact The app has been used during a performance at the Royal Northern College of Music (RNCM) in Manchester in October with around 500 active participants. See event reported under appropriate section. 
 
Title Semantic Player Framework 
Description Semantic Player Framework, 2015-present, ongoing development, used internally within the project, as well as in a collaboration with Birmingham and University of Newcastle, Australia, no public release yet. The Semantic Music Player is a cross-platform web and mobile app built with Ionic and the Web Audio API that explores new ways of playing back music on mobile devices, particularly indeterministic, context-dependent, and interactive ways. It is based on Dynamic Music Objects, a format that represents musical content and structure in an abstract way and makes it modifiable within definable constraints. For each Dynamic Music Object, the Semantic Music Player generates a custom graphical interface and enables appropriate user interface controls and mobile sensors based on its requirements. When the object is played back, the player takes spontaneous decisions based on the given structural information and the analytical data and reacts to sensor and user interface inputs. The Dymo Designer is a prototypical web app that allows people to create and analyze Dynamic Music Objects in a visual, interactive, and computer-assisted way. The Semantic Player framework includes a number of npm packages which can be embedded in other web-based software. https://github.com/florianthalmann/semantic-player https://github.com/florianthalmann/dymo-core https://github.com/florianthalmann/dymo-designer https://github.com/florianthalmann/music-visualization https://github.com/florianthalmann/dymo-generator https://github.com/florianthalmann/example-dymos 
Type Of Technology Webtool/Application 
Year Produced 2015 
Impact Ongoing, no impact yet. 
URL https://github.com/florianthalmann/semantic-player
 
Title Software for HMM-based confidence measure 
Description Queen Mary team member (Johan Pauwels) published two code repositories related to the ISMIR 2017 paper "Confidence measures and their applications in music labelling systems based on hidden Markov models". One contains the reusable part in a mixture of C++ and Python (https://github.com/jpauwels/Hiddini), the other the Python code needed to recreate the experiments (https://github.com/jpauwels/chord-estimation-confidence). 
Type Of Technology Software 
Year Produced 2017 
Impact No notable impacts known. 
URL https://github.com/jpauwels/Hiddini
 
Description "Transforming Musicology: Looking to the Future", 8 December 2017 (D. De Roure, K. Page, D. Weigl) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Attendees were drawn from across the international musicology community (well beyond the AHRC project itself) who were with presented the FAST technologies in view of future musicological applications or adaptations. 40 attendees from across the international musicology community were invited to this day of talks and discussions, and poster presentations of new technologies, including poster presentations of FAST work (Numbers into Notes, MELD). The event led to discussions and ongoing queries about how these technologies can be applied to future musicological research.
Year(s) Of Engagement Activity 2017
 
Description 'The Gift of Algorithm', at: Testing Turing: unsettling legacies, 2 Oct 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Event: Testing Turing: unsettling legacies, The Alan Turing Institute. Speakers: Pip Thornton (Royal Holloway University of London, UK); Pip Willcox (Bodleian Libraries, University of Oxford, UK); Louise Amoore (University of Durham, UK). The human-machine relationship is often described in terms of agency and quiescence. To many, data science might seem like a domain where humans 'inject' their ideas into computers, and where their reconstruction occurs (or fails) at the touch of a key. But is this really such an unproblematic one-way relationship? This event questions the perceived lack of reciprocity in this relationship by making the machine the starting point of critique: what humanity remains in the system? To answer this question, three talks on diverse case studies in literature, music and security both tested and tried to make sense of what it is to be human in the age of big data and digital technology. As part of FAST research, Pip Willcox's talk (Oxford Bodleian Libraries, UK) discussed the work of Ada Lovelace and algorithmic music composition.
Year(s) Of Engagement Activity 2017
URL https://www.turing.ac.uk/events/testing-turing-unsettling-legacies/
 
Description 2nd International Workshop on Digital Libraries for Musicology (DLfM 2015), USA 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The 2nd International Workshop on Digital Libraries for Musicology (DLfM 2015) was held on the 24th June 2015, Knoxville, TN, USA. Kevin Page from the FAST Oxford team co-chaired this workshop, held in conjunction with ACM/IEEE JCDL 2015.
Year(s) Of Engagement Activity 2015
 
Description AI and Music (by M. Sandler) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Professor Mark Sandler presented his talk about the FAST project to researchers from across the whole Dipartimento di Elettronica,
Informazione e Bioingegeria (DEIB), Politecnico di Milano University. No direct outcomes are known yet.
Year(s) Of Engagement Activity 2018
 
Description Application of Semantic Audio Analysis to the Music Production Workflow, 139th Convention of the Audio Eng. Society 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 139th Convention of the Audio Eng. Society - Workshop: Application of Semantic Audio Analysis to the Music Production Workflow - György Fazekas (co-chair), Ryan Stables (co-chair), Jay LeBoeuf and Bryan Pardo (panelists). This was a workshop intended for audio engineers.The semantic player was demonstrated to show the potential of new music formats. Questions were raised regarding how to produce content for the format proposed. This influenced further research direction and collaborations.
Year(s) Of Engagement Activity 2015
URL http://www.aes.org/events/139/workshops/?ID=4703
 
Description Attendance of International Symposium on Musical Accoustics, Montreal 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The 2017 International Symposium on Musical Acoustics (ISMA) was held at McGill University, Montreal, Quebec, Canada from 18 - 22 June 2017.

The 2017 ISMA provided a focused, intimate forum with non-overlapping presentation and poster sessions on such topics as computer modelling of music instruments and the voice, experimental techniques for sound or instrument characterization, analysis and synthesis of sounds, visualisation and analysis of player-instrument interactions, music pedagogy, and human perception of music and sound. The event was hosted by the Computational Acoustic Modeling Laboratory in the Schulich School of Music at McGill University, together with the Centre for Interdisciplinary Research in Music Media and Technology, and was also co-sponsored by the Acoustical Society of America. Funding to support the symposium was provided by the Social Sciences and Humanities Research Council of Canada.
Year(s) Of Engagement Activity 2017
URL https://isma2017.cirmmt.mcgill.ca/
 
Description BBC 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Nottingham team hosted a one day visit by a team from BBC R&D to discuss new collaborations. They have visited the BBC in February 2016 for a follow-up conversation about possible musical projects in relation to their new 'Homelab' activity.
Year(s) Of Engagement Activity 2015
 
Description BBC DIRA! Forum: AI Impacts on Radio 13 Feb 2020 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact BBC holds an annual event for its Radio broadcast professionals. This year the theme was AI and Radio. Profs Sandler and Reiss each presented some of the outcomes from the FAST project and were the only academics present.

Title: DIRA! Forum: AI impacts on Radio on 13/2/20
Year(s) Of Engagement Activity 2020
 
Description BBC Music Podcast, 21 December 2018: Music by Numbers. 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact This is a magazine article by David De Roure, Music by Numbers. BBC Music Magazine, January 2019. Immediate Media London Company Limited. Pp 42-6. ISSN: 0966-7180. Features in BBC Music Podcast, 21 December 2018, available from http://www.classical-music.com/podcasts (download URL is http://cdn.immediatecontent.com/bbcmusic/Podcast/Music_2019_01-v2.mp3 12'10"-14'49'').
Year(s) Of Engagement Activity 2019
URL http://cdn.immediatecontent.com/bbcmusic/Podcast/Music_2019_01-v2.mp3
 
Description Bela Workshop at STEIM, Amsterdam (F. Morreale, G. Moro, A. McPherson, A. Chamberlain) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The Bela Workshop took place on the 10th, 11th & 12th of August, 2016, STEIM, Achtergracht 19, 1017WL, Amsterdam. Participants of the workshops (academics and artists) used Bela (http://bela.io), a new embedded audio / sensor platform based on the BeagleBone Black which provides submillisecond latency between action and sound, and which replaces the need for a laptop and external microcontroller boards such as Arduino to create digital musical instruments.

The programme of the workshop included:
- a comprehensive hands-on introduction to developing with Bela;
- a number of design activities aimed at elaborating ideas and objectives when designing DMIs;
- a prototyping session where members of STEIM and C4DM will help participants port their instruments to Bela
- a test/evaluation session;
- a concluding performance or demo with the newly built instrument.

A major goal of the workshop was to make the new instrument designs from the workshop sustainable by thoroughly documenting the process of building and using the instrument. In addition to the new artefacts created in the workshop, we released documentation that allowed others in the community to replicate and modify the instruments. In addition to technical help, the organising team helped the participants document their efforts as they went along, recording short interviews as part of a research study on digital musical instrument sustainability.
Year(s) Of Engagement Activity 2016
URL http://bela.io
 
Description Between chaos and control: compositional & computational approaches to alchemy inspired sonification 21 April 2017 (A. Chamberlain and D. Roberts) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact This was a presentation "Between chaos and control: compositional & computational approaches to alchemy inspired sonification" given at "The Music of Sound" Symposium, 21st of April 2017, University of Oxford, E-Research Centre. It emerged based on Nottingham team's work from FAST, evolving from a series of compositional studies and related to the relationships made at the Interconnected Alchemy Conference. Around twenty (20) people attended the group, which was a mix of people ranging from composers and sound artists, to academics and archivists - this went beyond our normal peer group and usual academic partners (interdisciplinary). The event was primarily UK-based. We were able to discuss our work and give examples of an emergent area of research, this was combined with compositional pieces that then related back to humanities-based research. The most significant part of this event was the contacts that were made with students who exchanged ideas with senior staff and this has led to the submission of short papers and performances to the "Audio Mostly" Conference.
Year(s) Of Engagement Activity 2017
URL http://www.semanticaudio.ac.uk/news/fast-partners-at-the-music-of-sound-symposium-21-april-oxford/
 
Description Carolan guitar blog (Nottingham) 
Form Of Engagement Activity Engagement focused website, blog or social media channel
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Over a period of a fifteen months the Carolan guitar engaged over 50 players, including visiting 6 homes, being played at 3 gigs, taking part in 2 recording sessions, visiting 8 clubs or jam sessions, hosting an 'open mic' event in Liverpool, residing in a shop and undertaking an international road-trip. These activities were documented in in over 50 posts on Carolan's blog www.carolanguitar.com. To date this has been
visited by 7,000 people, receiving 23,000 views. A video about Carolan published on the Computerphile youtube channel (https://www.youtube.com/watch?v=tyjgn5YO1Lk) has received 72,000 views to date.
Year(s) Of Engagement Activity 2015
URL http://www.carolanguitar.com
 
Description Chairing Music Encoding Conference 2019 (Vienna) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Kevin Page from the Oxford FAST team was Programme Chair of the Music Encoding Conference 2019, held in Vienna in May 2019. Over 100 people attended the Music Encoding Conference in Vienna, a 4 day conference which has emerged as the foremost international forum where researchers and practitioners from across these diverse fields can meet and explore new developments in music encoding and its use. The Conference celebrates a multidisciplinary programme, combining the latest advances from established music encodings, novel technical proposals and encoding extensions, and the presentation or evaluation of new practical applications of music encoding (e.g. in academic study, libraries, editions, commercial products).
Year(s) Of Engagement Activity 2019
 
Description Chairing session: Sound event detection and classification at EUSIPCO 2018, Sept 3-7, Rome Italy. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas chaired the session "Sound event detection and classification" (AASP-L2 Wednesday, September 5, 10:30 - 12:30) at 26th European Sig. Proc. Conference (EUSIPCO 2018), Sept 3-7, Rome (Italy) in front of an audience of approx. 90 professional practitioners and researchers.
Year(s) Of Engagement Activity 2018
 
Description Chairing workshop The IEEE FRUCT International Workshop on Semantic Audio and the Internet of Things ISAI18, Bologna, 14-15 Nov 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas chaired the workshop in front of an international audience of up to 50 professional practitioners and researchers, promoting the use of Semantic Audio to the IoT community. As a result he was invited to give a keynote lecture at the 24th FRUCT conference.
Year(s) Of Engagement Activity 2018
URL https://www.fruct.org/imsa18
 
Description Chairing workshop: The IEEE FRUCT International Workshop on Semantic Audio and the Internet of Things ISAI18 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 1) George Fazekas chaired the workshop "The IEEE FRUCT International Workshop on Semantic Audio and the Internet of Things ISAI18", Bologna (Italy) on 14-15 November 2018. This activity facilitated the promotion of the use of Semantic Audio to the IoT community. This also led to his invitation to give a keynote talk at the 24th FRUCT conference.
Year(s) Of Engagement Activity 2018
 
Description Charing a session at First International Music Workshop on Multilayer music representation and processing, MIlan, Italy 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact See above.
Year(s) Of Engagement Activity 2019
 
Description Climb! Performance at the Iitallia Music Festival Iitallia, Finland, June 2018. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Maria Kallionpää, Adrian Hazzard and Hans-Peter Gasselsider presented a live performance and talk about the FAST project "Climb!" at the Iittala Music Festival, Finland.
Year(s) Of Engagement Activity 2018
 
Description Climb! Performance at the Reflective Conservatoire Conference, February 2018, Barbican, London 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Maria Kallionpää, Adrian Hazzard and Glenn McGary presented a live performance and talk about the FAST project "Climb!". The conference placed a focus on musicology and contemporary classical performance, thus presenting "Climb!" to a new audience.
Year(s) Of Engagement Activity 2018
 
Description Co-chairing Digital Libraries for Musicology workshop 2016 (Kevin Page, Oxford) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact The Digital Libraries for Musicology (DLfM) workshop is a satellite event of ISMIR 2016. Kevin Page Co-chaired the workshop. The event had an attendance of 45 people (from academia, industry, galleries/libraries/museums sector). Date: August 2016, New York.

David Weigl (Oxford FAST IMPACt team member) gave a presentation at DLfM 2016: "In Collaboration with In Concert: Reflecting a Digital Library as Linked Data for Performance Ephemera".

For more information about the workshop, see:
http://www.transforming-musicology.org/dlfm2016/
Year(s) Of Engagement Activity 2016
URL http://www.transforming-musicology.org/dlfm2016/
 
Description Co-charing 1st international workshop on Semantic Applications for Audio and Music 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas (Queen Mary) and Kevin Page (Oxford) co-chaired the 1st International Workshop on Semantic Applications for Audio and Music , 9th October 2018, Monterey, California, USA, held in conjunction with ISWC 2018. The workshop was organised by FAST, allowing both the promotion of the project and the research. Fazekas's participation in the organisation of the workshop led to an invitation to talk at Gracenote (mentioned seperately in the report) and IA.
Year(s) Of Engagement Activity 2018
URL http://saam.semanticaudio.ac.uk
 
Description Collaboration and knowledge transfer discussions with BBC 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Kevin Page and David Weigl from the FAST Oxford team visited BBC R&D to discuss their work, in conjunction with BBC Radio, on the SALT and SLoBR tools, with a view to further use across BBC data and the Corporation's requirements for DMOs.
Year(s) Of Engagement Activity 2015
 
Description Collaboration with Di Wilshire 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The Nottingham team have collaborated with the artist Di Wilshire to create an interactive sound installation called Sentiment. This features a series of provocative audio interviews with people that are edited to be played over a circular array of speakers, with the mix being controlled by the listener's movement in the space. Di also recorded galvanic skin response data from interviewees (a possible measure of stress) that is also played back to listeners using a wearable tactile device. Sentiment premiered at FACT in July 2015 and is now being extended ready touring with support from an Arts Council grant.
Year(s) Of Engagement Activity 2015
 
Description Collaboration with artist Albino Mosquito 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Nottingham University team have collaborated with the artists group Albino Mosquito to produce an interactive film (with soundtrack) called #Scanners that is controlled through a braincomputer interface. This was exhibited first at the ACM's Creativity and Cognition conference and then at FACT in July 2015. The following video trailer produced by the artists documents the experience as it appeared at FACT:
https://vimeo.com/135983464
Year(s) Of Engagement Activity 2015
URL https://vimeo.com/135983464
 
Description Collaboration with artist Caroline Locke 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The Nottingham team have collaborated with artist Caroline Locke who has developed an artistic interface called sound fountains in which sound in visualised through the activation of water (see: http://www.weareprimary.org/people/caroline-locke/). Caroline exhibited a version of sound fountains connected to a live data stream at FACT and is currently exploring how to Twork with us further extend her approach.
Year(s) Of Engagement Activity 2015
URL http://www.weareprimary.org/people/caroline-locke/
 
Description Collaboration with artist Tracy Redhead 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Recording artist and academic Tracy Redhead was invited to describe her work on a flexible music format to a QMUL FAST meeting. Her ways of working will inform the project's activities on Digital Music Objects.
Year(s) Of Engagement Activity 2015
 
Description College musical performance ("Manchester, The Music of Proof") 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact A talk and performance on mathematics and music open to the public. Covered in New Scientist. Four hundred people attended the event. The talk was given by the Oxford team members David de Roure and Matthew Wilcoxson. It also included a demonstration of how feedback can be taken with mobile phones during live performances by the general public. In addition, de Roure and Wilcoxson collected emails of around 100 people who would consider attending future performances of this nature.
Year(s) Of Engagement Activity 2017
 
Description Conference Presentation at the Audio Mostly Conference, Norrkoping, Sweden (Benford, Chamberlain, Hazzard, Greenhalgh) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact 75 people attended the presentation. The most notable impact or outcome was the introduction of this work - via a published paper- into the international academic community on audio. This conference presentation acted as a catalyst for discussion around the Muzicodes work with a new community of researchers.
Year(s) Of Engagement Activity 2016
 
Description D-Box paper presentation and demo at ACM Designing Interactive Systems Conference, Brisbane, Australia, July 2016. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The D-Box demo provided an opportunity for conference delegates to configure, reconfigure and play the D-Box, while discovering more about an instrument designed to promote exploratory play.

Approximately 15 participants played the D-Box, and discussed the underlying concepts of exploratory play and design of such instruments. This led to discussion around similar and related work and the forming of networks between academics.
Year(s) Of Engagement Activity 2016
 
Description D-box workshops 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Performers often find ways of playing musical instruments that differ from the designer's original intent. Two "hackable instruments" sessions to explore creative and unexpected uses of digital instruments were organised as workshops:

1) D-Box, FACT, Liverpool, 14th of July 2015
Each participant received a D-Box,, a simple electronic instrument that has been purpose-designed to be as hackable as possible. D-Boxes can be opened up and then completely rewired to produce new sonic effects. Participants learned to play, explore and modify their D-Boxes, share these skills with others and swap instruments to compare hacks.

2) D-BOX workshop as part of Being Human, A Festival of the Humanities, London 2015 16th November.
As above.
Year(s) Of Engagement Activity 2015
URL http://www.fact.co.uk/whats-on/current/the-mrl-d-box-instrument-hack-workshop.aspx
 
Description DReAM Lab workshop: Linked Data for the Humanities 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Dream Lab (Digital Resources and Methods) is a week-long digital humanities training opportunity hosted at the University of Pennsylvania and designed to help humanists become more confident and thoughtful users, creators and critics of digital technology.

19 people attended the 'Linked Data for the Humanities: a semantic web of scholarly data' workshop run and taught by Kevin Page and David Lewis. This drew upon data and tools developed at the University of Oxford e-Research Centre, including from the FAST, Unlocking Musicology, Linked Art, and Mapping Manuscript Migrations projects.

Delegates left the workshop with practical experience, new knowledge, and enthusiasm for Linked Data approaches, alongside new familiarity with these projects.
Year(s) Of Engagement Activity 2019
 
Description DUPLICATE: Co-chairing workshop: 1st Intl' Workshop on Semantic Applications for Audio and Music (held in conjunction with ISWC 2018.) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas and Kevin Page co-chaired workshop: 1st Intl' Workshop on Semantic Applications for Audio and Music , 9th October 2018, Monterey, California, USA,
(held in conjunction with ISWC 2018.). The workshop was sponsored by FAST and Audio Commons, promoting semantic audio to the Semantic Web community and industry (panelists included researchers, managers from Gracenote/Nielsen, Pandora, Internet Archive).
Year(s) Of Engagement Activity 2018
 
Description DUPLICATE: Presention of FAST to the research team at Gracenote/Nielsen in Emeryville, CA, USA 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact George Fazekas presented the FAST project to the research team at Gracenote/Nielsen in Emeryville, CA, USA 18, Oct. 2018.
Year(s) Of Engagement Activity 2018
 
Description DUPLICATE: Talk at the Alibaba Computing Conference, Hangzhou, China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Talk by George Fazekas at the Alibaba Computing Conference, Sept. 19-22, 2018, Hangzhou, China. He talked about intelligent music production at this large public event in China, including some FAST outcomes e.g. SAFE compressor and data analysis from music production. The two most significant outcomes were:
1) invitation to talk at AliMusic, Hangzhou, China
2) Alibaba / AliMusic supporting UK-China Creative Industries Partnership Development Grant, titled "AI and Music in the Creative Industries of China and the UK", which got funded by AHRC in 2019.
Year(s) Of Engagement Activity 2018
 
Description Data Scholarship for the Humanities, July 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The Oxford e-Research Centre Digital Humanities team organised and hosted a workshop on "Data Scholarship for the Humanities" on 5th July 2019. 15 attendees gained hands-on practical experience and new skills in learning to investigate datasets using computationally extracted features (e.g. from the HathiTrust Digital Library).
Year(s) Of Engagement Activity 2019
 
Description Demo of Jam with Jamendo/Deezer at ICASSP and SMC conferences, 2019. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact Jam with Jamendo/Deezer (work by Johann Pauwels, C4DM and FAST member) was presented on two occasions at the ICASSP and a the 16th Sound and Music Computing conference Malaga to a mixed crowd of academics from various backgrounds and musicians. Participants were invited to search a large catalogue of music for suitable practice material, by querying for certain chord combinations.
Year(s) Of Engagement Activity 2019
 
Description Demonstrations and posters at ISMIR 2016 (Oxford team) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact ISMIR is the premier international conference on music information retrieval. 2016's demonstration session was, for the first time, open to the public, as well as to the academics and industry representatives attending ISMIR. The Oxford FAST IMPACt team presented their three poster/demos side-by-side, sparking interesting discussions about the individual demos as well as on the wider FAST project:
1) "Numbers into Notes: Cast your mind back 200 years", D. de Roure, P. Willcox, and D. M. Weigl
2) "Dynamic Semantic Notation: Jamming together Music Encoding and Linked Data", D. M. Weigl and K. R. Page
3) "MIR user studies through the lens of relevance: Promoting the impact of MIR user research", D. M. Weigl, D. Steele, J. C. Bartlett, & C. Guastavino
Year(s) Of Engagement Activity 2016
URL https://wp.nyu.edu/ismir2016/
 
Description Digital Collaborations: crowds, experiments, inspiration (Summer School Lecture, Oxford) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Summer school lecture: Pip Willcox, "Digital Collaborations: crowds, experiments, inspiration" at Public Engagement with Research Summer School, TORCH, University of Oxford. July 2018.
Year(s) Of Engagement Activity 2018
 
Description Digital Delius: Unlocking Digitised Music Manuscripts" event and panel at the British Library (Kevin Page) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Kevin Page participated on a panel at the "Digital Delius: Unlocking Digitised Music Manuscripts" at the British Library with an audience of interested members of the general public. The event took place on 1 October 2018.

50 members of the public attended the free "Digital Delius: Unlocking Digitised Music Manuscripts" event at the British Library, which included a performance and a panel. During the panel an enhanced digital article was demonstrated and discussed, which was built using the FAST project's MELD platform.
Year(s) Of Engagement Activity 2018
 
Description Digital Humanities at Oxford Summer School 2017 (P. Wilcox, D. de Roure, J. Pybus, G. Klyne, K. Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The Summer School offers training to anyone with an interest in the Digital Humanities, including academics at all career stages, students and project managers. This year 185 participants from over 30 countries will converge at St. Anne's College to discuss the latest in research and practice in Digital Humanities. Numerous contributions to the organisation and teaching of the Digital Humanities at Oxford Summer School from the FAST project were given. David De Roure and Pip Willcox co-directed the event, while Graham Klyne and Kevin Page contributed to the Linked Data workshop. In addition, three week long workshops were convened by project members, which are reported in separate entries.
Year(s) Of Engagement Activity 2017
URL http://digital.humanities.ox.ac.uk/dhoxss/2017/
 
Description Digital Humanities at Oxford Summer School 2018 (other contributions) (Pip Willcox, David De Roure) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The Summer School offers training to anyone with an interest in the Digital Humanities, including academics at all career stages, students and project managers. This year 220 participants from over 30 countries converged at Keble College to discuss the latest in research and practice in Digital Humanities. David De Roure and Pip Willcox directed the event. In addition, three week long workshops were convened by project members, which are reported in separate entries.

Graham Klyne presented at a poster session in the Bodleian Library, the topic of which included linked data modelling patterns that came out of FAST work on describing musical performances, and also context-recording patterns using ideas from MELD.
Year(s) Of Engagement Activity 2018
 
Description Digital Music Research Network (DMRN+12) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The Digital Music Research Network (DMRN+12) is organised annually by the C4DM at Queen Mary in December. For the past three years, it has received sponsorship from the FAST project. Among other, Oxford FAST team presentations of Climb!, Numbers into Notes, and MELD integrations were given, followed by networking activities. The Oxford team presented work around the FAST performance demonstrator theme, under the title "FAST forward to the semantics of design for musical performance", to a crowd of digital music researchers from across the UK and beyond. Dave de Roure and David Weigl shared a 20 minute presentation slot, covering Climb!, Numbers into Notes, and MELD integrations. These demonstrators, and their implications on the formulation of Digital Music Objects, were discussed with numerous attendees during the coffee sessions and at the pub after the event.
Year(s) Of Engagement Activity 2017
URL https://qmro.qmul.ac.uk/xmlui/bitstream/handle/123456789/30583/ID%3a%2097442919-02C3-424B-9C18-B08D3...
 
Description Digital Musicology workshop at Digital Humanities at Oxford Summer School 2016 (organised and run by Kevin Page). 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Kevin Page (Oxford) organised and ran the Digital Musicology workshop at Digital Humanities at Oxford Summer School. The workshop was attended by 19 registrants (students, academics, industry). Date: July 2016, Oxford. Reach: International reach.

More information about the workshop and FAST participation can be found in our FAST news item:
http://www.semanticaudio.ac.uk/news/fast-partners-participate-in-the-digital-humanities-at-oxford-summer-school/

The workshop website:
http://digital.humanities.ox.ac.uk/dhoxss/2016/workshops/digitalmusicology
Year(s) Of Engagement Activity 2016
URL http://digital.humanities.ox.ac.uk/dhoxss/2016/workshops/digitalmusicology
 
Description Digital Musicology workshop at Digital Humanities at Oxford Summer School 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact Kevin Page (Oxford) convened and organised a one week Digital Musicology summer school workshop; David Weigl (Oxford) and Chris Cannam (QMUL) ran sessions within a one week Digital Musicology summer school workshop.

12 workshop delegates attended a week long summer school workshop led by the e-Research Centre team. Attendees from across academia (postgraduate students to
professors), industry, and third sector (libraries and cultural heritage) learnt about the use of digital tools and methods for investigating audio and symbolic encodings of music, and the application of semantic technologies for linking resultant workflows and data.
Year(s) Of Engagement Activity 2018
 
Description Digital Musicology workshop at the Digital Humanities at Oxford Summer School 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Members of the Unlocking Musicology and FAST project teams organised and led teaching for the Digital Musicology workshop at DHOxSS 2019 between the 22nd and 26th July 2019. The convener was Kevin Page. The workshop is one of few opportunities worldwide to learn about practically applying computational and informatics approaches to music and musicology during a single week-long course. The workshop was attended by 18 people from a variety of backgrounds (academic, libraries, archives, industry).
Year(s) Of Engagement Activity 2019
 
Description Digital Musicology: An Interdisciplinary Perspective - talk at Digital Humanities at Oxford online 2021 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Kevin Page delivered the presentation 'Digital Musicology - An Interdisciplinary Perspective' to a plenary session of the 2021 Digital Humanities at Oxford online event (held as an alternative to the usual in-person Digital Humanities Summer School).
Year(s) Of Engagement Activity 2021
 
Description Digital Musicology: Applied Computational and Informatics Methods for Enhancing Musicology, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Digital Musicology: Applied computational and informatics methods for enhancing musicology, Monday 20 - Friday 24 July 2015, Oxford

This workshop at the Digital Humanities at Oxford Summer School was organised by Kevin Page, supported by David Weigl. Several other members of the FAST project team also presented to attendees from academia and industry.
Year(s) Of Engagement Activity 2015
 
Description Digital musicology workshop at the Digital Humanities at Oxford Summer School 2017 (K. Page and D. Weigl) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact This is an annual workshop that took place in summer 2015, 2016, and 2107. FAST Oxford team members Kevin Page and David Weigl convened and organised a one week Digital Musicology summer school workshop (K. Page); and ran sessions within a one week Digital Musicology summer school workshop (D. Weigl). Chris Cannam (Queen Mary project team member) also participated in the workshop. Nineteen (19) workshop delegates attended a week long summer school workshop led by the e-Research Centre team. Attendees from across academia (postgraduate students to professors), industry, and third sector (libraries and cultural heritage) learnt about the use of digital tools and methods for investigating audio and symbolic encodings of music, and the application of semantic technologies for linking resultant workflows and data.
Year(s) Of Engagement Activity 2015,2016,2017
URL https://digital.humanities.ox.ac.uk/dhoxss/
 
Description Experience the Carolan Guitar, interactivity demo at ACM CHI 2016, San Jose, USA, May 2016. 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Experience the Carolan Guitar' was an opportunity for conference delegates to spend some time playing the Carolan Guitar and scan its embedded Artcodes patterns. Alongside this practical activity participants could discuss the concepts of instrumenting instruments, artcodes, accountable artefacts (physical objects with digital records of their use and function). Their performances were captured and uploaded to its blog (www.carolanguitar.com), thus contributing to the history of the instrument's usage.

Approximately 30 participants played the Carolan guitar, most of which contributed a video recorded performance, discussed the underlying concepts of Artcodes, and accountable artefacts. This led to discussion around similar and related work and the forming of networks between academics.

The most signiticant impact was the dissemination of work to a broad HCI audience alongside their 'performed' contribution to the Carolan Guitar's digital history.
Year(s) Of Engagement Activity 2016
URL http://www.carolanguitar.com
 
Description Experimental Humanities: the case study of Lovelace and Babbage (Digital Practices in the Humanities Software Sustainability Institute workshop) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Workshop talk: Pip Willcox, "Experimental Humanities: the case study of Lovelace and Babbage", Digital Practices in the Humanities Software Sustainability Institute workshop, Oxford e-Research Centre and the Bodleian Libraries' Centre for Digital Scholarship, University of Oxford, UK, June 2018.

The workshop addressed the full range of digital toolmaking and use in the humanities and seeks to address questions such as:

How do humanities researchers find out about, make, commission or use software tools?
To what extent is software considered a research output? How does making software influence other outputs?
How are software and other digital outputs designed, funded, supported and sustained in the humanities?
What kinds of training do digital humanists require?
What career pathways exist for digital practitioners and research software engineers in the humanities?
How far do digital practices in the arts and humanities intersect with their use outside academia, such as in the creative industries and the media?
How does the digital humanities relate to humanities work as critical practice?
How do digital humanists engage with colleagues in other disciplines, inside and outside the humanities, and other audiences? Are DH outputs open, accessible and accountable, and do they apportion fair credit?
Year(s) Of Engagement Activity 2018
 
Description FACT 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact In July 2015 the Nottingham team hosted a public exhibition and series of associated workshops at the Foundation for Art and Creative technology (FACT) a major UK venue for interactive art in Liverpool. Themed under the general banner of 'Performing Data', this included several pieces of work that were produced by or with support from the Fast project, including works by the artists Albino Mosquito, Di Wilshire and Caroline Locke discussed below as well as a workshop to learn to hack the D-Box musical instruments that have been created by Andrew McPherson and his team from QMUL.
Year(s) Of Engagement Activity 2015
 
Description FAST Industry Day Abbey Road Studios 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Music's changing fast: FAST is changing music. Showcasing the culmination of five years of digital music research, the FAST IMPACt project (Fusing Audio and Semantic Technologies for Intelligent Music Production and Consumption) led by Queen Mary University of London hosted an invite only industry day at Abbey Road Studios on Thursday 25 October, 2 - 8 pm. Presented by Professor Mark Sandler, Director of the Centre for Digital Music at Queen Mary, the event showcased to artists, journalists and industry professionals the next generation technologies that will shape the music industry - from production to consumption.

FAST is looking at how new technologies can positively disrupt the recorded music industry. Research from across the project was presented to the audience, with work from partners at the University Nottingham and the University of Oxford presented alongside that from Queen Mary. The aim being that by the end of the FAST Industry day, people would gain some idea how AI and the Semantic Web can couple with Signal Processing to overturn conventional ways to produce and consume music. Along the way, industry attendees were able to preview some cool and interesting new ideas, apps and technology that the FAST team showcased.

One hundred and twenty (120) attendees were treated to an afternoon and evening of talks demonstrations, the Climb! performance, and an expert panel discussion with Jon Eaves (The Rattle), Paul Sanders (state51), Peter Langley (Origin UK), Tracy Redhead (award-winning musician, composer and interactive producer, University of Newcastle, Australia), Maria Kallionpää (composer and pianist, Hong Kong Baptist University) and Mark d'Inverno (Goldsmiths) who chaired the panel. Rivka Gottlieb, harpist and music therapist, performed some musical pieces based on her collaboration with PI David de Roure and the project 'Numbers into Notes', Oxford e-Research Centre, throughout the day. Oxford e-Research Centre, throughout the day. Other speakers included George Fazekas who outlined the Audio Commons Initiative, Tracy Redhead and Florian Thalmann who presented their work on the semantic player technologies and Ben White who spoke about the Open Music Archive project (exploring the intersection betweeen art, music and archives).

The FAST Industry Day was opened by Lord Tim Clement-Jones (Chair of Council, Queen Mary University of London) and was compered by Professor Mark d'Inverno (Professor of Computing at Goldsmiths College, London).

Below are some highlights of the FAST technologies demonstrated on the day:

Carolan Guitar: Connecting Digital to the Physical - The Carolan Guitar tells its own story. Play the guitar, contribute to its history, scan its decorative patterns and discover its story. Carolan uses a unique visual marker technology that enables the physical instrument to link to the places it's been, the people who've played it and the songs it's sung, and deep learning techniques to better event detection. https://carolanguitar.com

FAST DJ - Fast DJ is a web-based automatic DJ system and plugin that can be embedded into any website. It generates transitions between any pair of successive songs and uses machine learning to adapt to the user's taste via simple interactive decisions.

Grateful Dead Concert Explorer - A Web service for the exploration of recordings of Grateful Dead concerts, drawing its information from various Web sources. It demonstrates how Semantic Audio and Linked Data technologies can produce an improved user experience for browsing and exploring music collections. See Thomas Wilmering explaining more about the Grateful Dead Concert explorer: https://vimeo.com/297974486

Jam with Jamendo - Jam with Jamendo brings music learners and unsigned artists together by recommending suitable songs as new and varied practice material. In this web app, users are presented with a list of songs based on their selection of chords. They can then play along with the chord transcriptions or use the audio as backing tracks for solos and improvisations. Using AI-generated transcriptions makes it trivial to grow the underlying music catalogue without human effort. See Johan Pauwels explaining more about Jam with Jamendo: https://vimeo.com/297981584

MusicLynx - a web platform for music discovery that collects information and reveals connections between artists from a range of online sources. The information is used to build a network that users can explore to discover new artists and how they are linked together.

The SOFA Ontological Fragment Assembler - enables the combination of musical fragments - Digital Music Objects, or DMOs - into compositions, using semantic annotations to suggest compatible choices.

Numbers into Notes - experiments in algorithmic composition and the relationship between humans, machines, algorithms and creativity. See David de Roure explaining more about the research: https://vimeo.com/297989936

rCALMA Environment for Live Music Data Science - a big data visualisation of key in the Live Music Archive using Linked Data to combine programmes and audio feature analysis. See David Weigl talking about rCALMA: https://vimeo.com/297970119

Climb! Performance Archive - Climb! is a non-linear composition for Disklavier piano and electronics. This web-based archive creates a richly indexed and navigable archive of every performance of the work, allowing audiences and performers to engage with the work in new ways.
Year(s) Of Engagement Activity 2018
URL http://www.semanticaudio.ac.uk/events/fast-industry-day
 
Description FAST Press Release (issued by Queen Mary) 
Form Of Engagement Activity A press release, press conference or response to a media enquiry/interview
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Showcasing the culmination of five years of digital music research, the FAST IMPACt project (Fusing Audio and Semantic Technologies for Intelligent Music Production and Consumption), led by Queen Mary University of London, hosted an invite-only industry day at Abbey Road Studios. A FAST press release was produced by the project lead (Queen Mary) in collaboration with other two partners. The press release is available under the URL given below. The press release was also shared on social media (@semanticaudio).

In addition, the FAST Industry Day was publicised on different social media platforms by the partners and the FAST Curatorial Advisor. It has attracted a total of 26663 impressions on twitter and 511 views on Linked In.
Year(s) Of Engagement Activity 2018
URL https://www.qmul.ac.uk/media/news/2018/se/musics-changing-fast-fast-is-changing-music.html
 
Description FAST demos at BBC Data Science Research Partnership Launch October 2017 (Florian Thalmann) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Media (as a channel to the public)
Results and Impact Florian Thalmann (Queen Mary) presented FAST demos at BBC Data Science Research Partnership Launch event, October 19, 2017. 200-300 attendees from BBC, BBC R&D, and British Universities attended the event. He discussed the ways in which the FAST discovery demonstrators could be used in broadcasting and production, as well as on the consumer side. Potential new collaborations to be followed up on.
Year(s) Of Engagement Activity 2017
 
Description FAST documentation film 
Form Of Engagement Activity A broadcast e.g. TV/radio/film/podcast (other than news/press)
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact An external filming company (Loop Films) was hired to produce a FAST short documentation film. The film was released in early January 2019 on Vimeo and youtube platforms. A (45 sec) trailer was also produced.

Music's changing fast, FAST is changing music. Showcasing the culmination of five years of digital music research, the FAST project led by Queen Mary University of London hosted an invite only industry day at Abbey Road Studios on Thursday 25 October, 2 - 8 pm. The film combines interviews of the FAST partners, artists and academics with footage from Abbey Road Studios. Telling the FA|ST story are: Prof. Mark Sandler (Queen Mary Principal Investigator), Prof. David de Roure (Oxford Co-investigator), Prof. Steve Benford (Nottingham Co-investigator) and Prof. Josh Reiss (Queen Mary Co-investigator). Also speaking are Professor Mark d'inverno (Chair of the Advisory Board), pianist and composer Maria Kallionpää, and artist, composer and researcher Tracy Redhead. Background music: Tracy Redhead.

Full film: https://player.vimeo.com/video/307448834
Trailer: https://player.vimeo.com/video/307427514

Full film: https://youtu.be/VF4qQRcGfl8
trailer: https://youtu.be/rzzXMAXGUBs
Year(s) Of Engagement Activity 2018
URL https://player.vimeo.com/video/307448834
 
Description FAST live demonstrations at Ideas Unwrapped, 26 April 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact As part of the yearly Ideas Unwrapped Queen Mary event, FAST showcased some of the project's most exciting research and developments for the recorded music industry. It preceded the FAST Industry Day on the 25 October at Abbey Road Studios (see relevant report). Not aware of any impact.

The news about FAST's participation was shared on socia media and on our website. On Twitter, it received 3160 impressions and 32 engagements.
Year(s) Of Engagement Activity 2018
URL http://www.semanticaudio.ac.uk/news/fast-show-tell-session-ideas-unwrapped/
 
Description Fazekas: Chairing session: "Sound event detection and classification" at 26th European Sig. Proc. Conference (EUSIPCO 2018) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas chaired the session / workshop: Sound event detection and classification (AASP-L2 Wednesday, September 5, 10:30 - 12:30) at 26th European Sig. Proc. Conference (EUSIPCO 2018), Sept 3-7, Rome Italy. Other outcome: promotion of Fazekas's research.
Year(s) Of Engagement Activity 2018
 
Description General chair of Digital Libraries for Musicology 2019 conference (DLfM 2019), 9th November 2019, The Hague, Netherlands (Kevin Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Kevin Page was general chair of the DLfM 2019 conference, held at The Royal Library of the Netherlands in The Hague on 9th November 2019. The programme consisted of 13 papers presented by international authors to an international audience, and continues DLfM's role as one of the premier events for research in this area.
Year(s) Of Engagement Activity 2019
URL https://dlfm.web.ox.ac.uk/2019-proceedings
 
Description Hacking Sound workshop (Oxford) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The Centre for Digital Scholarship and the University of Oxford e-Research Centre organised a day of sound hacking for the general public.

The hack day experimented with ways of representing data with sound or music and exploring the sonic world. The participants were encouraged to bring data and existing projects to share, and to start on fresh ideas. The day encouraged networking and developing ideas and projects, ending with a showcase of what was produced and future directions that might be taken.
Year(s) Of Engagement Activity 2016
URL http://blogs.bodleian.ox.ac.uk/digital/2016/09/20/an-invitation-to-hack-sound/
 
Description ICMPC15 conference (Graz, Austria) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact This was a presentation by Michelle Philips (Oxford) at the "15th International Conference on Music Perception and Cognition". The talk entitled " What musical features influence perception of section boundaries in contemporary music? A live audience study with a bespoke data capture app. " was presented and rebroadcast to people from a wide range of backgrounds. The paper was well received ('an exciting talk', 'amazing presentation', 'very nice talk'), people were excited about the research, and there was interest in reusing the app for future research.
Year(s) Of Engagement Activity 2007,2018
 
Description IEEE UK and Ireland members open day 2017 (P Kumudakis) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The IEEE UK and Ireland Members Open Day reached about 50 people from academia and industry il London on 7th October 2017. Panos Kumudakis presented MixRights: Fair Trade Music Ecosystem.
Year(s) Of Engagement Activity 2017
 
Description Ideas Unwrapped, 26 April 2018 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact As part of the yearly Ideas Unwrapped Queen Mary event, Professor Mark Sandler was invited to give a keynote speech, 'FAST forward'. He introduced the FAST project to Queen Mary students and staff, as well as general public. This activity served as a rehearsal for the project's main industry day scheduled on the 25 October at Abbey Road Studios. No known outcomes or impacts.

FAST's participation was reported on social media on the FAST account (@semanticaudio). It had 3160 impressions and 32 people enaged with the tweet.
Year(s) Of Engagement Activity 2018
URL https://ideasunwrapped.wordpress.com/
 
Description Innovation in Music (In'Music15) conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact The FAST project organized a panel session at this industry-focused conference. Panelists included Matt White (Director of User Experience, Omnifone), Jon Eades (Project Manager, Abbey Road Red), Gyorgy Fazekas (C4DM, QM), Peter Tolmie (MRL, Nottingham), Gary Bromham (composer, recording / mix engineer, producer) and Adrian Hazzard (MRL, Nottingham). The panel session explored and discussed the FAST project themes as an opportunity to reach out to a wider audience to both promote and foster future engagement with other related parties.
Year(s) Of Engagement Activity 2015
 
Description Interconnected alchemy: an apparatus for alchemical algorithms 3 March 2017 (D. De Roure, P. Wilcox, A. Chamberlain) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact This was a presentation about ongoing work from the FAST project relating to the Experimental Digital Humanities at an event organised at the National Library of Wales. Forty (40) people attended the event and the audience consisted of artists, performers, academics and the general public. This meant that we were able to engage directly with a range of interested people beyond both the project and our peer groups. People attended the symposium from the UK, USA and Europe. Discussions arose from the symposium and have led to another presentation at the University of Oxford. The most significant contribution related to the development and understanding of a an emergent methodology - Experimental Digital Humanities.
Year(s) Of Engagement Activity 2017
URL http://eprints.nottingham.ac.uk/41107/1/Interconnected%20Alchemy.pdf
 
Description International Musicological Society 20th Quinquennial Congress (Tokyo) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation of the Oxford project team of FAST related research in a session at the largest international musicology conference, including a demonstrator re-use our MELD framework beyond it's original FAST use cases to assist musicological investigation. Fifty (50) people attended the session. Participation in IMS Digital Musicology study group meeting.
Year(s) Of Engagement Activity 2017
 
Description Internet Archive, December 2019 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Kevin Page visited the Internet Archive headquarters in San Francisco, USA, to showcase the demonstrator using Live Music Archive data created by the Unlocking Musicology project, with technologies from the FAST project. He discussed opportunities for future collaboration with Brewster Kahle, Digital Librarian and Founder of the Internet Archive, considering how materials in the archive might be better utilised by musicologists.
Year(s) Of Engagement Activity 2019
 
Description Internship with Naver Labs, South Korea 
Form Of Engagement Activity Participation in an open day or visit at my research institution
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact QMUL-funded FAST PhD student Keunwoo Choi spent 3 months with Naver, South Korea's leading internet search company. He developed visualisations of Convolutional Neural Networks and investigated learning from playcount and playlist data held by the company.
Year(s) Of Engagement Activity 2015
 
Description Introduction to Digital Humanities workshop at Digital Humanities at Oxford Summer School 2018 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The one week Introduction to Digital Humanities workshop at the DHOxSS summer school workshop included presentations from David De Roure, Pip Willcox, and Kevin Page (on Readable Digital Archives, and Linked Data respectively). 65+ people attended the Introduction to Digital Humanities workshop, having registered (fee paying)
Year(s) Of Engagement Activity 2018
 
Description Invitation to chair a session at the First International Workshop on Multilayer music representation and processing, Milan 24 Jan 2019 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Professor Sandler was invited to chair a session at the First International Workshop on Multilayer music representation and processing, Milan 24 Jan 2019. The most significant outcomes involved requests about further involvement.
Year(s) Of Engagement Activity 2008,2018
 
Description Invited panellist, Joint Conference on Digital Libraries on "At the Nexus of Data and Collections: New Affordances in the Age of Mass-Scale Digital Libraries", Fort Worth, Texas, USA 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The panel on "At the Nexus of Data and Collections: New Affordances in the Age of Mass-Scale Digital Libraries" considered how large scale structured data can be both provided by Digital Library collection, and when computationally processed be considered an emergent collection in of itself. This included discussion of how computational features can be combined with Linked Data to this end; and finished with a session of questions posed by the audience and answers from the panel.
Year(s) Of Engagement Activity 2018
 
Description Invited talk on Climb! and MELD at the Multimodal Interaction Lab, School of Information Studies, McGill University, Montreal, Canada (D. Weigl, Oxford) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact David Weigl (Oxford) gave a 20 minute presentation on activities within the FAST project, focussing on Climb!, Muzicodes, and MELD. As the group has a research focus on (everyday and musical) audio perception and representation, the MELD and Linked Data aspects proved particularly informative to the group, and good discussions were had with many questions raised.
Year(s) Of Engagement Activity 2018
 
Description Keynote Talk by David De Roure, Brisbane, Oct 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact David De Roure was invited to give a plenary talk "Creativity in Digital Scholarship" at the 11th eResearch Australasia Conference, to be held at the Brisbane Convention and Exhibition Centre, 16 - 20 October 2017.

eResearch 2017 offered delegates the opportunity to engage, connect, and share their ideas and exemplars concerning new information centric research capabilities, and how information and communication technologies help researchers to collaborate, collect, manage, share, process, analyse, store, find, understand and re-use information (as stated on their website).
Year(s) Of Engagement Activity 2017
URL https://conference.eresearch.edu.au/2017/08/creativity-in-digital-scholarship/
 
Description Keynote talk at Web Audio Conference 2022 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Keynote presentation : "AI Everywhere:some observations and thoughts"
video available at https://www.youtube.com/watch?v=PaiiKpCeFgg
Year(s) Of Engagement Activity 2022
URL https://wac2022.i3s.univ-cotedazur.fr/node/9
 
Description Keynote talk: Music's Changing Fast, FAST's changing Music, 31 May 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Keynote talk by Prof Mark Sandler: Music's Changing Fast, FAST's changing Music, 31 May 2019, at the 16th Sound and Music Computing Conference Malaga. The keynote presented a summary of FAST outcomes to an audience that included influential academics from across the world. The talk led to invitation for QMUL to participate in the Nordic SMC consortium, by sending students for Short Term Scientific Visits to one of 5 Nordic universities.
Year(s) Of Engagement Activity 2019
 
Description Lab Tour & Seminar (Spotify) at Queen Mary (G Fazekas) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact The Lab Tour and Seminar (Spotify) took place at Queen Mary, 17 July 2017. The topics covereed were: Showcase of C4DM research, MIR research at Spotify. The event was attended by 10 people from Spotify and 25 researchers from Queen Mary.
Year(s) Of Engagement Activity 2017
 
Description Linked Art Editorial Board face-to-face meeting (F2F1), 4th-6th March 2019, Los Angeles, USA 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The first face-to-face meeting of the Linked Art Editorial Board took place at the Getty Center, Los Angeles, USA, on 4-6th March 2019. The group is standardising a Linked Data profile for art and artworks. Invited representatives were present from the J. Paul Getty Trust, Europeana, the Smithsonian Institute, Newfields - Indianapolis Museum of Art, the National Gallery of Art, Yale University, the Victoria & Albert Museum, Philadelphia Museum of Art, University of Bologna, Canadian Heritage Information Network, Princeton University, University of Oxford, the Frick Collection, the Museum of Modern Art (MoMA), and FORTH.
Year(s) Of Engagement Activity 2019
URL https://linked.art/
 
Description Linked Data workshop at Digital Humanities at Oxford Summer School 2018 (John Pybus, Graham Klyne, Kevin Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact 16-18 highly engaged participants attended the workshop. Graham Klyne presented a session in Linked Data track. The topic included linked data modelling patterns that came out of FAST work on describing musical performances, and also context-recording patterns using ideas from MELD.
Year(s) Of Engagement Activity 2018
 
Description Linked Data workshop at the Digital Humanities at Oxford Summer School 2017 (G. Klyne and K. Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The Summer School offers training to anyone with an interest in the Digital Humanities, including academics at all career stages, students and project managers. This year 185 participants from over 30 countries will converge at St. Anne's College to discuss the latest in research and practice in Digital Humanities. David De Roure and Pip Willcox co-directed the event, while Graham Klyne and Kevin Page contributed to the Linked Data workshop. In addition, three week long workshops were convened by project members, which are reported in separate entries. Connected with the Linked Data workshop, Graham Klyne also presented a poster about Annalist applied to linked data for Early Modern Letters Online (EMLO), which was in part derivative from modelling work for the Carolan Guitar and Performance ephemera. https://github.com/gklyne/EMLO_in_CRM_samples/blob/master/EMLO_LD_CRM_Annalist/EMLO_LD_CRM_Annalist.pdf
Year(s) Of Engagement Activity 2017
URL http://digital.humanities.ox.ac.uk/dhoxss/2017/
 
Description Linked Music Hackaton, Goldsmiths 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Linked Music Hackaton event (Programming with Purcell, Hacking with Handel, Linking with Liszt, 9th October 2015, Goldsmiths University of London)

Over 25 academics and developers gathered for a Linked Music Hackathon, organised by Kevin Page and David Weigl. Attendees were able to use data produced by FAST and more than 20 other Linked Data music sources to produce new mashups prototyped and presented on the same day. A variety of hacks were shown at the end of the event with the winning project "Geobrowsing using RISM" chosen by popular vote. A Radio 1 team were also in attendance to interview attendees for the BBC's "Make It Digital" campaign.
Year(s) Of Engagement Activity 2015
URL http://semanticmedia.org.uk/?q=hackathon
 
Description Lohengrin TimeMachine Digital Companion at DMRN+14 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Postgraduate students
Results and Impact We demonstrated the Lohengrin TimeMachine Digital Companion, alongside an explanatory poster, to attendees at the Digital Music Research Network event on 17th December 2010, held at Queen Mary University of London.

The Digital Companion was created by the Unlocking Musicology project (AH/R004803/1) and is built upon the MELD framework developed by the Oxford team as part of the FAST project (EP/L019981/1).
Year(s) Of Engagement Activity 2019
 
Description Lohengrin TimeMachine Digital Companion at ISMIR 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact We demonstrated the Lohengrin TimeMachine Digital Companion, alongside an explanatory poster, to attendees at the International Society for Music Information Retrieval conference on the 8th November 2019, held at Delft University, The Netherlands. The Digital Companion was created by the Unlocking Musicology project (AH/R004803/1) and is built upon the MELD framework developed by the Oxford team as part of the FAST project (EP/L019981/1).
Year(s) Of Engagement Activity 2019
 
Description MEI Linked Data Interest Group 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The Interest Group considers applications of Linked Data to interconnect the rich music and music-related information resources available on the Web with MEI encodings. It focuses on establishing and documenting best practices through community discussion, work on the MEI guidelines for this topic, and proposing useful changes to the MEI schema to enhance or facilitate such connections to and from MEI encodings. The group seeks to provide reference points, both for newcomers, and those with more advanced experience in the topic. Finally, the group intends to work to raise awareness of Linked Data practices within the MEI community, and of music-specific approaches within the Semantic Web and Web science communities.
Year(s) Of Engagement Activity 2020,2021,2022
URL https://music-encoding.org/community/interest-groups
 
Description MPEG Media Value Chain Ontology meetings 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact QMUL is working to standardise aspects of the musicontology.com within the context of the wider MPEG Media Value Chain Ontology. They are attending meetings every four months; this is ongoing and continuing.
Year(s) Of Engagement Activity 2015
 
Description Member of the organizing committee for the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) (Sebastian Ewert) 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Sebastian Ewert (Queen Mary) was a member of the organizing committee for the IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA) 2017 in New Paltz, NY, USA. The conference was attended by ~170 people.
Year(s) Of Engagement Activity 2017
URL http://www.waspaa.com
 
Description Moodplay Interactive Experience Digital Shoreditch 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact The C4DM team showcased the Moodplay Interactive experience at the Digital Shoreditch exhibition. Very good interaction with visitors was noted during the event and a number of questionnaires were completed by the public; these provide valuable information on feed back from the user.
Year(s) Of Engagement Activity 2015
 
Description Moodplay installation at BBC Sound Now and Next 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact BBC R & D organised a two day event at the BBC on innovation in sound production. The Queen Mary team was invited as an exhibitor and they presented the Moodplay Installation to professional practitioners, academic and industry and business.

Mention in press release by AudioMedia International (pro audio magazine):
http://www.audiomediainternational.com/broadcast/report-bbc-sound-now-and-next/04522
Year(s) Of Engagement Activity 2015
URL http://www.bbc.co.uk/rd/events/sound2015
 
Description Moodplay.github.io demo 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact This activity involved representing the FAST project as a sponsor of the SMC 2019 conference, including engaging with conference attendees by giving them general information about the project and showcasing some of the technologies and platforms that have been developed. This included handing out the FAST LP to participants and demonstrating the MusicLynx and Moodplay systems. This was the first public presentation of moodplay.github.io, a web based collaborative music player that allows users to collaboratively choose music by mood. The music is automatically mixed by an auto-DJ module that models various DJ-ing styles using content-based audio features that represent musical parameters such as tempo, beats, bars, keys, instrumentation and volume. The work was presented by Alo Allik, C4DM and FAST member.
Year(s) Of Engagement Activity 2019
 
Description Music Encoding Initiative Technical Meeting, Oxford (Kevin Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The FAST team at the University of Oxford e-Research Centre hosted and participated in the annual technical meeting of the Music Encoding Initiative. The meeting is the principle annual meeting for progressing the standardisation activities of the Music Encoding Initiative (MEI).

19 attendees worked on progressing the aims and outputs of the Music Encoding Initiative. MEI 4.0 was finalised and released at the meeting.
Year(s) Of Engagement Activity 2018
 
Description Music Hack Day & Sonar Festival, Barcelona, 17-19 June 2015 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Music Hack Day is an international 24-hour event where programmers, designers and artists come together to conceptualize, build and demo the future of music. Three C4DM members (Matthieu Barthet, Gyorgy Fazekas and Alo Allik) attended the Barcelona Music Hack Day 2015 collocated with the Sonar festival (music, creativity and technology). They won one of the awards from the Rapidmix EU project for the most original hack using biosignal/multimodal wearable technology for music performance. (The award is listed in the Rapidmix section). The prize was a BITalino toolkit to prototype applications using body signals and was awarded by the company biosignalplux.

Description of the hack MoodBox:

MoodBox is a collaborative music jukebox which selects music following user emotional states as characterised by body signals measured with wireless wearable sensors. Correlates of arousal (excitation) and valence (pleasantness) are computed using electrodermal activity (EDA) and electromyography (EMG) with the Biosignalsplux Bitalino wearable sensor as well as electroencephalography (EEG) with the Neuroelectrics Enobio brain helmet. We use our mood recognition technology merging affective computing and semantic web techniques to map a collection of 10,000 tracks to the arousal/valence space. Our visualiser displays the track which is played back in the arousal/valence space according to how users feel on average!

MoodBox cited in thedrum.com article:

http://www.thedrum.com/opinion/2015/06/26/hacking-brain-real-virtual-reality-coolest-creative-tech-s-nard

More news about the Music Hack Day in Barcelona:
http://musichackday.upf.edu/mhd/2015/?p=206
Year(s) Of Engagement Activity 2015
URL http://www.thedrum.com/opinion/2015/06/26/hacking-brain-real-virtual-reality-coolest-creative-tech-s...
 
Description Music Hack Day and Sonar Festival 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Three C4DM members (Matthieu Barthet, Gyorgy Fazekas and Alo Allik) attended the Barcelona Music Hack Day 2015 collocated with the Sonar festival (music, creativity and technology). They won one of the awards from the Rapidmix EU project for the most original hack using biosignal/multimodal wearable technology for music performance. (The award is listed in the Rapidmix section). The prize was a BITalino toolkit to prototype applications using body signals and was awarded by the company biosignalplux.

Description of the hack MoodBox:

MoodBox is a collaborative music jukebox which selects music following user emotional states as characterised by body signals measured with wireless wearable sensors. Correlates of arousal (excitation) and valence (pleasantness) are computed using electrodermal activity (EDA) and electromyography (EMG) with the Biosignalsplux Bitalino wearable sensor as well as electroencephalography (EEG) with the Neuroelectrics Enobio brain helmet. We use our mood recognition technology merging affective computing and semantic web techniques to map a collection of 10,000 tracks to the arousal/valence space. Our visualiser displays the track which is played back in the arousal/valence space according to how users feel on average!

MoodBox cited in thedrum.com article:
http://www.thedrum.com/opinion/2015/06/26/hacking-brain-real-virtual-reality-coolest-creative-tech-s-nard

More news about the Music Hack Day in Barcelona:
http://musichackday.upf.edu/mhd/2015/?p=206
Year(s) Of Engagement Activity 2015
URL http://www.semanticaudio.ac.uk/news/c4dm-team-win-an-award-at-the-music-hack-day-barcelona-17-19-jun...
 
Description Music and Maths (Sheldonian, Oxford) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact A talk on how mathematical ideas are embedded in music. One part included audience participation via mobile devices, and attempted to record if people could detect palindromes in Haydn's Symphony No. 47, "Palindrome". In additional we collected emails of around 100 people who would consider attending future performances of this nature.
Year(s) Of Engagement Activity 2018
 
Description Music encoding conference 2017 (K Page) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact 80 people attended a FAST presentation by Kevin Page (Oxford) including a demonstrator re-use our MELD framework beyond it's original FAST use cases to assist musicological investigation. Second paper proposing PROV data structures for use in Music Encoding.
Year(s) Of Engagement Activity 2017
 
Description Music, Data Science and AI @ Turing Institute 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact an afternoon meeting, organised by Prof De Roure and Prof Sandler, at the Alan Turing Institute on 7 May 2019, to bring together researcher there with an interest in Music as a scientific research topic.
Year(s) Of Engagement Activity 2019
 
Description Music, Data Science and AI, 7 May 2019, symposium at Alan Turing Institute 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Music, Data Science and AI, 7 May 2019, symposium at Alan Turing Institute. FAST activities in Data Science and AI pertaining to music were presented by Prof Mark Sandler at a 2 hour symposium at the Turing. This involved 6 short spoken presentations and a wide ranging discussion with the participants.
Year(s) Of Engagement Activity 2019
 
Description Muzicodes workshops (C. Greenhalgh, S. Benford, A. Hazzard, A. Chamberlain) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Four workshops with a range of participants who engaged with setting up, authoring and performing the Muzicodes system, using their own musical instruments. These workshops identified groups of potentially interested participants, thus recruitment was by invite.

These workshops enabled the FAST IMPACt Nottingham team to observe how musicians interacted with the system, thus drawing some broad conclusions, which then inform further technical developments. They disseminated the work to range of practitioners and researchers (some of whom are continuing to engage with it, e.g., Maria Kallionpaa) and enabled its continuing development.
Year(s) Of Engagement Activity 2016
 
Description Mycelia meeting at Sonos Studios 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Mycelia is an initiative by the music performer and artist Imogen Heap to galvanise change in the rights and renumeration in the 21st century recorded music industry. Mark Sandler presented overview of EP/L019981/1 on 9 Feb 2016.
Year(s) Of Engagement Activity 2016
 
Description Narratives through Data showcase 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact The Unlocking Musicology project held an evening showcase event on 24th July 2019 on "Narratives through Data" at Keble College, Oxford. The event was open and advertised to the general public; all 80 available registrations sold out; attendees included local members of the Oxford general public, alongside national and international visitors attending other events. The event was organised and staffed by Kevin Page (Unlocking Musicology, FAST) and David Lewis (Unlocking Musicology).

After a scene setting presentation in the main auditorium, attendees were able to interact with hands on demonstrations allowing them to explore the notion of narratives through data. This was illustrated through the collaborations with Unlocking Musicology partners - the Internet Archive Live Music Archive, RILM, the New York Philharmonic, and Prof. Laurence Dreyfus's Lohengrin Time Machine - alongside an exemplar from the Digital Delius project using British Library collections, and technologies from the FAST project.
Year(s) Of Engagement Activity 2019
URL https://um.web.ox.ac.uk/event
 
Description Open Symphony 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact In a traditional music performance situation, the audience has limited means to give feedback (e.g. applause!) and little opportunity to interact with the music's performance. What if this were revisited? 'Open Symphony' is an immersive performance system developed as part of a collaboration between Queen Mary University of London and a Masters graduate of Guildhall School of Music and Drama. Open Symphony explores the creativity and spontaneity of real-time human interaction through an ensemble of performers and an audience using mobile technology. The project aims to extend the nature of live music to enable audience members to meaningfully collaborate in the development of a musical piece. By realigning both music and technology as co-operating tools, audience members actively influence the music being played in a live environment, creating a meaningful mutual experience between multiple audience members and performers. "Open Symphony" creates new musical experiences, new music and new compositional methods. This is made possible by using a wide range of technologies including web, information visualisation, and sensors.
Year(s) Of Engagement Activity 2015
URL http://isophonics.net/content/opensymphony
 
Description Orchestras Live - Strategic Discussion (Adrian Hazzard) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Adrian Hazzard was invited by Orchestras Live (a national charity) to contribute to a roundtable discussion which explored how the creative application of digital technology supports the work of Orchestras Live and partners in engaging a more diverse audience in live orchestral music. The Roundtable facilitated an informal discussion with a small group of engaged professionals (e.g. Arts Council England, Welsh National Opera, Helsinki Philharmonic Orchestra, Trinity College London, Lincolnshire Music Education Hub).
Year(s) Of Engagement Activity 2018
 
Description Organisation of AES workshop (G Fazekas and T Wilmering) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact FAST IMPACt project members from the Centre for Digital Music (C4DM) organised a workshop on the 20th October 2017 as part of AES New York 2017 on Archiving & Restoration: AR08 - The Music Never Stopped: The Future of the Grateful Dead Experience in the Information Age.

During this workshop Thomas Wilmering and George Fazekas (who co-chaired the event) demonstrated new ways of navigating concert recordings with editorial metadata and semantic audio analysis combined using Semantic Web technologies. They focussed particularly on material by the Grateful Dead and discussed opportunities and requirements with audio archivists and librarians, as well as the broader social and cultural context of how new technologies bear on music archiving and fandom. The workshop also explored the opportunities created by semantic audio technologies in experiencing live music performances and interacting with live performance and cultural archives. The workshop included presentations by Prof. Mark Sandler, head of C4DM, introducing challenges and opportunities in semantic audio. C4DM members Thomas Wilmering and Ben White presented their research in navigating music archives and the creative use of archival material. A number of experts from the USA were invited to contribute in the areas of live sound reinforcement, metadata and semantic audio. The workshop included a panel discussion moderated by George Fazekas. Further Information: Fazekas, G., Wilmering, T. (2017). The Music Never Stopped: The Future of the Grateful Dead Experience in the Information Age. Audio Engineering Society 143rd Convention, New York, NY, USA, October 20, 2017 (see website in the next section).
Year(s) Of Engagement Activity 2017
URL http://www.aes.org/events/143/archiving/?ID=5761
 
Description Organisation of DMRN +10 conference 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact FAST sponsored the workshop and FAST presentations at the Digital Music Research Network (DMRN+10) 2015 event held at QMUL. This is an annual event organised by C4DM.
Year(s) Of Engagement Activity 2015
 
Description Organising and chairing Digital Libraries for Musicology conference (DLfM 2018), Paris, France (Kevin Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Kevin Page was the organiser and programme chair for Digital Libraries for Musicology conference (DLfM 2018) at the Institut de Recherche et Coordination Acoustique/Musique (IRCAM) in Paris, France.

70 registered attendees including international academics in the field took part in a single day conference held at the Institut de Recherche et Coordination Acoustique/Musique (IRCAM) in Paris on the intersection between MIR and Digital Library technologies, and music and musicology. This included 7 long and 7 short papers with corresponding formal written papers in proceedings as part of the ACM ICPS series; and 6 posters.
Year(s) Of Engagement Activity 2018
URL https://dlfm.web.ox.ac.uk/
 
Description Organising and chairing Digital Libraries for Musicology workshop (DLfM 2017), 28 Oct 2017, Shanghai, China (K Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The FAST Oxford team member David Weigl was the organiser and programme chair for Digital Libraries for Musicology workshop (DLfM 2017) at the Shanghai Conservatory of Music in China, to an audience of 32 international academics in the field, and engaging 22 domestic (Chinese) guests being introduced to these new technologies and methods. In total, fifty four (54) attendees took part in the day-long workshop held at the Shanghai Conservatory of Music on the intersection between MIR and Digital Library technologies, and music and musicology. This included ten (10) short and three (3) long papers with corresponding formal written papers in proceedings as part of the ACM ICPS series; three (3) posters; and a panel on the future of music digital libraries. Beyond the traditional DLfM attendees of international academics and students, the workshop attracted significant engagement from domestic Chinese attendees who, while having rich digital cultural collections, have not typically employed the technologies presented at the workshop yet.
Year(s) Of Engagement Activity 2017
 
Description Organising and chairing Semantic Applications for Audio and Music workshop (SAAM 2018), Monterey, USA (Kevin Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact 20 registered attendees took part in a half day workshop held as part of the International Semantic Web Conference in Monterey, USA. The workshop took the form of 4 panels and discussion, with participants from academia and industry, including Pandora, the Internet Archive, Gracenote, and Music Artificial Intelligence Algorithms, Inc. This included 5 long and 3 short papers with corresponding formal written papers in proceedings as part of the ACM ICPS series.
Year(s) Of Engagement Activity 2018
 
Description Oxford Digital Humanities Summer School (Graham Klyne) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Graham Klyne presented poster and session in linked data track. The topic of these included linked data modelling patterns that came out of FAST work on describing musical performances, and also context-recording patterns using ideas from MELD.
Year(s) Of Engagement Activity 2018
 
Description Oxford Ideas Festival: Wonderlab: Designing the future - engineers reimagining the world 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Demos of music, AI and algorithms (De Roure, Pybus, Emsley) at iF Oxford Science and Ideas Festival, 19 October 2019
Year(s) Of Engagement Activity 2019
URL https://if-oxford.com/event/westgate-wonderlab/
 
Description Panel: Calculus of the Nervous System 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Public music performances and panel: Calculus of the Nervous System, performances by Britten Sinfonia of Ada sketches, Wild Clematis in Winter, But then what are these numbers? (Howard) and Alter (Laidlow, PRiSM). Panel chaired by Prof Philip Bullock, featuring Emily Howard and Robert Laidlow in conversation with David De Roure and Ursula Martin about Lovelace's legacy and the interface between academic research and artistic creativity. Holywell Music Room, Oxford. 18 November 2019.
Year(s) Of Engagement Activity 2019
URL https://www.torch.ox.ac.uk/event/calculus-of-the-nervous-system
 
Description Performance of Climb! for Disklavier and Electronics 7 June 2017 (Adrian) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact This was the first performance of "Climb!" for Disklavier and Electronics (June 7th 2017, Djanogly Recital Hall, University of Nottingham) a collaborative performance project that Maria Kallionpaa (composer / pianist Aalborg University, Denmark) and members of the Mixed Reality Lab, Nottingham and E-Research Centre, Oxford have been developing since the summer of 2016. An audience of 48 came to the public performance. Additionally, audience questionnaires, use of a developed audience app and one on one interviews captured a dataset for research purposes.
Year(s) Of Engagement Activity 2017
 
Description Pint od Science (London) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact Ten (10) members of the public attended the talk which was held in Bethnal Green Working Men's Club. This sparked at least 20 minutes of questions afterwards.
Year(s) Of Engagement Activity 2017
 
Description Presentation and demonstration of MELD to the Semantic Web community at ESWC 2017 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact The FAST Oxford team set up a demonstration station including a poster on the MELD framework, a table with a laptop demonstration of the MELD jam session scenario, and a projector with a video of Climb! (using MuziMELD). The purpose was to inform the semantic web community of the FAST work on music encoding and linked data. The demonstration triggered many good discussions - people were intrigued both by MELD specifically, and by the application of Linked Data to music performance more generally. About two hundred (200) people attended the presentation and demonstration.
Year(s) Of Engagement Activity 2017
 
Description Presentation and workshop on Sound Design: Experimental approaches (A. Chamberlain) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Presentation and Workshop by Alan Chamberlain (Nottingham) on Sound Design: Experimental Approaches at Aberystwyth University to 15 staff and students - filmakers.

Work was presented relating to the FAST projects and the attendees were able to see how cutting edge technological developments could be applied to their film making. A. Chamberlain then used some of the tools created on the FAST project and the attendees where able to develop their own soundtrack that was later imported into a Digital Audio Workstation. The students and lecturers were interested in using the technology in their film-making practice.
Year(s) Of Engagement Activity 2018
 
Description Presentation at Music//Media//History conference at the University of Music and Performing Arts, Vienna, 14-17th March 2019 (Kevin Page) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Kevin Page presented an invited paper on "Musically-meaningful annotations of audio-visual material" at the Music//Media//History conference at the University of Music and Performing Arts in Vienna on the subject of "Re-Thinking Musicology in an Age of Digital Media". The presentation described the Oxford e-Research Centre team's application of semantic annotation technology to three different areas of musicology: composition of new works, the study of performance and rehearsal by musicians, and the digital encoding of evidence and argument in the scholarly discussion of music.
Year(s) Of Engagement Activity 2019
URL https://www.mdw.ac.at/upload/MDWeb/iatgm/downloads/MUSIC-MEDIA_HISTORY_TellingSounds_Programm.pdf
 
Description Presentation at NIME 2017 (D Weigl) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact FAST presented their work on Climb! and the associated technological integration of MELD and Muzicodes to a mixed audience of researchers, music technologists, and music performers. It was a presentation to an audience of 160 people consisting of a mixed, international audience of researchers, music technologists, and performers.
Year(s) Of Engagement Activity 2017
URL http://eprints.nottingham.ac.uk/44529/
 
Description Presentation at the 2019 Congress of the International Association of Music Libraries, Archives and Documentation Centres (IAML), 14-19th July 2019, Kraków, Poland 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Kevin Page and David Lewis presented "Enhancing musicological articles with multimedia and interaction using Linked Data and the Music Encoding Initiative" to an international audience of professional music librarians and archivists.
Year(s) Of Engagement Activity 2019
 
Description Presentation at the Music Encoding Conference (College Park, MD, USA) (D. Weigl, Oxford) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact D. Weigl (Oxford) presented the use of MELD in the encoding of Climb! for performance and archival. The conference theme this year was "Music Encoding and Performance", to which MELD/Climb! fits perfectly. The presentation was well-received and generated interesting questions and discussion, both immediately after the talk and informally throughout the rest of the conference.
Year(s) Of Engagement Activity 2018
 
Description Presentation at the Music Encoding Conference in Montreal 2016 (Kevin Page) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Kevin Page (Oxford FAST IMPACt team member) gave a presentation at the Music Encoding Conference in Montreal, May 2016: "Prototypical Scenarios for Contextual Navigation with MEI and Linked Data".
Year(s) Of Engagement Activity 2016
 
Description Presentation at the Sonar+D Festival, June 2016, Barcelona, Spain 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact From 16-18 June 2016, the Centre for Digital Music (QMUL) including members from the FAST project presented a public exhibition of its research at the Sonar+D festival, a high-profile annual event in Barcelona which caters to musicians, the music technology industry, and members of the general public. C4DM was chosen by competitive application for a display booth (roughly 4m x 4m) on the exhibition floor, in a prime location near the entrance to the facility. 12 C4DM researchers, including PhD students, postdocs, early- and mid-career academics, attended to showcase their work.

The event was attended by thousands of people, mainly adults but also occasionally children. The booth had many visitors from both large and small businesses, including several different members of the music company Focusrite. Several musicians who were performing and speaking at Sonar also attended the booth, including the well-known composer Brian Eno who took an interest in several of the research projects. The event raised the public profile of C4DM and the individual projects within it.

MusicWeb was demonstrated to app developers who have taken interest in linked music data.
Year(s) Of Engagement Activity 2016
 
Description Presentation by Mark Sandler, Alan Blumlein event, Abbey Road Studios 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact FAST was presented by Mark Sandler to an audience of ~100 on at Abbey Road Studios, marking the occasion of Blumlein's centenary with a plaque dedicated by IEEE. FAST is now dedicated to the memory of Alan Dower Blumlein, the inventor of binaural and crossed-pair microphone recording techniques, as well as the stereo groove configuration in vinyl LP records.
Year(s) Of Engagement Activity 2015
 
Description Presentation of FAST and Audio Commons projects, Gracenote / Nielsen 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact George Fazekas presented the FAST and Audio Commons projects to the research team of 20 people at Gracenote / Nielsen in Emeryville, CA, USA, 18 Oct 2018.
Year(s) Of Engagement Activity 2018
 
Description Presentation of FAST project to Tandemlaunch Venture Capital, Montreal Canada. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Presentation of FAST project by Professor Sandler to Tandemlaunch Venture Capital, Montreal Canada.
Year(s) Of Engagement Activity 2018
 
Description Presentation of FAST project to undergraduate composition students (Nottingham) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Undergraduate students
Results and Impact As part of an on-going relationship building between new members of staff in the Department of Music (Nottingham) and the Mixed Reality Lab music / audio research (e.g. FAST) a presentation on FAST work was given to Undergraduate composition students (supervised by Elizabeth Kelly [Director of Composition]).
Year(s) Of Engagement Activity 2018
 
Description Presentation of. Semantic Web Technology for New Experiences throughout the Music Production-Consumption Chain 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Presentation of. Semantic Web Technology for New Experiences throughout the Music Production-Consumption Chain, Mark Sandler1 , Steve Benford2 , David De
Roure3 , Kevin Page3, 1Queen Mary University of London, 2University of Nottingham, 3University of Oxford, at First International Workshop on Multilayer music
representation and processing, Milan 24 Jan 2019.
Year(s) Of Engagement Activity 2019
 
Description Presentation on FAST to Spotify, New York (Mark Sandler) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Prof. Mark Sandler gave a presentation on FAST research to approximately ten (10) employees at Spotify in New York on the 11 October 2017.
Year(s) Of Engagement Activity 2017
 
Description Presentation to Politecnico di Milano AI and Music, Milan 12 Oct 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Mark Sandler presented a seminar to researchers from across the whole Dipartimento di Elettronica, Informazione e Bioingegeria (DEIB), University of Milan, 12 Oct 2019.
Year(s) Of Engagement Activity 2019
 
Description Presentations at Oxford Digital Humanities Summer School (July 2016) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact FAST IMPACt had several presentations at the Oxford Digital Humanities Summer School (July 2016). The Summer School is made out of multiple workshops drawn from the over 150 summer school attendees (international; students, academics, professionals, industry.

1) "Creating linked data with Annalist", Linked Data workshop, Graham Klyne. This was a hands-on session which gave participants an opportunity to create linked data based on modelling they had performed in previous workshop sessions.
2) "Linked Data", Introduction to Digital Humanities workshop, Kevin Page
3) "The Physical and the Digital via the Meta", Humanities Data workshop, Kevin Page

FAST produced a news item on FAST participation: http://www.semanticaudio.ac.uk/news/fast-partners-participate-in-the-digital-humanities-at-oxford-summer-school/
Year(s) Of Engagement Activity 2016
URL http://www.oerc.ox.ac.uk/news/digi-humanities-summer-school
 
Description Programme Chair of Music Encoding Conference 2019, 29th May to 1st June 2019, University of Vienna, Austria (Kevin Page) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The Music Encoding Conference is the key annual event for dissemination and discussion for those working with, and on, music encoding. In 2019 the conference received 51 submissions from authors across the globe, with a programme of 16 accepted papers, 18 posters, 1 panel, and 5 workshops given to an audience of 102 international registrations.
Year(s) Of Engagement Activity 2019
URL https://music-encoding.org/conference/2019/
 
Description Public Lecture: David De Roure and Pip Willcox. The Imagination of Ada Lovelace: An Experimental Humanities Approach. ANU, Canberra. October 2017 (on Ada Lovelace day) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Public Lecture by David De Roure and Pip Willcox, "The Imagination of Ada Lovelace: An Experimental Humanities Approach", ANU, Canberra, October 2017 (on Ada Lovelace day).

More info available at: http://cdhr.cass.anu.edu.au/events/lecture-imagination-ada-lovelace-experimental-humanities-approach-david-de-roure .

Slides can be accessed at: https://www.slideshare.net/dder/the-imagination-of-ada-lovelace
Year(s) Of Engagement Activity 2017
URL http://cdhr.cass.anu.edu.au/events/lecture-imagination-ada-lovelace-experimental-humanities-approach...
 
Description Public lecture by Pip Willcox & David De Roure on Ada Lovelace at the Oxford Women's International Festival and the Research Uncovered series, 2017. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact This was a public lecture by Pip Willcox, "The imagination of Ada Lovelace: creative computing and experimental humanities", St Luke's Chapel, Oxford. March 2017. The talk was followed by a demonstration of the tools used by David De Roure "Making Numbers into Notes: the making of Ada Lovelace's generative music".

This event was part of the Oxford Women's International Festival and the Research Uncovered series organised by the Centre for Digital Scholarship.

More details can be found on: http://blogs.bodleian.ox.ac.uk/digital/2017/01/09/pip-willcox/
Year(s) Of Engagement Activity 2017
URL http://blogs.bodleian.ox.ac.uk/digital/2017/01/09/pip-willcox/
 
Description Public lecture by Pip Willcox & David De Roure on Numbers into Notes, Centre for Digital Scholarship, Weston Library, Jan 2016. 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact David De Roure presented a public lecture "Ada Lovelace, Numbers, and Notes-a short journey into music, mathematics and computation at the time of Lovelace and Babbage" together with Pip Willcox. The lecture took place at the Weston Library, Oxford in January 2016.

More details available at: http://blogs.bodleian.ox.ac.uk/digital/2016/01/11/research-uncovered-david-de-roure-on-ada-lovelace-numbers-and-notes/
Year(s) Of Engagement Activity 2016
URL http://blogs.bodleian.ox.ac.uk/digital/2016/01/11/research-uncovered-david-de-roure-on-ada-lovelace-...
 
Description QMUL Stragegy 2030 Launch, V & A, 2 May 2019 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Policymakers/politicians
Results and Impact QMUL Strategy 2030 Launch event at V&A, 2 May 2019. Professor Mark Salnder gave a talk on FAST activities that were demonstrated to QMUL's wider stakeholder community to communicate its excellence in research, and to support the vision of the university into the next 10 years.
Year(s) Of Engagement Activity 2019
 
Description Quantitative Humanities workshop at Digital Humanities at Oxford Summer School 2018 (David De Roure) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact No other information available.
Year(s) Of Engagement Activity 2018
 
Description Queen Mary C4DM team visit to the acoustics departments Universidad Nacional Autonoma de Mexico (UNAM) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Alessia Milo, a Queen Mary (C4DM) postgraduate student, was invited to visit the University during the C4DM team (G Fazekas and T Wilmering) Mexico visit by the Head of the acoustics and vibrations group, Dr. Felipe Orduña Bustamante (Titular "A" del Grupo de Acústica y Vibraciones, CCADET-UNAM). They discussed the group's work and introduced the FAST project with the 5 main researchers of the group. Both teams also discussed overlap in projects, and possible collaborations, and visits by postgraduate students.
Year(s) Of Engagement Activity 2017
 
Description Real World Studios 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The Nottingham team was hosted by Real World Studios for a day where they introduced the FAST project and explored opportunities for future partnership.
Year(s) Of Engagement Activity 2015
URL http://realworldstudios.com
 
Description Returning Ghosts - Performance and New Technologies WG Interim Event 24th May 2016 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact The audience engaged with during this workshop were academic researchers in the Performing Arts discipline.

Returning Ghosts focused on identifying new ways to recall memories using performance and technology and features performances and presentations. Jocelyn Spence gave a talk on the Rough Mile Experience.

One of the outcomes that has arisen was an early discussion about collaborating on a book chapter of performative works. It is hoped to facilitate dissemination of work (primarily situated in an HCI research community) to a Performing Arts research community.
Year(s) Of Engagement Activity 2016
 
Description Scores of Scores workshop and hackathon, Cambridge, UK 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The Oxford team presented their MELD technology to 32 attendees as a contribution to the Scores of Scores workshop and hackathon held at Cambridge Big Data.
Year(s) Of Engagement Activity 2018
 
Description Semantic Digital Humanities workshop, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Kevin Page from the FAST Oxford team co-organised this 3 day workshop which brought together contributors from the humanities and computer science, and academia and the arts and cultural heritage industry.
Year(s) Of Engagement Activity 2015
 
Description Semantic Web Technology for New Experiences throughout the Music Production-Consumption Chain, 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact This was a presentation of: Semantic Web Technology for New Experiences throughout the Music Production-Consumption Chain, Mark Sandler 1 , Steve Benford 2 , David De
Roure 3 , Kevin Page 3, 1 Queen Mary University of London, 2 University of Nottingham, 3 University of Oxford, at First International Workshop on Multilayer music representation and processing, Milan, 24 Jan 2019.
Year(s) Of Engagement Activity 2019
 
Description Seminar "Reflections of Ada Lovelace: creative computing, experimental humanities" (Pip Willcox) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Pip Willcox, head of the Centre for Digital Scholarship and Senior Researcher at the Oxford e-Research Centre, gave a talk on Ada Lovelace, creative computing, and experimental humanities as part of National University of Ireland Galway's Moore Institute series of Digital Scholarship Seminars in November 2016.

Taking inspiration from Oxford's celebrations of Ada Lovelace's 200th birthday in December 2015 and the performance of composer Emily Howard's 'Ada sketches' with mathematician Lasse Rempe Gillen, Pip Willcox has been working with Professor David De Roure and the FAST project to imagine what might have happened had Babbage built his Analytical Engine and Lovelace pursued its potential for musical composition: the Analytical Engine "might compose elaborate and scientific pieces of music of any degree of complexity or extent".

The Web application Numbers into Notes (reported under the relevant category) they developed uses the mathematics of Lovelace's day to produce sequences of notes whose music can be explored interactively by visualizing and selecting fragments to play, then exported as an audio file, piano roll, or sheet music. The application proved popular after the talk: Erin McCarthy, a doctoral student at NUIG, said "Thanks to @pipwillcox, this is what I'll be doing this afternoon".

The thought experiment continued with imagining what Lovelace might have done had she travelled forward to our time. Arduino microcontroller boards built to function as analytical engines run the Numbers into Notes software to enable them to play music. The location and orientation of the listener interacts with the Arduinos, enabling the audience to become co-creators of the music.

For further info see: https://www.oerc.ox.ac.uk/news/lovelace-NUI-Galway
Year(s) Of Engagement Activity 2016
 
Description Seminar at Image and Sound Processing Group (ISPG), Milan (G Fazekas) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact George Fazekas gave a seminar at the Image and Sound Processing Group (ISPG), Milan, June 2017. The topics covered were: Semantic Audio, Ontologies, Moed Recognition.
Year(s) Of Engagement Activity 2017
 
Description Seminar at McGIll University (Mark Sandler) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Mark Sandler's talk to McGill presented some current research from FAST in the context of other research both in C4DM and outside, particularly as it highlights issues related to Artificial Intelligence.
Year(s) Of Engagement Activity 2017
 
Description Seminar at Music Technology Group, Barcelona (G Fazekas) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Other audiences
Results and Impact Seminar at the Music Technology Group MTG-UPF, Barcelona, to researchers from MTG, in February 2017. The topic was Semantic Audio and Ontologies.
Year(s) Of Engagement Activity 2017
 
Description Series of talks in the Centre for Digital Scholarship: "Research Uncovered" (Oxford team) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Talks in the Centre for Digital Scholarship: "Research Uncovered" is a series of public talks on digital scholarship; many attendees come from around the University of Oxford but others come from the region, and audiences includes visitors from around the country and the world):

1) "Research Uncovered-David De Roure on Ada Lovelace, Numbers, and Notes", 22 Jan 2016. See: https://blogs.bodleian.ox.ac.uk/digital/2016/01/11/research-uncovered-david-de-roure-on-ada-lovelace-numbers-and-notes/
2) "Research Uncovered-The imagination of Ada Lovelace: creative computing and experimental humanities", part of the Oxford Women's International Festival. 7th March. See: https://blogs.bodleian.ox.ac.uk/digital/2017/01/09/pip-willcox/
3) "Research Uncovered-Making Numbers into Notes: the making of Ada Lovelace's generative music", part of the Oxford Women's International Festival. 7th March. See:
http://blogs.bodleian.ox.ac.uk/digital/2017/02/24/making-numbers-into-notes-the-making-of-ada-lovelaces-generative-music/
4) "Research Uncovered-Finding music to move to: Relevance in Music Information Retrieval", 31 Jan 2017. See: http://blogs.bodleian.ox.ac.uk/digital/2017/01/06/david-weigl/
Year(s) Of Engagement Activity 2016
 
Description SoLID workshop 21 July 2017 Oxford (D Weigl, D De Roure, G Klyne) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact The FAST Oxford team hosted and participated in a SoLiD (Social Linked Data) workshop, an outreach activity of the Social Machines (Sociam) project, which may be particularly relevant to realization of distributed DMOs. Twenty (20) people attended the workshop, a combination of regional and international audiences, mainly Semantic Web researchers and students. The workshop was a discussion of Social Linked Data protocols (https://solid.mit.edu) as a platform for creating decentralized linked data on the web. This capability is likely to be important for dealing with multi-ownership issues around DMO data as it passes along the music production-to-consumption value chain, and future collaboration with this work may allow FAST to provide compelling applications to drive adoption of this new technology. They also hosted the "Linked Data Lunchtime" presentation of SoLiD and Dokieli (distributed authoring and review system) to researchers from other groups within OeRC.
Year(s) Of Engagement Activity 2017
URL https://solid.mit.edu
 
Description Social Humanities workshop at Digital Humanities at Oxford Summer School 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Professor David de Roure (FAST Principal Investigator, Oxford) run a workshop on Social Humanities as part of the Digital Humanities Summer School in Oxford, 3 - 7 July 2017. The Digital Humanities at Oxford Summer School offers training to anyone with an interest in the Digital Humanities, including academics at all career stages, students, project managers, and people who work in IT, libraries, and cultural heritage. Delegates follow one of the week-long workshops offered, supplementing their training with expert guest lectures.
Year(s) Of Engagement Activity 2017
URL http://digital.humanities.ox.ac.uk/dhoxss/2017/
 
Description Social music machine: Crowdsourcing for composition & creativity 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Poster presentation by Alan Chamberlain, David De Roure and Pip Willcox, "Social music machine: Crowdsourcing for composition & creativity" at the DMRN+12: Digital Music Research Network Workshop 2017 organised by Queen Mary University of London, December 2017 in front of an audience of +50 international researchers and postgrad students. The workshop was sponsored by FAST.
Year(s) Of Engagement Activity 2017
 
Description Soundlincs 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Industry/Business
Results and Impact The Nottingham FAST team have established a collaboration with Soundlincs, a company that delivers musical outreach activities to disadvantaged communities around the midlands (http://www.soundlincs.org). Following an initial visit, they hosted a one day workshop to explore collaboration at which they identified various opportunities for future joint-projects.
Year(s) Of Engagement Activity 2015
URL http://www.soundlincs.org
 
Description Special Session panelist: Fusing Semantic and Audio Technologies for Intelligent Audio Production and Consumption project (FAST) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact George Fazekas, Centre for Digital Music, Queen Mary acted as a special session panelist: Fusing Semantic and Audio Technologies for Intelligent Audio Production and Consumption project (FAST), Innovation in Music 2015, Anglia Ruskin University, Cambridge, UK.

Intended for music industry professionals. Audience: 60-80.
Year(s) Of Engagement Activity 2015
URL http://innovationinmusic.com/
 
Description Talk at Tate Modern: The Making of Music: Creative Algorithmic interventions, and the Imagination of?Ada Lovelace 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact Public talk and hands-on demo by David De Roure on "The Making of Music: Creative Algorithmic interventions, and the Imagination of Ada Lovelace" at the Tate Modern, as part of a showcase event for the EPSRC PETRAS project (i.e. this event is at the intersection of PETRAS and FAST).
Year(s) Of Engagement Activity 2019
URL https://www.tate.org.uk/whats-on/tate-modern/tate-exchange/workshop/living-internet-things
 
Description Talk at University of Oxford Faculty of Music research colloquium 14 Nov 2017 (D Weigl) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact D Weigl was invited to give a talk on the subject of relevance in music information retrieval as part of the Faculty of Music's ongoing monthly series of research colloquia. The event was attended by 40 people. The audience was mostly drawn from the Oxford Faculty of Music, with some attendance from other members of the University of Oxford community, and from the public. The talk comprised a 50 minute presentation, 20 minutes of questions and discussion, followed by further discussion over a wine reception and subsequent dinner with a smaller group of 8 music DPhil students. Interesting discussions were had on applying digital methods to the students' music research. As a result, several students intend to attend future digital musicology meetings at the Oxford e-Research Centre.
Year(s) Of Engagement Activity 2017
 
Description Talk by G. Fazekas at the Alibaba Computing Conference, Sept 12-22, Hangzhou, China 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact George Fazekas gave a public talk at the Alibaba Computing Conference, Sept. 19-22, 2018, Hangzhou, China, in front of an audience of approximately 200 people including the general public and students. The talk was streamed reaching potentially thousands. Dr. Fazekas talked about intelligent music production, including some FAST outcomes e.g. SAFE compressor and data analysis from music production.

The talk led to the development of the Alibaba / AliMusic supporting UK-China Creative Industries Partnership Development Grant, titled "AI and Music in the Creative Industries of China and the UK" which got funded by AHRC in 2019.
Year(s) Of Engagement Activity 2018
URL https://www.alibabacloud.com/the-computing-conference-2018
 
Description Talk by Pip Willcox, Imitating Ada Lovelace: creative computing and experimental humanities, at Turing Institute event 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact Public lecture by Pip Willcox, "Imitating Ada Lovelace: creative computing and experimental humanities", at "Testing Turing: unsettling legacies'", The Alan Turing Institute. October 2017.

Willcox's talk, which draws on work with the David De Roure explores how Ada Lovelace might have developed her ideas about Babbage's Analytical Engine as a partner in the creative process, had she lived longer (Lovelace died in 1852, aged 36).

More at: https://www.turing.ac.uk/events/testing-turing-unsettling-legacies
Year(s) Of Engagement Activity 2017
 
Description Talks and posters at DMRN+11 (2016) (Oxford team) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Digital Music Research Network (DMRN) aims to promote research in the area of Digital Music, by bringing together researchers from UK universities and industry in electronic engineering, computer science, and music. The following FAST talks and posters were presented:
1) "Interacting with robots as performers and producers of music", Alan Chamberlain (University of Nottingham), Kevin R. Page, David De Roure, Graham Klyne and Pip Willcox(University of Oxford)"
2) "Understanding creativity and autonomy in music performance and composition: A proposed 'toolkit' for research and design", Alan Chamberlain (University of Nottingham), David De Roure, Pip Willcox (University of Oxford), Steve Benford and Chris Greenhalgh (University of Nottingham)
3) "Conceptualizing relevance for music information retrieval", David M. Weigl (University of Oxford)
Year(s) Of Engagement Activity 2016
URL http://c4dm.eecs.qmul.ac.uk/dmrn/events/dmrnp11/
 
Description Talks on "Random Forest Classification of folk songs" at two international conferences 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact Talks by FAST member Cornelia Metzig on "Random Forest Classification of folk songs", conference "Traditional Tunes and popular airs", June 8-9, Sheffield & conference "Folk Music Analysis", July 2-4, Birmingham. She presented a machine learning method and music similarity network with interactive web application to audiences from modelling and musicology. In both conferences this sparked a lot of interest, as many musicologists work on building databases but do not undertake data science research on them, and are interested in using the code for specific questions.

Cornelia found many people who are interested to use her code, three of which with a concrete project and data. She also received an invitation to give a lecture in Birmingham on data science (by Islah McLachln), and by A. Little from University of Oxford (music department).
Year(s) Of Engagement Activity 2019
 
Description The "Ada Sketches" event, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The "Ada sketches" event was held on 30 November, in the Mathematical Institute in Oxford. It opened with a performance of Ada sketches by four musicians from the Royal Northern College of Music, after which the work was explained musically and mathematically by its composer Emily Howard and mathematician Lasse Rempe- Gillen (from Liverpool), then it was performed a second time. After the break the participants went into the "co-creation phase" where audience members turned "numbers into notes" and these were performed by the musicians. The event captured a live annotation of the first performance by Carolin, and the audience response to the work before and after explanation was collected via questionnaires designed in conjunction with Daniel and Iris from Goldsmiths. The audience included several attendees of the IT as a Utility network "Internet of Audio Things event" which was held earlier that day.
Year(s) Of Engagement Activity 2015
 
Description The Ada Lovelace Symposium, Oxford 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact The Ada Lovelace Symposium was held on the 10-11 December 2015. There was a display in the coffee area with a slideshow based on the performance and played audio clips over headphones (silent disco!), which gave the participants a chance to sit, talk, and demo with interested delegates (many were musicians). On Wednesday afternoon there was a session in the symposium constructed as a conversation on stage between David de Roure and the composer Emily Howard. This also featured a clip of Emily's work "Mesmerism", which is another part of her Ada Lovelace Trilogy, and an example from David de Roure of generating a number sequence on a simulator of the Analytical Engine and developing the output as a music theme (i.e. directly addressing the Lovelace quote on which all our discussions have been based).

There was an additional musical event at the Wednesday evening reception in Blackwell Hall - world premières of "An algorithmic study on ADA" and "ADA", composed by James Whitbourn, performed by Commotio (mixed-voice contemporary choir), Andrew Bernardi (violin), Anna Lapwood (harp), and conducted by Matthew Berry.

David de Roure gave a presentation on all the above at QMUL as part of the Digital Music Research network event. The Transforming Musicology and FAST projects were acknowledged at both events.
Year(s) Of Engagement Activity 2015
URL https://dl.dropboxusercontent.com/u/15772302/NumbersIntoNotes/index.html
 
Description The B076 audio experience 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The B076 audio experience engaged with 12 members of the public who signed up to take part. They were recruited via the Primary Arts Space and distributed flyers. It was hosted in the Primary Arts Space, Nottingham. It was an indoor interactive installation where visitors walked around an empty exhibition space. iBeacons were distributed around the room which tracked the proximity of visitors, thus determining their location in the room. Their position triggered playback of different audio streams which culminate in a continuous soundscape narrative.

The most significant outcome/impact of this activity was extending the sensor functionality of the Semantic Player.
Year(s) Of Engagement Activity 2016
 
Description The FAST project 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact This was a presentation of the FAST project by Mark Sandler to Tandemlaunch Venture Capital, Montreal Canada, 14 November 2018.
Year(s) Of Engagement Activity 2018
 
Description The Making of Music: Creative Algorithmic interventions, and the Imagination of?Ada Lovelace (public lecture, D De Roure) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The FAST project combined forces with the ESRC PETRAS Internet of Things project in a public event at the at the Tate Modern on 8-9 February. The event explored how the Internet of Things is changing our lives now, and how it may influence or disrupt our futures - at home, at work and in our environment.

Professor David De Roure (University of Oxford) closed the event with a discussion about IoT, music, and creativity with his talk "The making of music: creative algorithmic interventions and the imagination of Ada Lovelace", including demos of arduino-based and algorithmically-enhanced electronic instruments developed in the FAST project.
Year(s) Of Engagement Activity 2019
URL https://www.tate.org.uk/whats-on/tate-modern/tate-exchange/workshop/living-internet-things
 
Description The Media Talentlab project 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact TalentLab is an annaul programme of events that supports the creative development of BAME artists and filmmakers who are ready to take their careers to the next level. The engagement activities with artists this project is involved in show how working with external artists is part and parcel of our approach to research, allowing us to explore innovative new ideas while also delivering public impact. In order to broaden the diversity of artists with whom we work the Nottingham team have recently established a relationship with the company B3 Media and their Talentlab programme which provides training, development and support for Black, Asian and Minority Ethnic artists. By running workshops with Talentlab 2015 (see: http://www.b3media.net/talentlab#.Vq9f7OsZ7uU) we have recruited three new artists - all working with sound and music in different ways - to collaborate with us on new projects over the coming year. Their proposals are investigating interfaces for live performance, remote streaming of environmental sounds, and interactive musical interfaces for wellbeing.
Year(s) Of Engagement Activity 2015
URL http://www.b3media.net/talentlab#.Vq9f7OsZ7uU
 
Description The Rough Mile 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Public/other audiences
Results and Impact The Rough Mile experience engaged with 22 members of the public, who signed up to take part. They were recruited via Rough Trade records, posters and flyers distributed around Nottingham City.

The Rough Mile experience consisted of two locative audio walks that took place on different days, for pairs of friends to come and experience together. The first walk was a pre-defined narrative performance that in part captured information from the friends about music tracks choices they would like to gift to each other. The second walk then consisted of this gifted experience, where they listened to these music tracks as between pairs of friends. The experience was a research exercise, but also a standalone 'artistic engagement' in its own right. Anecdotal evidence was captured from participants discussing their enjoyment and subsequent desire to seek out and engage with other similar experiences.

The most significant outcome / impact was the successful deployment of a detailed locative audio experience with a universally positive reception.
Year(s) Of Engagement Activity 2016
 
Description The imagination of Ada Lovelace and an Experimental Humanities (Digital Humanities at Oxford Summer School) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Summer school lecture: Pip Willcox and David De Roure. The imagination of Ada Lovelace and an Experimental Humanities. Digital Humanities at Oxford Summer School, Keble College, Oxford, July 2018.
Year(s) Of Engagement Activity 2018
 
Description Visit at University of Tokyo and Software Defined Media meeting, July 17 2018 (Florian Thalmann) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Florian Thalmann visited the Graduate School of Information Science and Technology (IST), University of Tokyo. He met with Dr. Manabu Tsukada and discussed similarities and differences between FAST ontologies and demonstrators and work at IST. He also attended the Software Defined Media meeting (SDM, http://sdm.wide.ad.jp) and gave a short presentation on FAST demonstrators related to the technology. He then attended a joint dinner with members of SDM.
Year(s) Of Engagement Activity 2018
URL http://sdm.wide.ad.jp
 
Description Visit at the DOREMUS meeting 11, Lille, Sept 2017 (Thomas Wilmering) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact Queen Mary team member (Thomas Wilmering) attended the DOREMUS Meeting 11 in Lille, France, September 28/29, 2017. The DOing REusable MUSical data (DOREMUS) research project is a French project that aims at improving music description to foster music exchange and reuse and enhancing the user experience for musical archives of France's largest institutions. I gave a one-hour presentation introducing the work in FAST related to metadata, ontologies and semantic audio for musical archives. The main investigators of the project were present (~20 people). The audience was from different French institutions including universities, companies and libraries.

The purpose of the visit was to exchange ideas about metadata for musical archives, since the DOREMUS and FAST project are related in several areas. Discussions covered ontology design and the role of semantic audio for musical archives.

Members of the audience reported that they were made aware of the significance of semantic audio analysis of musical archive content and reported change in views.
Year(s) Of Engagement Activity 2017
URL http://www.doremus.org/
 
Description Visit at the University of Kyoto, 20 August 2018 (Florian Thalmann) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Florian Thalmann visited the Speech and Audio Processing Group (SAP), University of Kyoto. He gave a short presentation and demonstration of various FAST demonstrators. He met with Kazuyoshi Yoshii and Eita Nakamura, and discussed the demonstrators and work at SAP with several students.
Year(s) Of Engagement Activity 2018
 
Description Visit of the Internet Archive, San Francisco, October 15, 2018 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Industry/Business
Results and Impact Presentation of two FAST demonstrators (Grateful Dead Live Explorer & FAST DJ) to founder Brewster Kahle & discussion of potential collaborations.
Year(s) Of Engagement Activity 2018
 
Description Workshop at Audio Mostly 2017 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact Workshop at Audio Mostly 2017: Interaction, Instruments and Performance: HCI and the Design of Future Music Technologies Technologies, Hosted By: Alan Chamberlain, Xenia Pestova, Mads Bodker, Maria Kalionpaa and David De Roure. This workshop examined the interplay between people, musical instruments, performance and technology. Now, more than ever technology is enabling us to augment the body, develop new ways to play, perform, and augment existing instruments that can span the physical and digital realms. By bringing together performers, artists, designers and researchers the aim was to develop new understandings how we might co-create new performance technologies.
Year(s) Of Engagement Activity 2017
URL http://audiomostly.com/conference-program/proceedings/
 
Description Workshop co-chair: Objective Evaluation in Semantic Audio Analysis and Processing (G. Fazekas) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Professional Practitioners
Results and Impact George Fazekas, Centre for Digital Music, Queen Mary, acted as workshop co-chair: Objective Evaluation in Semantic Audio Analysis and Processing, 138th International AES Convention, May 7-10, 2015. The workshop was intended for audio engineers and music industry professionals.
Year(s) Of Engagement Activity 2015
 
Description Workshop on Auditory Neuroscience, Cognition and Modelling 2016 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact The main aim of the organisers (Marcus Pearce, Emmanouil Benetos, Yvonne Blockland) was to organise and host at QMUL a workshop on Auditory Neuroscience and Computation, which took place on Wednesday 17 February 2016, at the Charterhouse Square campus. The workshop brought together auditory neuroscientists, cognitive scientists, as well as researches in music and audio signal processing and related fields. New insights on the cognitive and neural underpinnings of speech, music and sound processing were presented, with a large focus on EEG and MEG data analysis. The workshop focused on academic impact, however it had industry participation (from Audio Analytic, Red Apple Creative). Following an open call for abstracts and selection process., 32 presentations were accepted: 3 keynote talks, 6 oral presentations and 23 poster presentations.

The workshop website includes a PDF book of abstracts and video recorded oral presentations (see website below). Post-workshop summaries are being written by both workshop organizers and attendees, to be published to several venues: Psychomusicology, Young Acousticians Network newsletter, Audio Analytics Lab blog. Future plans: discussions are underway on applying for an EPSRC Research Network grant, for funding future workshops and network activities.

Post-workshop summaries are being written by both workshop organizers and attendees, to be published to several venues: Psychomusicology, Young Acousticians Network newsletter, Audio Analytics Lab blog.

- Psychomusicology report:
o Workshop on Auditory Neuroscience, Cognition and Modeling. Agres, Kat; Sauvé, Sarah Anne Psychomusicology: Music, Mind, and Brain, Vol 26(3), Sep 2016, 288-292. http://dx.doi.org/10.1037/pmu0000151
- Audio Analytic Lab blog post:
http://www.audioanalytic.com/aa-labs-impressions-on-the-workshop-on-auditory-neuroscience-cognition-and-modelling-2016/
- Young Acousticians Network newsletter:
https://euracoustics.org/activities/yan/yan-newsletter-folder/2016/march-2016/at_download/file

Preliminary discussions have been made with Iris Mencke and Elvira Brattico on hosting the next workshop.
Year(s) Of Engagement Activity 2015
URL http://c4dm.eecs.qmul.ac.uk/wancm2016/
 
Description Workshop on source separation 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact The hands-on workshop on sound source separation aims to inspire early-stage researchers in the field and promote the sense of scientific community by offering a common place for discussion. During the workshop, PhD students, senior researchers and academics all get together to spend the day actively brainstorming/hacking some source separation related topics given by some of us (so no keynotes/talks/posters). Everyone is there to engage with each other and so everyone becomes much more approachable than in a traditional conference setting and it promotes further collaborations between researches of the same or different institution.
Year(s) Of Engagement Activity 2018,2019
URL http://www.semanticaudio.ac.uk/blog/fast-phd-students-from-c4dm-organise-sound-source-separation-wor...
 
Description Workshop presentation by De Roure, David and Wilcox, Pip and Chamberlain, "Interconnected alchemy: an apparatus for alchemical algorithms" 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other audiences
Results and Impact David De Roure , Pip Willcox , Alan Chamberlain presented their talk "Interconnected Alchemy: An Apparatus for Alchemical Algorithms" at the "Listen to the Voice of Fire: Alchemy in Sound Art" workshop, 3 March 2017, National Library of Wales, Aberysthwyth.

More details can be accessed at: http://www.academia.edu/31559499/Listen_to_the_Voice_of_Fire_Alchemy_in_Sound_Art_March_3rd_National_Library_Wales_Aberystwyth
Year(s) Of Engagement Activity 2017
URL http://www.academia.edu/31559499/Listen_to_the_Voice_of_Fire_Alchemy_in_Sound_Art_March_3rd_National...
 
Description Workshop, "Audio in Place: Media, Mobility & HCI - Creating Meaning in Space" (by Chamberlain A., Bødker M., Hazzard A. and Benford S.) 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other audiences
Results and Impact Workshop based on presentation by Chamberlain A, Bødker M, Hazzard A and Benford S. (2016), "Audio in Place: Media, Mobility & HCI - Creating Meaning in Space", In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services.

Short workshop presentation, followed by discussion and then practical activities based around capturing and using audio to highlight issues related to HCI.

The workshop was a catalyst for further discussion and debate, new collaborations betweens attendees have arisen in the form of submitted research outputs (publications).
Year(s) Of Engagement Activity 2016
 
Description Workshops with BBC, Abbey Road, Rectify, Weav 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Industry/Business
Results and Impact Small discussion meetings exploring dynamic music formats and how it relates to Digital Music Objects and Dynamic Music.
Year(s) Of Engagement Activity 2015
 
Description Workshops with Omnifone Engineering teams 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Professional Practitioners
Results and Impact The FAST QMUL team was training the company in linked data and its advantages.
Year(s) Of Engagement Activity 2015
 
Description XML Summer School, Oxford 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Industry/Business
Results and Impact Graham Klyne from the Oxford FAST team gave talk in the "Trends and Transientstrack about linked data in the digital humanities. One of the two main examples used in this talk was the MELD framework, and how it uses linked data to connect musical structure (e.g. expressed using MEI) with other media and semantic descriptions.
Year(s) Of Engagement Activity 2019
URL https://xmlsummerschool.com/curriculum-2019/trends-and-transients-2019/