Bridging the Gap - visually impaired and sighted music producers working side by side
Lead Research Organisation:
Queen's University Belfast
Department Name: Sch of Arts, English and Languages
Abstract
This research will examine the access barriers encountered by visually-impaired music producers using software-based creative tools in the context of a music production studio. Performance Without Barriers (PwB) an established research team at Queen's University Belfast (QUB), active in the area of inclusive, accessible instrument design, will lead this proposed three-year research project. PwB will collaborate with the Centre for Digital Music (CDM) at Queen Mary University of London (QMUL), benefiting from their engineering expertise in electronics hardware design and development. The research aims to bridge the gap between visually-impaired music producers and their sighted counterparts. At the heart of the PwB team is a firm belief that equal and undifferentiated access to technology can lead to equal employment opportunities.
Many visually-impaired people utilise Screen-reading software for computer access. Due to underlying technical reasons, the majority of software used for music production, digital audio workstations (DAWs) for example, remain incompatible with such accessibility tools. On a fundamental level, the nature of control which screen-reading affords, is likely to have unintended consequences on creative processes such as music composition. In this project, PwB will examine accessibility in music production software for UK-based visually-impaired music producers and develop and evaluate alternatives to the screen-reader paradigm. Four main research questions will be focused upon, which PwB believe will lead to greater equality in accessing digital tools used for creative purposes. The main questions we pose are:
Which usability and accessibility issues are inherent in controlling music production software with a screen-reader?
How could the design of tactile control surface technologies improve the usability and accessibility of music production software for visually-impaired music producers?
Do visually-impaired music producers experience a greater degree of cognitive load when operating music production software in comparison to their sighted counterparts?
How do linear ways of accessing music production software parameters, currently the standard of many accessible software packages, inform or change the creative flow of the music production process?
Following the adage "Nothing About Us Without Us", the research is rooted in the disabled community, guided by the insights of a visually-impaired music producer (Dasent) with over 25 years of industry experience. Dasent will join PwB, on a QUB match-funded PhD studentship, becoming an integral part of this proposed research.
DAWs see use in a range of pursuits; music production, music composition, audio recording, audio mixing and mastering to name but a few. The outcomes of this research, therefore have the potential to impact visually-impaired people working with sound and music in several contexts. Furthermore, due to the pervasive nature of accessibility barriers in computing, the research has a potentially global impact. The outcomes of the research will contribute knowledge in accessibility studies, technological influence on creativity, and tactile human-computer interaction.
Three project partners (Creative United in London and two music production studios in Belfast) will support the team in enabling access to industry-standard music production tools and working methods. These partners will support the dissemination of research outcomes and promote the creative work of visually-impaired music producers through industry facing publications and a symposium. A documentary film of the research processes and outcomes has been discussed and agreed on with Outpost Production, Belfast.
Many visually-impaired people utilise Screen-reading software for computer access. Due to underlying technical reasons, the majority of software used for music production, digital audio workstations (DAWs) for example, remain incompatible with such accessibility tools. On a fundamental level, the nature of control which screen-reading affords, is likely to have unintended consequences on creative processes such as music composition. In this project, PwB will examine accessibility in music production software for UK-based visually-impaired music producers and develop and evaluate alternatives to the screen-reader paradigm. Four main research questions will be focused upon, which PwB believe will lead to greater equality in accessing digital tools used for creative purposes. The main questions we pose are:
Which usability and accessibility issues are inherent in controlling music production software with a screen-reader?
How could the design of tactile control surface technologies improve the usability and accessibility of music production software for visually-impaired music producers?
Do visually-impaired music producers experience a greater degree of cognitive load when operating music production software in comparison to their sighted counterparts?
How do linear ways of accessing music production software parameters, currently the standard of many accessible software packages, inform or change the creative flow of the music production process?
Following the adage "Nothing About Us Without Us", the research is rooted in the disabled community, guided by the insights of a visually-impaired music producer (Dasent) with over 25 years of industry experience. Dasent will join PwB, on a QUB match-funded PhD studentship, becoming an integral part of this proposed research.
DAWs see use in a range of pursuits; music production, music composition, audio recording, audio mixing and mastering to name but a few. The outcomes of this research, therefore have the potential to impact visually-impaired people working with sound and music in several contexts. Furthermore, due to the pervasive nature of accessibility barriers in computing, the research has a potentially global impact. The outcomes of the research will contribute knowledge in accessibility studies, technological influence on creativity, and tactile human-computer interaction.
Three project partners (Creative United in London and two music production studios in Belfast) will support the team in enabling access to industry-standard music production tools and working methods. These partners will support the dissemination of research outcomes and promote the creative work of visually-impaired music producers through industry facing publications and a symposium. A documentary film of the research processes and outcomes has been discussed and agreed on with Outpost Production, Belfast.
Organisations
Publications
Duarte E
(2023)
Analysis of Accessible Digital Musical Instruments through the lens of disability models: a case study with instruments targeting d/Deaf people
in Frontiers in Computer Science
Frid E
(2024)
Editorial: New advances and novel applications of music technologies for health, well-being, and inclusion
in Frontiers in Computer Science
McMillan, A
(2023)
Designing Accessible Musical Instruments by Addressing Musician-Instrument Relationships
in New Advances and Novel Applications of Music Technologies for Health, Well-Being, and Inclusion
TBC
(2023)
Below 38 BPS, Involving real time monitoring and self medication practices in music performance through IoT technology
in New Advances and Novel Applications of Music Technologies for Health, Well-Being, and Inclusion
Title | ALCI Performance |
Description | Together with visually-impaired musician, composer and academic James Cunningham we designed and developed a musical instrument built upon the physicality of an accessible long cane. This was named the accessible long cane instrument (ALCI). James performed with this instrument at the Haptic Audio Interaction Design Conference 2022 |
Type Of Art | Performance (Music, Dance, Drama, etc) |
Year Produced | 2022 |
Impact | The most notable impacts of this artistic endeavour were the social connections made with those attending the performance. It was also a fantastic opportunity to share the goals and motivations of the Bridging the Gap research project with fellow academics. |
Title | Bridging the Gap Podcast |
Description | This podcast series of five episodes interviews previous research participants from the blind and visually impaired music-making community. It is due to be released very shortly as a free download. |
Type Of Art | Artefact (including digital) |
Year Produced | 2023 |
Impact | The creation of this podcast has built on the relationships we have been developing as part of the Bridging the Gap research project. We hope that the podcast will help amplify the voices of our participants and provide an information source to VIB creatives interested in learning sound and music technology and those involved in the design and development of music technology products. |
Description | The primary finding of this study to date is the identification of three gaps impacting the accessibility of music software from the perspective of blind and visually impaired people. These gaps include a gap in technology, education and information, i.e. many mainstream music software programs are not entirely accessible at the point of purchase, educators are often unaware of accessible workflows in music software, and finally, there is a lack of information on which music software packages are accessible, how to improve accessibility and alternative accessible workflows. Our research has demonstrated that online communities of visually impaired and blind people are critical in bridging the three gaps above. Community members openly develop and share software tools to improve music software accessibility; they share knowledge, teaching one another accessible workflows and music production techniques. These communities are proactive in addressing barriers to music-making and, therefore, stand in contrast to the charity model of disability. |
Exploitation Route | Continuation of linking closely with industry partners has been an essential finding and we want to encourage further accessible, inclusive research design to continuously connect with industry partners. The main issues to address and to take forward are to close the gaps in: - technology - education - information, i.e. many mainstream music software programs are not entirely accessible at the point of purchase, and educators are often unaware of accessible workflows in music software, and finally, there is a lack of information on which music software packages are accessible, how to improve accessibility and alternative accessible workflows. |
Sectors | Creative Economy Education Healthcare |
URL | https://performancewithoutbarriers7.wordpress.com/bridging-the-gap/music-software-accessibility-symposium/ |
Description | Initial findings were used and discussed during our Symposium in London, 2022, where industry partners were linked tp, and discussed accessibility issue with representatives from the VIB music creators community. |
First Year Of Impact | 2022 |
Impact Types | Cultural Societal |
Description | Investigating Mental Models Of DAW Software Use By Visually-impaired Musicians |
Amount | £97,000 (GBP) |
Organisation | Ableton AG |
Sector | Private |
Country | Germany |
Start | 03/2022 |
End | 10/2023 |
Description | Accessibility Zone at the Audio Developers Conference |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Industry/Business |
Results and Impact | The Audio Developer Conference is the largest annual conference of its kind, attracting an international audience of designers and developers of music software. Together with Jason Dasent we supported the Accessibility Zone; a new initiative intended to celebrate VIB-accessible products in the music technology industry. |
Year(s) Of Engagement Activity | 2022 |
URL | https://audio.dev/conference/ |
Description | International Synth Design Hackathon (NI Science Festival) |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Public/other audiences |
Results and Impact | This event offered an opportunity for the general public to design and build their very own sound experiences in collaboration Belfast-based sound art collective, Tone Burst. Supported by Cycling 74, Electrosmith and Synthux Academy, this event provided access to a range of cutting-edge digital fabrication technologies, including 3D printers and laser-cutting machines. This was a fantastic event that shared the technical expertise of research staff with those outside of academia. |
Year(s) Of Engagement Activity | 2023,2024 |
URL | https://nisciencefestival.com/events/international-synth-design-hackathon |
Description | Invited Keynote Performance at the Health Innovation and Research Alliance NI (HIRANI), Health Tech Spring conference, using our new Virtual Reality Instruments, 2024 |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Following on from our success at the Belfast International Festival 2023 and coverage on BBC and ITV, I was invited to curate a keynote performance as part of the Health Innovation and Research Alliance NI (HIRANI), Health Tech Spring conference: Belfast 29 & 30 April 2024. With local and global partners, the conference focused on two strands; digital ecosystems to integrate diagnostics and therapeutics; and community people-centred design to accelerate innovation and adoption of health technology. HIRANI expanded the event into a two-day conference which included a "Life Sciences, Life Support" event for businesses who provide support services to the life science industry. With Innovation zones and pitching events, global keynotes and local thought leaders, Health Tech Spring was an iconic conference hosted in the Titanic Building. |
Year(s) Of Engagement Activity | 2024 |
URL | https://hira-ni.com/event/health-tech-spring-conference |
Description | Jason Dasent Genisys Concert and Seminar |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | National |
Primary Audience | Public/other audiences |
Results and Impact | During a seminar and concert at SARC, blind music producer and academic Jason Dasent shared his experiences in music technology, music production and software development over the past 25 years. Jason is currently pursuing a PhD at Kingston University where he is developing a voice assistant for use in recording studios to allow differently-abled producers and audio engineers to function more independently. His academic work also formed part of his presentation. |
Year(s) Of Engagement Activity | 2022 |
URL | https://www.qub.ac.uk/sarc/events/EventsArchive/Concert-JasonDasentGENISYS.html |
Description | Keynote at ICDC2024 - Invited keynote address at the Third Interdisciplinary Conference on Disability and Consumption |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | Invited keynote presentation entitled ""Performing without barriers - researching accessible musical instruments embedded in communities of practice". We presented the work from "Bridging the Gap" in the wider context of our "Performance without Barriers" research group. The conference was co-chaired by Dr. Hilary Downey (Queen's University Belfast, CHARMS, Northern Ireland), Dr. Anthony Beudaert (University Toulouse Jean Jaurès, CERTOP, France) and Dr. Jean-Philippe Nau (University of Lorraine, CEREFIGE, France), whose work has been largely devoted to consumers with disabilities. |
Year(s) Of Engagement Activity | 2024 |
URL | https://icdc-belfast.sciencesconf.org/ |
Description | Music Software Accessibility Symposium |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Professional Practitioners |
Results and Impact | This was a one-day free hybrid (online and in person) symposium that brought together people interested in understanding and improving blind and visually impaired (VIB) access to music technology. The event was attended by VIB musicians, sound engineers, live performers, bedroom producers, software developers, product owners and academics. The event featured several talks, panel discussions. Attendees also engaged in a design activity. |
Year(s) Of Engagement Activity | 2022 |
URL | https://performancewithoutbarriers7.wordpress.com/bridging-the-gap/music-software-accessibility-symp... |
Description | Opening a DAW for Accessibility: CSUN Assistive Technology Conference Presentation |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Industry/Business |
Results and Impact | The Digital Audio Workstation (DAW) is an essential piece of technology used within the music industry. In this session, Jacob Harrison from the Bridging the Gap team explores the trials and tribulations of making DAWs accessible to the visually impaired and blind communities. |
Year(s) Of Engagement Activity | 2023 |
URL | https://www.csun.edu/cod/conference/sessions/index.php/public/presentations/view/1477 |
Description | Presentation at QUB Disability Research Network Postgraduate Research Forum: Showcase Event |
Form Of Engagement Activity | A talk or presentation |
Part Of Official Scheme? | No |
Geographic Reach | Local |
Primary Audience | Postgraduate students |
Results and Impact | Alex Lucas and James Cunningham gave a 15-minute presentation at this event that provided an overview of the activities of the Bridging the Gap research project to date. This event also provided an opportunity to connect with academics within QUB who's research is linked to disability studies. |
Year(s) Of Engagement Activity | 2022 |
Description | Zoomtime Over and Out - A "Performance without Barriers" collaboration at the Belfast International Arts Festival, 2023 |
Form Of Engagement Activity | Participation in an activity, workshop or similar |
Part Of Official Scheme? | No |
Geographic Reach | International |
Primary Audience | Public/other audiences |
Results and Impact | Zoom Time - Over and Out: Belfast International Arts Festival, 2023: An inclusive ensemble performance with the Ulster Orchestra. Featuring Prof Schroeder's "Performance without Barriers" Research Group:Schroeder, Franziska (Developer); Lucas, Alex (Producer); Cunningham, James (Performer) et al.. 2023. Funded by UKRI, as part of "Future Screens NI". |
Year(s) Of Engagement Activity | 2023 |
URL | https://youtu.be/_t2TVEPlRYI |