Controlling the Emotion of Music using Generative Deep Learning

Lead Research Organisation: University of Manchester
Department Name: Computer Science

Abstract

This research project aims to develop novel, knowledge-based deep learning techniques for emotional music generation. The primary objectives are: (1) To explore effective methods for converting 'vanilla' melodies into ones that express a specific emotional state, and (2) To identify which technique among statistical analysis, training neural networks, music information retrieval (MIR), or music theory offers the best emotion control over generated melodies.

The approach will involve resampling a melody, generated by an existing model, note-by-note, to reflect the chosen emotion. The effectiveness of each technique will be empirically evaluated using small datasets of symbolic music. A prototype will be created to allow users to either generate a new melody with a specified emotion or convert an existing melody to the chosen emotional state.

This project holds novelty in applying knowledge-enhanced deep learning methods to music composition for emotion representation. Its contributions will expand the knowledge in knowledge-based deep learning techniques and underscore the intersection of engineering, physical sciences, and musicology.

Publications

10 25 50

Studentship Projects

Project Reference Relationship Related To Start End Student Name
EP/T517823/1 01/10/2020 30/09/2025
2857056 Studentship EP/T517823/1 01/10/2021 31/03/2025 Jason Dominguez