Controlling the Emotion of Music using Generative Deep Learning
Lead Research Organisation:
University of Manchester
Department Name: Computer Science
Abstract
This research project aims to develop novel, knowledge-based deep learning techniques for emotional music generation. The primary objectives are: (1) To explore effective methods for converting 'vanilla' melodies into ones that express a specific emotional state, and (2) To identify which technique among statistical analysis, training neural networks, music information retrieval (MIR), or music theory offers the best emotion control over generated melodies.
The approach will involve resampling a melody, generated by an existing model, note-by-note, to reflect the chosen emotion. The effectiveness of each technique will be empirically evaluated using small datasets of symbolic music. A prototype will be created to allow users to either generate a new melody with a specified emotion or convert an existing melody to the chosen emotional state.
This project holds novelty in applying knowledge-enhanced deep learning methods to music composition for emotion representation. Its contributions will expand the knowledge in knowledge-based deep learning techniques and underscore the intersection of engineering, physical sciences, and musicology.
The approach will involve resampling a melody, generated by an existing model, note-by-note, to reflect the chosen emotion. The effectiveness of each technique will be empirically evaluated using small datasets of symbolic music. A prototype will be created to allow users to either generate a new melody with a specified emotion or convert an existing melody to the chosen emotional state.
This project holds novelty in applying knowledge-enhanced deep learning methods to music composition for emotion representation. Its contributions will expand the knowledge in knowledge-based deep learning techniques and underscore the intersection of engineering, physical sciences, and musicology.
Organisations
People |
ORCID iD |
Ke Chen (Primary Supervisor) | |
Jason Dominguez (Student) |
Studentship Projects
Project Reference | Relationship | Related To | Start | End | Student Name |
---|---|---|---|---|---|
EP/T517823/1 | 01/10/2020 | 30/09/2025 | |||
2857056 | Studentship | EP/T517823/1 | 01/10/2021 | 31/03/2025 | Jason Dominguez |