ViMuSe - a video-based AI music recommendation engine to improve creative efficiency and diversity.

Lead Participant: PYRSOS AI RESEARCH LTD

Abstract

This project aims to develop an AI tool which will instantly recommend music tracks that would go well with a specific video clip (i.e. movie trailer). Our proposed recommendation engine will be able to dynamically recommend music tracks that are well-suited to the video content, even if the user does not have a specific music track in mind.

This project unites Pyrsos' outstanding research capabilities with DAACI's existing music catalogue and software platform infrastructure to build cutting edge machine learning technology and make it available to a broad audience. It builds upon state-of-the art representation learning for multimedia and advances it by training a neural network that can map video and music excerpts into a shared semantic space. Extensive user testing will be conducted during the project to evaluate the technology and provide feedback.

Lead Participant

Project Cost

Grant Offer

PYRSOS AI RESEARCH LTD £177,534 £ 124,273
 

Participant

DAACI LIMITED £26,821 £ 18,775
INNOVATE UK

Publications

10 25 50