Cortexica VisuRec: visual search of movies or music videos

Abstract

Google have built a multi billion dollar empire on the supply of text based searches. We
believe that over time, a similar opportunity exists for image based search. This means no
reason to type in your query or description into a search engine, simply submit an image or a
sample of video , and it will be recognised by a machine based vision system residing in the
cloud and give you information on what you are interested in looking at. Our vision for this
proof of concept project is for content on multiple media types (broadcast, movie, outdoor,
print) to be discoverable via a "handheld screen device". Introduction of a variety of
technologies will help users gain instant access to content and rich media and enable new
types of interaction.
So imagine you were to take a sample of a live playing video using your mobile phone from a
TV or video screen TV programme or film and instantly receive back relevant content and
extras on the program so that you could interact with the recognised video content in a variety
of ways:
• Receive back relevant content and extras
• If it’s a new movie trailer, add it to your Lovefilm wishlist.
• If it’s a music video, instantly resume play back on your mobile phone and take it
away with you.
• Take a video recording of another mobile phone playing a music video and “Thump”
it from mobile screen to mobile screen, enabling instant viral distribution of playing media.
Using the Cortexica VISUALSEARCHTM platform, a proof of concept will be to create the
vision we have just described
We believe there is a business opportunity to provide content owners and broadcasters with a
competitive edge by offering their customers a more engaging “third screen” experience and
new means of distributing media. Ultimately the content owners will be prepared to share
some of their increased revenue to have this competitive advantage.

Lead Participant

Project Cost

Grant Offer

CORTEXICA VISION SYSTEMS LIMITED £212,906 £ 100,000
 

Participant

IMPERIAL COLLEGE OF SCIENCE, TECHNOLOGY AND MEDICINE

People

ORCID iD

Publications

10 25 50