“Robust Media Search” Instantaneously Identifies Audio/video Content

Technological fields
Cutting-edge Technologies
Keyword
  • Audio search
  • Video search
  • Copyright management
Laboratory organization
NTT Communication Science Laboratories

Download PDF (384KB)


Overview

Robust Media Search (RMS) is a basic multipurpose search technology for audio and video signals. It has been used, for example, in copyright monitoring systems for video sharing sites on the Internet that can instantaneously detect the uses of known content. The most recent development not only doubles the search speed and further increases the robustness, but also adds a highly distinctive search function that distinguishes very small content differences. It expands the application areas of RMS; for example, it enables version analysis or use generation tracking for audio/video content.

Features

  • Fast: Enables a real-time full-scan for all the major video posting sites in the world
  • Robust: Strong against noise, signal degradation, occlusion, and even editing
  • Accurate: Distinguishes very small differences while maintaining the robustness
  • Precise: Detects any audio or video segments if they are any part of known signals
  • Scalable: Works at various scales, e.g. on a mobile device or on hundreds of servers

Application scenarios

  • Copyright management/enforcement on the Internet such as in video sharing sites
  • Ads/recommendations that are sensitive to a playback history of audio/video content
  • Ratings/analysis for programs, movies, music, commercials on TV, radio or the Internet
  • Internet search engines accepting audio or video fragments as queries

figure