학술논문

Utilizing related samples to learn complex queries in interactive concept-based video search
Document Type
Conference
Source
Proceedings of the ACM International Conference on Image and Video Retrieval. :66-73
Subject
concept-based video search
interactive search
related sample
Language
English
Abstract
One of the main challenges in interactive concept-based video search is the insufficient relevant sample problem, especially for queries with complex semantics. To address this problem, in this paper, we propose to utilize "related samples" to learn the complex queries. The "related samples" refer to those video segments that are irrelevant to the query but relevant to some of the related concepts of the query. Different from the relevant samples which may be rare, the related samples are usually sufficient and easy to find in the search result list. Specifically, we learn a detector for the query by simultaneously leveraging the related concept detectors, as well as users' feedbacks including relevant, irrelevant, and related samples. The query detector is then employed to predict the presence of the query in new video segments. As a result, new search results can be obtained according to the query presence. Furthermore, our approach is developed based on incremental learning technique. Thus, the query detector can be efficiently updated in each feedback iteration. We conduct experiments on two real-world video datasets: TRECVID 2008 and Youtube datasets. The experimental results demonstrate the effectiveness and efficiency of the proposed approach.

Online Access