Putting Active Learning into Multimedia Applications: Dynamic Definition and Refinement of Concept Classifiers - Robotics Institute Carnegie Mellon University

Putting Active Learning into Multimedia Applications: Dynamic Definition and Refinement of Concept Classifiers

Ming-Yu Chen, Michael Christel, Alex Hauptmann, and Howard Wactlar
Conference Paper, Proceedings of 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05), pp. 902 - 911, November, 2005

Abstract

The authors developed an extensible system for video exploitation that puts the user in control to better accommodate novel situations and source material. Visually dense displays of thumbnail imagery in storyboard views are used for shot-based video exploration and retrieval. The user can identify a need for a class of audiovisual detection, adeptly and fluently supply training material for that class, and iteratively evaluate and improve the resulting automatic classification produced via multiple modality active learning and SVM. By iteratively reviewing the output of the classifier and updating the positive and negative training samples with less effort than typical for relevance feedback systems, the user can play an active role in directing the classification process while still needing to truth only a very small percentage of the multimedia data set. Examples are given illustrating the iterative creation of a classifier for a concept of interest to be included in subsequent investigations, and for a concept typically deemed irrelevant to be weeded out in follow-up queries. Filtering and browsing tools making use of existing and iteratively added concepts put the user further in control of the multimedia browsing and retrieval process.

BibTeX

@conference{Chen-2005-9357,
author = {Ming-Yu Chen and Michael Christel and Alex Hauptmann and Howard Wactlar},
title = {Putting Active Learning into Multimedia Applications: Dynamic Definition and Refinement of Concept Classifiers},
booktitle = {Proceedings of 13th Annual ACM International Conference on Multimedia (MULTIMEDIA '05)},
year = {2005},
month = {November},
pages = {902 - 911},
publisher = {ACM},
keywords = {video retrieval, extensible concept classification, active learning},
}