Putting Active Learning into Multimedia Applications: Dynamic Definition and Refinement of Concept Classifiers

Ming-Yu Chen, Michael Christel, Alex Hauptmann, and Howard Wactlar
Proc. ACM Multimedia 2005, December, 2005, pp. 902-911.


Download
  • Adobe portable document format (pdf) (3MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
The authors developed an extensible system for video exploitation that puts the user in control to better accommodate novel situations and source material. Visually dense displays of thumbnail imagery in storyboard views are used for shot-based video exploration and retrieval. The user can identify a need for a class of audiovisual detection, adeptly and fluently supply training material for that class, and iteratively evaluate and improve the resulting automatic classification produced via multiple modality active learning and SVM. By iteratively reviewing the output of the classifier and updating the positive and negative training samples with less effort than typical for relevance feedback systems, the user can play an active role in directing the classification process while still needing to truth only a very small percentage of the multimedia data set. Examples are given illustrating the iterative creation of a classifier for a concept of interest to be included in subsequent investigations, and for a concept typically deemed irrelevant to be weeded out in follow-up queries. Filtering and browsing tools making use of existing and iteratively added concepts put the user further in control of the multimedia browsing and retrieval process.

Keywords
video retrieval, extensible concept classification, active learning

Notes
Sponsor: ARDA
Associated Center(s) / Consortia: Vision and Autonomous Systems Center
Associated Project(s): Informedia Digital Video Library

Text Reference
Ming-Yu Chen, Michael Christel, Alex Hauptmann, and Howard Wactlar, "Putting Active Learning into Multimedia Applications: Dynamic Definition and Refinement of Concept Classifiers," Proc. ACM Multimedia 2005, December, 2005, pp. 902-911.

BibTeX Reference
@inproceedings{Christel_2005_6847,
   author = "Ming-Yu Chen and Michael Christel and Alex Hauptmann and Howard Wactlar",
   title = "Putting Active Learning into Multimedia Applications: Dynamic Definition and Refinement of Concept Classifiers",
   booktitle = "Proc. ACM Multimedia 2005",
   pages = "902-911",
   publisher = "ACM",
   month = "December",
   year = "2005",
}