Name-It: Naming and Detecting Faces in News Video

S. Satoh, Toshio Sato, Michael Smith, Y. Nakamura, and Takeo Kanade
Network-Centric Computing (NCC) Special Issue, , 1996


Download
  • Adobe portable document format (pdf) (2MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
We have developed Name-It, a system that associates faces and names in news videos. The system is given news videos, which include image sequences and transcripts obtained from audio tracks or closed caption texts. The system can then either infer possible name candidates for a given face, or locate a face in news videos by name. To accomplish this task, the system takes a multi-modal video analysis approach: face sequence extraction/identification from videos, name extraction from transcripts, and video caption recognition. Each method includes several advanced image and natural language processing techniques: face tracking, face identification, intelligent name extraction using dictionary, thesaurus, and parser, text region detection, image enhancement, character recognition, and the integration of these techniques. The success of our experiments demonstrates the benefits of a multi-modal approach to video analysis.

Notes
Associated Center(s) / Consortia: Vision and Autonomous Systems Center

Text Reference
S. Satoh, Toshio Sato, Michael Smith, Y. Nakamura, and Takeo Kanade, "Name-It: Naming and Detecting Faces in News Video," Network-Centric Computing (NCC) Special Issue, , 1996

BibTeX Reference
@article{Sato_1996_3158,
   author = "S. Satoh and Toshio Sato and Michael Smith and Y. Nakamura and Takeo Kanade",
   title = "Name-It: Naming and Detecting Faces in News Video",
   journal = "Network-Centric Computing (NCC) Special Issue",
   year = "1996",
}