Search

Navigator: RI | Publications | Toward Automatic Sign Translation

Graphics enhanced version of this site

Toward Automatic Sign Translation
J. Yang, J. Gao, Y. Zhang, and unknown
Proceedings of the First International Conference on Human Language Technology Conference (HLT 2001), March, 2001.

Jump to: Download | Abstract | Text Reference | BibTeX Reference


Download [Help]

Adobe portable document format (pdf) [981 KB]

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Abstract

Signs are everywhere in our lives. They make our lives easier when we are familiar with them. But sometimes they also pose problems. For example, a tourist might not be able to understand signs in a foreign country. In this paper, we present our efforts towards automatic sign translation. We discuss methods for automatic sign detection. We describe sign translation using example based machine translation technology. We use a user-centered approach in developing an automatic sign translation system. The approach takes advantage of human intelligence in selecting an area of interest and domain for translation if needed. A user can determine which sign is to be translated if multiple signs have been detected within the image. The selected part of the image is then processed, recognized, and translated. We have developed a prototype system that can recognize Chinese signs input from a video camera which is a common gadget for a tourist, and translate them into English text or voice stream.


Text Reference

J. Yang, J. Gao, Y. Zhang, and unknown, "Toward Automatic Sign Translation," Proceedings of the First International Conference on Human Language Technology Conference (HLT 2001), March, 2001.


BibTeX Reference

@inproceedings{Yang_2001_3936,
   author = "Jie Yang and Jiang Gao and Ying Zhang and unknown",
   title = "Toward Automatic Sign Translation",
   booktitle = "Proceedings of the First International Conference on Human Language Technology Conference (HLT 2001)",
   month = "March",
   year = "2001"
}


The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
For updates and comments, please see these instructions.
This page maintained by robotwebmaster@ri.cmu.edu