RI Homepage Carnegie Mellon Homepage RI Homepage

The Robotics Institute

Carnegie Mellon Robotics Institute

An Automatic Sign Recognition and Translation System

Jie Yang, Jiang Gao, Ying Zang, Xilin Chen, and
Proceedings of the Workshop on Perceptive User Interfaces (PUI'01), November, 2001.


Download
  • Adobe portable document format (pdf) (1MB)
Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Abstract
A sign is something that suggests the presence of a fact, condition, or quality. Signs are everywhere in our lives. They make our lives easier when we are familiar with them. But sometimes they pose problems. For example, a tourist might not be able to understand signs in a foreign country. This paper discusses problems of automatic sign recognition and translation. We present a system capable of capturing images, detecting and recognizing signs, and translating them into a target language. We describe methods for automatic sign extraction and translation. We use a user-centered approach in system development. The approach takes advantage of human intelligence if needed and leverage human capabilities. We are currently working on Chinese sign translation. We have developed a prototype system that can recognize Chinese sign input from a video camera that is a common gadget for a tourist, and translate the signs into English or voice stream. The sign translation, in conjunction with spoken language translation, can help international tourists to overcome language barriers. The technology can also help a visually handicapped person to increase environmental awareness.

Notes

Text Reference
Jie Yang, Jiang Gao, Ying Zang, Xilin Chen, and , "An Automatic Sign Recognition and Translation System," Proceedings of the Workshop on Perceptive User Interfaces (PUI'01), November, 2001.

BibTeX Reference
@inproceedings{Yang_2001_3927,
   author = "Jie Yang and Jiang Gao and Ying Zang and Xilin Chen and ",
   title = "An Automatic Sign Recognition and Translation System",
   booktitle = "Proceedings of the Workshop on Perceptive User Interfaces (PUI'01)",
   month = "November",
   year = "2001",
}

The Robotics Institute is part of the School of Computer Science, Carnegie Mellon University.
Contact Us | Update Instructions