Automatic Detection and Translation of Text from Natural Scenes - Robotics Institute Carnegie Mellon University

Automatic Detection and Translation of Text from Natural Scenes

Jie Yang, Xiaoping Chen, Jiayong Zhang, Yun Zhang, and Alex Waibel
Conference Paper, Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '02), pp. 2101 - 2104, May, 2002

Abstract

Large amounts of information are embedded in natural scenes. Signs are good examples of natural objects with high information content. In this paper, we discuss problems in automatic detection and translation of text from natural scenes. We describe the chal1enges of automatic text detection and propose methods to address these chal1enges. We extend example based machine translation technology for sign translation and present a prototype system for Chinese sign translation. This system is capable of capturing images, automatically detecting and recognizing text, and translating the text into English. The translation can be displayed on a palm size PDA, or synthesized as a voice output message over the earphones.

BibTeX

@conference{Yang-2002-8456,
author = {Jie Yang and Xiaoping Chen and Jiayong Zhang and Yun Zhang and Alex Waibel},
title = {Automatic Detection and Translation of Text from Natural Scenes},
booktitle = {Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '02)},
year = {2002},
month = {May},
pages = {2101 - 2104},
}