Carnegie Mellon University
An Integrated Framework for High Level Information Fusion

Katia Sycara, Robin Glinton, Bin Yu, Joseph Andrew Giampapa, Sean R. Owens, , and LTC Charles Grindle
International Journal of Information Fusion, April, 2007.

In today? fast paced military operational environment, vast amounts of information must be sorted out and fused not only to allow commanders to make situation assessments, but also to support the generation of hypotheses about enemy force disposition and enemy intent. Current information fusion technology has the following two limitations. First, current approaches do not consider the battlefield context as a first class entity. In contrast, we consider situational context in terms of terrain analysis and inference. Second, there are no integrated and implemented models of the high-level fusion process. This paper describes the HiLIFE (High-Level Information Fusion Environment) computational framework for seamless integration of high levels of fusion (levels 2, 3 and 4). The crucial components of HiLIFE that we present in this paper are: (1) multi-sensor fusion algorithms and their performance results that operate in heterogeneous sensor networks to determine not only single targets but also force aggregates, (2) computational approaches for terrain-based analysis and inference that automatically combine low-level terrain features (such as forested areas, rivers, etc.) and additional information, such as weather, and transforms them into high-level militarily relevant abstractions, such as NO-GO, SLOW-GO areas, avenues of approach, and engagement areas, (3) a model for inferring adversary intent by mapping sensor readings of opponent forces to possible opponent goals and actions, and (4) sensor management for positioning intelligence collection assets for further data acquisition. The HiLIFE framework closes the loop on information fusion by specifying how the different components can computationally work together in a coherent system. Furthermore, the framework is inspired by a military process, the Intelligence Preparation of the Battlefield, that grounds the framework in practice. HiLIFE is integrated with a distributed military simulation system, OTBSAF, and the RETSINA multi-agent infrastructure to provide agile and sophisticated reasoning. In addition, the paper presents validation results of the automated terrain analysis that were obtained through experiments using military intelligence Subject Matter Experts (SMEs).

High-level fusion, Intent inference, Integrated framework

Sponsor: Air Force Office for Scientific Research (AFOSR)
Associated Center(s) / Consortia: Center for Integrated Manfacturing Decision Systems
Associated Lab(s) / Group(s): Advanced Agent - Robotics Technology Lab
Associated Project(s): AFOSR PRET: Information Fusion for Command and Control: The Translation of Raw Data To Actionable Knowledge and Decision
Note: Article in press.

Text Reference
Katia Sycara, Robin Glinton, Bin Yu, Joseph Andrew Giampapa, Sean R. Owens, , and LTC Charles Grindle, "An Integrated Framework for High Level Information Fusion," International Journal of Information Fusion, April, 2007.

BibTeX Reference
   author = "Katia Sycara and Robin Glinton and Bin Yu and Joseph Andrew Giampapa and Sean R Owens and and LTC Charles Grindle",
   title = "An Integrated Framework for High Level Information Fusion",
   journal = "International Journal of Information Fusion",
   publisher = "Elsevier B.V.",
   month = "April",
   year = "2007",
   Notes = "Article in press."