학술논문

Using POMDP-based state estimation to enhance agent system survivability
Document Type
Conference
Source
IEEE 2nd Symposium on Multi-Agent Security and Survivability, 2005. Multi-Agent Security and Survivability Multi-Agent Security and Survivability, 2005 IEEE 2nd Symposium on. :11-20 2005
Subject
Computing and Processing
State estimation
Sensor systems
Actuators
System testing
Resilience
Logistics
Intelligent sensors
Bonding
Sensor phenomena and characterization
Robustness
Language
Abstract
A survivable agent system depends on the incorporation of many recovery features. However, the optimal use of these recovery features requires the ability to assess the actual state of the agent system accurately at a given time. This paper describes an approach for the estimation of the state of an agent system using partially-observable Markov decision processes (POMDPs). POMDPs are dependent on a model of the agent system - components, environment, sensors, and the actuators that can correct problems. Based on this model, we define a state estimation for each component (asset) in the agent system. We model a survivable agent system as a POMDP that takes into account both environmental threats and observations from sensors. We describe the process of updating the state estimation as time passes, as sensor inputs are received, and as actuators affect changes. This state estimation process has been deployed within the Ultralog application and successfully tested using Ultralog's survivability tests on a full-scale (1000+) agent system.