학술논문

Risk sensitive control of finite state machines on an infinite horizon. I
Document Type
Conference
Source
Proceedings of the 36th IEEE Conference on Decision and Control Decision and control Decision and Control, 1997., Proceedings of the 36th IEEE Conference on. 4:3407-3412 vol.4 1997
Subject
Robotics and Control Systems
Computing and Processing
Automata
Robust control
Output feedback
Stochastic resonance
Control systems
Infinite horizon
State feedback
Optimal control
Cost function
Information analysis
Language
ISSN
0191-2216
Abstract
Robust and risk sensitive control of discrete time, finite state systems on an infinite horizon is considered, with either state or output feedback. The solution of the state feedback robust control problem is characterized in terms of the value of an average cost dynamic game. The risk sensitive stochastic optimal control problem is solved using the policy iteration algorithm, and the optimal rate is expressed in terms of the value of a stochastic dynamic game with average cost per unit time criterion. By taking a small noise limit a deterministic dynamic game is obtained, which is closely related to the robust control problem. For the problem with output feedback (partial state information) the analysis depends on introducing appropriate information states for the risk sensitive and robust control problems.