학술논문

Infinite dimensional control of doubly stochastic Jump Diffusions
Document Type
Conference
Source
2016 IEEE 55th Conference on Decision and Control (CDC) Decision and Control (CDC), 2016 IEEE 55th Conference on. :1145-1152 Dec, 2016
Subject
Robotics and Control Systems
Process control
Markov processes
Probability density function
Optimal control
Diffusion processes
Aerospace engineering
Language
Abstract
We present the infinite dimensional approach to control of a general class of doubly stochastic or otherwise known Q-mark Markov Jump Diffusion (Q-MJD) processes. The governing dynamics for the the probability density function (PDF) of this class of Q-MJD processes is a Partial Integro Differential Equation (PIDE). The infinite dimensional Minimum Principle (MP) is applied to control these PIDE dynamics. We qualitatively compare the infinite dimensional MP and the stochastic Dynamic Programming Principle (DPP) frameworks as applied to control of Q-MJD processes. The developed sampling based algorithms illustrate how the presented framework is a multi trajectory optimization method to solve nonlinear stochastic optimal control problems for Q-MJD processes.