학술논문

Policy Optimization Over Submanifolds for Linearly Constrained Feedback Synthesis
Document Type
Periodical
Source
IEEE Transactions on Automatic Control IEEE Trans. Automat. Contr. Automatic Control, IEEE Transactions on. 69(5):3024-3039 May, 2024
Subject
Signal Processing and Analysis
Geometry
Costs
Manifolds
Cost function
Convergence
Behavioral sciences
Symmetric matrices
Optimization over submanifolds
output-feedback linear quadratic regulator (LQR) control
structured LQR (SLQR) control
constrained stabilizing controllers
Language
ISSN
0018-9286
1558-2523
2334-3303
Abstract
In this article, we study linearly constrained policy optimization over the manifold of Schur stabilizing controllers, equipped with a Riemannian metric that emerges naturally in the context of optimal control problems. We provide extrinsic analysis of a generic constrained smooth cost function that subsequently facilitates subsuming any such constrained problem into this framework. By studying the second-order geometry of this manifold, we provide a Newton-type algorithm that does not rely on the exponential mapping nor a retraction, while ensuring local convergence guarantees. The algorithm hinges instead upon the developed stability certificate and the linear structure of the constraints. We then apply our methodology to two well-known constrained optimal control problems. Finally, several numerical examples showcase the performance of the proposed algorithm.