×

An inverse-free ADI algorithm for computing Lagrangian invariant subspaces. (English) Zbl 1438.65079

This paper deals with the numerical computation of Lagrangian invariant subspaces of large-scale Hamiltonian matrices in the context of the solution of Lyapunov equations.
Given matrices \(F,W=W^T\in\mathbb{R}^{n\times n}\), a Lyapunov equation is a linear matrix equation of the form \[ F^TX+XF+W=0, \] to be solved for a symmetric matrix \(X\). This equation is closely connected to the algebraic Riccati equations \[ F^TX+XF+W-XGX=0, \] where \(G=G^T\in\mathbb{R}^{n\times n}\), to be solved for \(X=X^T\) such that \(F-GX\) has all its eigenvalues in the open left half plane.
For small and medium-size problems (\(n\approx 1000\)), the most usual methods in practice for solving the Riccati equation use a reformulation as an invariant subspace problem: Find \(S\in\mathbb{R}^{2n\times n}\) with full column rank and \(T\in\mathbb{R}^{n\times n}\) with eigenvalues in the left half plane such that \(HS=ST\) with \[ H=\begin{bmatrix} F&G\\ -W&-F^T\end{bmatrix}. \] The solution of this problem is related to the Riccati equation: Setting \[ S=\begin{bmatrix} S_1\\ S_2\end{bmatrix},\;\;\text{with}\;\;S_1,S_2\in\mathbb{R}^{n\times n} \] the solution of the Riccati equation is \(X=S_2S_1^{-1}\). The difference in accuracy between the approaches based on the invariant subspace problem \(HS=ST\) and those based on solving Riccati equation directly is mostly evident in the case in which matrix \(S_1\) is ill-conditioned or almost singular, corresponding to a solution \(X\) with very large entries. This situation is described as close to uncontrollability.
On the other hand, a property that holds in many cases is that the eigenvalues of \(X\) decay very rapidly, so that \(X\) can be approximated accurately by a low-rank matrix \(ZZ^T\), \(Z\in\mathbb{R}^{n\times k}\), \(k\ll n\). So, \[ X\approx ZZ^T,\;\mathcal{S} = \operatorname{im}S,\;\text{with}\;S\approx\begin{bmatrix} I\\ ZZ^T\end{bmatrix}, \] is a data-sparse format to represent and compute the solution.
In this paper, the authors consider the low-rank alternating direction iteration (LR-ADI) method for Lyapunov equations and propose a way to combine it with ideas from inverse-free techniques to represent a basis of invariant subspace \(\mathcal{S}=\operatorname{Im}\begin{bmatrix} I\\ X\end{bmatrix}\) that is well-conditioned even if \(\|X\|>1\) and the problem is close to uncontrollability. The inverse-free representation uses a pair \((A,E)\) such that \(Z=AE^{-1}\) in the low-rank factor \(Z\) of \(X\), and they show how to adapt the main LR-ADI loop to work with it.
At termination of the LR-ADI, the authors show how \((A,E)\) can be used to construct directly a data-sparse representation of \(\mathcal{S}\) \[ \mathcal{S} = \operatorname{im}U,\;\text{with}\;U=\begin{bmatrix} I_n-U_1U_2^T\\ U_3U_4^T\end{bmatrix}, \] where \(U_1,U_2,U_3,U_4\in\mathbb{R}^{n\times k}\) with \(k\ll n\), for which the condition number \(\kappa(U)\) can be bounded explicitly. This achieves both goals of data sparsity and stability in the case of close to uncontrollable problems.
Finally, a partial error analysis is presented and some numerical examples are provided to confirm the theoretical results and to compare the proposed methods with other known ones.

MSC:

65F45 Numerical methods for matrix equations
65F55 Numerical methods for low-rank matrix approximation; matrix compression

References:

[1] AntoulasAC. Approximation of large‐scale dynamical systems. In Advances in Design and Control, Vol. 6. Society for Industrial and Applied Mathematics (SIAM): Philadelphia, PA, 2005. · Zbl 1112.93002
[2] BennerP, MehrmannV, SorensenD. Dimension reduction of large‐scale systems. In Lecture Notes in Computational Science and Engineering, Vol. 45. Springer‐Verlag: Heidelberg, 2005.
[3] HinrichsenD, PritchardAJ. Mathematical Systems Theory I. Modelling, State Space Analysis, Stability and Robustness. Springer‐Verlag: New York, NY, 2005. · Zbl 1074.93003
[4] LancasterP, TismenetskyM. The Theory of Matrices (2nd edn). Academic Press: Orlando, 1985. · Zbl 0558.15001
[5] LancasterP, RodmanL. Algebraic Riccati Equations. Oxford University Press: Oxford, 1995. · Zbl 0836.15005
[6] MehrmannV. The autonomous linear quadratic control problem. In Theory and Numerical Solution, Lecture Notes in Control and Information Sciences, Vol. 163. Springer‐Verlag: Berlin, 1991. · Zbl 0746.93001
[7] BennerP, MehrmannV, SimaV, Van HuffelS, VargaA. SLICOT - a subroutine library in systems and control theory. Applied and Computational Control, Signals and Circuits1999; 1:505-546.
[8] The MATLAB control toolbox, version 5.0. The MathWorks, Inc., Cochituate Place, 24 Prime Park Way, Natick, Mass, 01760, 2000.
[9] ChuD, LiuX, MehrmannV. A numerical method for computing the Hamiltonian Schur form. Numerische Mathematik2007; 105(3):375-412. · Zbl 1116.65043
[10] MehrmannV, SchröderC, WatkinsDS. A new block method for computing the Hamiltonian Schur form. Linear Algebra and Its Applications2009; 431(3‐4):350-368. · Zbl 1168.65337
[11] WatkinsDS. On the reduction of a Hamiltonian matrix to Hamiltonian Schur form. Electronic Transactions on Numerical Analysis2006; 23:141-157. · Zbl 1115.65049
[12] BennerP, ByersR, LosseP, MehrmannV, XuH. Robust formulas for optimal \(\mathcal{\mathcal{H}}_\infty\) controllers. Automatica2011; 47:2639-2646. · Zbl 1252.93047
[13] BennerP, ByersR, MehrmannV, XuH. A robust numerical method for the γ‐iteration in \(\mathcal{\mathcal{H}}_\infty \)‐control. Linear Algebra and its Applications2007; 425:548-570. · Zbl 1124.93022
[14] ZhouK, DoyleJC, GloverK. Robust and Optimal Control. Prentice‐Hall: Upper Saddle River, NJ, 1995.
[15] AhuesM, LimayeBV. On condition numbers of a basis. Linear Algebra and its Applications2013; 439:3359-3377. · Zbl 1283.65044
[16] BennerP, ByersR. An arithmetic for matrix pencils: theory and new algorithms. Numerische Mathematik2006; 103(4):539-573. · Zbl 1101.65046
[17] WatkinsDS. Product eigenvalue problems. SIAM Review2005; 47(1):3-40. · Zbl 1075.65055
[18] MehrmannV, PoloniF. Doubling algorithms with permuted Lagrangian graph bases. SIAM Journal on Matrix Analysis and Applications2012; 33(3):780-805. · Zbl 1260.65059
[19] MehrmannV, PoloniF. Using permuted graph bases in \(\mathcal{\mathcal{H}}_\infty\) control. Automatica2013; 49(6):1790-1797. · Zbl 1360.93224
[20] BennerP, BujanovićZ. On the solution of large‐scale algebraic Riccati equations by using low‐dimensional invariant subspaces. Technical Report MPIMD/14‐15, Max‐Planck Institute Magdeburg, 2014.
[21] SimonciniV. The Lyapunov matrix equation. Matrix analysis from a computational perspective. E‐print arXiv:1501.07564, 2015. Available on http://arxiv.org/abs/1501.07564v1 [Accessed on 29 September 2015].
[22] BennerP, LiJR, PenzlT. Numerical solution of large‐scale Lyapunov equations, Riccati equations, and linear‐quadratic optimal control problems. Numerical Linear Algebra with Applications2008; 15(9):755-777. · Zbl 1212.65245
[23] SimonciniV, DruskinV. Convergence analysis of projection methods for the numerical solution of large Lyapunov equations. SIAM Journal on Numerical Analysis2009; 47(2):828-843. · Zbl 1195.65058
[24] SimonciniV, SzyldDB, MonsalveM. On two numerical methods for the solution of large‐scale algebraic Riccati equations. IMA Journal of Numerical Analysis2014; 34(3):904-920. · Zbl 1298.65083
[25] PaigeCC, Van LoanCF. A Schur decomposition for Hamiltonian matrices. Linear Algebra and its Applications1981; 14:11-32. · Zbl 1115.15316
[26] GolubGH, Van LoanCF. Matrix Computations (3rd edn), Johns Hopkins Studies in the Mathematical Sciences. Johns Hopkins University Press: Baltimore, MD, 1996.
[27] HighamNJ. Accuracy and Stability of Numerical Algorithms (2nd edn). Society for Industrial and Applied Mathematics (SIAM): Philadelphia, PA, 2002. · Zbl 1011.65010
[28] KnuthDE. Semioptimal bases for linear dependencies. Linear and Multilinear Algebra1985; 17(1):1-4. · Zbl 0556.15001
[29] PenzlT. Eigenvalue decay bounds for solutions of Lyapunov equations: the symmetric case. Systems Control Letters2000; 40:139-144. · Zbl 0977.93034
[30] BennerP, SaakJ. Numerical solution of large and sparse continuous time algebraic matrix Riccati and Lyapunov equations: a state of the art survey. GAMM‐Mitteilungen2013; 6:32-52. · Zbl 1279.65044
[31] PenzlT. A cyclic low‐rank Smith method for large sparse Lyapunov equations. SIAM Journal on Scientific Computing1999; 21:1401-1418. · Zbl 0958.65052
[32] WachspressEL. Iterative solution of the Lyapunov matrix equation. Applied Mathematics Letters1988; 1:87-90. · Zbl 0631.65037
[33] DrmačZ. Accurate computation of the product‐induced singular value decomposition with applications. SIAM Journal on Numerical Analysis1998; 35(5):1969-1994 (electronic). · Zbl 0914.65034
[34] DopicoFM, JohnsonCR. Parametrization of the matrix symplectic group and applications. SIAM Journal on Matrix Analysis and Applications2009; 31(2):650-673. · Zbl 1193.15011
[35] StewartGW, SunJG. Matrix Perturbation Theory. Academic Press: New York, 1990. · Zbl 0706.65013
[36] HalkoN, MartinssonPG, TroppJA. Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Review2011; 53(2):217-288. · Zbl 1269.65043
[37] MehrmannV, PoloniF. An inverse‐free ADI algorithm for computing Lagrangian invariant subspaces. Technical Report 14/2014, Institut für Mathematik, TU Berlin: Str. des 17. Juni 136, D‐10623 Berlin, FRG, 2014.
[38] PenzlT. LYAPACK users’ guide: a MATLAB toolbox for large Lyapunov and Riccati equations, model reduction problems, and linear quadratic optimal control problems. Technical Report, Technical University Chemnitz, SFB 393, 2000. Version 1.0.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.