×

A fast algorithm for the recursive calculation of dominant singular subspaces. (English) Zbl 1154.65319

Summary: In many engineering applications it is required to compute the dominant subspace of a matrix \(A\) of dimension \(m\times n\), with \(m\gg n\). Often the matrix \(A\) is produced incrementally, so all the columns are not available simultaneously. This problem arises, e.g., in image processing, where each column of the matrix \(A\) represents an image of a given sequence leading to a singular value decomposition-based compression [S. Chandrasekaran, B.S. Manjunath, Y.F. Wang, J. Winkeler and H. Zhang, An eigenspace update algorithm for image analysis, Graphical Models and Image Process. 59 (5) 321–332 (1997)]. Furthermore, the so-called proper orthogonal decomposition approximation uses the left dominant subspace of a matrix \(A\) where a column consists of a time instance of the solution of an evolution equation, e.g., the flow field from a fluid dynamics simulation. Since these flow fields tend to be very large, only a small number can be stored efficiently during the simulation, and therefore an incremental approach is useful [P. Van Dooren, in: Griffiths, D. F. (ed.) et al., Numerical analysis 1999. Proceedings of the 18th Dundee biennial conference, Univ. of Dundee, GB, June 29th–July 2nd, 1999. Boca Raton, FL: Chapman & Hall/CRC. Chapman Hall/CRC Res. Notes Math. 420, 231–247 (2000)].
In this paper, an algorithm for computing an approximation of the left dominant subspace of size \(k\) of \(A\in \mathbb R^{m\times n}\), with \(k\ll m,n\), is proposed requiring at each iteration O\((mk+k^{2})\) floating point operations. Moreover, the proposed algorithm exhibits a lot of parallelism that can be exploited for a suitable implementation on a parallel computer.

MSC:

65F30 Other matrix algorithms (MSC2010)
15A15 Determinants, permanents, traces, other special matrix functions
15A09 Theory of matrix inversion and generalized inverses
15A23 Factorization of matrices

Software:

mctoolbox
Full Text: DOI

References:

[1] Chahlaoui, Y.; Gallivan, K.; Van Dooren, P., Recursive calculation of dominant singular subspaces, SIAM J. Matrix Anal. Appl., 25, 2, 445-463 (2003) · Zbl 1051.65047
[2] Chandrasekaran, S.; Manjunath, B. S.; Wang, Y. F.; Winkeler, J.; Zhang, H., An eigenspace update algorithm for image analysis, Graphical Models and Image Process., 59, 5, 321-332 (1997)
[3] Golub, G. H.; Van Loan, C. F., Matrix Computations (1989), The Johns Hopkins University Press: The Johns Hopkins University Press Baltimore, MD · Zbl 0733.65016
[4] Mastronardi, N.; Van Barel, M.; Van Camp, E.; Vandebril, R., On computing the eigenvectors of a class of structured matrices, J. Comput. Appl. Math., 189, 1-2, 580-591 (2006) · Zbl 1086.65035
[5] Mastronardi, N.; Van Barel, M.; Vandebril, R., A note on the recursive calculation of dominant singular subspaces, Numer. Algorithms, 38, 4, 237-242 (2005) · Zbl 1068.65054
[6] Park, H.; Van Huffel, S., Two-way bidiagonalization scheme for downdating the singular value decomposition, Linear Algebra Appl., 222, 23-39 (1995) · Zbl 0833.65033
[7] Van Dooren, P., Gramian based model reduction of large-scale dynamical systems, (Numerical Analysis 1999 (2000), Chapman & Hall: Chapman & Hall CRC Press, London, Boca Raton, FL), 231-247 · Zbl 0952.65051
[8] Van Huffel, S., Iterative algorithms for computing the singular subspace of a matrix associated with its smallest singular values, Linear Algebra Appl., 154-156, 675-709 (1991) · Zbl 0741.65031
[9] Van Huffel, S.; Park, H., Parallel tri- and bi-diagonalization of bordered bidiagonal matrices, Parallel Comput., 20, 8, 1107-1128 (1994) · Zbl 0804.65046
[10] Van Huffel, S.; Vandewalle, J.; Haegemans, A., An efficient and reliable algorithm for computing the singular subspace of a matrix, associated with its smallest singular values, J. Comput. Appl. Math., 19, 313-330 (1987) · Zbl 0632.65041
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.