×

How bad are Vandermonde matrices? (English) Zbl 1382.15008

Summary: Estimation of the condition numbers of Vandermonde matrices, motivated by applications to interpolation and quadrature, can be traced back to at least the 1970s. Empirical study has consistently shown that Vandermonde matrices tend to be badly ill-conditioned, with a narrow class of exceptions, such as the matrices of the discrete Fourier transform (hereafter we use the acronym DFT). So far, however, formal support for this empirical observation has been limited to the matrices defined by the real set of knots. We prove that, more generally, any Vandermonde matrix of a large size is badly ill-conditioned unless its knots are more or less equally spaced on or about the circle \(\{x:~| x| =1\}\). The matrices of the DFT are unitary up to scaling and therefore perfectly conditioned. They are defined by a cyclic sequence of knots, equally spaced on that circle, but we prove that even a slight modification of the knots into the so-called quasi-cyclic sequence on this circle defines badly ill-conditioned Vandermonde matrices. Likewise, we prove that the half-size leading (that is, northwestern) block of a large DFT matrix is badly ill-conditioned. (This result was motivated by an application to preconditioning of an input matrix for Gaussian elimination with no pivoting and for block Gaussian elimination.) Our analysis involves the Ekkart-Young theorem, the Vandermonde-to-Cauchy transformation of matrix structure, our new inversion formula for a Cauchy matrix, and low-rank approximation of its large submatrices.

MSC:

15A12 Conditioning of matrices
65F35 Numerical computation of matrix norms, conditioning, scaling
47A65 Structure theory of linear operators
12Y05 Computational aspects of field theory and polynomials (MSC2010)

Software:

drsolve; na31; hlib; tpls

References:

[1] A. Aricò and G. Rodriguez, {\it A fast solver for linear systems with displacement structure}, Numer. Algorithms, 55 (2010), pp. 529-556. · Zbl 1203.65062
[2] S. Börm, {\it Efficient Numerical Methods for Non-local Operators: \( \mathcal{H}^2\)-Matrix Compression, Algorithms and Analysis}, European Math. Society, Zürich, 2010. · Zbl 1208.65037
[3] G. Ballard, E. Carson, J. Demmel, M. Hoemmen, N. Knight, and O. Schwartz, {\it Communication lower bounds and optimal algorithms for numerical linear algebra}, Acta Numer., 23 (2014), pp. 1-155. · Zbl 1396.65082
[4] H.A. Barker, A.H. Tan, and K.R. Godfrey, {\it Optimal levels of perturbation signals for nonlinear system identification}, IEEE Trans. Automat. Control, 49 (2004), pp. 1404-1407. · Zbl 1365.93099
[5] J. Carrier, L. Greengard, and V. Rokhlin, {\it A fast adaptive multipole algorithm for particle simulations}, SIAM J. Sci. Stat. Comput., 9 (1988), pp. 669-686. http://epubs.siam.org/doi/abs/10.1137/0909044. · Zbl 0656.65004
[6] S. Chandrasekaran, M. Gu, X. Sun, J. Xia, and J. Zhu, {\it A superfast algorithm for Toeplitz systems of linear equations}, SIAM J. Matrix Anal. Appl., 29 (2007), pp. 1247-1266. http://epubs.siam.org/doi/abs/10.1137/040617200. · Zbl 1221.65084
[7] R.E. Cline, R.J. Plemmons, and G. Worm, {\it Generalized inverses of certain Toeplitz matrices}, Linear Algebra Appl., 8 (1974), pp. 25-33. · Zbl 0273.15004
[8] P.J. Davis, {\it Circulant Matrices}, Wiley, New York, 1970. · Zbl 0418.15017
[9] W. Gautschi, {\it How unstable are Vandermonde systems?}, in Proceedings of the International Symposium on Asymptotic and Computational Analysis: Conference in Honor of Frank W. J. Olver’s 65th Birthday, Lecture Notes in Pure Appl. Math. 124, R. Wong, ed., Marcel Dekker, New York, 1990, pp. 193-210. · Zbl 0689.00009
[10] M. Gu, {\it Stable and efficient algorithms for structured systems of linear equations}, SIAM J. Matrix Anal. Appl., 19 (1998), pp. 279-306. http://epubs.siam.org/doi/abs/10.1137/S0895479895291273. · Zbl 0915.65024
[11] W. Gautschi and G. Inglese, {\it Lower bounds for the condition number of Vandermonde matrices}, Numer. Math., 52 (1988), pp. 241-250. · Zbl 0646.15003
[12] I. Gohberg, T. Kailath, and V. Olshevsky, {\it Fast Gaussian elimination with partial pivoting for matrices with displacement structure}, Math. Comp., 64 (1995), pp. 1557-1576. · Zbl 0848.65010
[13] G.H. Golub and C.F. Van Loan, {\it Matrix Computations}, 4th ed., Johns Hopkins University Press, Baltimore, MD, 2013. · Zbl 1268.65037
[14] L. Greengard and V. Rokhlin, {\it A fast algorithm for particle simulation}, J. Comput. Phys., 73 (1987), pp. 325-348. · Zbl 0629.65005
[15] G. Heinig and A. Bojanczyk, {\it Transformation techniques for Toeplitz and Toeplitz-plus-Hankel matrices, I: Transformations}, Linear Algebra Appl., 254 (1997), pp. 193-226. · Zbl 0872.65021
[16] G. Heinig and A. Bojanczyk, {\it Transformation techniques for Toeplitz and Toeplitz-plus-Hankel matrices. II: Algorithms}, Linear Algebra Appl., 278 (1998), pp. 11-36. · Zbl 0939.65039
[17] M.E.A. El-Mikkawy, {\it Explicit inverse of a generalized Vandermonde matrix}, Appl. Math. Comput., 146 (2003), pp. 643-651. · Zbl 1101.15002
[18] N. Macon and A. Spitzbart, {\it Inverses of Vandermonde matrices}, Amer. Math. Monthly, 65 (1958), pp. 95-100. · Zbl 0081.01503
[19] M. Marcus and H. Minc, {\it A Survey of Matrix Theory and Matrix Inequalities}, Dover, New York, 1992. · Zbl 0126.02404
[20] P.G. Martinsson, V. Rokhlin, and M. Tygert, {\it A fast algorithm for the inversion of Toeplitz matrices}, Comput. Math. Appl., 50 (2005), pp. 741-752. · Zbl 1087.65025
[21] H. Olkkonen and J.T. Olkkonen, {\it Sampling and reconstruction of transient signals by parallel exponential filters}, IEEE Trans. Circuits Systems II: Express Briefs, 57 (2010), pp. 426-429. · Zbl 1369.94430
[22] V.Y. Pan, {\it On computations with dense structured matrices}, Math. Comp., 55 (1990), pp. 179-190. · Zbl 0703.47022
[23] V.Y. Pan, {\it Structured Matrices and Polynomials: Unified Superfast Algorithms}, Birkhäuser Boston, Inc., Boston, MA; Springer-Verlag, New York, 2001. · Zbl 0996.65028
[24] G.M. Phillips, {\it Interpolation and Approximation by Polynomials}, Springer, New York, 2003. · Zbl 1023.41002
[25] F. Poloni, {\it A note on the \(O(n)\)-storage implementation of the GKO algorithm and its adaptation to Trummer-like matrices}, Numer. Algorithms, 55 (2010), pp. 115-139. · Zbl 1195.65057
[26] V.Y. Pan, {\it Transformations of matrix structures work again}, Linear Algebra Appl., 465 (2015), pp. 1-32. · Zbl 1310.15006
[27] V.Y. Pan, {\it Fast Approximate Computations with Cauchy Matrices and Polynomials}, preprint, 2015. http://arxiv.org/abs/1506.02285.
[28] V.Y. Pan, G. Qian, and X. Yan, {\it Random multipliers numerically stabilize Gaussian and block Gaussian elimination: Proofs and an extension to low-rank approximation}, Linear Algebra Appl., 481 (2015), pp. 202-234. · Zbl 1317.65080
[29] V.Y. Pan, G. Qian, and A. Zheng, {\it Randomized preprocessing versus pivoting}, Linear Algebra Appl., 438 (2013), pp. 1883-1899. · Zbl 1261.65030
[30] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, {\it Numerical Recipes: The Art of Scientific Computing}, 3rd ed., Cambridge University Press, Cambridge, UK, 2007. · Zbl 1132.65001
[31] V.Y. Pan and X. Wang, {\it Inversion of displacement operators}, SIAM J. Matrix Anal. Appl., 24 (2003), pp. 660-677. http://epubs.siam.org/doi/abs/10.1137/S089547980238627X. · Zbl 1056.47015
[32] V.Y. Pan and L. Zhao, {\it Randomized circulant and Gaussian preprocessing}, in Proceedings of the 17th International Workshop on Computer Algebra in Scientific Computing (CASC 2015), Lecture Notes in Comput. Sci. 9301, V.P. Gerdt, V. Koepf, and E.V. Vorozhtsov, eds., Springer, Heidelberg, 2015, pp. 359-373.
[33] V.Y. Pan and L. Zhao, {\it How Much Randomization Do We Need for Supporting Gaussian Elimination, Block Gaussian Elimination, and Low-Rank Approximation? } preprint, 2015. https://arxiv.org/abs/1501.05385 arXiv:1501.05385 [cs.SC].
[34] G. Rodriguez, {\it Fast solution of Toeplitz- and Cauchy-like least-squares problems}, SIAM J. Matrix Anal. Appl., 28 (2006), pp. 724-748. http://epubs.siam.org/doi/abs/10.1137/050629148. · Zbl 1157.65355
[35] O. Ryan and M. Debbah, {\it Asymptotic behaviour of random Vandermonde matrices with entries on the unit circle}, IEEE Trans. Inform. Theory, 5 (2009), pp. 3115-3147. · Zbl 1367.15056
[36] F. Soto-Eguibar and H. Moya-Cessa, {\it Inverse of the Vandermonde and Vandermonde confluent matrices}, Appl. Math. Inf. Sci., 5 (2011), pp. 361-366.
[37] L.R. Turner, {\it Inverse of the Vandermonde Matrix with Applications}, Technical report NASA TN D-3547, NASA, Washington, DC, 1966.
[38] E.E. Tyrtyshnikov, {\it How bad are Hankel matrices?}, Numer. Math., 67 (1994), pp. 261-269. · Zbl 0797.65039
[39] L.N. Trefethen and R.S. Schreiber, {\it Average-case stability of Gaussian elimination}, SIAM J. Matrix Anal. Appl., 11 (1990), pp. 335-360. http://epubs.siam.org/doi/abs/10.1137/0611023. · Zbl 0703.65015
[40] J. Xia, Y. Xi, and M. Gu, {\it A superfast structured solver for Toeplitz linear systems via randomized sampling}, SIAM J. Matrix Anal. Appl., 33 (2012), pp. 837-858. http://epubs.siam.org/doi/abs/10.1137/110831982. · Zbl 1258.65030
[41] Y. Xi, J. Xia, S. Cauley, and V. Balakrishnan, {\it Superfast and stable structured solvers for Toeplitz least squares via randomized sampling}, SIAM J. Matrix Anal. Appl., 35 (2014), pp. 44-72. http://epubs.siam.org/doi/abs/10.1137/120895755. · Zbl 1300.65018
[42] M.-C. Yeung and T.F. Chan, {\it Probabilistic analysis of Gaussian elimination without pivoting}, SIAM J. Matrix Anal. Appl., 18 (1997), pp. 499-517. http://epubs.siam.org/doi/abs/10.1137/S0895479895291741. · Zbl 0871.65019
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.