×

Convergence and stability analysis for iterative dynamics with application to compartmental networks: a trajectory distance based Lyapunov approach. (English) Zbl 1281.93042

Summary: This paper addresses the convergence and stability analysis for iterative processes such as numerical iterative algorithms by using a novel trajectory distance based approach. Iterative dynamics are widespread in distributed algorithms and numerical analysis. However, efficient analysis of convergence and sensitivity of iterative dynamics is quite challenging due to the lack of systematic tools. For instance, the trajectories of iterative dynamics are usually not continuous with respect to the initial condition. Hence, the classical dynamical systems theory cannot be applied directly. In this paper, a trajectory distance based Lyapunov approach is proposed as a means to tackling convergence and sensitivity to the initial condition of iterative processes. Technically the problem of convergence and sensitivity is converted into finiteness of trajectory distance and semistability analysis of discrete-time systems. A semidefinite Lyapunov function based trajectory distance approach is proposed to characterize convergence and semistability of iterative dynamics. Three examples are provided to elucidate the proposed method. Finally, the proposed framework is used to solve the convergence and stability of iterative algorithms developed for balanced resource allocation and damage mitigation problems under adversarial attacks.

MSC:

93B40 Computational methods in systems theory (MSC2010)
37M99 Approximation methods and numerical treatment of dynamical systems
Full Text: DOI

References:

[1] Bhat, S. P.; Bernstein, D. S., Nontangency-based Lyapunov tests for convergence and stability in systems having a continuum of equilibria, SIAM Journal on Control and Optimization, 42, 1745-1775 (2003) · Zbl 1078.34031
[2] Hui, Q.; Haddad, W. M.; Bhat, S. P., Finite-time semistability and consensus for nonlinear dynamical networks, IEEE Transactions on Automatic Control, 53, 1887-1900 (2008) · Zbl 1367.93434
[3] Hui, Q.; Haddad, W. M.; Bhat, S. P., Semistability, finite-time stability, differential inclusions, and discontinuous dynamical systems having a continuum of equilibria, IEEE Transactions on Automatic Control, 54, 2465-2470 (2009) · Zbl 1367.34070
[4] Bhat, S. P.; Bernstein, D. S., Arc-length-based Lyapunov tests for convergence and stability with applications to systems having a continuum of equilibria, Mathematics of Control, Signals, and Systems, 22, 155-184 (2010) · Zbl 1248.93125
[5] Hui, Q., Semistability and robustness analysis for switched systems, European Journal of Control, 17, 1, 73-88 (2011) · Zbl 1248.93132
[6] Haddad, W. M.; Chellaboina, V., Nonlinear Dynamical Systems and ControlA Lyapunov-Based Approach (2008), Princeton University Press: Princeton University Press Princeton, NJ · Zbl 1142.34001
[9] Jadbabaie, A.; Lin, J.; Morse, A. S., Coordination of groups of mobile autonomous agents using nearest neighbor rules, IEEE Transactions on Automatic Control, 48, 988-1001 (2003) · Zbl 1364.93514
[10] Olshevsky, A.; Tsitsiklis, J., On the nonexistence of quadratic Lyapunov functions for consensus algorithms, IEEE Transactions on Automatic Control, 53, 2642-2645 (2008) · Zbl 1367.93611
[11] Branicky, M. S., Multiple Lyapunov functions and other analysis tools for switched and hybrid systems, IEEE Transactions on Automatic Control, 43, 475-482 (1998) · Zbl 0904.93036
[14] Berman, A.; Plemmons, R. J., Nonnegative Matrices in the Mathematical Sciences (1979), Academic: Academic New York · Zbl 0484.15016
[16] Haddad, W. M.; Chellaboina, V.; Hui, Q., Nonnegative and Compartmental Dynamical Systems (2010), Princeton University Press: Princeton University Press Princeton, NJ · Zbl 1184.93001
[17] Tsitsiklis, J. N.; Bertsekas, D. P.; Athans, M., Distributed asynchronous deterministic and stochastic gradient optimization algorithms, IEEE Transactions on Automatic Control, 31, 803-812 (1986) · Zbl 0602.90120
[19] Elsner, L.; Koltracht, I.; Neumann, M., On the convergence of asynchronous paracontractions with applications to tomographic reconstruction from incomplete data, Linear Algebra Application, 130, 65-82 (1990) · Zbl 0716.65026
[20] Lynch, N. A., Distributed Algorithms (1996), Morgan Kaufmann: Morgan Kaufmann San Francisco, CA · Zbl 0877.68061
[21] Bertsekas, D. P.; Tsitsiklis, J. N., Parallel and Distributed ComputationNumerical Methods (1997), Athena Scientific: Athena Scientific Belmont, MA
[22] Xiao, L.; Boyd, S., Fast linear iterations for distributed averaging, Systems Control Letters, 53, 65-78 (2004) · Zbl 1157.90347
[23] Moreau, L., Stability of multiagent systems with time-dependent communication links, IEEE Transactions on Automatic Control, 50, 169-182 (2005) · Zbl 1365.93268
[24] Bertsekas, D. P.; Tsitsiklis, J. N., Comments on ‘Coordination of groups of mobile autonomous agents using nearest neighbor rules’, IEEE Transactions on Automatic Control, 52, 968-969 (2007) · Zbl 1366.93113
[25] Hui, Q.; Haddad, W. M., \(H_2\) optimal semistable stabilization for linear discrete-time dynamical systems with applications to network consensus, International Journal of Control, 82, 456-469 (2009) · Zbl 1168.93385
[26] Haddad, W. M.; Hui, Q.; Nersesov, S. G.; Chellaboina, V., Thermodynamic modeling, energy equipartition, and nonconservation of entropy for discrete-time dynamical systems, Advances in Difference Equations, 2005, 275-318 (2005) · Zbl 1128.93306
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.