Improved neural solution for the Lyapunov matrix equation based on gradient search. (English) Zbl 1284.68492
Summary: By using the hierarchical identification principle, based on the conventional gradient search, two neural subsystems are developed and investigated for the online solution of the well-known Lyapunov matrix equation. Theoretical analysis shows that, by using any monotonically-increasing odd activation function, the gradient-based neural networks (GNN) can solve the Lyapunov equation exactly and efficiently. Computer simulation results confirm that the solution of the presented GNN models could globally converge to the solution of the Lyapunov matrix equation. Moreover, when using the power-sigmoid activation functions, the GNN models have superior convergence when compared to linear models.
MSC:
| 68T05 | Learning and adaptive systems in artificial intelligence |
| 68W40 | Analysis of algorithms |
| 65F10 | Iterative numerical methods for linear systems |
Keywords:
analysis of algorithms; recurrent neural networks; gradient search; hierarchical identification principle; energy function; activation functionReferences:
| [1] | Evensen, G.; Bergen, S., The ensemble Kalman filter for combined state and parameter estimation, IEEE Control Syst., 29, 3, 83-104 (2009) · Zbl 1395.93534 |
| [2] | Shi, Y.; Fang, H., Kalman filter-based identification for systems with randomly missing measurements in a network environment, Int. J. Control, 83, 3, 538-551 (2010) · Zbl 1222.93228 |
| [3] | Agarwal, A.; Gautam, P. K.; Roy, S. S., Dynamic modeling and optimal foot force distribution of quadruped walking robot, (Trends in Intelligent Robotics, vol. 103 (2010)), 146-153 |
| [4] | Zhang, Y.; Li, K., Bi-criteria velocity minimization of robot manipulators using LVI-based primal-dual neural network and illustrated via PUMA560 robot arm, Robotica, 28, 4, 525-537 (2010) |
| [5] | Li, Y.; Reisslein, M.; Chakrabarti, C., Energy-efficient video transmission over wireless link, IEEE Trans. Veh. Technol., 58, 3, 1229-1244 (2009) |
| [6] | Zhang, Y.; Leithead, W. E., Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gausssian process, Appl. Math. Comput., 171, 2, 1264-1281 (2005) · Zbl 1097.65019 |
| [7] | Liu, Y.; Li, S. Z.; Wu, W.; Huang, R., Dynamics of a mean-shift-like algorithm and its applications on clustering, Inf. Process. Lett., 113, 1-2, 8-16 (2013) · Zbl 1259.68177 |
| [8] | Chen, K., Robustness analysis of Wang neural network for online linear equation solving, Electron. Lett., 48, 22, 1391-1392 (2012) |
| [9] | Liu, Y.; You, Z.; Cao, L., A functional neural network for computing the largest modulus eigenvalues and their corresponding eigenvectors of an anti-symmetric matrix, Neurocomputing, 67, 384-397 (2005) |
| [10] | Liu, Y.; You, Z.; Cao, L., A recurrent neural network computing the largest imaginary or real part of eigenvalues of real matrices, Comput. Math. Appl., 53, 1, 41-53 (2007) · Zbl 1135.15006 |
| [11] | Yi, C.; Chen, Y.; Lu, Z., Improved gradient-based neural networks for online solution of Lyapunov matrix equation, Inf. Process. Lett., 111, 16, 780-786 (2011) · Zbl 1260.68353 |
| [12] | Zhang, Y.; Ge, S. S., Design and analysis of a general recurrent neural network model for time-varying matrix inversion, IEEE Trans. Neural Netw., 16, 6, 1477-1490 (2005) |
| [13] | Liu, Y.; Sheng, J.; Ding, R., Convergence of stochastic gradient estimation algorithm for multivariable ARX-like systems, Comput. Math. Appl., 59, 8, 2615-2627 (2010) · Zbl 1193.60057 |
| [14] | Liu, Y.; Xiao, Y.; Zhao, X., Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model, Appl. Math. Comput., 215, 4, 1477-1483 (2009) · Zbl 1177.65095 |
| [15] | Yi, C.; Zhang, Y., Analogue recurrent neural network for linear algebraic equation solving, Electron. Lett., 44, 28, 1078-1079 (2008) |
| [16] | Ding, F.; Chen, T., Gradient based iterative algorithms for solving a class of matrix equations, IEEE Trans. Autom. Control, 50, 8, 1216-1221 (2005) · Zbl 1365.65083 |
| [17] | Wang, D. Q.; Ding, F., Hierarchical least squares estimation algorithm for Hammerstein-Wiener systems, IEEE Signal Process. Lett., 19, 12, 825-828 (2012) |
| [18] | Ding, F., Hierarchical multi-innovation stochastic gradient algorithm for Hammerstein nonlinear system modeling, Appl. Math. Model., 37, 4, 1694-1704 (2013) · Zbl 1349.93391 |
| [19] | Tanaka, N.; Iwamotoa, H., Active boundary control of an Euler-Bernoulli beam for generating vibration-free state, J. Sound Vib., 304, 3, 570-586 (2007) · Zbl 1242.74051 |
| [20] | Mahmood, S.; Khan, A., An industrial study on the importance of software component documentation: A system integratorʼs perspective, Inf. Process. Lett., 111, 12, 583-590 (2011) |
| [21] | Zhou, B.; Lam, J.; Duan, G., Gradient-based maximal convergence rate iterative method for solving linear matrix equations, Int. J. Comput. Math., 87, 3, 515-527 (2010) · Zbl 1188.65058 |
| [22] | Horn, R. A.; Johnson, C. R., Topics in Matrix Analysis (2012), Cambridge University Press |
| [23] | Zhang, Y., Revisit the analog computer and gradient-based neural system for matrix inversion, (Proceedings of IEEE International Symposium on Intelligent Control (2005)), 1411-1416 |
| [24] | Zhang, Y., Dual neural networks: Design, analysis, and application to redundant robotics, (Progress in Neurocomputing Research (2007), Nova Science Publishers: Nova Science Publishers New York) |
| [25] | Duan, G.; Patton, R., Explicit and analytical solutions to Lyapunov algebraic matrix equations, (Proceedings of IEE UKACC International Conference on Control (1998)), 1397-1402 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
