Time-varying square roots finding via Zhang dynamics versus gradient dynamics and the former’s link and new explanation to Newton-Raphson iteration. (English) Zbl 1380.65086
Summary: Different from conventional gradient-based neural dynamics, a special class of neural dynamics have been proposed by Zhang et al. since 12 March 2001 for online solution of time-varying and static (or termed, time-invariant) problems (e.g., nonlinear equations). The design of Zhang dynamics (ZD) is based on the elimination of an indefinite error-function, instead of the elimination of a square-based positive or at least lower-bounded energy-function usually associated with gradient dynamics (GD) and/or Hopfield-type neural networks. In this paper, we generalize, develop, investigate and compare the continuous-time ZD (CTZD) and GD models for online solution of time-varying and static square roots. In addition, a simplified continuous-time ZD (S-CTZD) and discrete-time ZD (DTZD) models are generated for static scalar-valued square roots finding. In terms of such scalar square roots finding problem, the Newton iteration (also termed, Newton-Raphson iteration) is found to be a special case of the DTZD models (by focusing on the static-problem solving, utilizing the linear activation function and fixing the step-size to be 1). Computer-simulation results via a power-sigmoid activation function further demonstrate the efficacy of the ZD solvers for online scalar (time-varying and static) square roots finding, in addition to the DTZD’s link and new explanation to Newton-Raphson iteration.
MSC:
| 65H04 | Numerical computation of roots of polynomial equations |
| 34A34 | Nonlinear ordinary differential equations and systems |
| 65Y05 | Parallel numerical computation |
| 92B05 | General biology and biomathematics |
Keywords:
parallel algorithms; real-time systems; Zhang dynamics; gradient dynamics; indefinite error-function; square roots finding; Newton-Raphson iterationSoftware:
SimulinkReferences:
| [1] | Mathews, J. H.; Fink, K. D., Numerical Methods Using MATLAB (2005), Publishing House of Electronics Industry: Publishing House of Electronics Industry Beijing, BJ, CHN |
| [2] | Lin, C., Numerical Computation Methods (2005), Science Press: Science Press Beijing, BJ, CHN |
| [3] | Feng, J.; Che, G.; Nie, Y., Principles of Numerical Analysis (2001), Science Press: Science Press Beijing, BJ, CHN |
| [4] | Higham, N. J., Stable iterations for the matrix square root, Numerical Algorithms, 15, 2, 227-242 (1997) · Zbl 0884.65035 |
| [6] | Kong, F.; Cai, Z.; Yu, J.; Li, D. X., Improved generalized Atkin algorithm for computing square roots in finite fields, Information Processing Letters, 98, 1, 1-5 (2006) · Zbl 1195.11166 |
| [7] | Abbasbandy, S., Improving Newton-Raphson method for nonlinear equations by modified Adomian decomposition method, Applied Mathematics and Computation, 145, 2-3, 887-893 (2003) · Zbl 1032.65048 |
| [8] | Qian, J. B.; Wang, C. A., How much precision is needed to compare two sums of square roots of integers, Information Processing Letters, 100, 5, 194-198 (2006) · Zbl 1185.68788 |
| [9] | Basto, M.; Semiao, V.; Calheiros, F. L., A new iterative method to compute nonlinear equations, Applied Mathematics and Computation, 173, 1, 468-483 (2006) · Zbl 1091.65043 |
| [11] | Mead, C., Analog VLSI and Neural Systems (1989), Addison-Wesley: Addison-Wesley Reading, MA, USA · Zbl 0715.68002 |
| [12] | Zhang, Y.; Ma, W.; Li, K.; Yi, C., Brief history and prospect of coprocessors, China Academic Journal Electronic Publishing House, 13, 115-117 (2008) |
| [14] | Zhang, Y.; Yi, C.; Ma, W., Comparison on gradient-based neural dynamics and Zhang neural dynamics for online solution of nonlinear equations, (Lecture Notes in Computer Science, vol. 5370 (2008)), 269-279 |
| [15] | Zhang, Y.; Li, Z., Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints, Physics Letters A, 373, 18-19, 1639-1643 (2009) · Zbl 1229.92008 |
| [16] | Zhang, Y.; Ma, W.; Cai, B., From Zhang neural network to Newton iteration for matrix inversion, IEEE Transactions on Circuits and Systems, 56, 7, 1405-1415 (2009) · Zbl 1468.65026 |
| [21] | Zhang, Y.; Jiang, D.; Wang, J., A recurrent neural network for solving Sylvester equation with time-varying coefficients, IEEE Transactions on Neural Networks, 13, 5, 1053-1063 (2002) |
| [22] | Zhang, Y.; Ge, S. S., Design and analysis of a general recurrent neural network model for time-varying matrix inversion, IEEE Transactions on Neural Networks, 16, 6, 1477-1490 (2005) |
| [23] | Zhang, Y., A set of nonlinear equations and inequalities arising in robotics and its online solution via a primal neural network, Neurocomputing, 70, 513-524 (2006) |
| [27] | Mitra, S. K., Digital Signal Processing-A Computer-Based Approach (2006), Tsinghua University Press: Tsinghua University Press Beijing, BJ, CHN |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
