Hierarchical Newton and least squares iterative estimation algorithm for dynamic systems by transfer functions based on the impulse responses. (English) Zbl 1482.93661
Summary: This paper develops a parameter estimation algorithm for linear continuous-time systems based on the hierarchical principle and the parameter decomposition strategy. Although the linear continuous-time system is a linear system, its output response is a highly nonlinear function with respect to the system parameters. In order to propose a direct estimation algorithm, a criterion function is constructed between the response output and the observation output by means of the discrete sampled data. Then a scheme by combining the Newton iteration and the least squares iteration is builded to minimise the criterion function and derive the parameter estimation algorithm. In light of the different features between the system parameters and the output function, two sub-algorithms are derived by using the parameter decomposition. In order to remove the associate terms between the two sub-algorithms, a Newton and least squares iterative algorithm is deduced to identify system parameters. Compared with the Newton iterative estimation algorithm without the parameter decomposition, the complexity of the hierarchical Newton and least squares iterative estimation algorithm is reduced because the dimension of the Hessian matrix is lessened after the parameter decomposition. The experimental results show that the proposed algorithm has good performance.
MSC:
| 93E12 | Identification in stochastic control theory |
| 93E10 | Estimation and detection in stochastic control theory |
| 93E24 | Least squares and related methods for stochastic control systems |
| 93C05 | Linear systems in control theory |
Keywords:
parameter estimation; hierarchical principle; iterative estimation; Newton search; least squaresReferences:
| [1] | Al-Matouq, A. A.; Vincent, T. L., Multiple window moving horizon estimation, Automatica, 53, 264-274 (2015) · Zbl 1371.93079 · doi:10.1016/j.automatica.2014.12.002 |
| [2] | Cao, Y.; Li, P.; Zhang, Y., Parallel processing algorithm for railway signal fault diagnosis data based on cloud computing, Future Generation Computer Systems, 88, 279-283 (2018) · doi:10.1016/j.future.2018.05.038 |
| [3] | Cao, Y.; Ma, L. C.; Xiao, S.; Zhang, X.; Xu, W., Standard analysis for transfer delay in CTCS-3, Chinese Journal of Electronics, 26, 5, 1057-1063 (2017) · doi:10.1049/cje.2017.08.024 |
| [4] | Cao, Y.; Wen, Y.; Meng, X.; Xu, W., Performance evaluation with improved receiver design for asynchronous coordinated multipoint transmissions, Chinese Journal of Electronics, 25, 2, 372-378 (2016) · doi:10.1049/cje.2016.03.026 |
| [5] | Chen, F. W.; Agüero, J. C.; Gilson, M.; Garnier, H.; Liu, T., EM-based identification of continuous-time ARMA Models from irregularly sampled data, Automatica, 77, 293-301 (2017) · Zbl 1355.93189 · doi:10.1016/j.automatica.2016.11.020 |
| [6] | Chen, M. T.; Ding, F.; Xu, L.; Hayat, T.; Alsaedi, A., Iterative identification algorithms for bilinear-in-parameter systems with autoregressive moving average noise, Journal of the Franklin Institute, 354, 17, 7885-7898 (2017) · Zbl 1380.93271 · doi:10.1016/j.jfranklin.2017.09.014 |
| [7] | Chen, M. Z.; Zhu, D. Q., A workload balanced algorithm for task assignment and path planning of inhomogeneous autonomous underwater vehicle system, IEEE Transactions on Cognitive and Developmental Systems (2018) · doi:10.1109/TCDS.2018.2866984 |
| [8] | Dehghan, M.; Hajarian, M., Analysis of an iterative algorithm to solve the generalized coupled Sylvester matrix equations, Applied Mathematical Modelling, 35, 3285-3300 (2011) · Zbl 1227.65037 · doi:10.1016/j.apm.2011.01.022 |
| [9] | Ding, J. L., The hierarchical iterative identification algorithm for multi-input-output-error systems with autoregressive noise, Complexity, 2017, 1-11 (2017) · Zbl 1377.93164 · doi:10.1155/2017/5292894 |
| [10] | Ding, J. L., Recursive and iterative least squares parameter estimation algorithms for multiple-input-output-error systems with autoregressive noise, Circuits Systems and Signal Processing, 37, 5, 1884-1906 (2018) · Zbl 1418.93279 · doi:10.1007/s00034-017-0636-0 |
| [11] | Ding, F.; Chen, H. B.; Xu, L.; Dai, J. Y.; Li, Q. S.; Hayat, T., A hierarchical least squares identification algorithm for Hammerstein nonlinear systems using the key term separation, Journal of the Franklin Institute, 355, 8, 3737-3752 (2018) · Zbl 1390.93818 · doi:10.1016/j.jfranklin.2018.01.052 |
| [12] | Ding, F.; Meng, D. D.; Dai, J. Y.; Li, Q. S.; Alsaedi, A.; Hayat, T., Least squares based iterative parameter estimation algorithm for stochastic dynamical systems with ARMA noise using the model equivalence, International Journal of Control Automation and Systems, 16, 2, 630-639 (2018) · doi:10.1007/s12555-017-0001-x |
| [13] | Ding, F.; Wang, Y. J.; Dai, J. Y.; Li, Q. S.; Chen, Q. J., A recursive least squares parameter estimation algorithm for output nonlinear autoregressive systems using the input-output data filtering, Journal of the Franklin Institute, 354, 15, 6938-6955 (2017) · Zbl 1373.93393 · doi:10.1016/j.jfranklin.2017.08.009 |
| [14] | Ding, F.; Xu, L.; Alsaadi, F. E.; Hayat, T., Iterative parameter identification for pseudo-linear systems with ARMA noise using the filtering technique, IET Control Theory and Applications, 12, 7, 892-899 (2018) · doi:10.1049/iet-cta.2017.0821 |
| [15] | Fang, X. W.; Ni, Q.; Zeng, M. L., A modified quasi-Newton method for nonlinear equations, Journal of Computational and Applied Mathematics, 328, 44-58 (2018) · Zbl 1372.65146 · doi:10.1016/j.cam.2017.06.024 |
| [16] | Geng, F. Z.; Qian, S. P., An optimal reproducing kernel method for linear nonlocal boundary value problems, Applied Mathematics Letters, 77, 49-56 (2018) · Zbl 1380.65129 · doi:10.1016/j.aml.2017.10.002 |
| [17] | Gong, P. C.; Wang, W. Q.; Li, F. C.; So, H. C., Sparsity-aware transmit beamspace design for FDA-MIMO radar, Signal Processing, 144, 99-103 (2018) · doi:10.1016/j.sigpro.2017.10.008 |
| [18] | Hajarian, M., Solving the general Sylvester discrete-time periodic matrix equations via the gradient based iterative method, Applied Mathematics Letters, 52, 87-95 (2016) · Zbl 1330.65065 · doi:10.1016/j.aml.2015.08.017 |
| [19] | Ji, Y.; Ding, F., Multiperiodicity and exponential attractivity of neural networks with mixed delays, Circuits Systems and Signal Processing, 36, 6, 2558-2573 (2017) · Zbl 1370.92019 · doi:10.1007/s00034-016-0420-6 |
| [20] | Kulikova, M. V., Gradient-based parameter estimation in pairwise linear Gaussian system, IEEE Transactions on Automatic Control, 62, 1511-1517 (2017) · Zbl 1366.93636 · doi:10.1109/TAC.2016.2579745 |
| [21] | Li, M. H.; Liu, X. M., Auxiliary model based least squares iterative algorithms for parameter estimation of bilinear systems using interval-varying measurements, IEEE Access, 6, 21518-21529 (2018) · doi:10.1109/ACCESS.2018.2794396 |
| [22] | Li, Z. G.; Ma, Z. H., A new approach for filtering and derivative estimation of noisy signals, Circuits, Systems, and Signal Processing, 33, 2, 589-598 (2014) · doi:10.1007/s00034-013-9634-z |
| [23] | Li, X. Y.; Wu, B. Y., A new reproducing kernel collocation method for nonlocal fractional boundary value problems with non-smooth solutions, Applied Mathematics Letters, 86, 194-199 (2018) · Zbl 1408.65047 · doi:10.1016/j.aml.2018.06.035 |
| [24] | Li, Y.; Zhang, W. H.; Liu, X. K., H-index for discrete-time stochastic systems with Markovian jump and multiplicative noise, Automatica, 90, 286-293 (2018) · Zbl 1387.93145 · doi:10.1016/j.automatica.2017.12.032 |
| [25] | Li, X.; Zhu, D. Q., An improved SOM neural network method to adaptive leader-follower formation control of AUVs, IEEE Transactions on Industrial Electronics, 65, 10, 8260-8270 (2018) |
| [26] | Lin, Y.; Zhang, W., Necessary/sufficient conditions for pareto optimum in cooperative difference game, Optimal Control, Applications and Methods, 39, 2, 1043-1060 (2018) · Zbl 1407.91030 · doi:10.1002/oca.2395 |
| [27] | Liu, F., A note on Marcinkiewicz integrals associated to surfaces of revolution, Journal of the Australian Mathematical Society, 104, 3, 380-402 (2018) · Zbl 1395.42036 · doi:10.1017/S1446788717000143 |
| [28] | Liu, F.; Wu, H. X., Singular integrals related to homogeneous mappings in Triebel-Lizorkin spaces, Journal of Mathematical Inequalities, 11, 4, 1075-1097 (2017) · Zbl 1380.42013 · doi:10.7153/jmi-2017-11-81 |
| [29] | Liu, F.; Wu, H. X., Regularity of discrete multisublinear fractional maximal functions, Science China-Mathematics, 60, 8, 1461-1476 (2017) · Zbl 1385.42014 · doi:10.1007/s11425-016-9011-2 |
| [30] | Liu, F.; Wu, H. X., On the regularity of maximal operators supported by submanifolds, Journal of Mathematical Analysis and Applications, 453, 1, 144-158 (2017) · Zbl 1404.42036 · doi:10.1016/j.jmaa.2017.03.058 |
| [31] | Liu, F.; Wu, H. X., A note on the endpoint regularity of the discrete maximal operator, Proceedings of the American Mathematical Society (2019) · Zbl 1405.42036 · doi:10.1090/proc/13962 |
| [32] | Ma, P.; Ding, F.; Zhu, Q. M., Decomposition-based recursive least squares identification methods for multivariate pseudo-linear systems using the multi-innovation, International Journal of Systems Science, 49, 5, 920-928 (2018) · Zbl 1482.93656 · doi:10.1080/00207721.2018.1433247 |
| [33] | Mu, B. Q.; Guo, J.; Wang, L. Y.; Yin, G.; Xu, L. J.; Zheng, W. X., Identification of linear continuous-time systems under irregular and random output sampling, Automatica, 60, 100-114 (2015) · Zbl 1331.93145 · doi:10.1016/j.automatica.2015.07.009 |
| [34] | Pan, J.; Li, W.; Zhang, H. P., Control algorithms of magnetic suspension systems based on the improved double exponential reaching law of sliding mode control, International Journal of Control Automation and Systems (2018) · doi:10.1007/s12555-017-0616-y |
| [35] | Pan, J.; Ma, H.; Jiang, X.; Ding, W.; Ding, F., Adaptive gradient-based iterative algorithm for multivariate controlled autoregressive moving average systems using the data filtering technique, Complexity, 2018, 1-11 (2018) · Zbl 1398.93348 · doi:10.1155/2018/9598307 |
| [36] | Raghavan, H.; Tangirala, A. K.; Gopaluni, R. B.; Shah, S. L., Identification of chemical processes with irregular output sampling, Control Engineering Practice, 14, 5, 467-480 (2005) · doi:10.1016/j.conengprac.2005.01.015 |
| [37] | Rao, Z. H.; Zeng, C. Y.; Wu, M. H.; Wang, Z. F.; Zhan, N.; Liu, M.; Wan, X. K., Research on a handwritten character recognition algorithm based on an extended nonlinear kernel residual network, KSII Transactions on Internet and Information Systems, 12, 1, 413-435 (2018) |
| [38] | Simmons, J. C.; Danai, K., Multi-output parameter estimation of dynamic systems by output shapes, International Journal of Systems Science, 46, 1, 44-62 (2015) · Zbl 1317.93242 · doi:10.1080/00207721.2014.943822 |
| [39] | Wang, Y. J.; Ding, F., A filtering based multi-innovation gradient estimation algorithm and performance analysis for nonlinear dynamical systems, IMA Journal of Applied Mathematics, 82, 6, 1171-1191 (2017) · Zbl 1480.93421 · doi:10.1093/imamat/hxx029 |
| [40] | Wang, Y. J.; Ding, F.; Xu, L., Some new results of designing an IIR filter with colored noise for signal processing, Digital Signal Processing, 72, 44-58 (2018) · doi:10.1016/j.dsp.2017.09.006 |
| [41] | Wang, Y.; Zhang, H.; Wei, S.; Zhou, D.; Huang, B., Control performance assessment for ILC-controlled batch processes in two-dimensional system framework, IEEE Transactions on Systems, Man and Cybernetics: Systems, 48, 9, 1493-1504 (2018) · doi:10.1109/TSMC.2017.2672563 |
| [42] | Wang, Y.; Zhao, D.; Li, Y.; Ding, S. X., Unbiased minimum variance fault and state estimation for linear discrete time-varying two-dimensional systems, IEEE Transactions on Automatic Control, 62, 10, 5463-5469 (2017) · Zbl 1390.93773 · doi:10.1109/TAC.2017.2697210 |
| [43] | Xu, L., The parameter estimation algorithms based on the dynamical response measurement data, Advances in Mechanical Engineering, 9, 11, 1-12 (2017) · doi:10.1177/1687814017730003 |
| [44] | Xu, L.; Ding, F., Parameter estimation for control systems based on impulse responses, International Journal of Control Automation and Systems, 15, 6, 2471-2479 (2017) · doi:10.1007/s12555-016-0224-2 |
| [45] | Xu, L.; Ding, F., Iterative parameter estimation for signal models based on measured data, Circuits Systems and Signal Processing, 37, 7, 3046-3069 (2018) · Zbl 1411.94026 · doi:10.1007/s00034-017-0705-4 |
| [46] | Xu, L.; Ding, F.; Gu, Y.; Alsaedi, A.; Hayat, T., A multi-innovation state and parameter estimation algorithm for a state space system with d-step state-delay, Signal Processing, 140, 97-103 (2017) · doi:10.1016/j.sigpro.2017.05.006 |
| [47] | Xu, G. H.; Shekofteh, Y.; Akgul, A.; Li, C. B.; Panahi, S., A new chaotic system with a self-excited attractor: Entropy measurement, signal encryption, and parameter estimation, Entropy, 20, 2 (2018) · doi:10.3390/e20020086 |
| [48] | Xu, L.; Xiong, W. L.; Alsaedi, A.; Hayat, T., Hierarchical parameter estimation for the frequency response based on the dynamical window data, International Journal of Control Automation and Systems, 16, 4, 1756-1764 (2018) · doi:10.1007/s12555-017-0482-7 |
| [49] | Yin, C. C.; Shen, Y. Y.; Wen, Y. Z., Exit problems for jump processes with applications to dividend problems, Journal of Computational and Applied Mathematics, 245, 30-52 (2013) · Zbl 1267.91076 · doi:10.1016/j.cam.2012.12.004 |
| [50] | Yin, C. C.; Wen, Y. Z., Optimal dividend problem with a terminal value for spectrally positive Levy processes, Insurance: Mathematics and Economics, 53, 3, 769-773 (2013) · Zbl 1290.91176 |
| [51] | Yin, C. C.; Yuen, K. C., Optimality of the threshold dividend strategy for the compound Poisson model, Statistics & Probability Letters, 81, 12, 1841-1846 (2011) · Zbl 1225.91030 · doi:10.1016/j.spl.2011.07.022 |
| [52] | Yin, C. C.; Zhao, J. S., Nonexponential asymptotics for the solutions of renewal equations, with applications, Journal of Applied Probability, 43, 3, 815-824 (2008) · Zbl 1125.60090 · doi:10.1239/jap/1158784948 |
| [53] | Zhang, Y. Z.; Cao, Y.; Wen, Y. H.; Liang, L.; Zou, F., Optimization of information interaction protocols in cooperative vehicle-infrastructure systems, Chinese Journal of Electronics, 27, 2, 439-444 (2018) · doi:10.1049/cje.2017.10.009 |
| [54] | Zhang, X.; Ding, F.; Alsaadi, A.; Hayat, T., Recursive parameter identification of the dynamical models for bilinear state space systems, Nonlinear Dynamics, 89, 4, 2415-2429 (2017) · Zbl 1377.93062 · doi:10.1007/s11071-017-3594-y |
| [55] | Zhang, X.; Ding, F.; Xu, L.; Yang, E. F., State filtering-based least squares parameter estimation for bilinear systems using the hierarchical identification principle, IET Control Theory and Applications, 12, 12, 1704-1713 (2018) · doi:10.1049/iet-cta.2018.0156 |
| [56] | Zhang, W.; Lin, X.; Chen, B. S., LaSalle-type theorem and its applications to infinite horizon optimal control of discrete-time nonlinear stochastic systems, IEEE Transactions on Automatic Control, 62, 1, 250-261 (2017) · Zbl 1359.93544 · doi:10.1109/TAC.2016.2558044 |
| [57] | Zhang, X.; Xu, L.; Ding, F.; Hayat, T., Combined state and parameter estimation for a bilinear state space system with moving average noise, Journal of the Franklin Institute, 355, 6, 3079-3103 (2018) · Zbl 1395.93174 · doi:10.1016/j.jfranklin.2018.01.011 |
| [58] | Zhao, N.; Liu, R.; Chen, Y.; Wu, M.; Jiang, Y.; Xiong, W.; Liu, C., Contract design for relay incentive mechanism under dual asymmetric information in cooperative networks, Wireless Networks, 24, 8, 3029-3044 (2018) · doi:10.1007/s11276-017-1518-x |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
