An interactive maximum likelihood estimation method for multivariable Hammerstein systems. (English) Zbl 1454.93285
Summary: For a multivariable Hammerstein controlled autoregressive moving average (CARMA) system, the identification difficulty is hard to parameterize the system into an quasi auto-regression form to which the standard least square method can apply. By using an interactive maximum likelihood (IML) estimation method, this paper interactively maximizes the logarithmic likelihood function over multiple parameter vectors in a more general model, respectively. The details include: (1) reframe the system into a sum of some bilinear functions about the parameter vectors of the nonlinear part and the linear part; (2) interactively maximize the logarithmic likelihood function over each parameter vector to get their estimates; (3) when updating one parameter vector, substitute other parameter vectors or unknown information vectors by their estimates.
The advantage of the IML algorithm is that it overcomes the limit on an autoregressive model form with one parameter vector. The IML method is simple to understand and easy to implement. Numerical simulations indicate that the explored IML algorithm is capable of generating accurate parameter estimates, and easy to implement on-line.
The advantage of the IML algorithm is that it overcomes the limit on an autoregressive model form with one parameter vector. The IML method is simple to understand and easy to implement. Numerical simulations indicate that the explored IML algorithm is capable of generating accurate parameter estimates, and easy to implement on-line.
MSC:
| 93E12 | Identification in stochastic control theory |
| 93E10 | Estimation and detection in stochastic control theory |
| 93C35 | Multivariable systems, multidimensional control systems |
References:
| [1] | Giri, F.; Bai, E. W., Block-Oriented Nonlinear System Identification (2010), Springer · Zbl 1201.93004 |
| [2] | Hammar, K.; Djamah, T.; Bettayeb, M., Nonlinear system identification using fractional Hammerstein-Wiener models, Nonlinear Dynamics, 98, 3, 2327-2338 (2019) · Zbl 1430.93045 |
| [3] | Yang, L. D.; Liu, J. X.; Zhao, Z. B.; Yan, R. Q.; Chen, X. F., Interval variable step-size spline adaptive filter for the identification of nonlinear block-oriented system, Nonlinear Dynamics, 98, 3, 1629-1643 (2019) · Zbl 1431.65241 |
| [4] | Chaudhary, N. I.; Aslam, M. S.; Baleanu, D.; Raja, M. A.Z., Design of sign fractional optimization paradigms for parameter estimation of nonlinear Hammerstein systems, Neural Computing and Applications, 32, 8381-8399 (2020) |
| [5] | Chaudhary, N. I.; Latif, R.; Raja, M. A.Z.; Machado, J. A.T., An innovative fractional order LMS algorithm for power signal parameter estimation, Applied Mathematical Modelling, 83, 703-718 (2020) · Zbl 1481.94050 |
| [6] | Article number: 407 |
| [7] | Li, L. W.; Ren, X. M.; Guo, F. M., Modified multi-innovation stochastic gradient algorithm for wiener-Hammerstein systems with backlash, Journal of the Franklin Institute, 355, 9, 4050-4075 (2018) · Zbl 1390.93821 |
| [8] | Cheng, S. S.; Wei, Y. H.; Sheng, D.; Chen, Y. Q.; Wang, Y., Identification for Hammerstein nonlinear ARMAX systems based on multi-innovation fractional order stochastic gradient, Signal Processing, 142, 1-10 (2018) |
| [9] | Wang, D. Q.; Mao, L.; Ding, F., Recasted models based hierarchical extended stochastic gradient method for MIMO nonlinear systems, IET Control Theory and Applications, 11, 4, 476-485 (2017) |
| [10] | Li, F.; Jia, L., Parameter estimation of Hammerstein-Wiener nonlinear system with noise using special test signals, Neurocomputing, 344, 7, 37-48 (2019) |
| [11] | Kukreja, S. L.; Kearney, R. E.; Galiana, H. L., A least-squares parameter estimation algorithm for switched Hammerstein systems with applications to the VOR, IEEE Transactions on Biomedical Engineering, 52, 3, 431-444 (2005) |
| [12] | Bauer, D.; Ninness, B., Asymptotic properties of least-squares estimates of Hammerstein-Wiener models, International Journal of Control, 75, 1, 34-51 (2002) · Zbl 1023.93066 |
| [13] | Wang, D. Q.; Ding, F.; Liu, X. M., Least squares algorithm for an input nonlinear system with a dynamic subspace state space model, Nonlinear Dynamics, 75, 1-2, 49-61 (2014) · Zbl 1281.93050 |
| [14] | Li, J. H.; Zheng, W. X.; Gu, J. P.; Hua, L., Parameter estimation algorithms for Hammerstein output error systems using levenberg-marquardt optimization method with varying interval measurements, Journal of the Franklin Institute, 354, 1, 316-331 (2017) · Zbl 1355.93180 |
| [15] | Li, J. H.; Zhang, J. L., Maximum likelihood identification of dual-rate Hammerstein output error moving average system, IET Control Theory Applications, 14, 8, 1089-1101 (2020) · Zbl 07907180 |
| [16] | Wang, D. Q.; Zhang, Z.; Yuan, J. Y., Maximum likelihood estimation method for dual-rate Hammerstein systems, International Journal of Control, Automation and Systems, 15, 2, 698-705 (2017) |
| [17] | Wang, D. Q.; Zhang, S.; Gan, M.; Qiu, J. L., A novel EM identification method for Hammerstein systems with missing output data, IEEE Transactions on Industrial Informatics, 16, 4, 2500-2508 (2020) |
| [18] | Chen, J.; Huang, B.; Ding, F.; Gu, Y., Variational bayesian approach for ARX systems with missing observations and varying time-delays, Automatica, 94, 194-204 (2018) · Zbl 1401.93191 |
| [19] | Chen, J.; Huang, B.; Zhu, Q. M., Global convergence of the EM algorithm for ARX models with uncertain communication channels, Systems & Control Letters https (2020) · Zbl 1433.93135 |
| [20] | Mete, S.; Ozer, S.; Zorlu, H., System identification using Hammerstein model optimized with differential evolution algorithm, AEU—International Journal of Electronics and Communications, 70, 12, 1667-1675 (2016) |
| [21] | Cuevas, E.; Díaz, P.; Avalos, O.; Zaldívar, D.; Pérez-Cisneros, M., Nonlinear system identification based on ANFIS-Hammerstein model using gravitational search algorithm, Applied Intelligence, 48, 1, 182-203 (2018) |
| [22] | M. Schoukens, K. Worden, Evolutionary identification of block-structured systems, 2017, Dynamics of Coupled Structures. 4, 359-366. |
| [23] | Chen, J.; Li, J.; Liu, Y. J.; Ding, F., Gradient iterative algorithm for dual-rate nonlinear systems based on a novel particle filter, Journal of the Franklin Institute, 354, 11, 4425-4437 (2017) · Zbl 1380.93251 |
| [24] | Chen, J.; Liu, Y. J.; Ding, F.; Zhu, Q. M., Gradient based particle filter algorithm for an ARX model with nonlinear communication output, IEEE transactions on systems, Man and Cybernetics: Systems (2020) |
| [25] | D.Q. Wang, L.W. Li, Y. Ji, Y.R. Yan, 2018, Model recovery for Hammerstein systems using the auxiliary model based orthogonal matching pursuit method. 54, 537-550,Applied Mathematical Modelling · Zbl 1480.93431 |
| [26] | Wang, D. Q.; Yan, Y. R.; Liu, Y. J.; Ding, J. H., Model recovery for Hammerstein systems using the hierarchical orthogonal matching pursuit method, Journal of Computational and Applied Mathematics, 345, 135-145 (2019) · Zbl 1398.93349 |
| [27] | Mao, Y. W.; Ding, F.; Liu, Y. J., Parameter estimation algorithms for Hammerstein time-delay systems based on the OMP scheme, IET Signal Processing, 11, 3, 265-274 (2017) |
| [28] | Zhang, J.; Yu, F.; Chin, K. S., Recursive identification of Hammerstein systems with dead-zone nonlinearity in the presence of bounded noise, International Journal of Systems Science, 48, 11, 2394-2404 (2017) · Zbl 1372.93081 |
| [29] | Yu, F.; Mao, Z. Z.; Yuan, P.; He, D. K.; Jia, M. X., Recursive parameter estimation for Hammerstein-Wiener systems using modified EKF algorithm, ISA Transactions, 70, 104-115 (2017) |
| [30] | Mattsson, P.; Wigren, T., Convergence analysis for recursive Hammerstein identification, Automatica, 71, 179-186 (2016) · Zbl 1343.93091 |
| [31] | Zhang, X.; Ding, F.; Alsaadi, F. E.; Hayat, T., Recursive parameter identification of the dynamical models for bilinear state space systems, Nonlinear Dynamics, 89, 4, 2415-2429 (2017) · Zbl 1377.93062 |
| [32] | Bai, E. W.; Li, K., Convergence of the iterative algorithm for a general Hammerstein system identification, Automatica, 46, 11, 1891-1896 (2010) · Zbl 1218.93105 |
| [33] | Li, G. Q.; Wen, C. Y.; Zheng, W. X.; Zhao, G. S., Iterative identification of block-oriented nonlinear systems based on biconvex optimization, Systems & Control Letters, 79, 68-75 (2015) · Zbl 1326.93030 |
| [34] | Xu, L., Application of the newton iteration algorithm to the parameter estimation for dynamical systems, Journal of Computational and Applied Mathematics, 288, 33-43 (2015) · Zbl 1314.93062 |
| [35] | Wang, Z. Y.; Wang, Y.; Ji, Z. C., Hierarchical recursive least squares algorithm for Hammerstein systems using the filtering method, Nonlinear Dynamics, 77, 4, 1773-1781 (2015) · Zbl 1331.93204 |
| [36] | Wang, D. Q., Hierarchical parameter estimation for a class of MIMO Hammerstein systems based on the reframed models, Applied Mathematics Letters, 57, 13-19 (2016) · Zbl 1336.93155 |
| [37] | Ding, F.; Wang, X. H., Hierarchical stochastic gradient algorithm and its performance analysis for a class of bilinear-in-parameter systems, Circuits, Systems and Signal Processing, 36, 4, 1393-1405 (2017) · Zbl 1370.93088 |
| [38] | Ding, F.; Chen, H. B.; Xu, L.; Dai, J. Y.; Li, Q. S.; Hayat, T., A hierarchical least squares identification algorithm for Hammerstein nonlinear systems using the key term separation, Journal of the Franklin Institute, 355, 8, 3737-3752 (2018) · Zbl 1390.93818 |
| [39] | Tang, Y. G.; Han, Z. Z.; Wang, Y.; Zhang, L. L.; Lian, Q. S., A changing forgetting factor RLS for online identification of nonlinear systems based on ELM-Hammerstein model, Neural Computing and Applications, 28, 1, 813-827 (2017) |
| [40] | Jafari, M.; Salimifard, M.; Dehghani, M., Identification of multivariable nonlinear systems in the presence of colored noises using iterative hierarchical least squares algorithm, ISA Transactions, 53, 4, 1243-1252 (2014) |
| [41] | Chen, J.; Liu, Y. J.; Wang, X. H., Recursive least squares algorithm for nonlinear dual-rate systems using missing-output estimation model, Circuits, Systems and Signal Processing, 36, 4, 1406-1425 (2017) · Zbl 1370.93331 |
| [42] | Salhi, H.; Kamoun, S., A recursive parametric estimation algorithm of multivariable nonlinear systems described by Hammerstein mathematical models, Applied Mathematical Modelling, 39, 16, 4951-4962 (2015) · Zbl 1443.93016 |
| [43] | Voros, J., Identification of nonlinear dynamic systems with input saturation and output backlash using three-block cascade models, Journal of the Franklin Institute, 351, 12, 5455-5466 (2014) · Zbl 1393.93133 |
| [44] | Vörös, J., Identification of nonlinear cascade systems with output hysteresis based on the key term separation principle, Applied Mathematical Modelling, 39, 18, 5531-5539 (2015) · Zbl 1443.93020 |
| [45] | Vörös, J., Iterative identification of nonlinear dynamic systems with output backlash using three-block cascade models, Nonlinear Dynamics, 79, 3, 2187-2195 (2015) |
| [46] | Tan, Y. H.; Dong, R. L.; Li, R. Y., Recursive identification of sandwich systems with dead zone and application, IEEE Transactions on Control Systems Technology, 17, 4, 945-951 (2009) |
| [47] | Hafezi, Z.; Arefi, M. M., Recursive generalized extended least squares and RML algorithms for identification of bilinear systems with ARMA noise, ISA Transactions, 88, 50-61 (2019) |
| [48] | Ding, F.; Liu, X. M.; Hayat, T., Hierarchical least squares identification for feedback nonlinear equation-error systems, Journal of the Franklin Institute (2020) · Zbl 1451.93404 |
| [49] | Ding, F.; Xu, L.; Alsaadi, F. E.; Hayat, T., Iterative parameter identification for pseudo-linear systems with ARMA noise using the filtering technique, IET Control Theory and Applications, 12, 7, 892-899 (2018) |
| [50] | Chen, J.; Zhu, Q. M.; Ding, F.; Gu, Y., Aitken based modified Kalman filtering stochastic gradient algorithm for dual-rate nonlinear models, Journal of the Franklin Institute, 356, 8, 4732-4746 (2019) · Zbl 1412.93089 |
| [51] | Wang, D. Q.; Zhang, Z.; Xue, B. Q., Decoupled parameter estimation methods for Hammerstein systems by using filtering techniques, IEEE Access, 6, 66612-66620 (2018) |
| [52] | Wang, D. Q.; Ding, F.; Chu, Y. Y., Data filtering based recursive least squares algorithm for Hammerstein systems using the key-term separation principle, Information Sciences, 222, 203-212 (2013) · Zbl 1293.93758 |
| [53] | Xu, L.; Ding, F.; Gu, Y.; Alsaedi, A.; Hayat, T., A multi-innovation state and parameter estimation algorithm for a state space system with d-step state-delay, Signal Processing, 140, 97-103 (2017) |
| [54] | Chen, J.; Ding, F.; Liu, Y. J.; Zhu, Q. M., Multi-step-length gradient iterative algorithm for equation-error type models, Systems & Control Letters, 115, 15-21 (2018) · Zbl 1391.93071 |
| [55] | Li, M. H.; Liu, X. M., Auxiliary model based least squares iterative algorithms for parameter estimation of bilinear systems using interval-varying measurements, IEEE Access, 6, 21518-21529 (2018) |
| [56] | Chen, J.; Zhu, Q. M.; Budi, C.; Pu, Y., Auxiliary variable based identification algorithms for uncertain-input models, Circuits, Systems and Signal Processing (2020) · Zbl 1448.93060 |
| [57] | J. Chen, Q.M. Zhu, F. Ding, Y.J. Liu, 2020b, Interval error correction auxiliary model based gradient iterative algorithms for multi-rate ARX models. IEEE Transactions on Automatic Control doi:10.1109/TAC.2019.2955030. · Zbl 1536.93949 |
| [58] | D.Q. Wang, W. Zhang, 2015, Improved least squares identification algorithm for multivariable Hammerstein systems. 352, 11, 5292-5307, Journal of the Franklin Institute. · Zbl 1395.93287 |
| [59] | Salimifard, M.; Jafari, M.; Dehghani, M., Identification of nonlinear MIMO block-oriented systems with moving average noises using gradient based and least squares based iterative algorithms, Neurocomputing, 94, 22-31 (2012) |
| [60] | Chaudhary, N. I.; Ahmed, M.; Khan, Z. A.; Zubair, S.; Raja, M. A.Z.; Dedovic, N., Design of normalized fractional adaptive algorithms for parameter estimation of control autoregressive autoregressive systems, Applied Mathematical Modelling, 55, 698-715 (2018) · Zbl 1480.93456 |
| [61] | Chaudhary, N. I.; Khan, Z. A.; Zubair, S.; Raja, M. A.Z.; Dedovic, N., Normalized fractional adaptive methods for nonlinear control autoregressive systems, Applied Mathematical Modelling, 66, 457-471 (2019) · Zbl 1481.93147 |
| [62] | Ding, F., Computational efficiency of the identification methods. Part B: Iterative algorithms, Journal of Nanjing University of Information Science and Technology: Ntural Science Edition, 4, 5, 385-401 (2012) |
| [63] | Wang, D. Q.; Mao, L.; Ding, F., Recasted models based hierarchical extended stochastic gradient method for MIMO nonlinear systems, IET Control Theory and Applications, 11, 4, 476-485 (2017) |
| [64] | M. Jiao, D.Q. Wang, J.L. Qiu, 2020, A GRU-RNN based momentum optimized algorithm for SOC estimation,Journal of Power Sources 459: 228051. |
| [65] | Li, W. Q.; Yan, Y.; Wang, D. Q.; Yin, S. Q., The multi-innovation extended kalman filter algorithm for battery SOC estimation, Journal: Ionics (2020) |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
