Convergence properties of the least squares estimation algorithm for multivariable systems. (English) Zbl 1349.74043
Summary: This paper focuses on the convergence properties of the least squares parameter estimation algorithm for multivariable systems that can be parameterized into a class of multivariate linear regression models. The performance analysis of the algorithm by using the stochastic process theory and the martingale convergence theorem indicates that the parameter estimation errors converge to zero under weak conditions. The simulation results validate the proposed theorem.
MSC:
| 74A55 | Theories of friction (tribology) |
| 74G05 | Explicit solutions of equilibrium problems in solid mechanics |
Keywords:
recursive identification; parameter estimation; multivariable systems; least squares; convergence propertiesReferences:
| [1] | Ding, F., Several multi-innovation identification methods, Digital Signal Process., 20, 4, 1027-1039 (2010) |
| [2] | Ding, F.; Liu, X. P.; Liu, G., Auxiliary model based multi-innovation extended stochastic gradient parameter estimation with colored measurement noises, Signal Process., 89, 10, 1883-1890 (2009) · Zbl 1178.94137 |
| [3] | Ljung, L., System Identification: Theory for the User (1999), Prentice-hall: Prentice-hall Englewood Cliffs, NJ |
| [4] | Li, J. H.; Ding, F., Maximum likelihood stochastic gradient estimation for Hammerstein systems with colored noise based on the key term separation technique, Comput. Math. Appl., 62, 11, 4170-4177 (2011) · Zbl 1236.93150 |
| [5] | Li, J. H.; Ding, F.; Yang, G. W., Maximum likelihood least squares identification method for input nonlinear finite impulse response moving average systems, Math. Comput. Model., 55, 3-4, 442-450 (2012) · Zbl 1255.93147 |
| [6] | Wang, W.; Li, J. H.; Ding, R. F., Maximum likelihood parameter estimation algorithm for controlled autoregressive autoregressive models, Int. J. Comput. Math., 88, 16, 3458-3467 (2011) · Zbl 1248.93161 |
| [7] | Wang, W.; Ding, F.; Dai, J. Y., Maximum likelihood least squares identification for systems with autoregressive moving average noise, Appl. Math. Model., 36, 5, 1842-1853 (2012) · Zbl 1242.62105 |
| [8] | Peterka, V., Bayesian system identification, Automatica, 17, 1, 41-43 (1981) · Zbl 0451.93059 |
| [9] | Tulleken, H., Grey-box modelling and identification using physical knowledge and bayesian techniques, Automatica, 29, 2, 285-308 (1993) · Zbl 0800.93080 |
| [10] | Ding, F.; Chen, T.; Qiu, L., Bias compensation based recursive least squares identification algorithm for MISO systems, IEEE Trans. Circ. Syst. - II: Express Briefs, 53, 5, 349-353 (2006) |
| [11] | Zhang, Y.; Cui, G., Bias compensation methods for stochastic systems with colored noise, Appl. Math. Model., 35, 4, 1709-1716 (2011) · Zbl 1217.93163 |
| [12] | Zhang, Y., Unbiased identification of a class of multi-input single-output systems with correlated disturbances using bias compensation methods, Math. Comput. Model., 53, 9-10, 1810-1819 (2011) · Zbl 1219.93141 |
| [13] | Ding, J.; Ding, F., Bias compensation based parameter estimation for output error moving average systems, Int. J. Adap. Control Signal Process., 25, 12, 1100-1111 (2011) · Zbl 1263.93215 |
| [14] | Ding, F.; Chen, T., Performance bounds of the forgetting factor least squares algorithm for time-varying systems with finite measurement data, IEEE Trans. Circ. Syst. -I: Regular Papers, 52, 3, 555-566 (2005) · Zbl 1374.93390 |
| [15] | Ding, F.; Liu, X. P.; Liu, G., Identification methods for Hammerstein nonlinear systems, Digital Signal Process., 21, 2, 215-238 (2011) |
| [16] | Wang, D. Q.; Ding, F., Least squares based and gradient based iterative identification for Wiener nonlinear systems, Signal Process., 91, 5, 1182-1189 (2011) · Zbl 1219.94052 |
| [17] | Wang, D. Q.; Yang, G. W.; Ding, R. F., Gradient-based iterative parameter estimation for Box-Jenkins systems, Comput. Math. Appl., 60, 5, 1200-1208 (2010) · Zbl 1201.94046 |
| [18] | Wang, DQ., Least squares-based recursive iterative estimation for output error moving average (OEMA) systems using data filtering, IET Control Theory Appl., 5, 14, 1648-1657 (2011) |
| [19] | Lai, T.; Wei, C., Least squares estimates in stochastic regression models with applications to identification and control of dynamic systems, The Ann. Stat., 10, 1, 154-166 (1982) · Zbl 0649.62060 |
| [20] | Lai, T.; Ying, Z., Recursive identification and adaptive prediction in linear stochastic systems, SIAM J. Control Optim., 29, 5, 1061-1090 (1991) · Zbl 0756.93081 |
| [21] | Guo, L., Self-convergence of weighted least-squares with applications to stochastic adaptive control, IEEE Trans. Autom. Control, 41, 1, 79-89 (1996) · Zbl 0844.93081 |
| [22] | Bittanti, S.; Bolzern, P.; Campi, M., Recursive least-squares identification algorithms with incomplete excitation: convergence analysis and application to adaptive control, IEEE Trans. Automat. Control, 35, 12, 1371-1373 (1990) · Zbl 0795.93105 |
| [23] | Ding, F.; Shi, Y.; Chen, T., Performance analysis of estimation algorithms of nonstationary ARMA processes, IEEE Trans. Signal Process., 54, 3, 1041-1053 (2006) · Zbl 1373.94569 |
| [24] | Ding, F.; Shi, Y.; Chen, T., Auxiliary model-based least-squares identification methods for Hammerstein output-error systems, Syst. Control Lett., 56, 5, 373-380 (2007) · Zbl 1130.93055 |
| [25] | Zhang, J. B.; Ding, F.; Shi, Y., Self-tuning control based on multi-innovation stochastic gradient parameter estimation, Syst. Control Lett., 58, 1, 69-75 (2009) · Zbl 1154.93040 |
| [26] | Xiao, Y.; Ding, F.; Zhou, Y.; Li, M.; Dai, J., On consistency of recursive least squares identification algorithms for controlled auto-regression models, Appl. Math. Model., 32, 11, 2207-2215 (2008) · Zbl 1156.93411 |
| [27] | Ding, F.; Chen, T., Performance analysis of multi-innovation gradient type identification methods, Automatica, 43, 1, 1-14 (2007) · Zbl 1140.93488 |
| [28] | Ding, F.; Liu, G.; Liu, X. P., Partially coupled stochastic gradient identification methods for non-uniformly sampled systems, IEEE Trans. Automat. Control, 55, 8, 1976-1981 (2010) · Zbl 1368.93121 |
| [29] | Ding, J.; Ding, F.; Liu, X. P.; Liu, G., Hierarchical least squares identification for linear SISO systems with dual-rate sampled-data, IEEE Trans. Automat. Control, 56, 11, 2677-2683 (2011) · Zbl 1368.93744 |
| [30] | Zhu, X.; Murch, R., Performance analysis of maximum likelihood detection in an MIMO antenna system, IEEE Trans. Commun., 50, 2, 187-191 (2002) |
| [31] | Ding, F.; Chen, T., Hierarchical gradient-based identification of multivariable discrete-time systems, Automatica, 41, 2, 315-325 (2005) · Zbl 1073.93012 |
| [32] | Huang, Y.; Benesty, J.; Chen, J., Identification of acoustic MIMO systems: Challenges and opportunities, Signal Process., 86, 6, 1278-1295 (2006) · Zbl 1163.94348 |
| [33] | Ahmadi, M.; Mojallali, H., Identification of multiple-input single-output Hammerstein models using bezier curves and bernstein polynomials, Appl. Math. Model., 35, 4, 1969-1982 (2011) · Zbl 1217.93171 |
| [34] | Liu, Y. J.; Xiao, Y. S.; Zhao, X. L., Multi-innovation stochastic gradient algorithm for multiple-input single-output systems using the auxiliary model, Appl. Math. Comput., 215, 4, 1477-1483 (2009) · Zbl 1177.65095 |
| [35] | Han, L. L.; Ding, F., Multi-innovation stochastic gradient algorithms for multi-input multi-output systems, Digital Signal Process., 19, 4, 545-554 (2009) |
| [36] | Ding, F.; Qiu, L.; Chen, T., Reconstruction of continuous-time systems from their non-uniformly sampled discrete-time systems, Automatica, 45, 2, 324-332 (2009) · Zbl 1158.93365 |
| [37] | Ding, F.; Liu, Y. J.; Bao, B.; based, Gradient; Proceedings of the Institution of Mechanical Engineers, least squares based iterative estimation algorithms for multi-input multi-output systems., Part I: J. Syst. Control Eng., 226, 1, 43-55 (2012) |
| [38] | Sen, A.; Sinha, N., On-line estimation of the parameters of a multivariable system using matrix pseudo-inverse, Int. J. Syst. Sci., 7, 4, 461-471 (1976) · Zbl 0323.93033 |
| [40] | Liu, Y. J.; Sheng, J.; Ding, R. F., Convergence of stochastic gradient estimation algorithm for multivariable ARX-like systems, Comput. Math. Appl., 59, 8, 2615-2627 (2010) · Zbl 1193.60057 |
| [41] | Ding, F.; Chen, H. B.; Li, M.; systems, Multi-innovation least squares identification methods based on the auxiliary model for MISO, Appl. Math. Comput., 187, 2, 658-668 (2007) · Zbl 1114.93101 |
| [42] | Han, L. L.; Ding, F.; theory, Identification for multirate multi-input systems using the multi-innovation identification, Comput. Math. Appl., 57, 9, 1438-1449 (2009) · Zbl 1186.93076 |
| [43] | Liu, Y. J.; Xie, L.; Ding, F.; systems, An auxiliary model based recursive least squares parameter estimation algorithm for non-uniformly sampled multirate, Proceedings of the Institution of Mechanical Engineers, Part I: J. Syst. Control Eng., 223, 4, 445-454 (2009) |
| [44] | Ding, F.; Liu, X. P.; Liu, G., Multi-innovation least squares identification for system modeling, IEEE Trans. Syst. Man Cybernet. Part B: Cybernet., 40, 3, 767-778 (2010) |
| [45] | Ding, F.; Liu, X. P.; Yang, H. Z., Parameter intersample output estimation for dual-rate systems identification, IEEE Trans. Syst. Man Cybernet. Part A: Syst. Humans, 38, 4, 966-975 (2008) |
| [46] | Ding, F.; Ding, J., Least squares parameter estimation with irregularly missing data, Int. J. Adap. Control Signal Process., 24, 7, 540-553 (2010) · Zbl 1200.93130 |
| [47] | Ding, F.; Liu, G.; Liu, X. P., Parameter estimation with scarce measurements, Automatica, 47, 8, 1646-1655 (2011) · Zbl 1232.62043 |
| [48] | Goodwin, G.; Sin, K., Adaptive Filtering Prediction and Control (1984), Prentice-Hall: Prentice-Hall Englewood Cliffs, NJ · Zbl 0653.93001 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
