×

Instrumental variable-based multi-innovation gradient estimation for nonlinear systems with scarce measurements. (English) Zbl 1531.93060

Summary: This article considers the identification problems of nonlinear systems with scarce measurements by using the instrumental variable technique. When the product of the instrumental matrix and the information matrix is a nonsingular matrix and the weak persistent excitation condition about the instrumental vector is true, the obtained parameter estimates can be unbiased consistent estimates. The key is how to choose the instrumental variables. Difficulty arises in that the system outputs are unavailable. By applying the negative gradient search, a recursive instrumental variable-based gradient algorithm is derived to estimate the parameters of the nonlinear systems with missing observed data. Moreover, the multi-innovation identification theory is introduced to further improve the parameter estimation accuracy. The simulation results illustrate that the proposed methods are effective.
{© 2022 John Wiley & Sons Ltd.}

MSC:

93B30 System identification
93C10 Nonlinear systems in control theory
Full Text: DOI

References:

[1] KangZ, JiY, LiuXM. Hierarchical recursive least squares algorithms for Hammerstein nonlinear autoregressive output‐error systems. Int J Adapt Control Signal Process. 2021;35(11):2276‐2295. · Zbl 1543.93319
[2] PanJ, JiangX, WanXK, DingW. A filtering based multi‐innovation extended stochastic gradient algorithm for multivariable control systems. Int J Control Autom Syst. 2017;15(3):1189‐1197.
[3] DingF, MaH, PanJ, YangEF. Hierarchical gradient‐ and least squares‐based iterative algorithms for input nonlinear output‐error systems using the key term separation. J Franklin Inst. 2021;358(9):5113‐5135. · Zbl 1465.93040
[4] XuL. Separable multi‐innovation Newton iterative modeling algorithm for multi‐frequency signals based on the sliding measurement window. Circuits Syst Signal Process. 2022;41(2):805‐830. · Zbl 1509.94036
[5] XuL. Separable Newton recursive estimation method through system responses based on dynamically discrete measurements with increasing data length. Int J Control Autom Syst. 2022;20(2):432‐443.
[6] PanJ, LiW, ZhangHP. Control algorithms of magnetic suspension systems based on the improved double exponential reaching law of sliding mode control. Int J Control Autom Syst. 2018;16(6):2878‐2887.
[7] XiongJX, PanJ, ChenGY, et al. Sliding mode dual‐channel disturbance rejection attitude control for a quadrotor. IEEE Trans Ind Electron2022;69(10):10489‐10499. 10.1109/TIE.2021.3137600
[8] WangYJ, TangSH, GuXB. Parameter estimation for nonlinear Volterra systems by using the multi‐innovation identification theory and tensor decomposition. J Franklin Inst. 2022;359(2):1782‐1802. · Zbl 1481.93022
[9] WangYJ, YangL. An efficient recursive identification algorithm for multilinear systems based on tensor decomposition. Int J Robust Nonlinear Control. 2021;31(11):7920‐7936. · Zbl 1527.93044
[10] DingF, LiuYJ, BaoB. Gradient based and least squares based iterative estimation algorithms for multi‐input multi‐output systems. Proc Inst Mech Eng I J Syst Control Eng. 2012;226(1):43‐55.
[11] BinM, MarconiL. Output regulation by postprocessing internal models for a class of multivariable nonlinear systems. Int J Robust Nonlinear Control. 2020;30(3):1115‐1140. · Zbl 1447.93283
[12] HammarK, DjamahT, BettayebM. Identification of fractional Hammerstein system with application to a heating process. Nonlinear Dyn. 2019;96:2613‐2626.
[13] YangL, LiuY, DengZC. Multi‐parameters identification problem for a degenerate parabolic equation. J Comput Appl Math. 2020;366:112422. · Zbl 1423.35458
[14] LiuXM, FanYM. Maximum likelihood extended gradient‐based estimation algorithms for the input nonlinear controlled autoregressive moving average system with variable‐gain nonlinearity. Int J Robust Nonlinear Control. 2021;31(9):4017‐4036. · Zbl 1526.93264
[15] LiMH, LiuXM. Maximum likelihood least squares based iterative estimation for a class of bilinear systems using the data filtering technique. Int J Control Autom Syst. 2020;18(6):1581‐1592.
[16] PillonettoG, ChiusoA, De NicolaoG. Stable spline identification of linear systems under missing data. Automatica. 2019;108:108493. · Zbl 1536.93160
[17] HuJ, WangZD, LiuGP, et al. Event‐triggered recursive state estimation for dynamical networks under randomly switching topologies and multiple missing measurements. Automatica. 2020;115:108908. · Zbl 1436.93084
[18] WallinR, IsakssonAJ, NoreusO. Extensions to “output prediction under scarce data operation: control applications”. Automatica. 2001;37(12):2069‐2071. · Zbl 1031.93145
[19] SanchisR, PenarrochaI, AlbertosP. Design of robust output predictors under scarce measurements with time varying delays. Automatica. 2007;43(2):281‐289. · Zbl 1111.93021
[20] XiongWL, YangXQ. EM algorithm‐based identification of a class of nonlinear wiener systems with missing output data. Nonlinear Dyn. 2015;80(1):329‐339. · Zbl 1345.93151
[21] IsakssonAJ. Identification of ARX‐models subject to missing data. IEEE Trans Autom Control. 1993;38(5):813‐819. · Zbl 0785.93028
[22] DankersA, Van den HofPMJ, BomboisX, et al. Errors‐in‐variables identification in dynamic networks‐consistency results for an instrumental variable approach. Automatica. 2015;62:39‐50. · Zbl 1329.93048
[23] PanSQ, WelshJS, GonzalezRA, RojasCR. Efficiency analysis of the simplified refined instrumental variable method for continuous‐time systems. Automatica. 2020;121:109196. · Zbl 1448.93063
[24] SoderstromT, StoicaP. Instrumental Variable Methods for System Identification. LNCIS. Springer; 1983. · Zbl 0522.93003
[25] TothR, LaurainV, GilsonM, GarnierH. Instrumental variable scheme for closed‐loop LPV model identification. Automatica. 2012;48(9):2314‐2320. · Zbl 1258.93051
[26] YoungPC. Refined instrumental variable estimation: maximum likelihood optimization of a unified box‐CJenkins model. Automatica. 2015;52:35‐46. · Zbl 1309.93178
[27] ChenJ, JiangB, LiJ. Missing output identification model based recursive least squares algorithm for a distributed parameter system. Int J Control Autom Syst. 2018;16(1):150‐157.
[28] DingF, LiuXP, LiuG. Multiinnovation least squares identification for linear and pseudo‐linear regression models. IEEE Trans Syst Man Cybern Part B Cybern. 2010;40(3):767‐778.
[29] FanYM, LiuXM. Auxiliary model‐based multi‐innovation recursive identification algorithms for an input nonlinear controlled autoregressive moving average system with variable‐gain nonlinearity. Int J Adapt Control Signal Process. 2022;36(3):690‐707.
[30] LiMH, LiuXM. Maximum likelihood hierarchical least squares‐based iterative identification for dual‐rate stochastic systems. Int J Adapt Control Signal Process. 2021;35(2):240‐261. · Zbl 1543.93353
[31] ChenJ, LiJ, LiuYJ. Gradient iterative algorithm for dual‐rate nonlinear systems based on a novel particle filter. J Franklin Inst. 2017;354(11):4425‐4437. · Zbl 1380.93251
[32] XiaHF, YangYQ, HayatT. Maximum likelihood gradient‐based iterative estimation for multivariable systems. IET Control Theory Appl. 2019;13(11):1683‐1691. · Zbl 1432.93329
[33] XiaHF, JiY, LiuYJ, et al. Maximum likelihood‐based multi‐innovation stochastic gradient method for multivariable systems. Int J Control Autom Syst. 2019;17(3):565‐574.
[34] PanJ, MaH, ZhangX. Recursive coupled projection algorithms for multivariable output‐error‐like systems with coloured noises. IET Signal Process. 2020;14(7):455‐466.
[35] HouJ, ChenFW, LiPH, et al. Gray‐box parsimonious subspace identification of Hammerstein‐type systems. IEEE Trans Ind Electron. 2021;68(10):9941‐9951.
[36] ZhouYH, ZhangX. Partially‐coupled nonlinear parameter optimization algorithm for a class of multivariate hybrid models. Appl Math Comput. 2022;414:126663. · Zbl 1510.93338
[37] JiY, KangZ. Three‐stage forgetting factor stochastic gradient parameter estimation methods for a class of nonlinear systems. Int J Robust Nonlinear Control. 2021;31(3):871‐987. · Zbl 1525.93438
[38] ZhouYH. Modeling nonlinear processes using the radial basis function‐based state‐dependent autoregressive models. IEEE Signal Process Lett. 2020;27:1600‐1604.
[39] JiY, JiangXK, WanLJ. Hierarchical least squares parameter estimation algorithm for two‐input Hammerstein finite impulse response systems. J Franklin Inst. 2020;357(8):5019‐5032. · Zbl 1437.93131
[40] ZhouYH, ZhangX. Hierarchical estimation approach for RBF‐AR models with regression weights based on the increasing data length. IEEE Trans Circuits Syst II Exp Briefs. 2021;68(12):3597‐3601.
[41] JiY, KangZ, ZhangC. Two‐stage gradient‐based recursive estimation for nonlinear models by using the data filtering. Int J Control Autom Syst. 2021;19(8):2706‐2715.
[42] DingF, LiuXM, HayatT. Hierarchical least squares identification for feedback nonlinear equation‐error systems. J Franklin Inst. 2020;357(5):2958‐2977. · Zbl 1451.93404
[43] MaP, WangL. Filtering‐based recursive least squares estimation approaches for multivariate equation‐error systems by using the multiinnovation theory. Int J Adapt Control Signal Process. 2021;35(9):1898‐1915. · Zbl 1536.93999
[44] MaoYW, LiuS, LiuJF. Robust economic model predictive control of nonlinear networked control systems with communication delays. Int J Adapt Control Signal Process. 2020;34(5):614‐637. · Zbl 1467.93095
[45] XuL, HayatT. Hierarchical recursive signal modeling for multi‐frequency signals based on discrete measured data. Int J Adapt Control Signal Process. 2021;35(5):676‐693. · Zbl 1543.93331
[46] XuL, ZhuQM. Decomposition strategy‐based hierarchical least mean square algorithm for control systems from the impulse responses. Int J Syst Sci. 2021;52(9):1806‐1821. · Zbl 1483.93637
[47] ChenJ, HuangB, GanM, et al. A novel reduced‐order algorithm for rational models based on Arnoldi process and Krylov subspace. Automatica. 2021;129:109663. · Zbl 1478.93081
[48] DingJL, ZhangWH. Finite‐time adaptive control for nonlinear systems with uncertain parameters based on the command filters. Int J Adapt Control Signal Process. 2021;35(9):1754‐1767. · Zbl 1543.93146
[49] ChenJ, ZhuQM, LiuYJ. Modified Kalman filtering based multi‐step‐length gradient iterative algorithm for ARX models with random missing outputs. Automatica. 2020;118:109034. · Zbl 1447.93350
[50] DingF, LiuG, LiuXP. Parameter estimation with scarce measurements. Automatica. 2011;47(8):1646‐1655. · Zbl 1232.62043
[51] DingF. System Identification‐Performance Analysis for Identification Mthods. Science Press; 2014.
[52] DingF. System Identification‐Multi‐Innovation Identification Theory and Methods. Science Press; 2016.
[53] XuL, YangEF. Auxiliary model multiinnovation stochastic gradient parameter estimation methods for nonlinear sandwich systems. Int J Robust Nonlinear Control. 2021;31(1):148‐165. · Zbl 1525.93043
[54] MaH, PanJ, DingW. Partially‐coupled least squares based iterative parameter estimation for multi‐variable output‐error‐like autoregressive moving average systems. IET Control Theory Appl. 2019;13(18):3040‐3051.
[55] WangJW, JiY, ZhangC. Iterative parameter and order identification for fractional‐order nonlinear finite impulse response systems using the key term separation. Int J Adapt Control Signal Process. 2021;35(8):1562‐1577. · Zbl 1543.93052
[56] JiY, ZhangC, KangZ, et al. Parameter estimation for block‐oriented nonlinear systems using the key term separation. Int J Robust Nonlinear Control. 2020;30(9):3727‐3752. · Zbl 1466.93161
[57] DingF, ShiY, ChenT. Performance analysis of estimation algorithms of non‐stationary ARMA processes. IEEE Trans Signal Process. 2006;54(3):1041‐1053. · Zbl 1373.94569
[58] LiMH, LiuXM. Iterative identification methods for a class of bilinear systems by using the particle filtering technique. Int J Adapt Control Signal Process. 2021;35(10):2056‐2074. · Zbl 1543.93320
[59] JiY, KangZ, LiuXM. The data filtering based multiple‐stage Levenberg‐Marquardt algorithm for Hammerstein nonlinear systems. Int J Robust Nonlinear Control. 2021;31(15):7007‐7025. · Zbl 1527.93457
[60] FanYM, LiuXM. Two‐stage auxiliary model gradient‐based iterative algorithm for the input nonlinear controlled autoregressive system with variable‐gain nonlinearity. Int J Robust Nonlinear Control. 2020;30(14):5492‐5509. · Zbl 1465.93041
[61] DingF, LiuXP, YangHZ. Parameter identification and intersample output estimation for dual‐rate systems. IEEE Trans Syst Man Cybern Part A Syst Humans. 2008;38(4):966‐975.
[62] XiongW, JiaX, YangD, et al. DP‐LinkNet: a convolutional network for historical document image binarization. KSII Trans Internet Inf Syst. 2021;15(5):1778‐1797.
[63] ZhaoG, GaoTH, WangYD, et al. Optimal sizing of isolated microgrid containing photovoltaic/photothermal/wind/diesel/battery. Int J Photoenergy. 2021;2021:5566597.
[64] WangXG, ZhaoM, ZhouY, et al. Design and analysis for multi‐disc coreless axial‐flux permanent‐magnet synchronous machine. IEEE Transn Appl Superconductivity. 2021;31(8):5203804.
[65] WangXG, WanZW, TangL, et al. Electromagnetic performance analysis of an axial flux hybrid excitation motor for HEV drives. IEEE Trans Appl Superconductivity. 2021;31(8):5205605.
[66] LiM, XuG, LaiQ, ChenJ. A chaotic strategy‐based quadratic opposition‐based learning adaptive variable‐speed whale optimization algorithm. Math Comput Simul. 2022;193:71‐99. · Zbl 1540.90308
[67] ShuJ, HeJC, LiL. MSIS: multispectral instance segmentation method for power equipment. Comput Intell Neurosci. 2022;2022:2864717. doi:10.1155/2022/2864717
[68] AnY, ZhangY, GaoW, et al. A lightweight and practical anonymous authentication protocol based on bit‐self‐test PUF. Electron. 2022;11(5):772.
[69] WangH, FanH, PanJ. Complex dynamics of a four‐dimensional circuit system. Int J Bifurcation Chaos. 2021;31(14):2150208. · Zbl 1484.34122
[70] DingF, ChenT. Combined parameter and output estimation of dual‐rate systems using an auxiliary model. Automatica. 2004;40(10):1739‐1748. · Zbl 1162.93376
[71] DingF, ChenT. Parameter estimation of dual‐rate stochastic systems by using an output error method. IEEE Trans Autom Control. 2005;50(9):1436‐1441. · Zbl 1365.93480
[72] DingF, ShiY, ChenT. Auxiliary model‐based least‐squares identification methods for Hammerstein output‐error systems. Syst Control Lett. 2007;56(5):373‐380. · Zbl 1130.93055
[73] ZhangX. Adaptive parameter estimation for a general dynamical system with unknown states. Int J Robust Nonlinear Control. 2020;30(4):1351‐1372. · Zbl 1465.93115
[74] ZhangX. Recursive parameter estimation methods and convergence analysis for a special class of nonlinear systems. Int J Robust Nonlinear Control. 2020;30(4):1373‐1393. · Zbl 1465.93218
[75] ZhaoN, WuA, PeiY, et al. Spatial‐temporal aggregation graph convolution network for efficient mobile cellular traffic prediction. IEEE Commun Lett. 2022;26(3):587‐591.
[76] ChenYF, ZhangC, LiuCY, et al. Atrial fibrillation detection using feedforward neural network. J Med Biolog Eng. 2022;42(1):63‐73.
[77] XuL, ZhuQM. Separable synchronous multi‐innovation gradient‐based iterative signal modeling from on‐line measurements. IEEE Trans Instrum Meas. 2022;71:6501313.
[78] ZhangX. Optimal adaptive filtering algorithm by using the fractional‐order derivative. IEEE Signal Process Lett. 2022;29:399‐403.
[79] WangJ, DingC, WuM, LiuY, ChenG. Lightweight multiple scale‐patch dehazing network for real‐world hazy image. KSII Trans Internet Inf Syst. 2022;15(12):4420‐4438.
[80] WangH, FanH, PanJ. A true three‐scroll chaotic attractor coined. Discr Contin Dyn Syst Ser B. 2022;27(5):2891‐2915. · Zbl 1495.34025
[81] YinCC, WenYZ. An extension of Paulsen‐Gjessing’s risk model with stochastic return on investments. Insur Math Econom. 2013;52(3):469‐476. · Zbl 1284.91281
[82] YinCC, ZhaoJS. Nonexponential asymptotics for the solutions of renewal equations, with applications. J Appl Probab. 2006;43(3):815‐824. · Zbl 1125.60090
[83] YinCC, YuenKC. Optimality of the threshold dividend strategy for the compound Poisson model. Statist Probab Lett. 2011;81(12):1841‐1846. · Zbl 1225.91030
[84] YinCC, YuenKC. Optimal dividend problems for a jump‐diffusion model with capital injections and proportional transaction costs. J Ind Manag Optim. 2015;11(4):1247‐1262. · Zbl 1328.93285
[85] WeiC, ZhangX, XuL. Overall recursive least squares and overall stochastic gradient algorithms and their convergence for feedback nonlinear controlled autoregressive systems. Int J Robust Nonlinear Control. 2022;32(9):5534‐5554. · Zbl 1528.93227
[86] LiuSY, ZhangX. Expectation‐maximization algorithm for bilinear systems by using the Rauch‐Tung‐Striebel smoother. Automatica. 2022;142:110365. · Zbl 1494.93030
[87] GengFZ, WuXY. A novel kernel functions algorithm for solving impulsive boundary value problems. Appl Math Lett. 2022;134:108318. · Zbl 1503.65151
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.