×

System identification based on tensor decompositions: a trilinear approach. (English) Zbl 1425.93115

Summary: The theory of nonlinear systems can currently be encountered in many important fields, while the nonlinear behavior of electronic systems and devices has been studied for a long time. However, a global approach for dealing with nonlinear systems does not exist and the methods to address this problem differ depending on the application and on the types of nonlinearities. An interesting category of nonlinear systems is one that can be regarded as an ensemble of (approximately) linear systems. Some popular examples in this context are nonlinear electronic devices (such as acoustic echo cancellers, which are used in applications for two-party or multi-party voice communications, e.g., videoconferencing), which can be modeled as a cascade of linear and nonlinear systems, similar to the Hammerstein model. Multiple-input/single-output (MISO) systems can also be regarded as separable multilinear systems and be treated using the appropriate methods. The high dimension of the parameter space in such problems can be addressed with methods based on tensor decompositions and modelling. In recent work, we focused on a particular type of multilinear structure – namely the bilinear form (i.e., two-dimensional decompositions) – in the framework of identifying spatiotemporal models. In this paper, we extend the work to the decomposition of more complex systems and we propose an iterative Wiener filter tailored for the identification of trilinear forms (where third-order tensors are involved), which can then be further extended to higher order multilinear structures. In addition, we derive the least-mean-square (LMS) and normalized LMS (NLMS) algorithms tailored for such trilinear forms. Simulations performed in the context of system identification (based on the MISO system approach) indicate the good performance of the proposed solution, as compared to conventional approaches.

MSC:

93C10 Nonlinear systems in control theory
93B30 System identification
93D25 Input-output approaches in control theory

References:

[1] Roy, R.; Sherman, J.; A learning technique for Volterra series representation; IEEE Trans. Autom. Control: 1967; Volume 12 ,761-764.
[2] Barker, H.A.; Obidegwu, S.N.; Pradisthayon, T.; Performance of antisymmetric pseudorandom signals in the measurement of 2nd-order Volterra kernels by crosscorrelation; Proc. IEEE: 1972; Volume 119 ,353-362.
[3] Annabestani, M.; Naghavi, N.; Nejad, M.M.; Nonautoregressive nonlinear identification of IPMC in large deformation situations using generalized Volterra-based approach; IEEE Trans. Instrum. Meas.: 2016; Volume 65 ,2866-2872.
[4] Zhang, Z.; Ma, Y.; Modeling of rate-dependent hysteresis using a GPO-based adaptive filter; Sensors: 2016; Volume 16 .
[5] Rugh, W.J.; ; Nonlinear System Theory: The Volterra/Wiener Approach: Baltimore, MD, USA 1981; . · Zbl 0666.93065
[6] Carassale, L.; Kareem, A.; Modeling nonlinear systems by Volterra series; J. Eng. Mech.: 2010; Volume 136 ,801-818.
[7] Benesty, J.; Paleologu, C.; Ciochină, S.; On the identification of bilinear forms with the Wiener filter; IEEE Signal Process. Lett.: 2017; Volume 24 ,653-657.
[8] Bai, E.-W.; Li, D.; Convergence of the iterative Hammerstein system identification algorithm; IEEE Trans. Autom. Control: 2004; Volume 49 ,1929-1940. · Zbl 1365.93098
[9] Paleologu, C.; Benesty, J.; Ciochină, S.; Adaptive filtering for the identification of bilinear forms; Digit. Signal Process.: 2018; Volume 75 ,153-167. · Zbl 1461.93503
[10] Dogariu, L.; Paleologu, C.; Ciochină, S.; Benesty, J.; Piantanida, P.; Identification of bilinear forms with the Kalman filter; Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP): ; ,4134-4138. · Zbl 1461.93503
[11] Dogariu, L.-M.; Ciochină, S.; Paleologu, C.; Benesty, J.; A connection between the Kalman filter and an optimized LMS algorithm for bilinear forms; Algorithms: 2018; Volume 11 . · Zbl 1461.93503
[12] Gesbert, D.; Duhamel, P.; Robust blind joint data/channel estimation based on bilinear optimization; Proceedings of the 8th Workshop on Statistical Signal and Array Processing: ; ,168-171.
[13] Stenger, A.; Kellermann, W.; Adaptation of a memoryless preprocessor for nonlinear acoustic echo cancelling; Signal Process.: 2000; Volume 80 ,1747-1760. · Zbl 1034.94532
[14] Ribeiro, L.N.; Schwarz, S.; Rupp, M.; de Almeida, A.L.F.; Mota, J.C.M.; A low-complexity equalizer for massive MIMO systems based on array separability; Proceedings of the 2017 25th European Signal Processing Conference (EUSIPCO): ; ,2522-2526.
[15] Da Costa, M.N.; Favier, G.; Romano, J.M.T.; Tensor modelling of MIMO communication systems with performance analysis and Kronecker receivers; Signal Process.: 2018; Volume 145 ,304-316.
[16] Ljung, L.; ; System Identification: Theory for the User: Upper Saddle River, NJ, USA 1999; . · Zbl 0615.93004
[17] ; Acoustic Signal Processing for Telecommunication: Boston, MA, USA 2000; .
[18] Benesty, J.; Gaensler, T.; Morgan, D.R.; Sondhi, M.M.; Gay, S.L.; ; Advances in Network and Acoustic Echo Cancellation: Berlin, Germany 2001; . · Zbl 0965.94001
[19] Rupp, M.; Schwarz, S.; A tensor LMS algorithm; Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP): ; ,3347-3351.
[20] Rupp, M.; Schwarz, S.; Gradient-based approaches to learn tensor products; Proceedings of the 2015 23rd European Signal Processing Conference (EUSIPCO): ; ,2486-2490.
[21] Vervliet, N.; Debals, O.; Sorber, L.; Lathauwer, L.D.; Breaking the curse of dimensionality using decompositions of incomplete tensors: Tensor-based scientific computing in big data analysis; IEEE Signal Process. Mag.: 2014; Volume 31 ,71-79.
[22] Sidiropoulos, N.; Lathauwer, L.D.; Fu, X.; Huang, K.; Papalexakis, E.; Faloutsos, C.; Tensor decomposition for signal processing and machine learning; IEEE Trans. Signal Process.: 2017; Volume 65 ,3551-3582. · Zbl 1415.94232
[23] Boussé, M.; Debals, O.; Lathauwer, L.D.; A tensor-based method for large-scale blind source separation using segmentation; IEEE Trans. Signal Process.: 2017; Volume 65 ,346-358. · Zbl 1414.94086
[24] Lathauwer, L.D.; Signal Processing Based on Multilinear Algebra; Ph.D. Thesis: Leuven, Belgium 1997; .
[25] Kolda, T.G.; Bader, B.W.; Tensor decompositions and applications; SIAM Rev.: 2009; Volume 51 ,455-500. · Zbl 1173.65029
[26] Comon, P.; Tensors: A brief introduction; IEEE Signal Process. Mag.: 2014; Volume 31 ,44-53.
[27] Cichocki, A.; Mandic, D.P.; Phan, A.H.; Caiafa, C.F.; Zhou, G.; Zhao, Q.; Lathauwer, L.D.; Tensor decompositions for signal processing applications; IEEE Signal Process. Mag.: 2015; Volume 32 ,145-163.
[28] Loan, C.F.V.; The ubiquitous Kronecker product; J. Comput. Appl. Math.: 2000; Volume 123 ,85-100. · Zbl 0966.65039
[29] Paleologu, C.; Benesty, J.; Ciochină, S.; Linear system identification based on a Kronecker product decomposition; IEEE/ACM Trans. Audio Speech Lang. Process.: 2018; Volume 26 ,1793-1808.
[30] Elisei-Iliescu, C.; Paleologu, C.; Benesty, J.; Stanciu, C.; Anghel, C.; Ciochină, S.; Recursive least-squares algorithms for the identification of low-rank systems; IEEE/ACM Trans. Audio Speech Lang. Process.: 2019; Volume 27 ,903-918.
[31] Kiers, H.A.L.; Towards a standardized notation and terminology in multiway analysis; J. Chemom.: 2000; Volume 14 ,105-122.
[32] Kroonenberg, P.; ; Applied Multiway Data Analysis: Hoboken, NJ, USA 2008; . · Zbl 1160.62002
[33] Ribeiro, L.N.; de Almeida, A.L.F.; Mota, J.C.M.; Identification of separable systems using trilinear filtering; Proceedings of the 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP): ; ,189-192.
[34] Morgan, D.R.; Kratzer, S.G.; On a class of computationally efficient, rapidly converging, generalized NLMS algorithms; IEEE Signal Process. Lett.: 1996; Volume 3 ,245-247.
[35] Haykin, S.; ; Adaptive Filter Theory: Upper Saddle River, NJ, USA 2002; .
[36] Benesty, J.; Paleologu, C.; Ciochină, S.; On regularization in adaptive filtering; IEEE Trans. Audio Speech Lang. Process.: 2011; Volume 19 ,1734-1742. · Zbl 1235.94002
[37] Digital Network Echo Cancellers; ITU-T Recommendations G.168; 2002; ; .
[38] Morgan, D.R.; Benesty, J.; Sondhi, M.M.; On the evaluation of estimated impulse responses; IEEE Signal Process. Lett.: 1998; Volume 5 ,174-176.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.