×
Zhao, Wei; Zhang, Huaipin; Yu, Wenwu

Distributed optimal output synchronization of heterogeneous multiagent systems with communication delays. (English) Zbl 07885593

Int. J. Robust Nonlinear Control 34, No. 12, 7821-7836 (2024).
Summary: The optimal output synchronization problem of heterogeneous multi-agent systems (HMASs) with communication delays is studied in this article. In order to compensate for communication delays actively, we employ networked data-driven predictive control method to predict the agents’ outputs. Then the output synchronization issue of HAMSs is transformed into the stabilization issue of the local pseudo systems, and model-free off-policy reinforcement learning technique is used to learn optimal control policies of the local systems. Combined predicted output information with optimal control policies, we develop a distributed data-driven optimal output policy for each follower. Finally, a numerical example is given to show the effectiveness of our results.
© 2024 John Wiley & Sons Ltd.

MSC:

93A16 Multi-agent systems
93C43 Delay control/observation systems
93B45 Model predictive control
93B70 Networked control

Keywords:

communication delays; networked data-driven predictive control; off-policy reinforcement learning; optimal control; output synchronization
Cite Review PDF
Full Text: DOI

References:

[1] CuiJ, LiuY, NallanathanA. Multi‐agent reinforcement learning‐based resource allocation for UAV networks. IEEE Trans Wirel Commun. 2019;19(2):729‐743.
[2] ZhangZ, YueD, DouC, ZhangH. Multiagent system‐based integrated design of security control and economic dispatch for interconnected microgrid systems. IEEE Trans Syst Man Cybern Syst. 2020;51(4):2101‐2112.
[3] GreysonD, ReveliotisS, MohlerG. Optimized multiagent routing for a class of guidepath‐based transport systems. IEEE Trans Autom Sci Eng. 2018;16(1):363‐381.
[4] ShiP, YanB. A survey on intelligent control for multiagent systems. IEEE Trans Syst Man Cybern Syst. 2020;51(1):161‐175.
[5] DingL, HanQ, GeX, ZhangX. An overview of recent advances in event‐triggered consensus of multiagent systems. IEEE Trans Cybern. 2017;48(4):1110‐1123.
[6] WenG, YuX, YuW, LvJ. Coordination and control of complex network systems with switching topologies: a survey. IEEE Trans Syst Man Cybern Syst. 2021;51(10):6342‐6357.
[7] ChenK, WangJ, ZhangY, LiuZ. Leader‐following consensus for a class of nonlinear strick‐feedback multiagent systems with state time‐delays. IEEE Trans Syst Man Cybern Syst. 2018;50(7):2351‐2361.
[8] XueM, TangY, RenW, QianF. Practical output synchronization for asynchronously switched multi‐agent systems with adaption to fast‐switching perturbations. Automatica. 2020;116:108917. · Zbl 1440.93241
[9] WenG, WanY, CaoJ, HuangT, YuW. Master‐slave synchronization of heterogeneous systems under scheduling communication. IEEE Trans Syst Man Cybern Syst. 2018;48(3):473‐484.
[10] ChenK, WangJ, ZhaoZ, LaiG, LyuY. Output consensus of heterogeneous multiagent systems: a distributed observer‐based approach. IEEE Trans Syst Man Cybern Syst. 2020;52(1):370‐376.
[11] LuM, LiuL. Distributed feedforward approach to cooperative output regulation subject to communication delays and switching networks. IEEE Trans Automat Contr. 2016;62(4):1999‐2005. · Zbl 1366.93513
[12] SuY, HuangJ. Cooperative output regulation with application to multi‐agent consensus under switching network. IEEE Trans Syst Man Cybern B Cybern. 2012;42(3):864‐875.
[13] YangR, ZhangH, FengG, YanH, WangZ. Robust cooperative output regulation of multi‐agent systems via adaptive event‐triggered control. Automatica. 2019;102:129‐136. · Zbl 1415.93100
[14] ZhouQ, XuX, LiuL, FengG. A lyapunov approach to robust cooperative output regulation of multiagent systems under infinite communication delays. IEEE Trans Automat Contr. 2022;67(11):6271‐6278. · Zbl 1541.93078
[15] LuM, LiuL. Consensus of heterogeneous second‐order nonlinear uncertain multi‐agent systems under switching networks. IEEE Trans Automat Contr. 2021;66(7):3331‐3338. · Zbl 1467.93286
[16] YangJ, YuH, ChenT. Cooperative output regulation with asynchronous transmissions and time‐varying delays. IEEE Trans Automat Contr. 2022;67(3):1438‐1445. · Zbl 1537.93590
[17] BahareK, LewisFL. Output synchronization of heterogeneous discrete‐time systems: a model‐free optimal approach. Automatica. 2017;84:86‐94. · Zbl 1376.93064
[18] HamidrezaM, NageshraoSP, LopesGAD, BabuskaR, LewisFL. Optimal model‐free output synchronization of heterogeneous systems using off‐policy reinforcement learning. Automatica. 2016;71:334‐341. · Zbl 1343.93006
[19] MuC, QianZ, SunC. Optimal model‐free output synchronization of heterogeneous multiagent systems under switching topologies. IEEE Trans Ind Electron. 2019;67(12):10951‐10964.
[20] TaoF, ZhangJ, TongY, ZhangH. Q‐learning algorithm in solving consensusability problem of discrete‐time multi‐agent systems. Automatica. 2021;128:109576. · Zbl 1461.93466
[21] ShiJ, YueD, XieX. Optimal leader‐follower consensus for constrained‐input multiagent systems with completely unknown dynamics. IEEE Trans Syst Man Cybern Syst. 2022;52(2):1182‐1191.
[22] ZuoS, SongY, LewisFL, DavoudiA. Optimal robust output containment of unknown heterogeneous multiagent system using off‐policy reinforcement learning. IEEE Trans Cybern. 2018;48(11):3197‐3207.
[23] AbdelkaderA, TayebiA. Distributed output regulation of heterogeneous linear multi‐agent systems with communication constraints. Automatica. 2018;91:152‐158. · Zbl 1387.93007
[24] LiY, TanC, LiuG. Output consensus of networked multi‐agent systems with time‐delay compensation scheme. J Franklin Inst. 2016;353(4):917‐935. · Zbl 1395.93049
[25] ZhangH, RenH, MuY, HanJ. Optimal consensus control design for multiagent systems with multiple time delay using adaptive dynamic programming. IEEE Trans Cybern. 2022;52(12):12832‐12842.
[26] LiuGP. Predictive control of networked nonlinear multiagent systems with communication constraints. IEEE Trans Syst Man Cybern Syst. 2020;50(11):4447‐4457.
[27] HuangJ. The cooperative output regulation problem of discrete‐time linear multi‐agent systems by the adaptive distributed observer. IEEE Trans Automat Contr. 2017;62(4):1979‐1984. · Zbl 1366.93326
[28] AdibYF, LewisFL, SuR. Output regulation of heterogeneous linear multi‐agent systems with differential graphical game. Int J Robust Nonlinear Control. 2016;26(10):2256‐2278. · Zbl 1342.93014
[29] GaoW, LiuY, OdekunleA, JiangZ, YuY, LuP. Cooperative and adaptive optimal output regulation of discrete‐time multi‐agent systems using reinforcement learning. Proceeding of 2018 IEEE International Conference on Real‐Time Computing and Robotics. IEEE; 2018:348‐353.
[30] HouZ, JinS. Model Free Adaptive Control Theory and Applications. CRC Press; 2014. · Zbl 1279.93001
[31] HuGD, MitsuiT. Exponential stability of time‐varying linear discrete systems. Linear Algebra Appl. 2017;528:384‐393. · Zbl 1401.65033
[32] JiangW, ChenY, CharalambousT. Consensus of general linear multi‐agent systems with heterogeneous input and communication delays. IEEE Control Syst Lett. 2021;5(3):851‐856.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.