Adaptive critic learning for approximate optimal event-triggered tracking control of nonlinear systems with prescribed performances. (English) Zbl 07913812
Summary: This paper studies the approximate optimal event-triggered tracking control problem for a class of second-order nonlinear systems with prescribed performances. By employing a prescribed performances function, restrictions on tracking errors are removed for prescribed performances including convergence rate, maximum overshoot, and steady-state error. On this basis, a complex optimal tracking control problem can be transformed into an optimal stabilising control problem by constructing an augmented system. Subsequently, an event-triggered mechanism is introduced to reduce communication resources. Then, an adaptive critic learning algorithm is used to solve the Hamilton-Jacobi-Bellman equation, where the weights in the critic networks are tuned through the gradient descent approach and experience replay technology. Through the developed learning method, the persistence of excitation condition is released, and the data efficiency is improved. The Lyapunov stability theory is introduced to verify the stability of the close-loop system and the tracking errors are uniformly ultimately bounded. Finally, simulation results are presented to show the effectiveness of the proposed approach.
MSC:
| 93C40 | Adaptive control/observation systems |
| 49L12 | Hamilton-Jacobi equations in optimal control and differential games |
| 93C65 | Discrete event control/observation systems |
| 93C10 | Nonlinear systems in control theory |
Keywords:
adaptive critic learning; second-order nonlinear systems; event-triggered mechanism; prescribed performances; experience reply techniqueReferences:
| [1] | Cao, Y., Zhao, N., Xu, N., Zhao, X., & Alsaadi, F. E. (2022). Minimal-approximation-based adaptive event-triggered control of switched nonlinear systems with unknown control direction. Electronics, 11(20), 3386. |
| [2] | Cao, Z., Niu, B., Zong, G., Zhao, X., & Ahmad, A. (2023). Active disturbance rejection-based event-triggered bipartite consensus control for nonaffine nonlinear multiagent systems. International Journal of Robust and Nonlinear Control, 33(12), 7181-7203. · Zbl 1534.93295 |
| [3] | Cheng, F., Niu, B., Zhang, L., & Chen, Z. (2022). Prescribed performance-based low-computation adaptive tracking control for uncertain nonlinear systems with periodic disturbances. IEEE Transactions on Circuits and Systems II: Express Briefs, 69(11), 4414-4418. |
| [4] | Cohen, M. H., & Belta, C. (2023). Safe exploration in model-based reinforcement learning using control barrier functions. Automatica, 147, 110684. · Zbl 1505.93123 |
| [5] | Cui, L., Xie, X., Guo, H., & Luo, Y. (2022). Dynamic event-triggered distributed guaranteed cost FTC scheme for nonlinear interconnected systems via ADP approach. Applied Mathematics and Computation, 425, 127082. · Zbl 1510.93259 |
| [6] | Cui, L., Xie, X., Wang, X., Luo, Y., & Liu, J. (2019). Event-triggered single-network ADP method for constrained optimal tracking control of continuous-time non-linear systems. Applied Mathematics and Computation, 352, 220-234. · Zbl 1428.49038 |
| [7] | Cui, L., Zhang, Y., Wang, X., & Xie, X. (2021). Event-triggered distributed self-learning robust tracking control for uncertain nonlinear interconnected systems. Applied Mathematics and Computation, 395, 125871. · Zbl 1508.91076 |
| [8] | Dahal, R., & Kar, I. (2022). Robust tracking control of nonlinear unmatched uncertain systems via event-based adaptive dynamic programming. Nonlinear Dynamics, 109(4), 2831-2850. |
| [9] | Dong, H., Zhao, X., & Luo, B. (2022). Optimal tracking control for uncertain nonlinear systems with prescribed performance via critic-only ADP. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 52(1), 561-573. |
| [10] | Farzanegan, B., Suratgar, A. A., Menhaj, M. B., & Zamani, M. (2022). Distributed optimal control for continuous-time nonaffine nonlinear interconnected systems. International Journal of Control, 95(12), 3462-3476. · Zbl 1505.49023 |
| [11] | Fu, Y., Hong, C., Fu, J., & Chai, T. (2022). Approximate optimal tracking control of nondifferentiable signals for a class of continuous-time nonlinear systems. IEEE Transactions on Cybernetics, 52(6), 4441-4450. |
| [12] | Guo, S., Zhao, X., Wang, H., & Xu, N. (2023). Distributed consensus of heterogeneous switched nonlinear multiagent systems with input quantization and DoS attacks. Applied Mathematics and Computation, 456, 128127. · Zbl 07704209 |
| [13] | Guo, X., Yan, W., & Cui, R. (2020). Integral reinforcement learning-based adaptive NN control for continuous-time nonlinear MIMO systems with unknown control directions. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(11), 4068-4077. |
| [14] | Heemels, W. P., Johansson, K. H., & Tabuada, P. (2012). An introduction to event-triggered and self-triggered control. In 2012 IEEE 51st IEEE Conference on Decision and Control (CDC) (pp. 3270-3285). IEEE. |
| [15] | Kamalapurkar, R., Andrews, L., Walters, P., & Dixon, W. E. (2017). Model-based reinforcement learning for infinite-horizon approximate optimal tracking. IEEE Transactions on Neural Networks and Learning Systems, 28(3), 753-758. |
| [16] | Li, Y., Wang, H., Zhao, X., & Xu, N. (2022). Event-triggered adaptive tracking control for uncertain fractional-order nonstrict-feedback nonlinear systems via command filtering. International Journal of Robust and Nonlinear Control, 32(14), 7987-8011. · Zbl 1528.93139 |
| [17] | Li, Y., Wei, C., An, T., Ma, B., & Dong, B. (2022). Event-triggered-based cooperative game optimal tracking control for modular robot manipulator with constrained input. Nonlinear Dynamics, 109(4), 2759-2779. |
| [18] | Linsenmayer, S., Dimarogonas, D. V., & Allgöwer, F. (2019). Periodic event-triggered control for networked control systems based on non-monotonic Lyapunov functions. Automatica, 106, 35-46. · Zbl 1429.93293 |
| [19] | Liu, D., Xue, S., Zhao, B., Luo, B., & Wei, Q. (2021). Adaptive dynamic programming for control: A survey and recent advances. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(1), 142-160. |
| [20] | Liu, H., Cheng, Q., Xiao, J., & Hao, L. (2022). Data-driven optimal tracking control for SMA actuated systems with prescribed performance via reinforcement learning. Mechanical Systems and Signal Processing, 177, 109191. |
| [21] | Liu, P., Zhang, H., Ren, H., & Liu, C. (2021). Online event-triggered adaptive critic design for multi-player zero-sum games of partially unknown nonlinear systems with input constraints. Neurocomputing, 462, 309-319. |
| [22] | Liu, S., Niu, B., Zong, G., Zhao, X., & Xu, N. (2023). Adaptive neural dynamic-memory event-triggered control of high-order random nonlinear systems with deferred output constraints. IEEE Transactions on Automation Science and Engineering. |
| [23] | Luo, B., Yang, Y., Liu, D., & Wu, H.-N. (2020). Event-triggered optimal control with performance guarantees using adaptive dynamic programming. IEEE Transactions on Neural Networks and Learning Systems, 31(1), 76-88. |
| [24] | Ouyang, Y., Dong, L., & Sun, C. (2022). Critic learning-based control for robotic manipulators with prescribed constraints. IEEE Transactions on Cybernetics, 52(4), 2274-2283. |
| [25] | Roshanravan, S., & Shamaghdari, S. (2022). Adaptive fault-tolerant tracking control for affine nonlinear systems with unknown dynamics via reinforcement learning. IEEE Transactions on Automation Science and Engineering, 1-12. . |
| [26] | Song, R., & Liu, L. (2020). Event-triggered constrained robust control for partly-unknown nonlinear systems via ADP. Neurocomputing, 404, 294-303. |
| [27] | Tang, F., Niu, B., Zong, G., Zhao, X., & Xu, N. (2022). Periodic event-triggered adaptive tracking control design for nonlinear discrete-time systems via reinforcement learning. Neural Networks, 154, 43-55. · Zbl 1525.93256 |
| [28] | Tang, F., Wang, H., Zhang, L., Xu, N., & Ahmad, A. (2023). Adaptive optimized consensus control for a class of nonlinear multi-agent systems with asymmetric input saturation constraints and hybrid faults. Communications in Nonlinear Science and Numerical Simulation, 126, 107446. · Zbl 1529.93061 |
| [29] | Wang, J., Zhang, Z., Tian, B., & Zong, Q. (2022). Event-based robust optimal consensus control for nonlinear multiagent system with local adaptive dynamic programming. IEEE Transactions on Neural Networks and Learning Systems. |
| [30] | Wang, M., & Yang, A. (2017). Dynamic learning from adaptive neural control of robot manipulators with prescribed performance. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 47(8), 2244-2255. |
| [31] | Wang, T., Wang, H., Xu, N., Zhang, L., & Alharbi, K. H. (2023). Sliding-mode surface-based decentralized event-triggered control of partially unknown interconnected nonlinear systems via reinforcement learning. Information Sciences, 641, 119070. · Zbl 1541.93051 |
| [32] | Xue, S., Luo, B., Liu, D., & Gao, Y. (2021). Adaptive dynamic programming-based event-triggered optimal tracking control. International Journal of Robust and Nonlinear Control, 31(15), 7480-7497. · Zbl 1527.93232 |
| [33] | Yang, X., & He, H. (2020). Adaptive critic learning and experience replay for decentralized event-triggered control of nonlinear interconnected systems. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(11), 4043-4055. |
| [34] | Yang, X., & Wei, Q. (2021). Adaptive critic learning for constrained optimal event-triggered control with discounted cost. IEEE Transactions on Neural Networks and Learning Systems, 32(1), 91-104. |
| [35] | Yang, X., Zeng, Z., & Gao, Z. (2022). Decentralized neurocontroller design with critic learning for nonlinear-interconnected systems. IEEE Transactions on Cybernetics, 52(11), 11672-11685. |
| [36] | Yang, Y., Xu, C., Yue, D., Zhong, X., Si, X., & Tan, J. (2020). Event-triggered ADP control of a class of non-affine continuous-time nonlinear systems using output information. Neurocomputing, 378, 304-314. |
| [37] | Zhang, L., Zhang, X., Chang, X., & Zhao, N. (2023). Adaptive fault-tolerant control-based real-time reachable set synthesis of heterogeneous nonlinear singular multi-agent systems with uncertain parameters. IEEE Transactions on Automation Science and Engineering. |
| [38] | Zhang, L., Zhao, X., & Zhao, N. (2022). Real-time reachable set control for neutral singular Markov jump systems with mixed delays. IEEE Transactions on Circuits and Systems II: Express Briefs, 69(3), 1367-1371. |
| [39] | Zhang, L., Zong, G., Zhao, X., Zhao, N., & Sharaf, S. (2023). Reachable set control for discrete-time Takagi-Sugeno fuzzy singular Markov jump system. IEEE Transactions on Fuzzy Systems. |
| [40] | Zhang, Y., Li, S., & Jiang, X. (2018). Near-optimal control without solving HJB equations and its applications. IEEE Transactions on Industrial Electronics, 65(9), 7173-7184. |
| [41] | Zhao, H., Wang, H., Niu, B., Zhao, X., & Alharbi, K. H. (2023). Event-triggered fault-tolerant control for input-constrained nonlinear systems with mismatched disturbances via adaptive dynamic programming. Neural Networks, 164, 508-520. · Zbl 1525.93276 |
| [42] | Zhao, H., Wang, H., Xu, N., Zhao, X., & Sharaf, S. (2023). Fuzzy approximation-based optimal consensus control for nonlinear multiagent systems via adaptive dynamic programming. Neurocomputing, 533, 126529. |
| [43] | Zhao, N., Zhao, X., Chen, M., Zong, G., & Zhang, H. (2023). Resilient distributed event-triggered platooning control of connected vehicles under denial-of-service attacks. IEEE Transactions on Intelligent Transportation Systems, 24(6), 6191-6202. |
| [44] | Zhao, N., Zhao, X., Xu, N., & Zhang, L. (2023). Resilient event-triggered control of connected automated vehicles under cyber attacks. IEEE/CAA Journal of Automatica Sinica. |
| [45] | Zhao, Q., Sun, J., Wang, G., & Chen, J. (2022). Event-triggered ADP for nonzero-sum games of unknown nonlinear systems. IEEE Transactions on Neural Networks and Learning Systems, 33(5), 1905-1913. |
| [46] | Zhao, Y., Niu, B., Zong, G., Zhao, X., & Alharbi, K. (2023). Neural network-based adaptive optimal containment control for non-affine nonlinear multi-agent systems within an identifier-actor-critic framework. Journal of the Franklin Institute, 360(12), 8118-8143. · Zbl 1520.93283 |
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.
