×

Fractional Chebyshev functional link neural network-optimization method for solving delay fractional optimal control problems with Atangana-Baleanu derivative. (English) Zbl 1467.93137

Summary: In this article, we propose a higher order neural network, namely the functional link neural network (FLNN), for the model of linear and nonlinear delay fractional optimal control problems (DFOCPs) with mixed control-state constraints. We consider DFOCPs using a new fractional derivative with nonlocal and nonsingular kernel that was recently proposed by Atangana and Baleanu. The derivative possesses more important characteristics that are very useful in modelling. In the proposed method, a fractional Chebyshev FLNN is developed. At the first step, the delay problem is transformed to a nondelay problem, using a Padé approximation. The necessary optimality condition is stated in a form of fractional two-point boundary value problem. By applying the fractional integration by parts and by constructing an error function, we then define an unconstrained minimization problem. In the optimization problem, trial solutions for state, co-state and control functions are utilized where these trial solutions are constructed by using single-layer fractional Chebyshev neural network model. We then minimize the error function using an unconstrained optimization scheme based on the gradient descent algorithm for updating the network parameters (weights and bias) associated with all neurons. To show the effectiveness of the proposed neural network, some numerical results are provided.

MSC:

93B70 Networked control
93C15 Control/observation systems governed by ordinary differential equations
93C43 Delay control/observation systems
26A33 Fractional derivatives and integrals
49J15 Existence theories for optimal control problems involving ordinary differential equations
Full Text: DOI

References:

[1] CarpinteriA, MainardiF. Fractals and Fractional Calculus in Continuum Mechanics. Vol 378. New York, NY: Springer‐Verlag Wien; 2014.
[2] A.Atangana, D.Baleanu, New Fractional Derivatives With Non‐Local And Non‐Singular Kernel: Theory And Application To Heat Transfer Model, arXiv preprint arXiv:160203408, (2016);20:763‐769.
[3] LopesAM, MachadoJT, PintoCM, GalhanoAM. Fractional dynamics and MDS visualization of earthquake phenomena. Comput Math Appl. 2013;66(5):647‐658.
[4] RossikhinYA, ShitikovaMV. Application of fractional calculus for dynamic problems of solid mechanics: novel trends and recent results. Appl Mech Rev. 2010;63(1):15‐67.
[5] JelicicZD, PetrovackiN. Optimality conditions and a solution scheme for fractional optimal control problems. Struct Multidiscip Optim. 2009;38(6):571‐581. · Zbl 1274.49035
[6] I.Podlubny, Fractional Differential Equations: an Introduction to Fractional Derivatives, Fractional Differential Equations, to Methods of Their Solution and Some of Their Applications. Cambridge, MA: Academic Press; 1998. · Zbl 0922.45001
[7] KilbasA, SrivastavaH, TrujilloJ. New book: Theory and Applications of Fractional Differential Equations. North‐Holland Mathematics Studies. Vol 204. Amsterdam, NL: Elsevier; 2006. · Zbl 1092.45003
[8] K. S.Miller, B. Ross, An Introduction to the Fractional Calculus and Fractional Differential Equations. New York, NY: Wiley‐Interscience; 1993. · Zbl 0789.26002
[9] SamkoSG, KilbasAA, MarichevOI, et al. Fractional integrals and derivatives. Gordon and Breach, Yverdon: Theory and Applications; 1993. · Zbl 0818.26003
[10] CaputoM, FabrizioM. A new definition of fractional derivative without singular kernel. Progr Fract Differ Appl. 2015;1(2):1‐13.
[11] NazemiAR, MansooriM. Solving optimal control problems of the time‐delayed systems by Haar wavelet. J Vib Control. 2016;22:2657‐2670. · Zbl 1365.49006
[12] NazemiAR, ShabaniMM. Numerical solution of the time‐delayed optimal control problems with hybrid functions. IMA J Math Control Inf. 2015;32:623‐638. · Zbl 1327.93236
[13] GhomanjaniF, FarahiMH, Vahidian KamyadA. Numerical solution of some linear optimal control systems with pantograph delays. IMA J Math Control Inf. 2013;32:225‐243. · Zbl 1319.49047
[14] MoradiL, MohammadiF, BaleanuD. A direct numerical solution of time‐delay fractional optimal control problems by using Chelyshkov wavelets. J Vib Control. 2018;25:310‐324.
[15] BhrawyAH, Ezz‐EldienSS. A new Legendre operational technique for delay fractional optimal control problems. Calcolo. 2016;53:521‐543. · Zbl 1377.49032
[16] HosseinpourS, NazemiA, TohidiE. Müntz-Legendre spectral collocation method for solving delay fractional optimal control problems. J Comput Appl Math. 2019;351:344‐363. · Zbl 1462.65161
[17] HosseinpourS, NazemiAR. A collocation method via block‐pulse functions for solving delay fractional optimal control problems. IMA J Math Control Inf. 2016;34:1215‐1237. · Zbl 1400.49032
[18] RahimkhaniP, OrdokhaniY, BabolianE. An efficient approximate method for solving delay fractional optimal control problems. Nonlinear Dyn. 2016;86:1649‐1661. · Zbl 1371.34016
[19] SafaieE, FarahiMH, Farmani ArdehaieM. An approximate method for numerically solving multi‐dimensional delay fractional optimal control problems by Bernstein polynomials. Comput Appl Math. 2015;34:831‐846. · Zbl 1326.49047
[20] JajarmiA, BaleanuD. Suboptimal control of fractional‐order dynamic systems with delay argument. J Vib Control. 2017;24:763‐769.
[21] EffatiS, RakhshanSA, SaqiS. Formulation of Euler-Lagrange equations for multidelay fractional optimal control problems. J Comput Nonlinear Dyn. 2018;13:1‐10.
[22] ZiaeiE, FarahiMH. The approximate solution of non‐linear time‐delay fractional optimal control problems by embedding process. IMA J Math Control Inf. 2018;36:713‐727. · Zbl 1477.49008
[23] Romero‐UgaldeHM, CorbierC. Robust estimation of balanced simplicity‐accuracy neural networks‐based models. J Dyn Syst Meas Control. 2016;138(5):1‐8.
[24] CybenkoG. Approximation by Superpositions of a Sigmoidal Function. Math Control Signals Syst. 1989;2:303‐314. · Zbl 0679.94019
[25] HornikK, StinchombeM, WhiteH. Multilayer feed‐forward networks are universal approximators. Neural Netw. 1989;2:359‐366. · Zbl 1383.92015
[26] HuangGB, ZhuQY, SiewCK. Extreme Learning Machine Theory and Applications. Neuro Computing. 2006;70:489‐501.
[27] Romero‐UgaldeHM, CarmonaJC, Reyes‐ReyesJ, AlvaradoVM, CorbierC. Balanced simplicity‐accuracy neural network model families for system identification. Neural Comput & Applic. 2015;26(1):171‐186.
[28] DasT, KarIN. Design and implementation of an adaptive fuzzy logic‐based controller for wheeled mobile robots. IEEE Trans Control Syst Technol. 2006;14:501‐510.
[29] KrizhevskyA, SutskeverI, HintonGE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Proces Syst. 2012;1:1097‐1105.
[30] KhanS, NaseemI, TogneriR, BennamounM. A novel adaptive kernel for the RBF neural networks. Circuits, Syst Signal Processing. 2017;36(4):1639‐1653.
[31] HanHG, GuoYN, QiaoJF. Self‐organization of a recurrent RBF neural network using an information‐oriented algorithm. Neurocomputing. 2017;225:80‐91.
[32] KumarM, YadavN. Multilayer perceptrons and radial basis function neural network methods for the solution of differential equations: a survey. Comput Math Appl. 2011;62:3796‐3811. · Zbl 1236.65107
[33] LuS, BasarT. Robust nonlinear system identification using neural‐network models. IEEE Trans Neural Netw. 1998;9(3):407‐429.
[34] GardnerMW, DorlingS. Artificial neural networks (the multilayer perceptron)‐a review of applications in the atmospheric sciences. Atmos Environ. 1998;32(14):2627‐2636.
[35] FuZJ, XieWF, LuoWD. Robust on‐line nonlinear systems identification using multilayer dynamic neural networks with two‐time scales. Neurocomputing. 2013;113:16‐26.
[36] FanX, LiS, TianL. Chaotic characteristic identification for carbon price and an multilayer perceptron network prediction model. Expert Syst Appl. 2015;42(8):3945‐3952.
[37] EffatiS, PakdamanM. Artificial neural network approach for solving fuzzy differential equations. Inf Sci. 2010;180:1434‐1457. · Zbl 1185.65114
[38] EffatiS, PakdamanM. Optimal control problem via neural networks. Neural Comput & Appl. 2010;23:2093‐2100.
[39] JafarianA, RostamiF, GolmankhanehAK, BaleanuD. Using ANNs approach for solving fractional order Volterra Integro‐differential equations. Int J Comput Int Syst. 2017;10:470‐480.
[40] S.Mall, S.Chakraverty, Artificial Neural Network Approach for Solving Fractional order initial value problems, arXiv:1810.04992v2, (2018).
[41] BalakrishnanD, PuthusserypadyS. Multilayer perceptrons for the classification of brain computer interface data, Paper presented at: Proceedings of the IEEE 31st Annual Northeast Bioengineering Conference; Hoboken, NJ, 2005:118‐119.
[42] TuJ. Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J Clin Epidemiol. 1996;49(11):1225‐1231.
[43] PaoY. Adaptive Pattern Recognition and Neural Networks. Reading, MA (US): Addison Wesley Publishing Company; 1989. · Zbl 0748.68061
[44] DasDP, PandaG. Active mitigation of nonlinear noise processes using a novel filtered‐s LMS algorithm. IEEE Trans Audio Speech Lang Process. 2004;12(3):313‐322.
[45] ComminielloD, ScarpinitiM, ScardapaneS, ParisiR, UnciniA. Improving nonlinear modeling capabilities of functional link adaptive filters. Neural Netw. 2015;69:51‐59. · Zbl 1394.68279
[46] CariniA, SicuranzaGL. Fourier nonlinear filters. Signal Process. 2014;94:183‐194.
[47] PatelV, GandhiV, HedaS, GeorgeNV. Design of adaptive exponential functional link network‐based nonlinear filters. IEEE Trans Circuits Syst I. 2016;63(9):1434‐1442. · Zbl 1468.94767
[48] YinK, ZhaoH, LuL. Functional link artificial neural network filter based on the q‐gradient for nonlinear active noise control. J Sound Vib. 2018;435:205‐217.
[49] PatraJC, KotAC. Nonlinear dynamic system identification using Chebyshev functional link artificial neural networks. IEEE Trans Syst, Man, Cybern B (Cybernetics). 2002;32(4):505‐511.
[50] WengWD, YangCS, LinRC. A channel equalizer using reduced decision feedback Chebyshev functional link artificial neural networks. Inf Sci. 2007;177(13):2642‐2654. · Zbl 1111.94329
[51] LiM, LiuJ, JiangY, et al. Complex‐Chebyshev functional link neural network behavioral model for broadband wireless power amplifiers. IEEE Trans Microw Theory Tech. 2012;60(6):1979‐1989.
[52] MallS, ChakravertyS. Single layer Chebyshev neural network model for solving elliptic partial differential equations. Neural Process Lett. 2017;45(3):825‐840.
[53] J. C.Patra, W. C.Chin, P. K.Meher, et al. Legendre‐FLANN‐based nonlinear channel equalization in wireless communication system. Paper presented at: IEEE International Conference on Systems, Man and Cybernetics; 2008; Singapore:1826-1831.
[54] PetersonLE, LarineKV. Hermite/Laguerre neural networks for classification of artificial fingerprints from optical coherence tomography. Paper presented at: IEEE 7th International Conference on Machine Learning and Applications; 2008; San Diego, CA:637-643.
[55] LeeTT, JengJT. The Chebyshev‐polynomials‐based unified model neural networks for function approximation. IEEE Trans Syst, Man, Cybern B (Cybernetics). 1998;28(6):925‐935.
[56] ZhaoH, ZhangJ. Functional link neural network cascaded with Chebyshev orthogonal polynomial for nonlinear channel equalization. Signal Process. 2008;88(8):1946‐1957. · Zbl 1151.94439
[57] PurwarS, KarIN, JhaAN. On‐line system identification of complex systems using Chebyshev neural networks. Appl Soft Comput. 2007;7(1):364‐372.
[58] DehuriS, ChoSB. A comprehensive survey on functional link neural networks and an adaptive PSO‐BP learning for CFLNN. Neural Comput & Applic. 2010;19(2):187‐205.
[59] ZouAM, KumarKD, HouZG. Quaternion‐based adaptive output feedback attitude control of spacecraft using Chebyshev neural networks. IEEE Trans Neural Netw. 2010;21(9):1457‐1471.
[60] MaW, DuanJ, ZhaoH, ChenB. Chebyshev functional link artificial neural network based on correntropy induced metric. Neural Process Lett. 2018;47:233‐252.
[61] MallS, ChakravertyS. Numerical solution of nonlinear singular initial value problems of Emden‐Fowler type using Chebyshev Neural Network method. Neurocomputing. 2015;149:975‐982.
[62] MallS, ChakravertyS. Chebyshev Neural Network based model for solving Lane‐Emden type equations. Appl Math Comput. 2014;247:100‐114. · Zbl 1338.65206
[63] AbdeljawadT, BaleanuD. Integration by parts and its applications of a new nonlocal fractional derivative with Mittag‐Leffler nonsingular kernel. J Nonlinear Sci Appl. 2017;10(3):1098‐1107. · Zbl 1412.47086
[64] KhaderMM, HendyAS. an efficient numerical scheme for solving fractional optimal control problems. Int J Nonlinear Sci. 2012;14(3):287‐296. · Zbl 1394.49032
[65] ParandK, DelkhoshM. The generalized fractional order of the Chebyshev functions on nonlinear boundary value problems in the semi‐infinite domain. Nonlinear Eng. 2017;6(3):229‐240.
[66] TurutV, GüzelN. On solving partial differential equations of fractional order by using the variational iteration method and multivariate Padé approximations. Eur J Pure Appl Math. 2013;6:147‐171. · Zbl 1413.65401
[67] TurutV, GüzelN. Multivariate Padé approximation for solving nonlinear partial differential equations of fractional order. Abstract and Applied Analysis; 2013;1‐12. · Zbl 1275.65088
[68] PolVB, BremmerH. Operational Calculus Based on the Two‐sided Laplace Integral. London: Cambridge University Press; 1955. · Zbl 0066.09101
[69] MatsuzukaI, NagasawaK, KitahamaA. A proposal for two‐sided Laplace transforms and its application to electronic circuits. Appl Math Comput. 1999;100:1‐11. · Zbl 0929.44001
[70] BaleanuD, JajarmiA, HajipourM. A new formulation of the fractional optimal control problems involving Mittag‐Leffler nonsingular kernel. J Optim Theory Appl. 2017;175:718‐737. · Zbl 1383.49030
[71] NazemiA, EffatiS. An application of a merit function for solving convex programming problems. Comput Ind Eng. 2013;66:212‐221.
[72] PanSH, ChenJS. A semi smooth Newton method for the SOCCPs based on a one‐parametric class of SOC complementarity functions. Comput Optim Appl. 2010;45:59‐88. · Zbl 1208.90170
[73] SunD, SunJ. Strong semi smoothness of the Fischer‐Burmeister SDC and SOC complementarity functions. Source, Math Program. 2005;103(3):575‐581. · Zbl 1099.90062
[74] FacchineiF, JiangH, QiL. A smoothing method for mathematical programs with equilibrium constraints. Math Program. 1999;35:107‐134. · Zbl 0959.65079
[75] MiliF, HamdiM. A comparative study of expansion functions for evolutionary hybrid functional link artificial neural networks for data mining and classification. Paper presented at: 2013 International Conference on Computer Applications Technology (ICCAT), Sousse, Tunisia: IEEE; 2013:1‐8.
[76] PatraJC, PalRNA. Functional link artificial neural network for adaptive channel equalization. Signal Process. 1995;43(2):181‐195. · Zbl 0925.68385
[77] BazaraaMS, SheraliHD, ShettyCM. Nonlinear Programming: Theory and Algorithms. 3rd ed.Hoboken, NJ: John Wiley and Sons; 2006. · Zbl 1140.90040
[78] ZhangXS. Neural Networks in Optimization. Dordrecht, Boston, London: Kluwer Academic Publishers; 2000. · Zbl 1017.90109
[79] NocedalJ, WrightS. Numerical Optimization. 2nd ed.Berlin, NY: Springer‐Verlag; 2006. · Zbl 1104.65059
[80] K. Y.Lee, M. A.El‐Sharkawi, Modern Heuristic Optimization Techniques: Theory and Applications to Power Systems, IEEE Press Series on Power Engineering. Piscataway, NJ: Wiley‐IEEE Press; 2008.
[81] W.Mei, F. Bullo, LaSalle invariance principle for discrete‐time dynamical systems: A Concise and Self‐contained Tutorial, arXiv.org > math > arXiv:1710.03710; 2017.
[82] ChenCL, SunDY, ChangCY. Numerical solution of time‐delayed optimal control problems by iterative dynamic programming. Optim Control Appl Methods. 2000;21:91‐105. · Zbl 1069.49501
[83] S.Barati, Optimal Control of Constrained Time Delay Systems, AMO-Advanced Modeling and Optimization. 2012;14:103‐116. · Zbl 1332.49027
[84] GöllmannL, KernD, MaurerH. Optimal control problems with delays in state and control variables subject to mixed control‐state constraints. Optim Control Appl Methods. 2008;30:341‐365.
[85] MalekiM, HashimI. Adaptive pseudospectral methods for solving constrained linear and nonlinear time‐delay optimal control problems. J Franklin Inst. 2014;351:811‐839. · Zbl 1293.49086
[86] MarzbanHR, PirmoradianH. A direct approach for the solution of nonlinear optimal control problems with multiple delays subject to mixed state‐control constraints. Appl Math Model. 2018;53:189‐213. · Zbl 1480.49028
[87] MisraBB, DehuriS. Functional link neural network for classification task in datamining. J Comput Sci. 2007;3:948‐955.
[88] BergJ, NyströmK. A unified deep artificial neural network approach to partial differential equations in complex geometries. Neurocomputing. 2018;317:28‐41.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.