A Neural Network Method Based on Mittag-Leffler Function for Solving a Class of Fractional Optimal Control Problems

Document Type : Research Article


Faculty of Mathematical Sciences, Shahrood University of Technology, Shahrood, Iran


In this paper, a computational intelligence method is used for solution of fractional optimal control problems (FOCPs) with equality and inequality constraints. According to the Ponteryagin minimum principle (PMP) for FOCP with fractional derivative in the Riemann- Liouville sense and by constructing a suitable error function, we define an unconstrained minimization problem. In the optimization problem, we use trial solutions for the states, Lagrange multipliers and control functions where these trial solutions are constructed by a feed-forward neural network model. We then minimize the error function using a numerical optimization scheme where weight parameters and biases associated with all neurons are unknown. Examples are included to demonstrate the validity and capability of the proposed method. The strength of the proposed method is its equal applicability for the integer-order case as well as fractional order case. Another advantage of the presented approach is to provide results on entire finite continuous domain unlike some other numerical methods which provide solutions only on discrete grid of point.


Main Subjects

[1] Oldham K, Spanier J. The fractional calculus theory and applications of differentiation and integration to arbitrary order: Elsevier; 1974.
[2] Miller KS, Ross B. An introduction to the fractional calculus and fractional differential equations. 1993.
[3] Samko S, Kilbas A, Marichev O. Fractional integrals and derivatives and some of their applications. Science and Technica. 1987;1.
[4] Kilbas AAA, Srivastava HM, Trujillo JJ. Theory and applications of fractional differential equations: Elsevier Science Limited; 2006.
[5] Torvik PJ, Bagley RL. On the appearance of the fractional derivative in the behavior of real materials. Journal of Applied Mechanics. 1984;51(2):294-8.
[6] Khader M, Sweilam N, Mahdy A. An efficient numerical method for solving the fractional diffusion equation. Journal of Applied Mathematics and Bioinformatics. 2011;1(2):1.
[7] Oustaloup A, Levron F, Mathieu B, Nanot FM. Frequency-band complex noninteger differentiator: characterization and synthesis. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications. 2000;47(1):25-39.
[8] Tricaud C, Chen Y. An approximate method for numerically solving fractional order optimal control problems of general form. Computers & Mathematics with Applications. 2010;59(5):1644-55.
[9] Zamani M, Karimi-Ghartemani M, Sadati N. FOPID controller design for robust performance using particle swarm optimization. Fractional Calculus and Applied Analysis. 2007;10(2):169-87.
[10] Ghasemi S, Nazemi A, Hosseinpour S. Nonlinear fractional optimal control problems with neural network and dynamic optimization schemes. Nonlinear Dynamics. 2017;89(4):2669-82.
[11] Sabouri J, Effati S, Pakdaman M. A neural network approach for solving a class of fractional optimal control problems. Neural Processing Letters. 2017;45(1):59-74.
[12] Tohidi E, Nik HS. A Bessel collocation method for solving fractional optimal control problems. Applied Mathematical Modelling. 2015;39(2):455-65.
[13] Singha N, Nahak C. An efficient approximation technique for solving a class of fractional optimal control problems. Journal of Optimization Theory and Applications. 2017;174(3):785-802.
[14] Rakhshan SA, Effati S, Vahidian Kamyad A. Solving a class of fractional optimal control problems by the Hamilton–Jacobi–Bellman equation. Journal of Vibration and Control. 2018;24(9):1741-56.
[15] Alizadeh A, Effati S. An iterative approach for solving fractional optimal control problems. Journal of Vibration and Control. 2018;24(1):18-36.
[16] Almeida R, Torres DF. A discrete method to solve fractional optimal control problems. Nonlinear Dynamics. 2015;80(4):1811-6.
[17] Pooseh S, Almeida R, Torres DF. Fractional order optimal control problems with free terminal time. arXiv preprint arXiv:13021717. 2013.
[18] Hosseinpour S, Nazemi A. A collocation method via block-pulse functions for solving delay fractional optimal control problems. IMA Journal of Mathematical Control and Information. 2016;34(4):1215-37.
[19] Jafari H, Tajadodi H. Fractional order optimal control problems via the operational matrices of Bernstein polynomials. UPB Sci Bull. 2014;76(3):115-28.
[20] Heydari M, Hooshmandasl MR, Ghaini FM, Cattani C. Wavelets method for solving fractional optimal control problems. Applied Mathematics and Computation. 2016;286:139-54.
[21] Daniel G. Principles of artificial neural networks: World Scientific; 2013.
[22] Tang H, Tan KC, Yi Z. Neural networks: computational models and applications: Springer Science & Business Media; 2007.
[23] Müller B, Reinhardt J, Strickland MT. Neural networks: an introduction: Springer Science & Business Media; 2012.
[24] Beidokhti RS, Malek A. Solving initial-boundary value problems for systems of partial differential equations using neural networks and optimization techniques. Journal of the Franklin Institute. 2009;346(9):898-913.
[25] Kumar M, Yadav N. Multilayer perceptrons and radial basis function neural network methods for the solution of differential equations: a survey. Computers & Mathematics with Applications. 2011;62(10):3796-811.
[26] Dua V. An artificial neural network approximation based decomposition approach for parameter estimation of system of ordinary differential equations. Computers & chemical engineering. 2011;35(3):545-53.
[27] Shirvany Y, Hayati M, Moradian R. Numerical solution of the nonlinear Schrodinger equation by feedforward neural networks. Communications in Nonlinear Science and Numerical Simulation. 2008;13(10):2132-45.
[28] Shirvany Y, Hayati M, Moradian R. Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Applied Soft Computing. 2009;9(1):20-9.
[29] Vrabie D, Lewis F. Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems. Neural Networks. 2009;22(3):237-46.
[30] Cheng T, Lewis FL, Abu-Khalaf M. Fixed-final-time-constrained optimal control of nonlinear systems using neural network HJB approach. IEEE Transactions on Neural Networks. 2007;18(6):1725-37.
[31] Effati S, Pakdaman M. Optimal control problem via neural networks. Neural Computing and Applications. 2013;23(7-8):2093-100.
[32] Nazemi A, Karami R. A neural network approach for solving optimal control problems with inequality constraints and some applications. Neural Processing Letters. 2017;45(3):995-1023.
[33] Zuniga-Aguilar C, Coronel-Escamilla A, Gómez-Aguilar J, Alvarado-Martínez V, Romero-Ugalde H. New numerical approximation for solving fractional delay differential equations of variable order using artificial neural networks. The European Physical Journal Plus. 2018;133(2):75.
[34] Pontryagin L, Boltyanskii V, Gamkrelidze R, Mischenko E. 1964 The mathematical theory of optimal processes. Wiley and Macmillan) English transls. of 1st ed; 1962.
[35] Guo TL. The necessary conditions of fractional optimal control in the sense of Caputo. Journal of Optimization Theory and Applications. 2013;156(1):115-26.
[36] Agrawal OP. A general formulation and solution scheme for fractional optimal control problems. Nonlinear Dynamics. 2004;38(1-4):323-37.
[37] Nazemi A, Nazemi M. A gradient-based neural network method for solving strictly convex quadratic programming problems. Cognitive Computation. 2014;6(3):484-95.
[38] Raja MAZ, Khan J, Qureshi I. Swarm Intelligent optimized neural networks for solving fractional differential equations. International Journal of Innovative Computing, Information and Control. 2011;7(11):6301- 18.
[39] Stoer J, Bulirsch R. Introduction to numerical analysis: Springer Science & Business Media; 2013.
[40] Bazaraa MS, Sherali HD, Shetty CM. Nonlinear programming: theory and algorithms: John Wiley & Sons; 2013.
[41] Zhang X-S. Neural networks in optimization: Springer Science & Business Media; 2013.
[42] Nocedal J, Wright S. Numerical optimization: Springer Science & Business Media; 2006.
[43] Lee KY, El-Sharkawi MA. Modern heuristic optimization techniques: theory and applications to power systems: John Wiley & Sons; 2008.