×

Time periodic optimal policy for operation of a water storage tank using the dynamic programming approach. (English) Zbl 1428.90209

Summary: Operation of a water storage tank in a specific environment motivates mathematical studies on a discrete-time deterministic dynamic programming problem. The operator decides whether or not to open the valve releasing the water in the tank to a drip irrigation system, based on the information on the storage volume of the tank. Two cases of functional regularity, which are Lipschitz continuous and of bounded variations, are considered for the reward defining the performance index to be maximized. Firstly, it is shown that the value function inherits the Lipschitz continuity of the reward in the infinite time horizon problem with discounting. Then, time periodic value functions are discussed in terms of the fixed-point theorem. Discrete approximation of value functions is discussed as well, to conduct numerical experiments with a-posteriori error estimation applied to the real-world problem where the discount rate approaches to unity. It is found that a Skiba point appears as a threshold of valve opening for each day in an optimal policy for operation. Practically, setting a constant threshold throughout the period is quite reasonable and acceptable for the operator of the water storage tank to irrigate the farmland.

MSC:

90C90 Applications of mathematical programming
90C39 Dynamic programming
49L25 Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games
49L20 Dynamic programming in optimal control and differential games

References:

[1] Bardi, M.; Capuzzo-Dolcetta, I., Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations (2008), Birkhäuser · Zbl 1134.49022
[2] Barles, G., Deterministic impulse control problems, SIAM J. Control Optim., 23, 419-432 (1985) · Zbl 0571.49020
[3] Bellman, R., Introduction to the Mathematical Theory of Control Processes: Nonlinear Processes (1967), Academic Press · Zbl 0164.39601
[4] Bensoussan, A., Impulse control in discrete time, Georgian Math. J., 15, 439-454 (2008) · Zbl 1151.49029
[5] Bokanowski, O.; Megdich, N.; Zidani, H., Convergence of a non-monotone scheme for Hamilton-Jacobi-Bellman equations with discontinuous initial data, Numer. Math., 115, 1-44 (2010) · Zbl 1187.65098
[6] Bokanowski, O.; Falcone, M.; Ferretti, R.; Grüne, L.; Kalise, D.; Zidani H, H., Value iteration convergence of ε-monotone schemes for stationary Hamilton-Jacobi equations, Discret. Contin. Dyn. Syst., 35, 4041-4070 (2015) · Zbl 1334.65180
[7] Castelletti, A.; Pianosi, F.; Soncini-Sessa, R., Receding horizon control for water resources management, Appl. Math. Comput., 204, 621-631 (2008) · Zbl 1195.92059
[8] Castelletti, A.; Pianosi, F.; Soncini-Sessa, R., Integration, participation and optimal control in water resources planning and management, Appl. Math. Comput., 206, 21-33 (2008) · Zbl 1152.92025
[9] Corrias, L.; Falcone, M.; Natalini, R., Numerical schemes for conservation laws via Hamilton-Jacobi equations, Math. Comput., 64, 555-580 (1995) · Zbl 0827.65085
[10] Crandall, M. G.; Lions, P. L., Viscosity solutions of Hamilton-Jacobi equations, Trans. Am. Math. Soc., 277, 1-42 (1983) · Zbl 0599.35024
[11] Crandall, M. G.; Ishii, H.; Lions, P. L., User’s guide to viscosity solutions of second order partial differential equations, Bull. Am. Math. Soc., 27, 1-67 (1992) · Zbl 0755.35015
[12] El Farouq, N., Deterministic impulse control problems: two discrete approximations of the quasi-variational inequality, J. Comput. Appl. Math., 309, 200-218 (2017) · Zbl 1346.49011
[13] El Farouq, N., Degenerate first-order quasi-variational inequalities: an approach to approximate the value function, SIAM J. Control Optim., 55, 2714-2733 (2017) · Zbl 1428.35638
[14] Fadhil, R. M., Daily operation of Bukit Merah Reservoir with stochastic dynamic programming under the impact of climate change (2018), Universiti Putra Malaysia, (Doctoral Thesis)
[15] Fleming, W. H.; Soner, H. M., Controlled Markov Processes and Viscosity Solutions (2006), Springer · Zbl 1105.60005
[16] Grüne, L.; Kato, M.; Semmler, W., Solving ecological management problems using dynamic programming, J. Econ. Behav. Organ., 57, 448-473 (2005)
[17] Grüne, L.; Semmler, W., Using dynamic programming with adaptive grid scheme for optimal control problems in economics, J. Econ. Dyn. Control, 28, 2427-2456 (2004) · Zbl 1202.49026
[18] Ieda, M., An implicit method for the finite time horizon Hamilton-Jacobi-Bellman quasi-variational inequalities, Appl. Math. Comput., 265, 163-175 (2015) · Zbl 1410.93148
[19] Kesri, M., An explicit method for optimal control problems, Appl. Math. Comput., 219, 8213-8221 (2013) · Zbl 1290.49052
[20] Kossioris, G.; Zohios, C., The value function of the shallow lake problem as a viscosity solution of a HJB equation, Quart. Appl. Math., 70, 625-657 (2012) · Zbl 1255.49042
[21] Kružkov, S. N., First order quasilinear equations in several independent variables, Math. USSR Sbornik, 10, 217-243 (1970) · Zbl 0215.16203
[22] Mabaya, G.; Unami, K.; Fujihara, M., Stochastic optimal control of agrochemical pollutant loads in reservoirs for irrigation, J. Clean. Prod., 146, 37-46 (2017)
[23] Sharifi, E.; Unami, K.; Yangyuoru, M.; Fujihara, M., Verifying optimality of rainfed agriculture using a stochastic model for drought occurrence, Stoch. Environ. Res. Risk Assess., 30, 1503-1514 (2016)
[24] Unami, K.; Yangyuoru, M.; Alam, A. H.M. B.; Kranjac-Berisavljevic, G., Stochastic control of a micro-dam irrigation scheme for dry season farming, Stoch. Environ. Res. Risk Assess., 27, 77-89 (2013)
[25] Unami, K.; Mohawesh, O., A unique value function for an optimal control problem of irrigation water intake from a reservoir harvesting flash floods, Stoch. Environ. Res. Risk Assess., 32, 3169-3182 (2018)
[26] Unami, K.; Mohawesh, O.; Sharifi, E.; Takeuchi, J.; Fujihara, M., Stochastic modelling and control of rainwater harvesting systems for irrigation during dry spells, J. Clean. Prod., 88, 185-195 (2015)
[27] Wagener, F. O.O., Skiba points and heteroclinic bifurcations, with applications to the shallow lake system, J. Econ. Dyn. Control, 27, 1533-1561 (2003) · Zbl 1178.91031
[28] Yakowitz, S., Dynamic programming applications in water resources, Water Resour. Res., 18, 673-696 (1982)
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.