In this work we consider the fuzzy dynamic programming problems. For this purpose, using the generalized Hukuhara differentiability for fuzzy functions, new concepts, for example: the fuzzy product, the fuzzy collocation and the Bellman’s principle, we have the neccesary and sufficient conditions.
In fuzzy metric Hausdorff space En, there are several approaches to the study of fuzzy functions and fuzzy differential equations. One popular approach is based on H-differentiability. The first method was based on H-difference notation and was further investigated by the authors, for example: Allahviranloo [3–7], Bede [9–13], Kaleva [20], Lakshmikantham [23, 24], etc... The second approach is based on Zadeh’s extension principle [30] can be found in [32, 39], etc... Another approach can be found in [7, 15] and it is based on strongly generalized differentiability of fuzzy functions [9, 37].
In this case the derivative exists and the solution of a fuzzy differential equation may have decreasing length of the support, but the uniqueness is lost. Therefore, our point is that the new concept generalized H - differentiability can be of great help in the dynamic study of relative problems of fuzzy functions, for example, the conditions of fuzzy optimality problems, for example: Najariyan [27, 28], Osuna - Gomez, Chalco-Cano,... [31], Ramik [35] and fuzzy differential equationswith fuzzy initial conditions, for example: Bede [9], Hoa, Phu [22], Tri [38], Vu [39].
In this work we consider the fuzzy dynamic programming problems, where the objectives are fuzzy functions, that are generalized H - differentiable. The paper is organized as follows: in Section 2, we recall some basic concepts and notations about fuzzy numbers, fuzzy function and some kinds of Hukuhara derivatives of fuzzy functions, which are useful in next sections. In Sections 3 we present the fuzzy dynamic programming problems. In Section 4 give illustration for example of the algorithm to find the necessary and sufficient conditions.
Preliminaries
We recall some notations and concepts presented in detail in recent series works of Professor Lakshmikantham V. et al …(see [3, 4]). Let denote the collection of all nonempty, compact and convex subsets of Given A, B in the Hausdorff distance between A and B defined as
where ∥ . ∥ Rn denotes the Euclidean norm in . It is known that is a complete metric space and if the space is equipped with the natural algebraic operations of addition and nonegative scalar multiplication, then becomes a semilinear metric space which can be embedded as a complete cone into a corresponding Banach space. Set
ω is normal, that is, there exists an such that ω (z0) =1;
ω is fuzzy convex, that is, for 0 ≤ λ ≤ 1
ω is upper semicontinuous;
is compact.
The element ω ∈ En is called a fuzzy set. Whenn = 1, elements of E1 are often called the fuzzy numbers.
The set is called the α-level set. For all 0 ⩽ α ⩽ β ⩽ 1 then we have [ω] β ⊂ [ω] α ⊂ [ω] 0.
For two fuzzy sets ω1, ω2, we denote ω1 ⩽ ω2 if and only if [ω1] α ⊂ [ω2] α. Let us denote
the distance between ω1 and ω2 in En, where dH [[ω] α, [ω] α] is Hausdorff distance between two set [ω1] α, [ω2] α of . Then (En, D0) is a complete space. Some properties of metric D0 are as follows.
for all ω1, ω2, ω3 ∈ En and . Given an interval
Let us denote θn ∈ En the zero element of En as follows:
where is the zero element of .
Definition 2.1. Let x, y : [a, b] → E1 be the fuzzy functions, that means and . We say that
scalar product λx (t) exists if
fuzzy product z (t) = x (t) . y (t) exists if
Definition 2.2 Let x, y : [a, b] → E1 be a fuzzy function, that means and . We say that x (t) ≺ y (t) if and only if satisfies one of the followings:
;
[x (t)] α⊆ [y (t)] α, ∀ t ∈ [a, b] , α ∈ [0, 1] ;
D0 [x (t) , θ] ⩽ D0 [y (t) , θ] , ∀ t ∈ [a, b] .
Definition 2.3. Let x, y ∈ En . If there exists z ∈ En such that x = y + z then z is called a Hukuhara difference of x, y and it is denoted z = x ⊖ y .
Definition 2.4. (see [9]) Let x, y ∈ En, the generalized Hukuhara difference of x and y is
Definition 2.5. (see [24]) Let x : [a, b] → E1 be a fuzzy function, that means . We say x is classical Hukuhara differentiable at t0 ∈ (a, b) if there exists an element DHx (t0) ∈ En such that the limits
exist and equal to DHx (t0) ∈ En. Here the limits are taken in the metric space (En, D0), and at boundary points we consider only the one-side derivatives.
Definition 2.6. (see [22]) Let x : (a, b) → En and t ∈ (a, b). We say that x is strongly generalized differentable at t, if there exists , such that either (FHg1) for all h > 0 sufficiently small, the generalized H-differences exist and the limits (in the metric D0)
or (FHg2) for all h > 0 sufficiently small, the generalized H-differences exist and the limits
or (FHg3) for all h > 0 sufficiently small, the generalized H-differences exist and the limits
or (FHg4) for all h > 0 sufficiently small, the generalized H-differences exist and the limits
In this definition, case (FHg1) corresponds to the classic H-derivative, so this differentiability concept is a generalization of the Hukuhara derivative. A function that is strongly generalized differentiable as in case (FHg1) and (FHg2), will be referred as (FHg1) - differentiable or as(FHg2) - differentiable, respectively. As for cases (FHg3) and (FHg4), it is known that (see [9]) a function may be differentiable as in (FHg3) or (FHg4) only on a discrete set of points (where differentiability switches between cases (FHg1) and (FHg2). In this paper we consider only the two first generalized H-differentiabilities of Definition 2.6. In the other cases, the derivative is trivial because it is reduced to a crisp element.
Definition 2.7. Let x : [a, b] → En and f : [a, b] × En → En . We say that the fuzzy function f (t, x) is strongly generalized partial differentable at x if there exists , such that for m ∈ En we have:
Main results
The fuzzy dynamic programming problems
Definition 3.1. We consider the fuzzy dynamic programming problems:
where , the fuzzy states and the admissible fuzzy control u (t) ∈ E1 are fuzzy functions, t ∈ [0, T], the means that there is exist I (u*) such that I (u*) ≺ I (u) for all admissible fuzzy control u (t) ∈ E1 .
We have to solve this fuzzy dynamic programming problems (FDPP) (3.1), that means need to find the neccesary and sufficient conditions for FDPP. Solving this problems by Bellman’s principle, we have the Hamilton - Jacobi - Bellman (HJB) partial equation:
with the boundary conditions V (T, x (T)) = h (x (T)) , V (0, x (0)) = V (0, x0) . The fuzzy product exists in force (ii) of Definition 2.1. Putting
Lemma 3.1. (supplement lemma) Assume that V (t, x) is solution of HJB (3.2) which satisfy V (T, x (T)) = h (x (T)) , V (0, x (0)) = V (0, x0) . If u (t) is any admissible fuzzy control, such that W (t, x, u) ≥0 then for FDPP (3.1) exists the estimate:
Proof. Putting P (t) = V (t, x (t)) , where V (t, x) is solution of HJB (3.2) and x (t) - solution of
In problem FDPP (3.1) if admissible fuzzy controls are then for any interval (γ, β) ⊂ [0, T] , we have
We infer that
From HJB (3.2), we have
and
So that
or
and
The neccesary conditions of fuzzy dynamic programming problems
Theorem 3.1. (Necessary conditions) If FDPP (3.1) has solution, that means there exists optimal control u* (t) such that and V* (t, x) is a solution of HJB- partial differential Equation (3.2) with V* (T, x) = h (x (T)) then the necessary conditions for FDPP (3.1) are:
where W* (t, x, u*) was denoted in (3.3) according to solution V* (t, x).
Proof. Because W (t, x, u) was denoted in (3.3) then W (t, x, u) satisfies:
By Lemma 3.1, if u (t) is admissible control then for fuzzy dynamic programming problems FDPP (3.1) exists estimation
Because FDPP (3.1) satisfies (3.4) and has optimal control u* (t) for all t ∈ [0, T] , such that then we have:
□
The sufficient conditions of fuzzy dynamic programming problems
Theorem 3.2. (Sufficient conditions) Assume that u- any admissible control for FDPP (3.1) and V (t, x) solution of partial differential equation HJB (3.2), then the sufficient conditions of fuzzy dynamic programming problems FDPP (3.1) are:
and u* (t) will be optimization control for FDPP (3.1).
Proof. Because W (t, x, u) was denoted in (3.3), it satisfies:
For any admissible control and V (t, x) - solution of HJB (3.2), that satisfy V (T, x (T)) = h (x (T)), then we have
We infer that
For any control u*, we have solution V* (t, x) of HJB (3.2) so implies that:
then we have:
and u* (t) will be optimization control for FDPP(3.1). □
Illustrations
Example 4.1. We consider the fuzzy dynamic programming problems:
where α ∈ [0, 1] , x0, xT, x (t) , u (t) ∈ E1, r > 0, and [x0] α = [-1 + α, 1 - α] .
Building the Hamilton - Jacobi - Bellman (HJB) partial equation for FDPP (4.2):
Putting
where u (t) admissible controls for (4.1) such that
we have
Solving the HJB (4.2) we have V (t, x) :
V (t, x) will be under type we have
and because S (T) =1 then S (t) satisfies
We have
Replacing from (4.3) into this Cauchy problem, we have:
and replacing else into this Cauchy problem, we get:
This Cauchy problem of Riccati equation has one solution:
that implies
Finally, we have fuzzy control u (t) as feedback u (t) = u (x (t)) then need to find the optimal trajectory:
with fuzzy solution
where
We have the neccesary conditions of FDPP (4.1):
and the sufficient conditions of FDPP (4.1):
that are in the real forms:
with product of fuzzy functions
Example 4.2. We consider the other fuzzy dynamic programming problems:
where [C] α = [0, 1 - α] , α ∈ [0, 1) , x (t) , u (t) ∈ E1, g (t) ∈ C ([0, T] , R+) , g (0) =1, r > 0 .
Building the Hamilton - Jacobi - Bellman (HJB) partial equation for FDPP (4.5):
Putting
where u (t) admissible controls for (4.1) such that
We have
Solving the HJB (4.6) we have V (t, x) :
This solutions V (t, x) will be under type it implies that
and because S (T) =1 then S (t) satisfies
Replacing into this system, we have:
and replacing else into this system, we have:
We consider the following differential equation:
and the Bernoulli differential equation:
We divide (4.9) by S2 :
Putting Z = S-1, then Z′ = - S′S-2 and the Equation (4.10) is:
Putting the above equation has a solution:
Consider K = K (t) , we have
From (4.8), we have
Since we have
The Equation (4.8) has one solution
where
and
That implies
We have the neccesary conditions of FDPP (4.5):
and the sufficient conditions of FDPP (4.5):
that are in the real forms:
with product of fuzzy functions
where [C] α = [0, 1 - α] , ∀ α ∈ [0, 1) , r > 0 and condition:
Example 4.3. We consider the other fuzzy dynamic programming problems:
where [x0] α = [1 + α, 3 - α] , α ∈ [0, 1] , x (t) , u (t) ∈ E1, r > 0 .
Building the Hamilton - Jacobi - Bellman (HJB) partial equation for FDPP (4.11):
Putting
where u (t) admissible controls for (4.11) such that
We have
Finally, we have V (t, x) :
V (t, x) will be under type we have and
then S (t) satisfies
Replacing from (4.13) into Cauchy problem, we have:
and replacing else into this Cauchy problem, we have:
This Cauchy problem of separated variable equations has one solution:
where
That implies
We have the neccesary conditions of FDPP (4.11):
and the sufficient conditions of FDPP (4.11):
with product of fuzzy functions
Conclusion
In this work, the fuzzy dynamic programming problems (FDPP) in fuzzy metric space - the new object, that is interesting and important were investigated. To solve this problems for the fuzzy functions, we have used some new concepts, for example: the fuzzy product z (t) = x (t) · y (t), the fuzzy collocation x (t) ≺ y (t) and the Bellman’s principle for fuzzy optimization. The necessary and sufficient conditions can be obtained by the extension of Bellman’s principle. We give also some example of the algorithm to find the necessary and sufficient conditions for FDPP. The open problems are studying of the fuzzy dynamic programming problems in n- dimension fuzzy metric space En.
Acknowledgments
The authors are very grateful to the anoymous referees for their careful reading and many valuable remarks which improved the presentation of the paper.
References
1.
AgarwalR.P., ReganD.O. and LakshmikanthamV., A stacking theorem approach for fuzzy differential equations, J Nonlinear Anal55 (2003), 299–312.
2.
AgarwalR.P., ÓReganD. and LakshmikanthamV., Viability theory and fuzzy differential equations, Fuzzys and Systems151 (2005), 536–580.
3.
AllahviranlooT., KianiN.A. and MotamediN., Solving fuzzy differential equations by differential transformation method, Information Sciences179 (2009), 956–966.
4.
AllahviranlooT., AmirteimooriA., KhezerlooM. and KhezerlooS., A new method for solving fuzzy volterra integro –differential equations, Australian Journal of Basic and Applied Sciences5(4) (2011), 154–164.
5.
AllahviranlooT., GhanbariM., HaghiE., HosseinzadehA. and NouraeiR., A note on “Fuzzy linear systems, Journal of Fuzzy Sets and Systems177 (2011), 87–92.
6.
AllahviranlooT., SalahshourS. and AbbasbandyS., Solving fuzzy fractional differential equations by fuzzy Laplace transforms, Communications in Nonlinear Science and Numerical Simulation17 (2012), 1372–1381. doi: 10.1016/j.cnsns.2011.07.005
7.
AllahviranlooT., AbbasbandyS., SedaghatfarO. and DarabiP., A new method for solving fuzzy integro-differential equation under generalized differentiability, J Neural Computing and Applications21 (2012), 191–196. doi: 10.1007/s00521-011-0759-3
8.
BarrosL.C., BassaneziR.C. and TonelliP.A., Fuzzy modeling in population dynamics, J Ecological Modeling128 (2000), 27–33.
9.
BedeB. and GalS.G., Generalizations of the differentiability of fuzzy-number-valued functions with applications to fuzzy differential equations, J Fuzzy Sets and Systems151 (2005), 581–599.
10.
BedeB., RudasI.J. and BencsikA.L., First order linear fuzzy differential equations under generalized differentiability, J Information Sciences177 (2007), 1648–1662.
11.
BedeB. and RudasI.J., Approximation properties of fuzzy transforms, J Fuzzy Sets and Systems180 (2011), 1648–1662.
12.
BedeB., Mathematics of Fuzzy Sets and Fuzzy Logic, Springer VerlagBerlin Heidelberg, 2013, p. 276.
13.
BedeB. and StefaniniL., Generalized differentiability of fuzzyvalued functions, Fuzzy Sets and Systems230 (2013), 119–141.
14.
BezdekJ.C., Partern Recognition with Fuzzy Objective Function Algoriths, Plenum Press, New York, 1981.
15.
Chalco-CanoY. and Román-FloresH., On new solutions of fuzzy differential equations, Chaos Solitons Fractals38 (2008), 112–119.
16.
ChangS.S.L. and ZadehL., On fuzzy mapping and control, IEEE Transactions on System, Man and Cybernetics2 (1972), 30–34.
17.
DuboisD. and PradeH., Operation on fuzzy numbers, Int J Syst Sci9 (1978), 613–626.
18.
DuboisD. and PradeH., Towards fuzzy differential calculus, Fuzzy Sets and Systems8 (1982), 225–233.
19.
FengY. and HuL., On the quasi-controllability of continuoustime dynamic fuzzy control systems, Chaos, Solitons and Fractals30 (2006), 177–188.
20.
KalevaO., Fuzzy differential equations, Fuzzy Sets and Systems24 (1987), 301–317.
21.
KhastanA., NietoJ.J. and RodrÖuez–LÃşezR., Variation of constant formula for first order fuzzy differential equations, Fuzzy Sets Syst177 (2011), 20–33.
22.
HoaN.V. and PhuN.D., Fuzzy functional integro-differential equations under generalized H-differentiability, Journal of Intelligent and Fuzzy Systems26 (2014), 2073–2085.
23.
LakshmikanthamV. and LeelaS., Fuzzy differential systems and the new concept of stability, J Nonlinear Dynamics and Systems Theory1 (2001), 111–119.
24.
LakshmikanthamV. and Mohapatra, Theory of fuzzy differential equations and inclusionsTaylor Francis Inc, London, 2003.
25.
LupulescuV., On a class of fuzzy functional differential equations, Fuzzy Sets and Systems160 (2009), 1547–1562.
26.
MalinowskiM.T., Second type Hukuhara differentiable solutions to the delay set-valued differential equations, Applied Mathematics Letters218 (2012), 9427–9437.
27.
NajariyanM. and FarahiM.H., Optimal control of fuzzy linear controlled systems with fuzzy initial conditions, Iranian Journal of Fuzzy Systems10 (2013), 21–35.
28.
NajariyanM. and FarahiM.H., A new approach for the optimal fuzzy linear time invariant controlled system with fuzzy coefficients, Journal of Computational and Applied Mathematics259 (2014), 682–694.
29.
NietoJ.J., The Cauchy problem for continuous fuzzy differential equations, Fuzzy Sets and Systems102 (1999), 259–262.
30.
NguyenH.T., A note on the extension principle for fuzzy sets, Journal Math Anal Aplications64 (1978), 369–380.
31.
Osuna-GomezR., Chalco-CanoY., Ruflian-LizanaA. and Hernadez JimenezB., Necessary and sufficient conditions for fuzzy optimality problems,20. In Press, Fuzzy Sets and Systems (2015), 20. In Press.
32.
PhuN.D., AnT.V., HoaN.V. and HienN.T., Interval-valued functional di_erential equations under dissipative conditions, J. Advances in Di_erence Equations, (2014), 2014, 198.
33.
PhuN.D. and DungL.Q., On the Stability and Contrllability of Fuzzy Set Control Di_erential Equations, International Journal of Reliability and Safety, Vol 5 Nos 3/4, 320-335, 2011.
34.
PuriM.L. and RalescuD., Di_erential for fuzzy function, Journal of Mathematical Analysis and Applications91 (1983), 552–558.
35.
RamikJ., Duality in fuzzy linear programming: Some new concepts and results, Journal Fuzzy Optimization and Dicision Making, Vol 4 (2005), pp. 25–39.
36.
SongS. and WuC., Existence and uniqueness of solutions to Cauchy problem of fuzzy di_erential equations, Fuzzy Sets and Systems110 (2000), 55–67.
37.
StefaniniS., A generalization of Hukuhara di_erence and division for interval and fuzzy arithmetic, Fuzzy sets syst161 (2010), 1564–1584.
38.
TriP.V., HoaN.V. and PhuN.D., Sheaf fuzzy problems for functional di_erential equations, J, Advanced in Di_erence Equations2014 (2014), 156.
39.
VuH., HoaN.V. and PhuN.D., The local existence of solutions for random fuzzy integro-diff_erential equations under generalized H-di_erentiability, Journal of Intelligent and Fuzzy Systems26 (2014), 2701–2717.
40.
ZadehL.A., Fuzzy sets, Information and Control8 (1965), 338–353.