We consider the space of continuous functions defined between a locally compact Hausdorff space and the space of fuzzy numbers endowed with the level convergence topology. We obtain a Stone-Weierstrass type theorem for such space of functions equipped with the compact open topology.
As a corollary of the above results, we prove that such functions can be approximated by certain fuzzy-number-valued neural networks and sums of fuzzy-number-valued ridge functions.
Fuzzy Analysis has developed based on the notion of fuzzy number just as much as classical Real Analysis did based on the concept of real number. Fuzzy-number-valued functions, that is, functions defined on a topological space taking values in the space of fuzzy numbers, play a central role in Fuzzy Analysis as real-valued functions do in the classical setting. Namely, fuzzy-number-valued functions have become the main tool in several fuzzy contexts, such as fuzzy differential equations ([3]), fuzzy integrals ([27]) or fuzzy optimization ([13]). However the primary drawback of dealing with these functions is the fact that the space they form is not a linear space; indeed it is not a group with respect to addition.
The main question in Approximation Theory, a fundamental branch of Mathematical Analysis, is whether a given family of functions from which we plan to approximate is dense in the set of functions we wish to approximate. That is, can we approximate any function in our set, arbitrarily well, using finite linear combinations of functions from our given family? In the fuzzy setting, most results in this topic deal with the approximation capabilities of fuzzy neural networks (see e.g., [11, 20]) which turn out to be different from the capabilities of classical neural networks (see Section 4). It is known that neural networks are particularly useful in many domains, such as finance, medicine, mechanical engineering, geology, computer science, etc. Generally speaking, neural networks are implemented in all situations where forecasting, decision, classification and control problems arise. Since nature and human brain are inherently fuzzy in characteristic, it is natural to think that fuzzy neural networks have the ability for processing fuzzy information thanks to their learning abilities (which are closely related to their approximation capabilities). Related to these, the so-called ridge functions are also an important tool in Approximation Theory, although they have not been used in a fuzzy context yet. Indeed the term “ridge function” appeared after the seminal paper [21] about an approximation problem in computer tomography. They also arise naturally in several fields such as partial differential equations and neural networks ([19]).
In this paper we focus on finding dense (with respect to the compact-open topology) subspaces of the space of continuous (with respect to the level convergence topology) fuzzy-number-valued functions defined on a locally compact Hausdorff. The level convergence topology was introduced in [17] and, thanks to Goetschel-Voxman’s characterization of fuzzy numbers (see Section 2 below), has become a natural alternative to the usual metrics (d∞, dp, sendograph,...) used in . Indeed, the space of level continuous fuzzy-number-valued functions is strictly larger than the space of d∞-continuous fuzzy-number-valued functions. Furthermore, as far as the authors are aware, the use of the compact-open topology is also a novelty in this context ([2]).
As a corollary of the above results, we provide fuzzy-number-valued neural networks and sums of fuzzy-number-valued ridge functions which are dense in .
In the final sections, we provide a numerical example to illustrate the technique used in our main result and describe several possible applications in decision making and fuzzy optimization problems.
Preliminaries
Let denote the family of all fuzzy subsets on the real numbers (see, e.g., [6]). For and λ ∈ [0, 1], the λ-level set of u is defined by
The fuzzy number space is the set of elements u of satisfying the following properties (see, e.g., [6]):
u is normal, i.e., there exists an with u (xsb0) =1;
u is convex, i.e., for all ,
u is upper-semicontinuous;
[u] 0 is a compact set in .
Notice that if , then the λ-level set [u] spλ of u is a compact interval for each λ ∈ [0, 1]. We denote [u] spλ = [usp - (λ) , usp + (λ)]. Every real number r can be considered a fuzzy number since r can be identified with the fuzzy number defined as
We can now state the characterization of fuzzy numbers provided by Goetschel and Voxman ([12]):
Let and [u] λ = [u- (λ) , u+ (λ)], λ ∈ [0, 1]. Then the pair of functions u- (λ) and u+ (λ) has the following properties:
u- (λ) is a bounded left continuous nondecreasing function on mathopen (0, 1mathclose];
u+ (λ) is a bounded left continuous nonincreasing function on mathopen (0, 1mathclose];
u- (λ) and u+ (λ) are right continuous at λ = 0;
u- (1) ≤ u+ (1).
Conversely, if a pair of functions α (λ) and β (λ) satisfy the above conditions (i)-(iv), then there exists a unique such that [u] λ = mathopen [α (λ) , β (λ) mathclose] for each λ ∈ [0, 1].
Example 2.1. Let u (x) be a fuzzy number defined as
Then, its corresponding u- (λ) and u+ (λ) functions turn out to be
Given and , we can define u + v : = [u- (λ) , u+ (λ)] + [v- (λ) , v+ (λ)] and ku : = k [u- (λ) , u+ (λ)]. It is well-known that endowed with these two natural operations is not a vector space. Indeed is not a group ([6]).
The space of fuzzy numbers is usually endowed with the topology induced by certain metrics, mainly by the supremum metric dsb∞; namely, for , dsb ∞ (u, v) : = sup sbλ ∈ [0, 1] dH ([u] λ, [v] λ), where dH stands for the Hausdorff metric. That is, dH ([u] λ, [v] λ) = max {∣ u- (λ) - v- (λ) ∣ , ∣ u+ (λ) - v+ (λ) ∣} . It is well-known (see, e.g., [6]) that is a complete metric space. In [17], the authors introduced a new topology on based on the following convergence:
We say that the net levelly converges to if for any λ ∈ [0, 1] or, equivalently, if and for each λ ∈ [0, 1].
Notice that a net dsb∞-converges to if and only if converges uniformly to u+ and converges uniformly to u-. Thus, the dsb∞-convergence implies the level convergence. The converse fails to be true (see Example 2.1 in [26]).
In [8–10], the authors studied the topology τℓ associated with this level convergence in . Thus, it is known that is a Hausdorff, separable, Baire, first countable topological space. Also a local basis for in τℓ is of the form
for {λ1, . . . , λn} ⊂ [0, 1] and ϵ > 0.
Let X be a locally compact space. By the above paragraph, it is apparent that the space of continuous functions contains ; indeed, by [9, page 429], it is a proper subspace. In the sequel, we shall endow with the compact-open topology. That is, a local basis at is formed by sets of the form
for a compact subset K of X, {λ1, . . . , λn} ⊂ [0, 1] and ϵ > 0.
A Stone-Weierstrass type theorem in Fuzzy Analysis
Let us first recall the following classical result known as Uryshon’s Lemma:
Lemma 3.1. Let X be a locally compact Hausdorff space, and let K, F ⊂ X be two disjoint sets, with K compact, and F closed. Then there exists a continuous function f : X ⟶ [0, 1] such that f ≡ 1 on K and f vanishes on F.
Given , we shall write to denote the function in which takes the constant value u.
We can now state and prove a version of the Stone-Weierstrass theorem for endowed with the compact-open topology:
Theorem 3.2.Let be a subspace of which contains the finite combinations of the form , where ψi ∈ C (X, [0, 1]) and , i = 1, . . . , m. Then is dense in .
Proof. Fix ɛ > 0, {λ1, . . . , λn} ⊂ [0, 1], a compact subset K ⊂ X and . For each x ∈ X and 0 < ɛ (x) < ɛ, let us define
which is an open neighborhood of x since . As X is locally compact, we can find a relatively compact neighborhood of x, V (x), such that clV (x) ⊂ N (x). By Uryshon’s Lemma (Lemma 3.1), there exists a continuous function fx : X ⟶ [0, 1] such that fx ≡ 1 on clV (x) and fx vanishes on X \ N (x).
Choose x1 ∈ K. By the compacity of X \ N (x1) ∩ K, there is a finite set {x2, …, xm} ⊂ X \ N (x1) ∩ K such that X \ N (x1) ∩ K ⊂ V (x2) ∪ … ∪ V (xm). Define ɛ′ = max {ɛ (xi) :1 ≤ i ≤ m} .
Let us define the functions
Next we claim that
j = 2, …, m . Indeed, it is clear that
We proceed by induction. Assume that the result is true for a certain j ∈ {4, . . . , m - 1} and let us check
Namely,
as was to be checked. Finally, we can define ψ1 : = (1 - fx2) ⋯ (1 - fxm). Consequently, we have
On the other hand, we claim that
Indeed, if i ≥ 2, then the claim is clear by construction. If t ∉ N (x1), then t ∈ V (xj) for some j = 2, …, m. Hence fxj (t) =1 and then
Let us define
Next, given x0 ∈ K and by the properties of the Hausdorff metric (see, e.g., [6]), we infer
for j = 1, . . . , n.
Let I = {1 ≤ i ≤ m : x0 ∈ N (xi)} and J = {1 ≤ i ≤ m : x0 ∉ N (xi)}. Then, for all i ∈ I, we have
for j = 1, . . . , n and, for all i ∈ J, (1) yields
for j = 1, . . . , n. Hence, we deduce
for j = 1, . . . , n. Since x0 is arbitrary in K, we infer g ∈ V (f0, K, {λ1, . . . , λn} , ϵ).□
Remark 3.3. The following example shows that a subspace of which does not contain all the finite combinations of the form , where ψi ∈ C (X, [0, 1]) and , i = 1, . . . , m, may fail to be dense in :
Let X = [0, 1] and let H = span {xnj : 0 = n0 < n1 < n2 < . . .} with , which is a subset of C ([0, 1] , [0, 1]). Let u be the fuzzy number introduced in Example 2.1 and consider the subspace of . Let us suppose that is dense in . In that case, given any f0 ∈ C ([0, 1] , [0, 1]) and ɛ > 0, we could find f ∈ H such that for all x ∈ [0, 1]. Since u- (0.5) =0 and u+ (0.5) =1, we infer that |f0 (x) - f (x) | < ɛ for all x ∈ [0, 1]. This would imply that H is dense in C ([0, 1] , [0, 1]), which is not true by [22, Section 5].
Density of fuzzy-number-valued regular neural networks and sums of fuzzy-number-valued ridge functions
A fuzzy-number-valued four-layer regular neural network (four-layer RFNN) is defined by
for each , where , the coeficients wij and the thresholds θj are real numbers, the weights and stands for the activation function in the hidden layer. That is, H (x) is a -based fuzzy-number-valued function. In [5] (see also [20]), the authors proved that, although three-layer RFNNs cannot (unlike the classical real case) approximate the set of all d∞-continuous -based fuzzy-number-valued functions, four-layer RFNNs can. They used sigmoidal or bounded continuous nonconstant activation functions to achieve such approximation property of four-layer RFNNs.
For a fixed activation function σ, we denote the set of all possible -based fuzzy-number-valued four-layer RFNNs by .
We will show, based on the results in the previous section, that is dense in endowed with the compact-open topology provided the activation function σ be a non-polynomial continuous function.
Theorem 4.1.Assume that is either a non-polynomial continuous function or a bounded (not necessarily continuous) sigmoidal function. Then is dense in .
Proof. Let and take a neighborhood of f0,
By Theorem 3.2, there exist finitely many functions ψi ∈ C (K, [0, 1]) and , i = 1, . . . , m, such that
for all x ∈ K and for j = 1, . . . , q.
On the other hand, by [16, 18], we know that for each ψi, i = 1, . . . , m, there exist and such that
for all x ∈ K. Hence
for all x ∈ K, i = 1, . . . , m and j = 1, . . . , q. As a consequence,
for all x ∈ K and for j = 1, . . . , q and we are done. □
Let us recall that ridge functions are multivariate functions of the form g (a1x1 + . . . + anxn) where and is a fixed direction. For a subset A of , we can define
We can adapt these functions to the fuzzy setting as follows: Let stand for the sums of fuzzy-number-valued ridge functions of the form
for each and , where .□
Theorem 4.2.Let A be a subset of . Then and are dense in and in , respectively, if and only if contains all polynomials.
Proof. Assume contains all polynomials. As in the proof of Theorem 4.1, given and a neighborhood of f0, V (f0, K, {λ1, . . . , λq} , ϵ) , there exist finitely many functions ψi ∈ C (K, [0, 1]) and , i = 1, . . . , m, such that
for all x ∈ K and for j = 1, . . . , q. By [19, Theorem 2.1 and Remark 2.2], we can find, for each ψi, i = 1, . . . , m, ail ∈ A and such that
for all x ∈ K. Hence
for all x ∈ K, i = 1, . . . , m and j = 1, . . . , q. As a consequence,
for all x ∈ K and for j = 1, . . . , q.
Remark 4.3. According to [19, Theorem 2.1 and Remark 2.2], the expression “ contains all polynomials” can be replaced by “no nonzero homogeneous polynomial vanishes on A”.
Example
In this section, we provide a numerical example to illustrate the method which we have used in our main result (Theorem 3.2).
Let X = [0, 1 [ and let us define a level-continuous function as follows:
and for 0 ≤ x ≤ 1. Hence, we deduce that
and for t ∈]0, 1 [,
Fix ϵ = 0.1 and λ1 = 0.5. Hence, if take t ∈]0, 1 [, then
If we denote ti = 0.1i - 0.05 for i = 1, 2, . . . , 10, then it is apparent that .
Let us define the following trapezoidal functions for i = 2, . . . , 10:
From these functions we can next construct the following ones, which turn out to be trapezoidal too:
Namely,
and a routine manipulation shows
Similarly, we would obtain
Finally, let us define ψ1 (t) : =1 - (ψ2 (t) + . . . + ψ10 (t)), which yields
It is also apparent that the support of each ψi lies in N (ti), i = 1, 2, . . . , 10. Finally, we define
Fix t0 ∈ [0, 1 [. Then, since , we infer
Since t0 belongs to the support of, at most, two functions ψi and we know that such supports lie in their respective N (ti), we infer that
As a consequence, since t0 is arbitrary, we deduce g ∈ V (f0, λ1, ϵ) with ϵ = 0.1 and λ1 = 0.5.
Application
The study on the theory of fuzzy optimization has been active since the concept of fuzzy decision was proposed by Bellman and Zadeh ([4]) in 1970. This is a useful methodology, since it allows us to represent the underlying uncertainty of the optimization problem. As indicated by Dubois and Prade ([7]), constrained fuzzy optimization (also known as fuzzy mathematical programming) refers to the search for extrema of a fuzzy-valued utility (or objective) function defined on a bounded domain and, among a large number of forms, could be described as follows: consider a (level-continuous) fuzzy-valued objective function subject to a constraint set . Then
It is known (see [9, Theorem 5.1]) that if A = [a, b], then there exists the supremum and the infimum of f (x) on A. Indeed, if u denotes such maximum (similarly for the infimum), then, for each λ ∈ [0, 1],
However, such f (x) might not attain either its supremum or its infimum (see [9, Remark 5.3]). Consequently, our unique option is to approximate the supremum (resp. the infimum) and our Theorem 3.2 can help us by realizing the objective function based on a finite subset of fuzzy numbers rather than the whole , which will reduce the problem to a classical (crisp) real-valued optimization problem. In order to illustrate this technique, we can consider the problem of maximizing the function provided in the previous section subject to x ∈ [0, 1]. Then we can approximate the solution of such problem as follows: fix, for instance, ɛ = 0.1 and λ1 = 0.5, and let ψi (t), i = 1, . . . , 10 be as in the previous section. Then we can define the function
for t ∈ [0, 1] and, consequently,
If we denote v = sup {g (t) : t ∈ [0, 1]}, then we get
On the other hand, if u = sup {f (t) : t ∈ [0, 1]}, then it is apparent that [u] 0.5 = [0.5, 1], which yields
Similarly we can proceed with any λ = [0, 1].
Conclusion
In this paper we have studied density problems in the space of level continuous fuzzy-number-valued functions defined on a locally compact Hausdorff space endowed with the compact-open topology, whose use does not seem to have made its way in the fuzzy literature so far. We provide a numerical example to illustrate the techniques we have based on. As a corollary of the above results we find that many fuzzy-number-valued neural networks (with two hidden layers) and sums of fuzzy-number-valued ridge functions are dense in . We hope that our techniques, together with the introduction of ridge functions, will be helpful for obtaining stronger results and further applications in environments related to fuzzy approximation.
One of such fields is decision theory, which comprises a broad diversity of approaches to modeling behavior of a human decision maker under various information frameworks in management science, economics and other areas. Among the multiple approaches to decision making in a fuzzy context, the use of fuzzy-valued utility (or objective) functions as a quantitative representation of preferences of a decision maker was proposed in 1970 by Bellman and Zadeh in their seminal paper, [4], and was concretized in [23] by showing that their approach reduces to a fuzzy optimization problem of fuzzy-valued utility functions based on λ-level sets. In general, an optimization problem deals with two elements: a goal or utility function and a set of feasible domains and, in a fuzzy context, it consists of finding an x “belonging” to the domain X of a fuzzy-valued function such that f (x) can reach a possible “extremum” in a fuzzy sense. However, how to interpret the terms “belonging” and “extremum” in this fuzzy environment is not apparent since is not a linearly ordered space and that is why we can find a plethora of approaches in the literature (see [24]). For example, in [1], the authors use fuzzy-number-valued utility functions which represent linguistic preferences based on the Hausdorff distance of their images.
In fuzzy optimization it is desirable that all fuzzy solutions under consideration be attainable, but very often one may find that maximum covering problems are computationally complex and not easy to solve. In these cases the decision maker must usually accept approximate solutions instead of optimum ones. Thus, in [5] (see also [25]), Buckley and Hayashi were the first authors to introduce a technique to solve fuzzy optimization problems approximately. Their technique was based on maximizing the centroids of the fuzzy number in the range of the utility function.
As shown in the previous section, our results can contribute to find approximate solutions of constrained fuzzy optimization problems by realizing utility fuzzy-valued functions based on a finite subset of fuzzy numbers rather than the whole , which boils down the fuzzy problem to a classical (crisp) real-valued optimization problem.
Footnotes
Acknowledgement
The authors wish to thank the referees and the Associate Editor, Prof. X. Ma, for their remarks which contributed to improve the quality of this manuscript.
References
1.
R.Aliev, W.Pedrycz, B.Fazlollahi, O.H.Huseynov, A.V.Alizadeh and B.G.Guirimov, Fuzzy logic-based generalized decision theory with imperfect information, Information Sciences189 (2012), 243–246.
2.
A.Aygunoglu, V.Cetkin and H.Aygun, On embedding problem of fuzzy number valued continuous functions, J Intell Fuzzy Systems25 (2013), 243–246.
3.
B.Bede and S.Gal, Generalizations of the differentiability of fuzzy-number-valued functions with applications to fuzzy differential equations, Fuzzy Sets and Systems151 (2005), 581–599.
4.
R.E.Bellman and L.A.Zadeh, Decision making in a fuzzy environment, Management Science17 (1970), 141–164.
5.
J.Buckley and Y.Hayashi, Can fuzzy neural nets approximate continuous fuzzy functions?Fuzzy Sets and Systems61 (1994), 43–51.
6.
P.Diamond and P.Kloeden, Metric Spaces of Fuzzy Sets, Theory and Applications, World Scientific, Singapore, 1994.
7.
D.Dubois and H.Prade, Decision making under fuzzy constraints and fuzzy criteria mathematical programming vs rulebased system approach, in M.Delgado, et al., Ed. Fuzzy Optimization-Recent Advances, Physica-Verlag, Heidelberg, 1994, pp. 21–32.
8.
J.-X.Fang and H.Huang, Some properties of the level convergence topology on fuzzy number space En, Fuzzy Sets and Systems140 (2003), 509–517.
9.
J.-X.Fang and H.Huang, On the level convergence of a sequence of fuzzy numbers, Fuzzy Sets and Systems147 (2004), 417–435.
10.
J.J.Font, A.Miralles and M.Sanchis, On the fuzzy number space with the level convergence topology, J Funct Spaces Appl2012, 11. Article ID 326417.
11.
J.J.Font, D.Sanchis and M.Sanchis, A version of the Stone-Weierstrass theorem in fuzzy analysis, J Nonlinear Sci Appl10 (2017), 4275–4283.
12.
R.Goetschel and W.Voxman, Elementary fuzzy calculus, Fuzzy Sets and Systems18 (1986), 31–42.
13.
S.Hai, Z.Gong and H.Li, Generalized differentiability for n-dimensional fuzzy-number-valued functions and fuzzy optimization, Information Sciences374 (2016), 151–163.
14.
H.Huang and C.Wu, Approximation of level fuzzy-valued functions by multilayer regular fuzzy neural networks, Math Comp Model49 (2009), 1311–1318.
15.
H.Huang and C.Wu, Approximation of fuzzy-valued functions by regular fuzzy neural networks and the accuracy analysis, Soft Comput18 (2014), 2525–2540.
16.
L.K.Jones, Constructive approximations for neural networks by sigmoidal functions, Proc IEEE78 (1990), 1586–1589.
17.
O.Kaleva and S.Seikkla, On fuzzy metric space, Fuzzy Sets and Systems12 (1984), 215–229.
18.
M.Leshno, V.Y.Lin, A.Pinkus and S.Schocken, Multilayer feedforward networks with a nonpolynomial activation function can approximate any function, Neural Networks6 (1993), 861–867.
19.
V.Y.Lin and A.Pinkus, Fundamentality of ridge functions, J Approx Th75 (1993), 295–311.
20.
P.Y.Liu, Universal approximations of continuous fuzzy-valued function by multi-layer regular fuzzy neural networks, Fuzzy Sets and Systems119 (2001), 313–320.
21.
B.F.Logan and L.A.Shepp, Optimal reconstruction of a function from its projections, Duke Math J42 (1975), 645–659.
22.
A.Pinkus, Density in approximation theory, Surv Approx Theory1 (2005), 1–45.
23.
H.Tanaka, T.Okuda and K.Asai, On fuzzy-mathematical programming, J Cybern3 (1974), 37–46.
24.
J.F.Tang, D.W.Wang, R.Fung and K.L.Yung, Understanding of fuzzy optimization: Theories and methods, J Syst Sci Complexity17 (2004), 117–136.
25.
D.Tikk, L.T.Kóczy and T.D.Gedeon, A survey on universal approximation and its limits in soft computing techniques, International Journal of Approximate Reasoning33 (2003), 185–202.
26.
C.-X.Wu and G.-X.Wang, Convergence of sequence of fuzzy numbers and fixed point theorems for increasing fuzzy mappings and applications, Fuzzy Sets and Systems130 (2002), 383–390.
27.
C.Wu and Z.Gong, On Henstock integral of fuzzy-numbervalued functions (I), Fuzzy Sets and Systems120 (2001), 523–532.