Piecewise linear function (PLF) is not only a generalization of univariate segmented linear function in multivariate case, but also an important bridge to study the approximation of continuous function by Mamdani and Takagi-Sugeno fuzzy systems. In this paper, the definitions of the PLF and subdivision are introduced in the hyperplane, the analytic expression of PLF is given by using matrix determinant, and the concept of approximation factor is first proposed by using m-mesh subdivision. Secondly, the vertex coordinates and their changing rules of the n-dimensional small polyhedron are found by dividing a three-dimensional cube, and the algebraic cofactor and matrix norm of corresponding determinants of piecewise linear functions are given. Finally, according to the method of solving algebraic cofactors and matrix norms, it is proved that the approximation factor has nothing to do with the number of subdivisions, but the approximation accuracy has something to do with the number of subdivisions. Furthermore, the process of a specific binary piecewise linear function approaching a continuous function according to infinite norm in two dimensions space is realized by a practical example, and the validity of PLFs to approximate a continuous function is verified by t-hypothesis test in Statistics.
The core of fuzzy system is to bypass the precise mathematical model to carry out logical reasoning and calculation for fuzzy information. The main method is to process data information and language information based on a set of If -Then rules. Generally, Mamdani and T-S fuzzy systems are two kinds of common models, in which Mamdani fuzzy system is the simplest kind of model, the main characteristic of which is that the output of each rule is a fuzzy set, while the output of T-S fuzzy system is a multivariate linear function of the input variables. Although it does not depend on the accurate mathematical model, it has better logical reasoning and numerical calculation and nonlinear function approximation ability. In the late 1990 s, fuzzy systems as approximators have been widely used in the fields of system identification, pattern recognition, nonlinear system design and fuzzy control. See Ref. [1–3]. Especially in 1998, Ying [4] used the linear programming method to study the general approximation of T-S fuzzy system, and then Zeng [5] gave the sufficient conditions for the approximation of the fuzzy system. These results provide some new ideas and methods for further study of the approximation performance of generalized fuzzy systems.
In 2018, Li and Qin discussed the robustness and general approximation ability of fuzzy reasoning system based on the method of quintuple implication principle (QIP) in [6]. The results show that the QIP method has good performance in the fuzzy system composed of fuzzy rules. In 2019, Kwak et al. [7] proposed a compensatory fuzzy reasoning method based on the movement and deformation between the antecedent fuzzy set and the observation information, which effectively improved the accuracy and learning performance of the algorithm. In 2020, Aubry et al. [8] Put forward an effective algorithm for real solutions of polynomial systems with symmetric L-R fuzzy numbers based on fuzzy systems, and applied it to the computer algebra software package SageMath. Zhang and Hao et al. [9] proposed a multi task genetic fuzzy system based on evolutionary thought and fuzzy optimization, and designed a multi task evolutionary optimization algorithm for Mamdani fuzzy system based on completely overlapping triangular membership function. In 2021, Li and Galayko [10] studied the inverse problem of the isometric feature mapping (ISOMAP) by using multi-level adaptive neuro fuzzy inference system, which effectively solved the potential nonlinear relationship between the low performance results of general ISOMAP reconstruction algorithm and its original data. Setayandeh and Babaei [11] suggested an optimization algorithm based on genetic algorithm for multi-objective constrained optimization problems, and simulated the algorithm by Monte Carlo simulation method. These recent works greatly broaden the application scope of fuzzy system.
The essence of a piecewise linear function is an extension of a segmented linear function of one variable in the case of multivariate variables. It can not only approximate an unknown continuous function with arbitrary precision, but also play an important role in the approximation theory of fuzzy system. In 2000, the concept of multivariate piecewise linear function based on the subdivision input space was first proposed by Prof. Liu in [12], and it is an important bridge to study the approximation of Takagi-Sugeno fuzzy system to continuous function and integrable function in [13]. Subsequently, in 2001, he studied the approximation performance of generalized Mamdani fuzzy system to a class of p-integrable functions in [14], for further information. See Ref. [15–17]. In 2006, Zhang and Li [18] proved that Mamdani fuzzy system is a universal approximator of integrable function by means of a square piecewise linear function, and provided the necessary conditions for Mamdani fuzzy system to be an approximator in [19]. In recent years, the convergence of fuzzy transformation and the solution of fuzzy dual complex linear systems have been studied. See [20, 21]. However, these results only take PLFs as a bridge to complete the proof, and there is no specific method to obtain it, which naturally limits the wide application of piecewise linear functions.
In 2014, Wang proved the universal approximation of Mamdani fuzzy system by introducing the piecewise linear function in [22]. In the same year, Peng [23] further gave the construction method and analytical expression of the PLF on the basis of Ref. [22], and proposed the solution formula of corresponding equation system through the matrix determinant. In 2015, Tao and Wang et al. [24] introduced K-quasi-subtraction operation to give the concept of Kp-integral norm, and then discussed the approximation of PLFs to a class of integrable functions in 2015, she utilized the piecewise linear functions as a tool to explore the approximation performance of generalized Mamdani fuzzy system to Kp-integrable function in [25]. See [26, 30]. In 2017, Wang et al. [27] first proposed that the PLFs can approximate a continuous function to arbitrary approximation accuracy in the sense of maximum norm based on the mesh subdivision of a generalized cube. These beneficial works extend the application range of Mamdani fuzzy system from different aspects. In 2021, Wang [28] put forward a new Kp-norm by introducing the K-quasi-decreasing operator and the determinant representation of PLFs, it was proved that Mamdani fuzzy system can approach the PLFs and p-integrable function, and an upper bound representation of subdivision was given. Unfortunately, the authors only guessed that the approximation factor is a constant independent of the number of subdivision in [27], its proof process is not given. This conclusion is the key to whether the final Mamdani fuzzy system can approach a multivariate continuous function.
The main purpose of this article is to deal with and solve the remaining problems in Ref. [27], and to verify that PLFs can approximate continuous functions with any precision by t- hypothesis test in Statistics. The specific solution is to prove that the approximation factor has nothing to do with the number of subdivisions m by using the properties of the coefficient determinants of PLFs, so as to lay a theoretical foundation for Mamdani fuzzy system to approach a continuous function. There are two innovations in this paper. One is to utilize the m- mesh subdivision method to propose the concept of the approximation factor, and then give the representation of vertex coordinates of each generalized small cube by subdividing three-dimensional cube; The other is to prove that the approximation factor is independent of the number of subdivision m by directly calculating the algebraic cofactors and matrix norms, it is only related to the dimension n of input space, the advantage of this method is to get the analytic expression of PLFs.
The remainder of the paper is organized as follows. In Section 2, according to Ref. [14], the concepts of the piecewise linear function and subdivision number are introduced. Meanwhile, we provide the analytical expressions of coefficient matrixes of corresponding linear equation system. In Section 3, the concept of the approximation factor based on the piecewise linear functions is first proposed by applying m-mesh subdivision of a generalized cube, and the calculation method of algebraic cofactors and matrix norm for the corresponding determinant are given. In Section 4, we demonstrate that the approximation factor of a piecewise linear function is independent of the selection of subdivision number by solving algebraic cofactors and matrix norm. In Section 5, the realization process of the binary piecewise linear function approaching a continuous function is given by an example analysis, and it is verified that the approximation factor is independent of the number of subdivision, but the approximation accuracy is related to the number of subdivision.
Piecewise linear functions
A piecewise linear function is a generalization of a segmented linear function of one variable in the case of multivariate variables, so it has many excellent properties such as zero outside the compact set of , uniformly continuous on the compact set, existence of unilateral partial derivative and bounded. Next, we will give some related concepts of n-variables piecewise linear functions, where the word “n-variables” can be omitted.
In this paper, we use the symbols and to represent the n-dimensional Euclidean space and the set of natural numbers, respectively. For any a > 0, let
then Δ (a) is called the generalized cube with side length a in , and it is abbreviated to Δ (a) = [0, a] × [0, a] × ·· · × [0, a].
Definition 2.1.[22, 27] Let an n- variables continuous function . If the following conditions ① to ② are satisfied:
There is a real number a > 0 such that S is always zero outside the generalized cube Δ (a);
If there is a group of n-dimensional polyhedrons {Δ1, Δ2, ·· · , ΔNs} ⊂ Δ (a) with , such that S takes n- variables linear function on each small polyhedron Δj (j = 1, 2, ·· · , Ns), that is to say, the S can be expressed as
Then S is called a piecewise linear function on , where β1i1j and λj are constants, i = 1, 2, ·· · , n.
In fact, the piecewise linear functions play an important role in studying the approximation of Mamdani fuzzy system and T-S fuzzy system. This is because the fuzzy system can approximate some piecewise linear function, and the piecewise linear function can approximate a continuous or integrable function, thus achieving the fuzzy system approximating to some unknown continuous function.
Definition 2.2. Let , , then Ω (β) is call a β- hyperplane on , where real number , symbol <· > is inner product. Clearly, the hyperplane Ω (β) can also be expressed in the form of linear combination of multivariate variables, that is, .
Definition 2.3. Let input space be Δ (a) = [0, a] n (a > 0), and Δ (a) is divided into mi small closed intervls along each axis xi (i = 1, 2, ·· · , n) in turn, [0, a] is divided into [0, a/ mi] , [a/ mi, 2a/ mi], ⋯, [a (mi - 2)/ mi, a (mi - 1)/ mi] , [a (mi - 1)/ mi, a]. If all subdivision points can be uniformly listed as , j = 1, 2, ·· · , mi, then mi is called an isometry number of subdivision of the axis xi in the input space Δ (a), also referred to as mi is the subdivision number on the xi axis.
Note 1. For simplicity, this paper always assumes that the same number of subdivisions is taken on each axis xi, i.e., mi = m, i = 1, 2, ·· · , n. In this case, the isometry subdivision of input space Δ (a) is also called m- mesh subdivision. Under this convention, it is not difficult to obtain the generalized cube Δ (a) which can be decomposed into mn generalized small polyhedrons Δj with right angle side length as , and .
Construction of a piecewise linear functionS: According to Refs. [26, 27], the input space Δ (a) is divided into m- mesh. Let Δi1i2···in be a small n- dimensional polyhedron after subdivision, and is denoted as the k-th vertex coordinate of n- dimensional small polyhedron Δi1i2···in after subdivision, and suppose that these n + 1 vertices are not on the same hyperplane, so as to ensure that the following determinant |Dn| ≠ 0. If n + 1 vertices coordinates of Δi1i2···in are briefly note as in the specified order, then each can take the corresponding value under the action of f, and the vertices coordinates of each small polyhedron Δi1i2···in in can be expressed as follows:
Let the hyperplane S be determined by n + 1 vertices of form (1) of Δi1i2···in in , and the analytic expression of the linear function S is expressed as
where x = (x1, x2, ·· · , xn) ∈ Δi1i2···in, ; j = 1, 2, ·· · , n. In addition, because the hyperplane Si1i2···in (x) is formed by cutting surface f (x) in the sense of m- mesh, and n + 1 vertices on are the common intersection of hyperplane Si1i2···in (x) and surface f (x), it is necessary for each vertex coordinate to have , k = 1, 2, ·· · , n, n + 1.
By substituting the coordinates of n + 1 vertices of Δi1i2···in into formula (2), a set of hyperplane linear equations on can be obtained as follows:
By substituting the coordinates of n + 1 vertices of Δi1i2···in into formula (2), a set of hyperplane linear equations on can be obtained as follows:
Because all vertex coordinates of each small polyhedron Δi1i2···in in shown in formula (1) are known in the sense of m- mesh subdivision. Therefore, all coefficients in equation group (3) can be regarded as unknown quantities, and then the values of these coefficients can be obtained by solving equation group (3). According to Ref. [27], the analytic expression of the piecewise linear function S on Δ (a) is
Here, the coefficients (j = 1, 2, ·· · , n, n + 1) of the piecewise linear function S on each hyperplane Δi1i2···in are given in the following matrix determinant form, i.e.,
Moreover, by applying m- mesh subdivision, it is not difficult to know that the vertex coordinates of each small polyhedron Δi1i2···in can be written as , and the index of each coordinate axis is i1, i2, ·· · , in ∈ {1, 2, ·· · , m}. See [27, 30].
In fact, with the specific analytic expression (4) of piecewise linear function (PLF), people naturally wonder whether PLFs can approximate a multivariate continuous function with any precision? Only by admitting this fact can we continue to study the problem of Mamdani fuzzy system approximating PLF or even continuous function, in which PLF is only a bridge in the process of proof. On this question, Ref. [27] gives a positive answer. Unfortunately, the authors only guessed that the sum (called approximation factor) is a constant in [27], and did not give a detailed proof. However, this problem will hinder Mamdani fuzzy system to approach a continuous function in theory. Therefore, we prove that the approximation factor in [27] is indeed a constant through the properties of the coefficient determinants and matrix norm of PLF formula (4), which has important theoretical significance.
Approximation of piecewise linear functions
Actually, Mamdani fuzzy system is one of the simplest fuzzy system models. Its main feature is that each rule’s subsequent output is a fuzzy set, while the subsequent output of T-S fuzzy system is a multivariate linear function about input variables. Next, we first review some related knowledge of Mamdani fuzzy system, and assume that the rule base is composed of the following fuzzy rules
The input-output relationship of Mamdani fuzzy system with single point fuzzification, product reasoning machine and central average fuzzification is as follows:
where is an input variable, is a family of antecedent fuzzy sets of Mamdani fuzzy system corresponding to the ij-th coordinate axis, i.e., , j = 1, 2, ⋯ , n, ij = 1, 2, ⋯ , Nj, and Ci1i2⋯in is a consequent fuzzy set corresponding to rule Ri1i2⋯in in the output domain , the is the center of the consequent fuzzy set Ci1i2⋯in, the real number u is the output variable on V. See [27].
In addition, it is not hard to see that the total number of all possible fuzzy rules in Mamdani fuzzy system is M = N1 × N2 × ·· · × Nn, and , are the antecedent fuzzy sets on the ij-th coordinate axis, respectively. For simplicity, N1 = N2 = ⋯ = Nn = m is chosen in this paper. See [27, 30].
Lemma 1.[27] Let S be a piecewise linear function of form (4) on the generalized cube Δ (a), where a > 0, then, for arbitrary ɛ > 0, there is a such that Mamdani fuzzy system Fm of form (6) determined by the number of subdivisions m satisfies || Fm - S ||∞ < ɛ when m > m0.
In accordance with the properties of determinant, it is not difficult to rewrite the above matrix determinant (5) as follows:
Note 2. According to the m- mesh subdivision, the difference of all adjacent coordinate components in these determinants on the same coordinate axis can only be or zero.
If these determinants (except f) are expanded in column 1, column 2,. . . , column n, and then n algebraic cofactors of n - 1 order m can be obtained by combining and sorting out the factors item by item, where the n - 1 order algebraic cofactors corresponding to the factor are simply expressed as the factor corresponds to . By analogy, the factor corresponds to the n - 1 order algebraic cofactors are , where represents the algebraic cofactor of the i-th determinant, the column k and the i-th element. For example, is a cofactor of , and are cofactors of , is a cofactor of , and
It should be noted that in the sense of isometric subdivision, the vertex coordinates of each small polyhedron Δi1i2···in as . Hence, the difference of all adjacent coordinate components on the same coordinate axis in these algebraic cofactor is only or zero.
Definition 3.1. Let matrix A be n square array, let ||A|| = | (| A| ) |, then ||A|| is called matrix norm of A, that is, matrix norm ||A|| is absolute value of determinant of A. Obviously, the matrix norm of any square array A always satisfies ||A||≥0.
Lemma 2.[27] Let f be continuous function on compact set , (x ; f (x) ) is a given data pair, but the analytic expression of f is unknown. Then, for any ɛ > 0, there is a subdivision number and the piecewise linear function S of form (4), which satisfies the requirements in the sense of infinite norm ∥S - f∥ ∞ < , where the infinite norm is defined as .
It is not difficult to see that Lemma 1 and Lemma 2 can be utilized to obtain the following Lemma 3. That is to say, Mamdani fuzzy system Fm of form (6) can indeed approximate f to arbitrary accuracy with respect to infinite norm.
Lemma 3.[27] If f be a continuous function on compact set , then, for arbitrary ɛ > 0, there is the number of subdivisions and the Mamdani fuzzy system of form (6), such that || Fm - f ||∞ < ɛ when m > m0, that is, Fm can approximate f to any precision by infinite norm.
However, it must be said that it is a pity, because the Ref. [27] does not give strict proof in theory that the sum factor in Lemma 2 is a constant independent of the number of subdivisions m, but simply expounds it in language. Thus, in this paper we will prove that the sum factor is a constant independent of the number of subdivision m on .
Definition 3.2. Assume that matrix (i, k = 1, 2, ·· · , n) are the corresponding n - 1 order algebraic cofactors as described above, and and ||Dn|| are matrix norms, then the expression is called the approximation factor of ∥f - S ∥ ∞, also referred to as the approximation factor of a piecewise linear function S.
In fact, the expression of the approximation factor is more complex with the increasing dimension of the input variable n. Moreover, the isometric subdivision of the generalized cube Δ (a) no longer exists when n ≥ 4, which makes it difficult to find the n - 1 order algebraic cofactors.
Approximation factor and subdivision
According to Lemma 2, only if the approximation factor is a constant independent of the number of subdivision, the piecewise linear function S has the approximation, so it is very important whether the approximation factor is a constant independent of the number of subdivision. This conclusion is only a conjecture in [27], but has not been proved in detail. Therefore, in this paper we will prove that the approximation factor is indeed a constant independent of the number of subdivision m on .
In order to verify whether the approximation factor is constant, it is necessary to determin the vertex coordinates of each small polyhedron Δi1i2···in in and its order, and then find the n - 1 order algebraic cofactor and its matrix norm corresponding to factor according to Note 2. Next, take n = 3 as an example to continue to explore the vertex coordinates of small tetrahedron Δi1i2···in on , and its sorting problem. See Fig. 1.
Subdivision image of a small cube with a side length of when n = 3.
In fact, for any input variable (x1, x2, x3) ∈ [0, a] 3, there are the indexes i1, i2, i3, such that (x1, x2, x3) ∈ Δi1i2i3. Suppose all coordinates of four vertices of the small tetrahedron Δi1i2i3 are , , and respectively, as shown in Fig. 1.
Note 3. It is not difficult to find from Fig. 1 that if is taken as the base point, the order of vertices and conforms to the right-hand rule, that is, is taken as the base point, and the bending direction of the four fingers of the right hand is from to , so the order of is determined in turn. According to this sort, we find that the corresponding coordinates have the following rules: the straight-line distance of vertices and along their respective coordinate axes is , where the difference between the -first component, -second component and -third component of vertices and the -corresponding coordinate component are all , while the other coordinate components have no change (difference is zero), that is, the difference between the components of adjacent vertices on the same coordinate axis is or zero.
Similarly, the method can be extended to n- dimensional polyhedron. Specific method: firstly, select a vertex on n- dimensional polyhedron Δi1i2···in as the base point , let the base point be , and then rotate each coordinate component to or (j = 1, 2, ·· · , n) along its coordinate axis ij in turn. If the other components are invariant, then the total n + 1 vertex coordinates of Δi1i2···in can be obtained.
Thorem 4.1. Let f be a continuous function on compact set , the Δi1i2···in be the small polyhedron of the above n-dimensional subdivision, and the coordinates of all vertices are denoted as , i1, i2, ·· · , in ∈ {1, 2, ·· · , m}. Matrix determinant is the algebraic cofactor of n - 1 order defined in Note 2, i, k = 1, 2, ·· · , n, and ||Dn|| are matrix norms, then the approximation factor is independent of the number of subdivision m.
Proof. According to Ref. [25], for any input variable (x1, x2, ·· · , xn) ∈ Δ (a), there is m-mesh subdivision and index i1, i2, ·· · , in ∈ {1, 2, ·· · , m} on cube Δ (a), such that (x1, x2, ·· · , xn) ∈ Δi1i2···in, where the right angle side length of each small polyhedron Δi1i2···in is .
Without losing generality, we can choose vertex as the base point of Δi1i2···in, the other n vertex coordinates are
By Note 3, these vertex coordinates are directly substituted into the formula (7) to obtain
According to Note 2, the difference of adjacent coordinate components on the same coordinate axis in matrix determinant , , ···, can only be or zero. If the above vertex coordinates are directly substituted into formula (7), it can be obtained immediately.
By Note 2, the n - 1 order algebraic cofactors are obtained by expanding with column 1, i.e.,
In the same way, the n - 1 order algebraic cofactors are obtained by expanding with column 2, that is,
Analogously, the determinant is expanded by column n to obtain n - 1 order algebraic cofactors as follows:
In summary, after the determinant is expanded according to the column 1, except for the n - 1 order algebraic cofactor , all other n - 1 order algebraic cofactors are zero, that is, , i = 2, 3, ·· · , n; the is expanded according to the column 2, except for the n - 1 order algebraic cofactors and , all other n - 1 order algebraic cofactors are zero, i.e., , i = 3, 4, ·· · , n. Similarly, the is expanded as column 3, except for , and , all others have . Generally, the determinant is expanded by column n, we always have
Finally, by Definition 3.2 we can immediately get that
Hence, the approximation factor is . Clearly, It is only related to the dimension n of input space, but has nothing to do with the number of subdivision m.
Actually, although the number of subdivision m of input space Δ (a) is independent of the approximation factor, the number of subdivision m is closely related to the corresponding PLFs, Mamdani fuzzy system and approximation accuracy. For example, PLFs are mainly constructed by the subdivision of input space. Generally speaking, the larger the m value, the finer the subdivision, the better the approximation accuracy, but the greater the complexity. Conversely, if the m value is too small, although the complexity is reduced, it may not achieve the required approximation accuracy. So far, the problems left by [27] have been solved.
In addition, from the construction of Mamdani fuzzy system (6), the antecedent fuzzy sets and on the three coordinate axes also depend on the number of subdivisions m, but in this paper we assume that there is always N1 = N2 = N3 = m.
Example analysis
In this part, the important role of approximation factor of a piecewise linear function S is illustrated through a practical example. For simplicity, we may extend the condition of the given binary pair ((x, y) ; 1ptf (x, y)) to the analytic expression of the known function f (x, y), and assume that the binary function f (x, y) is a continuous differentiable function.
Example Let n = 2, a = 1, f (x, y) = e-(x2+y2)/-40, (x, y) ∈ [0, 1] × [0, 1], and the precision of a given piecewise linear function S approximate to f is σ = 0.1. Please give the realization process of this approximation by the approximation factor.
In fact, by Definition 2.3 and m- mesh subdivision of Note 1, for arbitrary (x, y) ∈ [0, 1] × [0, 1], there are i1, i2 such that (x, y) ∈ Δi1i2, and the length of the right angle side of triangle Δi1i2 is , where m is the number of subdivisions waiting to be determined, and each component coordinate on Δi1i2 meets and . See Fig. 1 or Fig. 2 below.
6-mesh subdivision graph of Δ (1) when n = 2.
Obviously, the function f (x, y) = e-(x2+y2)/-40 is uniform continuity on closed set Δi1i2, then, for arbitrary ɛ > 0, there is δ > 0, such that |f (x1, y1) - f (x2, y2) | < ɛ when for any (x1, y1) , (x2, y2) ∈ Δi1i2 with || (x1, y1) - (x2, y2) || < δ. Now, if it is satisfies
then, we only need to select the natural number with the number of subdivision .
Next, we will determine the value of the minimum number of subdivision m according to the path σ → ɛ → δ → m in turn with approximation accuracy σ = 0.1.
Firstly, for the above ɛ > 0, n = 2 and given accuracy σ = 0.1, by Theorem 4.1 and Lemma 2, if
The solution is ɛ ≤ 0.1/ - 4 = 1/ - 40. So we may take ɛ = 1/ - 40.
Secondly, as f (x, y) is a continuous differentiable function on the closed set Δi1i2, and the partial derivatives of f satisfy and .
By the binary Taylor formula, we can expand f (x, y) at point (x1, y1) in the first order, that is, for all (x, y) ∈ Δi1i2, there is θ ∈ (0, 1), such that
Let (x, y) = (x2, y2), then we have
Especially, when |x1 - y1| < δ and |x2 - y2| < δ, it is not hard to get that
According to the uniform continuity of f (x, y) = e-(x2+y2)/-40 on Δi1i2, for ɛ = 1/ - 40 > 0, if
The solution is δ ≤ 1/ - 4, we take δ = 1/ - 4. Finally, we can gain the number of subdivision based on formula (8) . Thus, the minimum number of subdivision m = 6.
Next, we will construct a specific bivariate piecewise linear function on with the number of subdivision m = 6 as follows:
Firstly, the compact set [0, 1] × [0, 1] = Δ (1) is divided into 6-meshes, and 36 small squares with side length of 1/ - 6 are obtained. In order to satisfy the rule of three points to determine a plane, then divide each small square into two parts with the diagonal, so as to get 72 small isosceles right angle triangles. We denote they as Δi1i2, where i1 = 1, 2, ⋯ , 6 ; i2 = 1, 2, ⋯ , 12. See Fig. 2.
It is not difficult to see that the vertex coordinates of all these small triangles can be determined. For example,
Now, the vertex coordinates of the surface of each triangular prism that each small triangle Δj,i on under the action of f are also determined in turn. For example, the vertex coordinates of the triangular prism of Δ2,3 on are in turn
According to the formulas (5) and (7), it is not difficult to obtain the plane equation determined by these three points. The specific steps are as follows:
We will immediately obtain the plane equation determined by Δ2,3 in with plugging these determinant values into the formula (4), it’s not hard to get that
Similarly, the analytic expression of each piecewise linear function of Δ1,1, Δ1,2, ⋯ , Δ2,1, ⋯ , Δ6,1, ⋯, Δ6,12 in can be determined in turn. Therefore, the analytic expression of the piecewise linear function S (x, y) on [0, 1] × [0, 1] as follows:
With the analytic expression of the piecewise linear function S (x, y), it is not difficult to draw the spatial surface graph and mixed surface graph of f (x, y) and S (x, y) on [0, 1] × [0, 1] by using MATLAB software programming, as shown in Figs. 3-4.
Surface graph of a given function f on Δ (1).
Mixed surface graphs of f and S on Δ (1).
However, only from the mixed Fig. 4, we have not enough reason to say that S can approximate f to arbitrary accuracy. Hence, we will test the approximation ability of the piecewise linear function S by sample points. We may randomly take 30 samples on [0, 1] × [0, 1], and calculate their values and errors at these sample points according to the analytical expressions of f (x, y) and S (x, y), respectively, as follows:
It is not difficult to see from Table 1 that the values of the function f (x, y) and S (x, y) are the same at the vertex coordinates, and their error values Di are all zero, which is consistent with the condition under the PLF is constructed in Section 2. However, it is not enough to judge that S can approximate f to arbitrary precision according to infinite norm only by randomly selecting the values of these 30 sample points in Table 1.
The corresponding values and errors of f (x, y) and S (x, y) at 30 sample points
Number i
Sample point (x1, x2)
f (x1, x2) = Xi
S (x1, x2) = Yi
Di = Xi - Yi
1
(1 / 6, 1/ 6)
0.998612075
0.998612075
0
2
(1/ 3, 1 / 3)
0.994459848
0.994459848
0
3
(1/ 2, 1/ 3)
0.991012850
0.991012850
0
4
(2/ 3, 1/ 6)
0.988263857
0.988263857
0
5
(2/ 3, 1 / 2)
0.982788725
0.982788725
0
6
(5 / 6, 1/ 3)
0.980062544
0.980062544
0
7
(5/ 6, 5 / 6)
0.965873677
0.965873677
0
8
(1/ 6, 1/ 3)
0.996533799
0.996533799
0
9
(1/ 2, 1 / 2)
0.987577800
0.987577800
0
10
(5/6, 2 / 3)
0.971929292
0.971929292
0
11
(1/6, 1/12)
0.999132321
0.998958935
0.000173386
12
(1/4, 1/ 3)
0.995669128
0.995496825
0.000172303
13
(1/12, 1/8)
0.999435923
0.999132486
0.000303437
14
(1/24,1/12)
0.999783010
0.999479468
0.000303542
15
(1/12,1/24)
0.999783010
0.999479468
0.000303542
16
(1/ 8, 1/12)
0.999435923
0.999132487
0.000303436
17
(1/12,1/12)
0.999652838
0.999306037
0.000346801
18
(1/ 6, 1/ 4)
0.997745601
0.996532355
0.001213246
19
(11/12, 5/6)
0.962358674
0.962198631
0.000160043
20
(1, 11 / 12)
0.955035330
0.954876504
0.000476796
21
(1/ 4, 1/ 8)
0.998048781
0.997746368
0.000302413
22
(1/ 4, 1 /24)
0.998395386
0.998092867
0.001302519
23
(11/12,11/12)
0.958856463
0.958551551
0.000304912
24
(1 / 4, 1 / 4)
0.996879878
0.996535960
0.000343918
25
(1/ 12, 5/24)
0.998742111
0.997572213
0.001169898
26
(1/12,23/24)
0.977131852
0.976841083
0.000290769
27
(11/12,23/24)
0.956985524
0.956714027
0.000271497
28
(11/12,21/24)
0.960647666
0.960375091
0.000272575
29
(5/ 6,11 /12)
0.962358674
0.962198631
0.000160043
30
(1/ 4, 1/ 12)
0.998265395
0.997919798
0.000345597
Next, we will apply the t- test method in Statistics to verify that the PLF S can indeed approximate to a continuous function f by the number of subdivision m = 6.
Assuming that the error data D (i) = Yi - Xi (i = 1, 2, ·· · , 30) in Table 1 are from a sample from the normal population distribution , where both mean value μD and variance are unknown. According to the t- hypothesis test method in statistical inference, we can easily calculate the values of the mean value and variance sD as follows:
For the error data {Yi - Xi} in Table 1, we can test the hypothesis {H0, H1} under the significance level α = 0.05, where the hypothesis (acceptance domain H0 and rejection domain) satisfies H0 : μD = 0, H1 : μD ≠ 0.
Adopting the approach of the t-test, we select the test statistic , let n = 30, 1ptμ = 0 and α = 0.05. By looking up to the t-distribution Table for t-hypothesis test, we can obtain t
α (n - 1) = t0.05 (29) =1.6991. Therefore, the rejection domain of the hypothesis test is
On the other hand, according to the above mean value and variance sD we can easily calculate the observational value of t is
Clearly, the observation value t falls within the rejection region H1. Hence, we must reject the hypothesis H0 under significance level α = 0.05. Therefore, the piecewise linear function S can approximate to the continuous function f with arbitrary accuracy.
Conclusion
So far, the problem left by Ref. [27] have been successfully solved, and it is verified that PLFs can approach a continuous function. It is not difficult to see from Lemma 2 and Theorem 4.1 that when the PLFs approach an unknown continuous function, the approximation factor is only related to the space dimension n, but not to the the number of subdivision m. Moreover, the larger the n is, the larger the approximation factor is, while the approximation accuracy is reduced. Hence, it is not enough to increase the approximation accuracy of PLFs only by increasing the number of subdivision m. Of course, how to select the vertex coordinates of the polyhedrons is also a key issue when calculating algebraic cofactors of determinant in Theorem 4.1. In three-dimensional space, it may change the approximation factor and affect the approximation accuracy if we select the vertex coordinates according to the left-hand rule. Therefore, it will be the next focus of the study on how to select the optimal vertex coordinates to minimize the approximation factor and improve the approximation accuracy. In addition, whether PLFs can be used to study the approximation of T-S fuzzy systems is also a problem worthy of further discussion.
References
1.
TakagiT. and SugenoM.Fuzzy identification of system and its application to modeling and control, IEEE Transactions on Systems Man Cybern15(1) (1985), 116–132.
2.
BuckleyJ.J.Sugeno type controllers are universal controllers, Fuzzy Sets and Systems53(3) (1993), 299–303.
3.
KoskoB.Fuzzy systems are universal approximators, IEEE Transactions on Computers43(11) (1994), 1329–1333.
4.
YingH.General SISO Takagi-Sugeno fuzzy systems with linear rule consequents are universal approximators, IEEE Transactions on Fuzzy Systems6(4) (1998), 582–587.
5.
ZengK., ZhangN.R. and XuW.L.A comparative study on sufficient conditions for Takagi-Sugeno fuzzy systems as universal approximators, IEEE Transactions on Fuzzy Systems8(6) (2000), 773–780.
6.
LiD.C. and QinS.J.Performance analysis of fuzzy systems based on quintuple implications method, International Journal of Approximate Reasoning96 (2018), 20–35.
7.
KwakS.I., RyuU.S., KimG.J., et al., A fuzzy reasoning method based on compensating operation and its application to fuzzy systems, Iranian Journal of Fuzzy Systems16(3) (2019), 17–34.
8.
AubryP., MarrezJ. and ValibouzeA.Computing real solutions of fuzzy polynomial systems, Fuzzy Sets and Systems399 (2020), 55–76.
9.
ZhangK., HaoW.N., YuXH., et al., A multitasking genetic algorithm for Mamdani fuzzy system with full overlapping triangle membership functions, International Journal of Fuzzy Systems22 (2020), 2449–2465.
10.
LiH.G., GalaykoD. and TrocanM.Multi-level adaptive neuro-fuzzy inference system-based reconstruction of 1D ISOMAP representations, Fuzzy Sets and Systems411 (2021), 155–173.
11.
SetayandehM.R. and BabaeiA.R. A novel method for multi-objective design optimization based on fuzzy systems, Iranian Journal of Fuzzy Systems DOI:10.22111/IJFS.2021.6126
12.
LiuP.Y. and LiH.X.Approximation of generalized fuzzy system to integrable function, Science in China (Series E)43(6) (2000), 618–628.
13.
LiuP.Y. and LiH.X.Analyses for Lp(u) norm approximation capability of the generalized Mamdani fuzzy systems, Information Sciences138(2) (2001), 195–210.
14.
LiuP.Y.Mamdani fuzzy system is universal approximator to a class of random process, IEEE Transactions on Fuzzy Systems10(6) (2002), 756–766.
15.
WangY.L., LiL., LiY., et al., Nonlinear observer design using piecewise-linear functions based approximations, Control and Decision48(1) (2008), 153–156.
16.
ZhangH. and WangS.N.Piecewise linear approximations with a hypercube partition, Journal of Tsinghua University (Science and Technology)48(1) (2008), 153–156.
17.
ZengK., ZahngN.Y. and XuW.L.Sufficient condition for linear T-S fuzzy systems as universal approximators, Acta Automatica Sinica27(5) (2001), 606–612.
18.
ZhangY.Z. and LiH.X.Generalized hierarchical Mamdani fuzzy systems and their universal approximation, Control Theory and Applications23(3) (2006), 449–454.
19.
SunF.C., YangJ. and LiuH.P.Preconditions for SISO Mamdani fuzzy systems to perform as function approximators, Transactions on Intelligent Systems4(4) (2009), 288–294.
20.
Verma1A.K., Kayenat1S. and JhaG.J.A note on the convergence of fuzzy transformed fifinite difference methods, Journal of Applied Mathematics and Computing63 (2020), 143–170.
21.
ChehlabiM.Solving fuzzy dual complex linear systems, Journal of Applied Mathematics and Computing60 (2019), 87–112.
22.
WangG.J., LiX.P. and SuiX.L.Universal approximation and its realization of a generalized Mamdani fuzzy system based on K-integral norms, Acta Automatica Sinica40(1) (2014), 143–148.
23.
PengW.L.Structure and approximation of a multi-dimensional piecewise linear function based on the input space of subdivision fuzzy systems, Journal System Science & Mathematical Science34(3) (2014), 340–351.
24.
TaoY.J., WangH.Z. and WangG.J.Approximation ability and its realization of the generalized Mamdani fzzzy system in the sense of Kp-integral norm, Acta Electronica Sinica43(11) (2015), 2284–2291.
25.
TaoY.J., WangH.Z. and WangG.J.Approximation of piecewise linear function in the sense of Kp-integral norm induced by K-quasi-arithmetic operations, Journal System Science & Mathematical Science36(2) (2016), 267–277.
26.
WangH.Z., TaoY.J. and WangG.J.Approximation analysis of non-homogeneous linear T-S fuzzy system based on grid piecewise linear function structure, Journal System Science & Mathematical Science35(11) (2015), 1276–1290.
27.
WangG.J. and LiX.P.Mesh construction of PLF and its approximation process in Mamdani fuzzy system, Journal of Intelligent & Fuzzy Systems32(6) (2017), 4213–4225.
28.
WangG.J., WangH.Z. and LongZ.Q.Norm approximation of Mamdani fuzzy system to a class of integrable functions, International Journal of Fuzzy Systems23(3) (2021), 833–848.
29.
WangG.J., YangY. and LiX.P.Rule number and approximation of the hybrid fuzzy system based on binary tree hierarchy, International Journal of Machine Learning and Cybernetics9(6) (2018), 979–991.
30.
WangG.J., Polygonal fuzzy neural network and fuzzy system approximation, Beijing, Science Press (2017).