Abstract
The task of the standard Mamdani fuzzy logic controller is to find a crisp control action from the fuzzy rule-base and from a set of crisp inputs. In this paper we modify this controller in order to work with Atanassov’s intuitionistic fuzzy sets and to activate a set of rules having the same conclusion. Usually, the inference rules used in a fuzzy logic controller are given by a domain expert; in our system, these rules are automatically induced as fuzzy association rules starting from a training set. The fuzzy confidence value associated with each rule is used to obtain the fuzzy set inferred by our system.
Keywords
Introduction
The knowledge base of a rule-based system may contain imprecisions which appear in the description of the rules given by the expert. Because such an inference can not be made by the methods which use multiple valued logic, Zadeh gave a theory of approximate reasoning [38] that is the deduction of imprecise conclusions from a set of imprecise premises. The theory of approximate reasoning is based on fuzzy logic inference processes. An important part of fuzzy reasoning is represented by Fuzzy Logic Control (FLC), which is very useful when the needed models are not known or when they are too complex for analysis with conventional quantitative techniques.
In a fuzzy logic controller the expert’s knowledge is of the form
In this paper we modify the standard Mamdani controller in order to work with Atanassov’s intuitionistic fuzzy sets. An Atanassov’s intuitionistic fuzzy set is a natural generalization of a fuzzy set used for better modeling imperfect knowledge and is characterized by two functions representing the degree of membership and the degree of non-membership.
We obtain an Atanassov’s Intuitionistic Fuzzy Logic Controller (IFLC), a model for fuzzy reasoning based on Atanassov’s intuitionistic fuzzy sets.
There are a lot of papers studying the approximate reasoning based on Atanassov’s Intuitionistic Fuzzy Sets (IFSs) or Interval-Valued Fuzzy Sets (IVFSs) which consider the mathematical equivalence between IFS and IVFS. In the paper [14], authors present two ways of inference: first is based on interval-valued inclusion grade indicator of the observation in the premise and second is based on interval-valued similarity measure. Using the idea of interval-valued fuzzy relations, in the paper [15] it is described a method of inference based on IVFS while in the paper [33] a completely new interval-valued fuzzy reasoning is introduced. This inference process uses interval-valued restricted equivalence functions to increase the relevance of the rules in which the equivalence of the interval membership degrees of the patterns and the ideal membership degrees is greater. The papers [7, 37] perform an extension of a fuzzy expert system to an Atanassov’s intuitionistic fuzzy expert system in order to incorporate in the expert system the uncertainty modeled by Atanassov’s intuitionistic fuzzy sets. Our system features and differences from those mentioned above are highlighted below.
Usually, the inference rules used by a reasoning system are provided by a domain expert. In our case, these rules are induced as fuzzy association rules using a training set and the system activates only a set of rules having the same conclusion (or consequence).
The proposed IFLC system works as follows: generates using data mining techniques, from training data, the rules used by inference engine; computes the firing level of each rule, corresponding to input data; computes the matching value of the input data with each set of rules having the same conclusion; this value is computed taking into account the fuzzy confidence value of the rule; selects the best set of rules used in the inference process; computes the fuzzy set that represents the conclusion inferred and its corresponding crisp value obtained by defuzzification process.
The rest of paper is organized as follows: Section 2 presents the basic concepts with references to our approach. In Section 3 it is described the proposed IFLC system. The Section 4 contains an example about presented system and the last section discusses conclusions and future works.
This paper is an extension of [28]; in order to prove the performance of the proposed IFLC system compared to the classic FLC system, we extended the sample data used in the Section 4, while as defuzzification method we employed the Center-of-Gravity technique.
Basic concepts
Atanassov’s intuitionistic fuzzy sets
The knowledge base of a rule-based system may contain imperfect information which is inherent in the description of the rules given by the expert. This information may be incomplete, imprecise, fragmentary, not fully reliable, vague, contradictory or deficient in some other ways. In these cases, some difficulties appear: the difficulty of representing the deduction rules expressed, generally, by means of natural language and the difficulty of utilization of these rules when the observed facts do not match the condition expressed in the premise of the rule, but are not too different from them. Nowadays, we can handle much of this information’s imperfection using fuzzy logic [12]. A membership function of a classical fuzzy set assigns to each element from the universe of discourse a number from the unit interval to indicate the membership degree to the set under consideration. The non-membership degree is just natural defined as the complement to 1 of the membership degree. However, a human being who expresses the membership degree of a given element in a fuzzy set very often does not express corresponding degree of non membership as the complement to 1. This reflects a well known psychological fact that the linguistic negation not always identifies with logical negation. Thus Atanassov [5] introduced the concept of an intuitionistic fuzzy set characterized by two functions expressing the degree of membership and the degree of non membership, respectively. Atanassov’s intuitionistic fuzzy sets (see [5, 9]), can be viewed as a tool that may help better model imperfect information, especially under imperfectly defined facts and imprecise knowledge.
For each x the numbers μ
A
(x) and ν
A
(x) represent the degree of membership and the degree of non-membership of the element x ∈ X to A, respectively. For each element x ∈ X we can compute the, so-called, Atanassov’s intuitionistic fuzzy index (or hesitation [35]) of x in A defined as follows:
This notion was extended in [16], obtaining a generalized Atanassov’s intuitionistic fuzzy index associated with a strong negation. Of course, a fuzzy set is a particular case of the Atanassov’s intuitionistic fuzzy set with ν A (x) =1 - μ A (x). The working with Atanassov’s intuitionistic fuzzy sets instead of fuzzy sets imply the adding of another degree of freedom (ν A or π A ) to μ A . The Atanassov’s intuitionistic fuzzy sets offer a new possibility to represent imperfect knowledge and, therefore, to describe in a more adequate way many real problems. Such problems appear when we face with human opinions involving two or more answer of the type [34]: “Yes”, “Not”, “I do not know”, “I am not sure”, etc.
Voting can be a good example of such a situation, as human voters may be divided into three groups of those who: "Vote for", "Vote against", "Abstain or Give invalid votes".
This third group is of great interest (from the point of view of customer behavior analysis, for instance) because people from this undecided group after proper enhancement (e.g. different marketing activities) can finally become sure, i. e. become persons voting for or against (customers wishing to buy products advertised).
The majority of applications operate with Atanassov’s intuitionistic fuzzy numbers which was proposed by Burillo et al. in [17], the literature being rich in various definitions (see, for example, [11, 32]).
A is if-normal: there exists such that μ
A
(x0) =1 and ν
A
(x0) =0, A is if-convex: its membership function is fuzzy convex μ
A
(λx1 + (1 - λ) x2) ≥ min (μ
A
(x1) , μ
A
(x2)) and its non-membership function is fuzzy concave ν
A
(λx1 + (1 - λ) x2) ≤ max (ν
A
(x1) , ν
A
(x2))
μ
A
and ν
A
are continuous by parts.
Because the operating principle of the proposed system is independent of the type of fuzzy numbers used, for an easy implementation we will work with trapezoidal Atanassov’s intuitionistic fuzzy numbers.
where and b1 ≤ a1 ≤ b2 ≤ a2 ≤ a3 ≤ b3 ≤ a4 ≤ b4.
By convention, we ignore the situations where the denominator is equal to zero.
A such number will be denoted by
The rule
I1: If x ≤ z then I (x, y) ≥ I (z, y) for all x, y, z ∈ [0, 1]
I2: If y ≤ z then I (x, y) ≤ I (x, z) for all x, y, z ∈ [0, 1]
I3: I (0, y) =1 (falsity implies anything)
for all y ∈ [0, 1]
I4: I (x, 1) =1 (anything implies tautology)
for all x ∈ [0, 1]
I5: I(1,0)=0 (Booleanity).
The following properties for fuzzy implication are required by different authors and they have their significance in various applications:
I6: I (1, x) = x (tautology cannot justify anything) for all x ∈ [0, 1]
I7: I (x, I (y, z)) = I (y, I (x, z)) (exchange principle) for all x, y, z ∈ [0, 1]
I8: x ≤ y if and only if I (x, y) =1 (implication defines ordering) for all x, y ∈ [0, 1]
I9: I (x, 0) = N (x) for all x ∈ [0, 1] is a strong negation
I10: I (x, y) ≥ y for all x, y ∈ [0, 1]
I11: I (x, x) =1 (identity principle) for all x ∈ [0, 1]
I12: I (x, y) = I (N (y) , N (x)) for all x, y ∈ [0, 1] and a strong negation N
I13: I is a continuous function.
Czogala and Leski [21] analyzing a set of eight implications (Kleene-Dienes, Reichenbach, Lukasiewicz, Godel, Rescher-Gaines, Goguen, Zadeh, Fodor) concluded that the Lukasiewicz implication
Other notions used in this paper are given by the following definitions.
Fuzzy association rules
Mining of association rules represents one of the most important task in data mining.
Association rules are used to represent and identify dependencies between items in a database [40]. These are expressions of the type X → Y, where X and Y are sets of items and X∩ Y ≠ ∅. This means that if all the items in X exist in a transaction then all the items in Y with a high probability are also in the transaction, and X and Y should not have any common items [3]. Knowledge of this type of relationship can enable proactive decision making to proceed from the inferred data.
Professor Mamdani did a pioneering job by investigating the use of fuzzy logic for interpreting the human derived control rules. Conceptually, fuzzy association rules follow the same scheme proposed by Mamdani in regression/control. In the described case it is used their meaning as descriptive rules of information, hence having a descriptive rule set that are a particular chunk of information.
The task of discovering association rules was first introduced in [2]. Initially, association rules mining focused on market basket data which stores items purchased on a per-transaction basis. A typical example of an association rule has the following statement: 86% of customers who purchase bread also purchase butter.
Several extensions to the classical relational model have been proposed to support quantitative data [4]. Fuzzy association rules can handle both quantitative and categorical data and are expressed in linguistic terms, which are more natural and understandable for human beings.
An example of fuzzy association rules is the following:
The basic problem of finding fuzzy association rules was introduced in [30]. Let DB = {t1, …, t n } be a database characterized by a set I = {i1, …, i m } of categorical or quantitative attributes (items). For each attribute i k , (k = 1, …, m), we will consider n (k) associated fuzzy sets. Let be the set of all these fuzzy sets.
For an attribute i
k
and a fuzzy set , the membership function, denoted , is defined as:
For a specified transaction t j ∈ DB and an attribute i k , we denote with t j [i k ] the value of attribute i k in transaction t j .
For the quantitative attribute Age we can take into consideration the following three fuzzy sets: young, middle - aged and old.
Thus, we have F Age = {young, :middle - aged, :old}. Similarly, let F Income = {low, :middle, :high} the set of fuzzy sets associated with attribute Income.
For the last attribute Cars we consider the following set of fuzzy sets F Cars = {few, :many}.
For example, the tuple 〈{Age, Income}{young,high}〉 represents a fuzzy itemset for the database given in Example 1.
The intuitive signification of this fuzzy association rule, 〈X,F X 〉⇒〈YF Y 〉, is: "if a transaction (tuple) satisfies the property X ∈ F X , then it will also satisfy the property Y ∈ F Y with a high probability".
An example of a fuzzy association rule is the following:
In order to express the quality of a fuzzy association rule two quality measures, fuzzy support and fuzzy confidence, have been proposed in [30].
and ω is a user specified minimum threshold for the membership function. Thus, the values of membership functions less than this minimum threshold, ω, are ignored.
A fuzzy association rule is considered as interesting if it has enough support and high confidence value.
According to the structure of a FLC, an IFLC requires the following operations: fuzzification, reasoning and defuzzification.
Fuzzification and firing levels
A fuzzification operator transforms crisp data into fuzzy sets. For instance, x0 ∈ U is fuzzified into according to the relations:
The μ-firing level and ν-firing level of an Atanassov’s intuitionistic fuzzy set A and a crisp value x0 as input are μ A (x0) and ν A (x0), respectively.
In order to perform reasoning a set of rules are necessary. Typically rules for fuzzy logic controllers appear in if-then form and are obtained from the knowledge of experts and operators. As a result, the rules are limited, subjective and inaccurate.
In our system, these rules are automatically induced as fuzzy association rules starting from a training set; for this we can use any algorithm for mining fuzzy association rules (see [18], [22], [26], [27]. We consider that the training set is described as a set of transactions DB = {t1, …, t n } characterized by a set I = {i1, …, i m } of attributes. These attributes are represented by the input and output variables of fuzzy logic controller. For each attribute (variable) i k , k = 1, …, m, we consider n (k) linguistic values represented as fuzzy sets.
We generate only rules with input attributes in premise and output attributes in conclusion. The generated rules has the following form:
For a given rule R
i
the input data x = {x1, …, x
r
} generates the μ-firing level μ
i
, the ν-firing level ν
i
and the Atanassov’s intuitionistic fuzzy index π
i
, computed as
We partition the generated rules in subsets with rules having the same conclusion: the μ-conclusion C
μ
, which is the traditional output of the rule computed using the membership function and the firing level l
μ
the ν-conclusion C
ν
, which is the output of the rule computed using the non-membership function and the firing level l
ν
The crisp value y0 associated to a inferred conclusion C′ is obtained by defuzzification method.
The μ-conclusion and the ν-conclusion inferred using the set of rules R (C), where the conclusion C is the trapezoidal Atanassov’s intuitionistic fuzzy number (b1, a1, b2, a2, a3, b3, a4, b4), are given by the following expressions:
The conclusions C μ and C ν are defuzzified into the numbers y μ and y ν using the Center-of-Gravity technique, that for a discrete fuzzy set C gives:
For π = 0 the IFLC system reduces to the system from [29].
A case study
In order to show how the proposed system works, we consider an example inspired from [1] concerning washing machines. We transform this example into an IFLC system with two inputs and one output, which are linguistic variables. The input variables are Degree-of-Dirt (DD) and Type-of-Dirt (TD); the output variable is Washing-Time (WT). We consider the universes of discourse [0, 100] for the input variables and [0, 60] for the output variable.
For the input variable DD we can take into consideration the following three linguistic terms (see Fig. 4):
Similarly, let
F TD = {VeryNotGreasy, NotGreasy,
Medium, Greasy, VeryGreasy}
be the set of linguistic terms associated with the input variable TD defined by the following trapezoidal Atanassov’s intuitionistic fuzzy numbers (see Fig. 5):
For the output variable WT we consider the following set of linguistic terms:
F WT = {VeryShort, Short, Medium,
Long, VeryLong}
with the membership and the non-membership functions defined as trapezoidal Atanassov’s intuitionistic fuzzy numbers (see Fig. 6):
In order to extract the rules used by the inference engine of IFLC, we use a modified implementation of Fuzzy Apriori-T algorithm [18]. This algorithm runs on a training dataset of the form (DD, TD, WT) and keep only rules with support and confidence greater than or equal to the minimum support threshold and minimum confidence threshold respectively.
A fragment from training dataset is presented in Table 2.
Table 3 contains the fuzzy association rules obtained applying the Fuzzy Apriori-T algorithm on training dataset.
Partitioning this set of rules, we get the following subsets having the same conclusion:
After this step, for each partition of rules we compute the matching value of the input data x using the formula (9) (see Table 4) and select the rules set having the maximum matching measure, R (Long).
For the set R (Long), the conclusions Long μ and Long ν are defuzzified into y μ = 30.86302 and y ν = 28.62719, respectively. Because the Atanassov’s intuitionistic fuzzy index for the set R (Long) is π = 0.05126, the conclusion inferred by the IFLC system is y = 30.74841. The response surfaces given by IFLC system is presented in Fig. 7. In order to evaluate the performance of the IFLC system we made a comparison with classical FLC system [29] for various inputs, which highlighted the performance of the proposed algorithm compared to the classic version. For sample inputs/outputs presented in the Table 5, the dispersions of the results are for FLC system and for IFLC system. Because it means that the Atanassov’s intuitionistic fuzzy system is more robust than the classical. Other statistics highlight this property. For instance, the amplitude (difference between extreme values) is 2.67875 for FLC system and 2.54143 for IFLC system; the coefficient of variation (standard deviation relative to the arithmetic mean) is 327.438368 * 10-4 for FLC system and 314.863087 * 10-4 for IFLC system.
Conclusion and future works
This paper presents a fuzzy controller model of Mamdani type working with Atanassov’s intuitionistic fuzzy sets; thus this controller is an extension of the model from [36],[29] and [28]. While the standard Mamdani controller activates a set of rules with different conclusions, our model activates a set of rules having the same conclusion; thus we obtain a fuzzy set as output, which can be defuzzified in order to obtain a crisp value. Moreover, the rules used by Fuzzy Inference Engine are generated using Data Mining techniques and taking into account the rule fuzzy confidence. In the future we intend to extend this version in order to work with crisp data, intervals and/or linguistic terms as inputs, and to work with Atanassov’s intuitionistic implication instead of dividing the Atanassov’s intuitionistic fuzzy rule into two fuzzy rules.
Acknowledgments
This work was partially supported by the strategic grant POSDRU/159/1.5/S/133255, Project ID 133255 (2014), co-financed by the European Social Fund within the Sectorial Operational Program Human Resources Development 2007-2013.
