In the papers of Mona Khare the notion of Shannon entropy of fuzzy σ-algebras on an F-probability measure space has been defined and some results concerning this measure have been presented. The purpose of the present paper is to provide analogues of these results for the case of the logical entropy. We define the logical entropy and conditional logical entropy of fuzzy σ-algebras on the F-probability measure space and prove the basic properties of these measures. We also define the concept of logical mutual information on the F-probability measure space and prove some properties concerning this measure. Shannon entropy of fuzzy σ-algebras can be replaced by logical entropy of fuzzy σ-algebras as a measure of information of experiments whose outcomes are fuzzy events.
Entropy is a tool to measure the amount of uncertainty in random events. The entropy has been applied in the information theory, physics, computer sciences, statistics, chemistry, biology, sociology, general systems theory and many other fields. The classical approach in the information theory was based on Shannon entropy [8, 20]. Shannon entropy of a probability distribution was studied in [17]. Kolmogorov and Sinai used the Shannon entropy to define the entropy of measurable partitions and then they defined the entropy of dynamical systems. Kolmogorov - Sinai entropy is a useful tool in studying the isomorphism of dynamical systems. In fact, the isomorphic dynamical systems have the same entropy [3, 21]. Thus, they developed a method for distinguishing non-isomorphic dynamical systems.
In [9, 19], Good, Patil, Taillie and Rao defined and studied the concept of the logical entropy. Let P = (p1,. . . , pn) be a probability distribution. The logical entropy of P is defined in [6] by the formula Rao introduced precisely this concept as a quadratic entropy [19]. In the years 2009 and 2013, this concept was discussed by Ellerman [6, 7] and the author [7] investigated the relationship between the logical entropy and Shannon entropy. Ebrahimzadeh, Eslami, Markechova and Riecan defined and studied the notion of logical entropy of partitions and dynamical systems on some algebraic structures [2, 16].
Markechova [14, 15] studied Shannon entropy of complete partitions and entropy of an F-dynamical system. Fuzzy partition theory in a different way using of triangular norms and its entropy were developed by Dumitrescu [1] (see also [10]). Klement in [13] defined the notion of F-probability measure space by defining the notions of fuzzyσ-algebra and F-measure. Mona Khare introduced the notions of Shannon entropy and conditional entropy of fuzzy σ-algebras having finitely many atoms on anF-probability measure space and presented some results concerning this measures [11, 22].
The main idea of the present research is to study analogues of these results for the cases of logical entropy and logical mutual information onF-probability measure spaces. We show that the basic properties of Shannon entropy of fuzzy σ-algebras on F-probability measure spaces, valid for the case of the logical entropy, too. So the suggested measure can be used (in addition to the Shannon entropy of fuzzy σ-algebras) as a measure of information of experiments whose outcomes are fuzzy events.
In Section 2, some basic definitions are presented that will be useful in further considerations. In Section 3, the logical entropy and conditional logical entropy of fuzzy sub σ-algebras on the F-probability measure space are defined and basic properties of these measures are investigated. In the subsequent section the logical entropy and conditional logical entropy under the relation of equivalence modulo 0, is studied. In Section 4, the logical mutual information of fuzzy sub σ-algebras on the F-probability measure space is defined and some properties of this measure are found.
Basic notions
In this section, some basic definitions are presented that will be useful in further considerations.
Definition 2.1. [13] A fuzzy σ-algebra on a nonempty set X is a subfamily of IX which satisfies the following conditions:
If λ ∈ M then
If , then .
If and are fuzzy σ-algebras on X, then is the smallest fuzzy σ-algebra on X containing [13].
Definition 2.2. [13] An F-probability measure m on is a function which satisfies:
m (1) =1,
m (1 - λ) =1 - m (λ) ,
m (λ ∨ μ) + m (λ ∧ μ) = m (λ) + m (μ) for every
If and λi ↑ λ, then .
The triple is called an F-probability measure space.
Example 2.3. Let X = [0, 1] and let where λi : [0, 1] → [0, 1] defined by λ1 (x) =1, λ2 (x) =0,
and
It is clear that is a fuzzy σ-algebra on X . Define by
Also let ∨ and ∧ mean respectively supremum and infimum. It is easy to see that m is an F-probability measure on So is an F-probability measure space.
Definition 2.4. [23] Let be an F-probability measure space.
For , a relation = (modm) is defined as
The relation = (modm) is an equivalence relation on . The set of all equivalence classes induced by this relation is denoted by and denotes the equivalence class determined by μ.
Elements are called m-disjoint if λ ∧ μ = 0 (modm), i.e.
Definition 2.5. [23] Let be an F-probability measure space, and be a fuzzy sub-σ-algebra of . An element is called an atom of if m (μ) >0, for any ,
The set of all atoms of is denoted by , and denotes the collection of fuzzy sub-σ-algebras of having finitely many atoms.
Example 2.6. Consider Example 2.3. We have m (λ1) =1, m (λ2) =0 and By Definition 2.4, we obtain ∀i ≠ j, [λi] ≠ [λj] and therefore Suppose From Definition 2.5, by a simple calculating we have
Definition 2.7. [23] Let be an F-probability measure space, and be fuzzy sub-σ-algebras of . Then is called an m-refinement of written as , if for there exists such that m (λ ∧ μ) = m (μ).
The fuzzy sub -σ-algebras are called m-quivalent, denoted by if
for each and
for each
The relation of “m-equivalence” is an equivalence relation on and denotes the set of all m-equivalent fuzzy sub -σ-algebras in [12].
Theorem 2.8.[23] Let be an F-probability measure space and be elements of . If then
Definition 2.9. [22] For , the relation ∼ is defined as follows:
Then ∼ is an equivalence relation on and this relation is called equivalence modulo 0 [22].
Logical entropy and conditional logical entropy
In this section, we define the notions of logical entropy and conditional logical entropy of fuzzy σ-algebras on an F-probability measure space. We prove some ergodic properties of the suggested measures. For example, we study the conditional logical entropy under the common refinement of fuzzy σ-algebras and prove the subadditivity property of logical entropy of fuzzy σ-algebras on an F-probability measure space. We show that the logical entropy and logical conditional entropy of fuzzy σ-algebras of an F-probability measure space are invariant under the relation of equivalence modulo 0.
Definition 3.1. Let be an F-probability measure space and and let We define the logical entropy by:
Example 3.2. Consider Examples 2.3 and 2.6. We obtained Since by Definition 3.1 we have
Definition 3.3. Let be an F-probability measure space and and The logical conditional entropy is defined as:
Note that and
Now the assertion of the following lemma will be proved that will be useful in the next theorem.
Lemma 3.4.Let be an F-probability measure space, and let and . If , then
ii) The desired result follows from the first part of this theorem and Theorem 3.6. □
The next theorem shows that the logical entropy and logical conditional entropy of fuzzy σ-algebras of an F-probability measure space are invariant under the relation of equivalence modulo 0.
Theorem 3.8.Let be an F-probability measure space and If then
implies
implies
implies
Proof.i) Let and . Then, for any , there exists such that m (λi ∧ μj) = m (μj). This means m (λi ∧ μj) - m (μj) =0 and so . Conversely, let . Since m (λi ∧ μj) ≥0 and m (λi ∧ μj) ≤ m (μj) we get for each i, j, m (λi ∧ μj) = m (μj) orm (λi ∧ μj) =0 . Now by the proof of Proposition 4.7 in [22] we obtain
ii) This follows from part i) of this theorem and Theorem 3.6.
iii) Since , from the first part of this theorem we have , therefore Similarly , implies Since we conclude
iv) Since by Theorem 2.8, Based on part ii) of this theorem and Theorem 3.6 ii) we obtain
v) implies According to part ii) of this theorem and Theorem 3.6 ii) we get
If m and n are F-probability measures on a fuzzy σ- algebra then for p ∈ [0, 1] , pm + (1 - p) n is an F-probability measure on too [12].
Theorem 3.9.Let and be two F-probability measure spaces. If and p ∈ [0, 1] , then
Proof. Let Since
we have
Logical mutual information
In this section, the notion of logical mutual information on an F-probability measure space will be defined and some important results relating to this measure will be proved.
Definition 4.1. Let be an F-probability measure space and and . The mutual information about a fuzzy σ-algebra in a fuzzy σ-algebras is defined as:
Note that in the previous definition since for each i, j, m (λi ∧ μj) = m (μi ∧ λj) we may obtain
Theorem 4.2.Let be an F-probability measure space and If then
implies
Proof. Let and .
By Definition 4.1, we have
The result follows from part i) of this theorem and Theorem 3.6 ii).
This follows from parts i) and ii) of this theorem.
Since by Theorem 2.8, So (see Theorem 3.8), we have
According to Theorem 3.6 iv) and part i) of the previous theorem we obtain Il (N1, N2) ≥0 . Since part ii) of the previous theorem implies that
Conclusion
This work has introduced the notions of logical entropy and logical conditional entropy of fuzzyσ-algebras on F-probability measure spaces. It was shown that the chain rules for logical entropy of fuzzy σ-algebras in F-probability measure spaces are established. The property of subadditivity for the logical entropy of fuzzy σ-algebras was proved. Furthermore, the notion of logical mutual information on F-probability measure spaces was studied. It was shown that the basic properties of Shannon entropy of fuzzy σ-algebras on F-probability measure spaces, valid for the case of the logical entropy, too. So the suggested measure can be used (in addition to the Shannon entropy of fuzzy σ-algebras) as a measure of information of experiments whose outcomes are fuzzy events.
The aim of our further research is to define using of the concept of logical entropy of fuzzy σ-algebras, the notion of logical entropy of dynamical systems on F-probability measure spaces. Then the notion of logical entropy of dynamical systems can be a new tool for distinction of non-isomorphic fuzzy dynamical systems.
Footnotes
Acknowledgments
The authors thank the editor and the referees for their valuable comments and suggestions.
References
1.
DumitrescuD., Fuzzy measures and the entropy of fuzzy partitions, J Math Anal Appl176 (1993), 359–373.
2.
EbrahimzadehA., Logical entropy of quantum dynamical systems, Open Physics14 (2016), 1–5.
3.
EbrahimzadehA. and EbrahimiM., The entropy of countable dynamical systems, UPB Sci Bull Series A76 (2014), 107–114.
4.
EbrahimzadehA. and EbrahimiM., Entropy of dynamical systems on weights of a graph, Journal of Mahani Mathematical Research Center2 (2013), 53–63.
5.
EbrahimzadehA., Eslami GiskiZ. and MarkechovaD., Logical entropy of dynamical systems - a general model, Mathematics5(1) (2017), doi: 10.3390/math5010006
6.
EllermanD., An introduction to logical entropy and its relation to Shannon entropy, International Journal of Semantic Computing7 (2013), 121–145.
7.
EllermanD., Counting distinctions on the conceptual foundations of shannon information theory, Synthese168 (2009), 119–149.
8.
GrayR.-M., Entropy and Information Theory, Springer Verlag, New York, (2009).
9.
GoodI.-J., Comment on patil and taillie: Diversity as a concept and its measurement, Journal of the American Statistical Association77 (1982), 561–563.
10.
Karayiannis and NicolaosB., Fuzzy partition entropies and entropy constrained fuzzy clustering algorithms, Journal of Intelligent and Fuzzy Systems5(2) (1997), 103–111. DOI: 10.3233/IFS-1997-5202
11.
KhareM., Fuzzy σ-algebras and conditional entropy, Fuzzy Sets and Systems102 (1999), 287–292.
12.
KhareM., Sufficient families and entropy of inverse limit, Math Slovaca49 (1999), 443–452.
13.
KlementE.-P., Fuzzy a-algebras and fuzzy measurable functions, Fuzzy Sets and Systems4 (1980), 83–93.
14.
MarkechovaD., The entropy of fuzzy dynamical systems and generators, Fuzzy Sets and Systems48 (1992), 351–363.
15.
MarkechovaD., Entropy of complete fuzzy partitions, Math Slovaca43 (1993), 1–10.
16.
MarkechovaD. and RiecanB., Logical entropy of fuzzy dynamical systems, Entropy18 (2016), 157–170. doi: 10.3390/e18040157
17.
MaticM. and PearceC.-E.-M., On an inequality for the entropy of a probability distribution, Acta Mathematica Hungarica85 (1999), 345–349.
18.
PatilG.-P. and TaillieC., Diversity as a Concept and its Measurement, Journal of the American Statistical Association77 (1982), 548–561.
19.
RaoC.-R., Diversity and dissimilarity coefficients, A unified approach, Theoretical Population Biology21 (1982), 24–43.
20.
ShannonC.-E., A mathematical theory of communication, Bell Systém Technical Journal27 (1948), 379–423.
21.
SinaiYa.-G., Ergodic theory with applications to dynamical systems and statistical Mechanics, Springer, (1990).
22.
SrivastavaP. and KhareM., Conditional entropy and Rokhlin metric, Math Slovaca49 (1999), 433–441.
23.
SrivastavaP., KhareM. and SrivastavaY.-K., m-equivalence, entropy and F-dynamical systems, Fuzzy Sets and Systems121 (2001), 275–283.