Abstract
For the Bayesian network (BN) structure learning, the key problem is to determine the relationship between the BN nodes. In this paper, the scheme of group decision making (GDM) based on the intuitionistic fuzzy set for the relationship determination between the BN nodes is proposed. Firstly, the alternative relationships between the BN nodes are analyzed. The relationship determination problem is transformed into the GDM problem. Furthermore, the specific GDM scheme is proposed to determine the relationship. Finally, the proposed scheme is applied to establish the model for the thickening process of gold hydrometallurgy. For the different conditions of group expert knowledge including the consistent and inconsistent information, the process of GDM is shown, and the aggregation results of different aggregation operators and the influence of hesitancy degree are analyzed. We can conclude that the expert who owns bigger membership degree and less hesitancy degree plays the most important role in the process of decision making.
Keywords
Introduction
Bayesian network (BN) is a powerful tool to represent the conditional probability relationships among the variables in the form of a directed acyclic graph, which has been used in the various fields, such as information fusion [24, 32], fault diagnosis [11, 26] and prediction [17, 21]. For the establishment of BN, two aspects need to be considered: parameter and structure. For the structure learning, the key problem is to determine the relationships among the variables. There are two ways to determine the relationships including expert knowledge methods [19, 26] and data-oriented methods [3, 6, 30]. The structure learning of BNs from data is an NP-hard problem [10], especially when the data are scarce and the related variables are huge in the problem domain. At the same time, the collected data are always imprecise, which are influenced by the noise interference and the precision of sensors. Therefore, when the researched domain includes available expert knowledge, it is an effective way to determine the relationship between the BN nodes using the expert knowledge. Especially in the real industrial environment, the expert knowledge is easy to be collected from the experts or operators. When integrating the expert knowledge to determine some relationships among the variables for the data-oriented methods, the search space of alternative structures is reduced greatly, and the best BN structure can be obtained as soon as possible. Therefore, the introduction of expert knowledge is beneficial for boosting the performance of structure learning methods.
Before using the expert knowledge, the first problem is how to express the expert knowledge in a suitable way. The traits of expert knowledge are imprecise and vague in nature. At the same time, the decision makers have limited ability to process a large amount of related information. Therefore, the evaluations on the relationships among the nodes are often uncertain and subjective. The experts may be unable to discriminate the causal relationship between the variables explicitly. In such cases, it is difficult to express the expert knowledge using the crisp numbers because of the inherent ambiguous, vague and subjective characteristics of human judgments. In order to solve the problem, the intuitionistic fuzzy set (IFS) theory proposed by Atanassov [2] is a useful tool to deal with vagueness, ambiguity and hesitation. Compared with the FS [31], except the membership function, the IFS is associated with the non-membership function and the hesitancy function. That is to say, in the FS, the sum of membership degree and non-membership degree is equal to one. However, in the IFS, the sum of membership degree, non-membership degree and hesitancy degree is equal to one. The hesitancy degree is introduced to represent the ignorance, which represents the lack of knowledge for the membership degree. The superiority of IFS has been proofed broadly in the aspects of representing and integrating the expert knowledge. In many aspects, such as evaluation, negotiation and decision making, the hesitancy degree plays an important role when the decision makers may not express their opinions on the alternative solutions accurately. The IFS has been widely applied in many fields involved in the decision making problems [5, 14, 23], pattern recognition [9, 18], and so on. When determining the relationship between the BN nodes, the objective is to determine the most suitable relationship among all the feasible alternative relationships. It can be regarded as a decision-making problem. To reduce the information bias from the single decision maker, in this paper, we consider the group experts to express opinions and make decisions. Different experts may hold different opinions on the same problem. Therefore, it is not only necessary to integrate the opinions of group experts but also to consider the integration problem of inconsistent information.
In this paper, first of all, by analyzing the alternative relationships between the BN nodes and collecting the expert knowledge in the form of intuitionistic fuzzy values (IFVs), the problem of relationship determination between the BN nodes is transformed into the group decision making (GDM) problem based on the IFS. Furthermore, the GDM scheme is proposed to determine the relationship between the BN nodes. Finally, the proposed scheme is applied to establish the model for the thickening process of gold hydrometallurgy. For the different conditions, the influences of different aggregation operators on the aggregation results and the role of hesitancy degree in the decision-making process are compared and analyzed. Two operators, the IFWA operator and the aggregation operator from the Dempster-Shafer (D-S) theory, are chosen to aggregate the opinions from the group experts respectively. The consistent and inconsistent information are analyzed respectively. The aggregation results are compared by changing the value of hesitancy degree in the IFVs. By analyzing the different aggregation results, the role of hesitancy degree is obtained in the process of decision making for the inconsistent information.
The novelty of this paper reflects three aspects. At first, this paper provides a new angle and scheme to determine the relationship between the BN nodes. The specific GDM scheme based on the IFS firstly is proposed to solve this problem. Furthermore, when collecting the expert knowledge in the form of IFVs, the subjective knowledge degree information is introduced to construct the expert knowledge base. This way is more reasonable to express the expert knowledge, which combines the subjective and objective factors. Finally, the proposed scheme is applied to establish the model for the thickening process of gold hydrometallurgy. By comparing the aggregation results of different conditions, the role of hesitancy degree is firstly obtained.
The remaining sections of this paper are organized as follows. The Section 2 discusses some related work. The Section 3 discusses some related concepts. In the Section 4, the problem of relationship determination between the BN nodes is analyzed, which is transformed into the GDM problem. The corresponding decision scheme is proposed. In the Section 5, the proposed scheme is applied to establish the BN structure for the thickening process of gold hydrometallurgy. Some conditions are analyzed to demonstrate the validity of proposed scheme for the consistent and inconsistent information aggregation problems. The aggregation results of different aggregation operators are shown and compared, and the role of hesitancy degree is discussed. Finally, the conclusions are presented in the Section 6.
Related work
Many research results [1, 7, 11, 20] have been proposed by integrating the expert knowledge into the BN structure learning process. In the paper [26], the BN structure is built based on the diagnostic criteria and the domain experts. In the paper [7], the proposed method needs to request the direct probabilistic relationships between the variables from the experts. In the paper [20], an interactive approach is proposed to integrate domain/expert knowledge at the different stages of learning BN structure. However, the above papers don’t explain that how to use the expert knowledge, which only show the final expression form of expert knowledge in the BN structure learning. Therefore, in this paper, we mainly analyze the specific process of using the expert knowledge when determining the relationship between the BN nodes and solve the related problems. The paper [25] proposes a methodology by transforming expert knowledge or final GDM statements into a set of qualitative statements and probability inequality constraints for inference in a BN. However, to the best of our knowledge, few researches [1, 7, 19, 20, 26] focus on the relationship determination problem between the BN nodes in the intuitionistic fuzzy environment. In addition, in the related researches of IFS, few results [5, 14, 23] discuss the role of hesitancy degree in the decision making process, especially for the inconsistent information aggregation. Therefore, the relationship determination problem between the BN nodes based on the IFS and the role of hesitancy degree in the decision-making process will be considered in this paper.
Preliminary
Bayesian network (BN) [22]
BN is a kind of effective method for the probabilistic representing and reasoning in the artificial intelligence. The form of BN is a directed acyclic graph. The nodes in the BN represent the variables; the arcs represent the direct causal relationships between the linked nodes. The nodes and the directed arcs constitute the BN structure. The conditional probability tables are assigned to the nodes to specify how strongly the linked nodes influence each other, which constitute the BN parameters.
Intuitionistic fuzzy set (IFS) [2]
An IFS
where
Another parameter of IFS is
Let
Let
The hesitancy degree of
It is obvious that
A mapping
For
The knowledge measure is related with the information provided by the experts [15], which represents how much information contains in the provided opinions. When the hesitation degrees of IFVs are the same, the bigger the membership degree of IFV is, and the bigger the knowledge measure is. When the membership degrees of IFVs are the same, the bigger the hesitation degree of IFV is, and the smaller the knowledge measure is.
Problem formulation
For the BN structure learning, the key problem is to determine the relationships among the variables. It is an effective way to determine the relationship using the expert knowledge. Especially when the data are scarce, and the related variables are huge in the researched domain, the expert knowledge can reduce the uncertainty of models. In the following part, we will analyze the relationship between the BN nodes.
After determining the related variables as the nodes of BN in the problem domain, the expert knowledge on the relationships between the BN nodes need to be collected. Taking the relationship between two nodes
where
In this section, for the proposed problem in the Section 4.1, the GDM scheme based on the IFS is shown in the following Algorithm. The steps of proposed GDM scheme are shown to determine the most appropriate relationship between the BN nodes.
Obtain the knowledge base from the group experts for each alternative relationship between the BN nodes in the intuitionistic fuzzy environment. The form is shown in the matrix Eq. (6). In the intuitionistic fuzzy environment, three elements need to be determined, membership degree Calculate the weight of each expert. In the decision-making process, it is an important problem that how to determine the weights of experts, which has high influence on the final decision results.
The determination of weight based on the knowledge measure is a typical objective method. Because the subjective and objective information are all included in the collected knowledge base, the determination of weight includes the subjective and objective information indirectly. Aggregate the information from the group experts to obtain the comprehensive evaluation on the alternative relationships between the BN nodes. In the intuitionistic fuzzy framework, a large number of aggregation operators have been proposed to aggregate the information, such as the IFWA, the intuitionistic fuzzy weighted geometric (IFWG), and so on. In addition, the aggregation operator from the D-S theory has attracted more and more attention [8, 12, 13, 28]. The choice of operators will influence the aggregation results of IFVs. In this step, to compare and analyze the aggregation results of different aggregation operators for the different conditions, we choose two operators, the IFWA operator and the aggregation operator from the D-S theory, to aggregate the opinions from the group experts respectively. The IFWA is one of the most common aggregation operators in the intuitionistic fuzzy environment, which is shown in Eq. (2). The aggregation operator from the D-S theory is shown in Eqs (3.4) and (4). Based on the research results in the papers [8, 28], when using the aggregation operator from the D-S theory, the IFVs need be handled by the discounting operation. In this paper, we use the weights of experts as the discount coefficients. The specific aggregation process can refer to the related research results in the papers [8, 28], which is omitted here. The aggregation results will be compared and analyzed in the simulation analysis section. Calculate the relative closeness coefficient of every alternative relationship. Based on the technique for order preference by similarity to ideal solution (TOPSIS) method [16], the distances from the alternative relationships to the ideal solutions should be calculated. The ideal solutions include the positive-ideal solution and negative-ideal solution, which are represented as
The relative closeness coefficient
where Rank all relative closeness coefficients and select the most suitable relationship between the BN nodes. The most suitable relationship between the BN nodes is the one which owns the highest value of all the relative closeness coefficients. The role of expert in the process of relationship determination between the BN nodes is shown in the Fig. 1. To solve the target problem, we need to analyze the process variables and extract the related variables as the BN nodes. The establishment of model structure is transformed into the relationship determination among the nodes. The group experts are invited to express their opinions on the relationship between two nodes until all the relationships among the nodes can be determined. When the experts express their opinions, it involves four problems: how to express the expert knowledge, how to determine the weight of each expert, how to aggregate the opinions of group experts and how to make a decision on the aggregation results. The proposed algorithm provides a scheme to solve the above problem.
The role of expert in the process of relationship determination between the BN nodes.

In this section, the proposed GDM scheme is applied to establish the model for the thickening process of gold hydrometallurgy. We will discuss the following two problems by the way of simulation analysis.
The first problem: in the decision-making process, the opinions from the group experts may be consistent or inconsistent. Therefore, how to combine the information of different conditions becomes a challenging problem in the decision-making process. In the following simulation analysis, we will carry out the proposed scheme in steps. At the same time, the aggregation results of two aggregation operators, the IFWA operator and the aggregation operator from the D-S theory, are shown and compared for the different conditions, which provide the basis for the choice of aggregation operators for the different conditions. The Examples 5.1–5.4 will discuss this problem.
The second problem: as far as we know, few researches discuss the role of hesitancy degree in the decision-making process for the inconsistent information. Therefore, in the following part, we will analyze the role of hesitancy degree by changing the value of hesitancy degree in the IFVs and observing the change of aggregation results. The Examples 5.5–5.6 will discuss this problem.
The thickening process of gold hydrometallurgy
The gold hydrometallurgical process consists of the following main sub-processes: flotation, concentration, leaching, washing and cementation. Before the cyanide leaching, the slurry needs to be concentrated to get the high solid. In this paper, we call this process as the thickening process which is a key process to guarantee efficiency of the following cyanide leaching. The simplified schematic diagram of thickening process is shown in the Fig. 2.
The simplified schematic diagram of thickening process.
In the thickening process, the main equipment includes thickener, pressure filter and buffer slots. The slurry pumps and the valves regulate the slurry rate among them. In this paper, we use the two common abnormities of thickening process as the research objects. The two abnormities are described as the following forms: (1) The underflow concentration of thickener is too high; (2) Buffer slot 1 under the thickener is empty. The specific description about the abnormities in the thickening process of gold hydrometallurgy can refer to the paper [19]. To make the safe control decisions to remove the abnormities, we will establish the BN model to analyze the causes and the corresponding removing measures of abnormities. The related variables include three types: the safe control decisions (
Obtain the knowledge base from the group experts for every alternative relationship between the BN nodes in the intuitionistic fuzzy environment. The matrix is in the following form.
The aggregation results for the relationship between the nodes
From the opinions of group experts, we can find that the four experts are all hold the higher membership degree on the relationship
Calculate the weight of every expert.
Aggregate the information from the group experts to obtain the comprehensive evaluation on the alternative relationships between the BN nodes.
The aggregation operator IFWA and the aggregation operator from the D-S theory are used to aggregate the information from the group experts respectively. The aggregation results are shown in the Table 1.
Calculate the relative closeness coefficient of every alternative relationship.
Based on Eqs (8) and (9), the relative closeness coefficients
Rank all relative closeness coefficients and select the most suitable relationship between the BN nodes.
By observing the opinions of four experts intuitively, we can infer that the aggregation result is
The obtained knowledge base matrix from the group experts for every alternative relationship between
From the opinions of group experts, we can find that the first expert holds the view
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for the relationship between the nodes
The aggregation results for the relationship between the nodes
and
The aggregation results for the relationship between the nodes
By observing the opinions of four experts intuitively, we can infer that the aggregation result is
From the obtained knowledge base matrix in the Example 5.2, we can find that no membership degree is equal to one and no non-membership degree is equal to zero. Therefore, the Examples 5.3 and 5.4 will consider the condition that the knowledge base matrix includes the special membership degree and non-membership degree.
The obtained knowledge base from the group experts for every alternative relationship between
From the opinions of group experts, we can find that the first expert holds the view
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for the relationship between the nodes
The aggregation results for the relationship between the nodes
By observing the opinions of group experts intuitively, we can infer that the aggregation result is
For the relationship between the nodes
In addition, we can also use another way to overcome this drawback of IFWA operator in some degree. The membership degree which is equal to one can be replaced by the membership degree which is close to one. For example, the opinion of first expert is replaced by not
The aggregation results for the relationship between the nodes
Based on the aggregation results of Examples 5.1–5.4, in the most conditions, two aggregation operators are all effective to make decision. But when the knowledge base matrix includes special membership degree or non-membership degree, the aggregation operator from the D-S theory can overcome some drawbacks of IFWA operator, which is the better choice to make decision than the IFWA aggregation operator.
Based on the aggregation results of Examples 5.1–5.4, the relationships among the nodes
To show the role of hesitancy degree in the decision-making process for the inconsistent information, in the following Examples 5.5 and 5.6, we will observe the change of aggregation results by changing the value of hesitancy degree in the IFVs.
The obtained knowledge base matrix from the group experts for every alternative relationship between
In
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for
The aggregation results for
The established BN structure by the proposed method for the thickening process of gold hydrometallurgy.
At first, to test the role of hesitancy degree, we increase the hesitancy degree of first expert for
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for
The aggregation results for
Furthermore, for
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for
The aggregation results for
Comparing the aggregation results of
Based on the aggregation results of Example 5.5, we can conclude that for the aggregation of inconsistent information, the aggregation results change as the change of hesitancy degrees. The hesitancy degree plays the important role in the decision-making process. The expert who owns bigger membership degree and less hesitancy degree plays more important role in the aggregation results.
In the Example 5.5, two of three experts own the consistent opinions. In the following example, we will consider the extreme condition that no one expert holds the same opinions, that is to say, the opinions of group experts are conflict.
The obtained knowledge base matrix from the group experts for every alternative relationship between
In
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for
The aggregation results for
At first, to test the role of hesitancy degree, we increase the hesitancy degree of second expert for
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for
Comparing the aggregation results of
The aggregation results based on the aggregation operator IFWA and the aggregation operator from the D-S theory for
Comparing the aggregation results of
The aggregation results for
The aggregation results for
By the above aggregation results, we can find that for the aggregation of conflict information, when the matrix is symmetrical, and the knowledge measures of group experts are the same, that is to say, when the group opinions are inconsistent entirely, the aggregation results cannot be obtained. However, the aggregation result changes as the change of hesitancy degree, which tends to the opinion of expert who owns the less hesitancy degree. Therefore, based on the simulation analysis in the Examples 5.2–5.6, we can conclude that the expert who owns bigger membership degree and less hesitancy degree plays the most important role in the aggregation of inconsistent information.
In this paper, the relationship determination problem between the BN nodes is transformed into the GDM problem under the intuitionistic fuzzy environment. The scheme of GDM based on the IFS is proposed. The expert knowledge about the relationships between the nodes is collected in the form of IFVs. When collecting the expert knowledge, the subjective and the objective information are integrated. For the consistent and inconsistent information, the IFWA operator and the aggregation operator from the D-S theory are applied to aggregate the opinions from the group experts respectively. The proposed scheme is applied to solve the practical problem for the thickening process of gold hydrometallurgy. The simulation results imply that when the knowledge base matrix includes the special membership degree or non-membership degree, the aggregation operator from the D-S theory can overcome some drawbacks of IFWA operator, which is the better choice to make decision. Furthermore, the role of hesitancy degree is analyzed by changing the value of hesitancy degree. We can conclude that the expert who owns bigger membership degree and less hesitancy degree plays the most important role in the aggregation results.
Footnotes
Acknowledgments
This work was supported by the National Nature Science Foundation of China [grant numbers 61533007; 61873049], the National Key Research and Development Program of China [grant numbers 2017YFB0304205].
