Abstract
With the changing business environment and the active participation of various stakeholders in the decision making process, it plays an increasingly important role to the weight of decision makers and the preference information given by decision makers. This paper presents a novel approach for group decision making under uncertainty with the involvement of the third-party evaluator in the decision making process. Recognizing the challenge in adequately determining the weight of decision makers in group decision making, the evidence theory is appropriately used with the involvement of the third-party evaluator. To effectively model the uncertainty and imprecision in the decision making process, fuzzy preference relations are used for better representing the subjective assessment of individual decision makers. To adequately determine the ranking of available alternatives, the logarithmic least square method is applied for appropriately aggregating the fuzzy preference relation of individual decision makers. A group consensus index is developed for facilitating consensus building in group decision making. This leads to better group decisions being made. A real-world application is presented that shows the proposed approach is effective in solving group decision making problems under uncertainty.
Introduction
Group decision making (GDM) is about selecting the best alternative from available alternatives in the presence of several decision makers [1–3]. It is becoming increasingly important due to the changing business environment and the active participation of various stakeholders in the decision making process. GDM usually consists of two phases including (a) the consensus process and (b) the selection process [4–8]. The consensus process is about the pursuit of the maximum degree of agreement between decision makers. The selection process is related to a comprehensive assessment of the overall performance of available alternatives with respect to the preference of individual decision makers. Effective GDM requires the development of appropriate approaches for selecting the best alternative from available alternatives through adequate consensus building with respect to the preference of individual decision makers [9].
Much researches have been done, and numerous consensus models have been developed for facilitating consensus building in solving the GDM problem [10–13]. Overall these models can be grouped into four groups in solving the GDM problem. The first group focuses on the representation of the preference of individual decision makers in consensus building [14–17]. The second group concentrates on the use of the minimum adjustment for achieving a group agreement [18–20]. The third group is related to the adoption of the individual consistency measure and the group consensus measure in consensus building [21, 22]. The fourth group considers the attitude of individual decision makers in consensus building [23, 24]. Such models have demonstrated their applicability in solving various GDM problems under different circumstances. These models, however, have not adequately incorporated the relative importance of individual decision makers represented by their respective weights in consensus building for GDM although such weights have a significant impact on the GDM outcome [23, 25].
Numerous approaches have been developed for determining the weights of decision makers in GDM including the subjective approach and the objective approach. The subjective approach focuses on an appropriate consideration of the decision maker’s preference in the decision making process. The adoption of such an approach allows decision makers to express their preferences in a specific manner. Such preferences are then aggregated for determining the weights of decision makers in a given situation. Saaty [26], for example, develops a pairwise comparison based approach for determining the weights of decision makers. Ramanathan and Ganesh [27] propose a subjective approach for better determining the weights of decision makers in GDM. Such approaches are useful in considering the subjective opinions of the decision maker. They are, however, often criticized for the presence of inconsistent subjective assessments and the challenging nature of the GDM process when there are many decision makers present.
The objective approach concentrates on the utilization of mathematical theories for determining the weights of decision makers. Yue [28] develops an objective approach based on the concept of ideal solutions for determining the weights of decision makers. Yue [29] proposes an approach for ranking the decision makers in determining the weights of decision makers. Wang et al. [30] construct a mathematical programming model for obtaining the weights of decision makers by minimizing the square logarithm compatibility in GDM. Tao et al. [31] provide a Shapley value based approach for assessing the weights of decision makers in GDM. Dong et al. [24] present a self-management mechanism for determining the weights of decision makers in a dynamical manner in GDM. Such approaches have demonstrated their respective merits in various GDM situations. They are, however, often questioned by the inconsistent weights obtained and the computational effort required.
There are attempts to combine the subjective approach and the objective approach together for better determining the weights of decision makers in GDM. Song and Zou [32], for example, introduce an approach for determining the weights of decision makers based on a convex combination of the subjective weight and the objective weight. Jabeur et al. [33] propose a hybrid approach for assessing the weights of decision makers with the adoption of a distance measure. Xu and Cai [34] develop an approach for deriving the weights of decision makers based on the interval multiplicative preference relation. Efe [35] proposes an integrated approach for deriving the weights of decision makers. Such approaches try to determine the weights of decision makers indirectly based on decision makers’ preferences about alternatives. They are often criticized due to their capacity in adequately handling the uncertainty and imprecision in the GDM process.
More and more decision makers express their opinions over alternatives by using fuzzy preference relations under the condition of the uncertainty and fuzziness of human thinking [36, 37]. In some situations, the decision makers may only provide incomplete preference relations due to the diversity of reasons, such as the lack of knowledge or data, time pressure, and their limited expertise related to the problem domain. Recently, many useful decision making methods have been developed to deal with group decision making (GDM) problems within incomplete fuzzy preference relation [38–40]. For example, Xu [39] presented a logarithmic least squares method (LLSM) to priority for group decision making with incomplete fuzzy preference relations. These existing methods have made significant contributions to the GDM problems with incomplete fuzzy preference relations.
All the existing studies have made considerable progress on GDM studies. However, there are still some research gaps:
First, the reliability of the preference of the decision maker with respect to the available alternatives in assessing their relative importance in GDM is often questioned due to various backgrounds of the decision makers. Existing method [23] takes the weight vectors of decision makers into consideration, but it is not reasonable for equal weights assumed when weights are not given. Very often, the involvement of the third-party evaluator to assess the knowledge, skills, and experience of the decision makers for determining their relative importance in the GDM process is critical.
Second, in the process of preference elicitation, decision makers may provide uncertain preference information even preference relations with some values unknown instead of crisp preference information due to the lack of knowledge. Therefore, it is also necessary to take incomplete preference information into account in GDM problems. Existing methods have made significant contributions to the GDM problems with incomplete fuzzy preference relations. However, they rarely analyze the individual consistency and the group consensus at the same time.
Finally, the weight vectors of decision makers usually play an important role in GDM. However, current researches do not take the weights of decision makers into consideration for the measurement of group consensus degree.
To fill the gap mentioned above, a novel approach for GDM is presented with incomplete fuzzy preference relations, which not only takes the decision makers’ weights into consideration but also manages the individual consistency and the group consensus simultaneously. In order to do so, evidence theory is extensively used [41,42, 41,42] to identify the weights of decision makers due to the belief structure which can express the uncertainty involving fuzzy and probability simultaneously. To adequately determine the ranking of available alternatives, the logarithmic least square method is applied for appropriately aggregating the incomplete fuzzy preference relation better representing the subjective assessment of individual decision makers. The consistency check is also conducted. A group consensus index considering the weight vectors of decision makers is developed for facilitating consensus building in group decision making. This leads to better group decisions being made. A real-world application is given to show the applicability of the proposed approach in solving GDM problems under uncertainty.
The rest of this paper is organized as follows. Section 2 presents a brief introduction to the evidence theory and fuzzy preference relations. Section 3 presents a novel approach for GDM under uncertainty. Afterwards, an example of a scientific foundation project selection and comparative discussion are given for illustrating the applicability and effectiveness of the proposed approach in Section 4. Finally, conclusion is presented in Section 5.
Preliminaries
In this section we briefly review some basic concepts of the belief structure and the Dempster’s rule of combination of the evidence theory and fuzzy preference relations.
The evidence theory provides a powerful tool for decision making through the representation and integration of uncertain information [43, 44]. With the use of this theory, the belief structure which can be used to better represent the subjective assessment on the decision maker provided by the third-party evaluator can be defined as follows.
When there are more than two evidences, a combination rule is adopted for fusing them. Considering two evidences indicated by m1 and m2 and these belief structures are mutually independent, the Dempster’s rule of combination can be used, denoted by m(A) =m1(I) ⊕ m2(J) (I∩J = A, where I, J ⊂ Θ) as follows
Decision makers express their opinions over alternatives by using fuzzy preference relations under uncertainty [37]. A fuzzy preference relation can usually be represented as follows.
A fuzzy preference relation R on X can be conveniently expressed by an n×n matrix R = (r ij ) n ×n, where rij =μ R (X i , X j ) (i, j = 1, 2, ... , n) is interpreted as the preference degree or intensity of the alternative X i over X j . When r ij = 0.5, it indicates indifference between X i and X j (X i ∼X j ); r ij > 0.5 indicates that X i is preferred to X j (Xi > X j ); rij = 1, denotes that X i is definitely preferred to X j . In general, R = (r ij ) n ×n satisfies the additive reciprocity property, namely, r ij +rji = 1 and rii = 0.5 for all i, j = 1, 2,..., n.
In complex GDM problems, the preference relations provided by DMs may be irrational and may result in inconsistent conclusions [46]. The consistency in fuzzy preference relations given by decision makers has a direct influence on the final ranking results [39]. Considering that the values in the fuzzy preference relations based on additive consistency may not be in the fixed scope. For example, if we let r12 = 0.8 and r23 = 0.8, it is unreasonable for r13 = r12 + r23–0.5 = 1.1 > 1. The multiplicative consistency on fuzzy preference relations is of considerable importance in GDM [47, 48]. It avoids the drawback of additive consistency and has no transformation which can keep more original information.
In real situations, decision makers may only provide incomplete preference relations. Such incomplete preferences can usually be defined as follows.
In a group decision situation, there are m (m≥2) decision makers and n (n≥2) alternatives denoted by D = {D1, D2, ... , D
m
} and X = {X1, X2, ... , X
n
}, respectively. A third-party evaluator is invited to determine the weights of decision makers with respect to the criteria C = {C1, C2, ... , C
t
} (t≥2). The criteria’s weight vector can be expressed by η= {η1, ... , η
γ
, ... , η
t
}, determined by the decision maker based on the research background in advance, where η
γ
satisfying η
γ
>0 (γ= 1, 2, ... , t) and
The evaluation of the decision maker provided by the third-party evaluator is the prerequisite in determining the weights of decision makers. To facilitate the making of the subjective assessment in the evaluations of decision makers by the third-party in GDM, linguistic terms [50] shown as in Table 1 can be used.
Linguistic terms for evaluation
Linguistic terms for evaluation
To facilitate the computation process in GDM, each linguistic term (s g ) is approximated by its corresponding utility value defined as in Table 2.
Utility values for linguistic terms
In an uncertain environment, a piece of evidences provided by the third-party evaluator can be represented as the belief structure
Decision makers’ evaluations provided by the third-party evaluator under different criteria
In order to rank the alternatives X = {X1, X2, ... , X
n
}, these m decision makers provide their preference information of the pros and cons of the two alternatives, which can be represented by the following fuzzy preference relation
With the formulation of the GDM problem as above, a novel approach can be developed for effectively solving such a problem, detailed as follows.
Phase I: The selection process
The belief structure can directly express the uncertainty involving fuzzy and probabilistic information simultaneously, and also shows how strongly the evidence supports the linguistic term. With the use of the belief structure
On the basis of Equation (3), the weighted average belief structure of s
g
under each criterion for D
k
can be identified as follows:
Based on Equation (4), the D
k
’s final belief structure can be obtained by
As a consequence, the overall aggregated belief structure for each decision maker can be obtained as in Table 4.
The final aggregated belief structure for each decision maker
The utility value of each decision maker reflects the credibility of the opinions expressed by each decision maker in GDM problem. The larger the utility value of each decision maker, the higher the credibility of their provided opinions. With the determination of each decision maker’s integrated belief structure in Table 4 and the utility value u (s
g
) of each linguistic term s
g
in Table 2, the utility value of each decision maker can be determined as follow.
The weight p
k
of D
k
(k = 1, 2, ... , m) can be determined by normalizing the results in Equation (6) as follows:
Based on the above analyses, the following algorithm is offered.
In order to obtain the overall ranking of alternatives, the corresponding ranking of alternatives for D
k
(k = 1, 2, ... , m) should be assessed by combining with the given fuzzy preference relations after determining the D
k
’s weight in Equation (7). Based on the logarithmic least square method [39] and fuzzy preference relation
For D
k
, the weights of alternatives can be expressed by the vector
In real situation, it is often difficult if not impossible for decision makers to give consistent assessments in assessing their preference of individual alternatives in GMD. To ensure that the GDM outcome can be accepted by all the decision makers, it is necessary to verify the reliability of the rankings based on the multiplicative consistency. On the basis of the consistency check [39], the measurement of consistency of the pairwise comparison matrix, namely fuzzy preference relation, provided by D k can be calculated as follows:
The fuzzy consistency ratio (FCR) is obtained by comparing the fuzzy consistency index (FCI) with the RI, where RI (random index) is the mean consistency index shown in Table 5 [52].
The mean consistency index of randomly generated matrices
FCR(k) < 0.1 shows that the fuzzy preference relation R is at the acceptable consistency. If an inconsistent fuzzy preference relation R is present, the decision maker is required to restructure a new matrix according to their new judgments until the fuzzy preference relation R achieves at a satisfactory consistency.
Based on the D
k
’s weight p
k
and its corresponding alternatives’ weights vector
According to the calculated final integration weight
From the above analyses, the algorithm 2 is introduced as follows.
Phase II: The consensus process
Achieving a high level of consensus is essential in GDM. Classically, consensus is about the full and unanimous agreement among all the decision makers on all the possible alternatives [53]. It is necessary for measuring the consensus degree according to fuzzy preference relations of decision makers. In this study, a new consensus index is defined by taking the weights of the decision makers into consideration. This leads to the development of a group consensus degree (GCD) for measuring the similarity between individual values and collective values.
The GCD value is normalized between [0, 1]. The larger GCD value shows the higher consensus degree among all decision makers. If GCD = 1, that means a full and unanimous agreement of all decision makers.
When the GCD value reaches the consensus level threshold τ which can be determined in advance, the decision making process is completed, and the ranking outcome can be determined. Otherwise, decision makers need to adjust their preference relations and recalculate related parameters until GCD≥τ. This is called the feedback adjustment which aims to give adjustment suggestions for assisting decision makers to improve the consensus. Similar to [5], the adjustment rules can be listed as follows:
There is not a uniform method [54] to choose the threshold value τ in GDM. When the decision is of much importance, the threshold for the consensus level should logically be as large as possible. Particularly, when the preference relations are almost incomplete, a relatively small threshold could be applied.
From the above analyses, the algorithm 3 is introduced as follows.
To sum up, the detail framework of the novel approach can be drawn as Fig. 1.

The detail framework of the novel approach.
Case illustration
In this section, an application of the developed approach is illustrated by an example of scientific foundation project selection. Such a scientific foundation project evaluation is usually completed by the cooperation of several evaluation experts by comprehensively incorporating their evaluation opinions. The evaluations of different experts, however, is often inconsistent. In general, the results of the expert review are usually influenced by the individual characteristics of the expert review and the review process [55, 56]. This shows that the assessment should be conducted by considering the differences among evaluation experts rather than using the average value only.
This section considers a GDM situation of selecting scientific foundation projects involved four evaluation experts reviewed by the academic committee. In order to determine the weights of four evaluation experts, the academic committee estimates four evaluation experts D1, D2, D3 and D4 under three evaluation indicators including C1: review performance, C2: science credibility and C3: review ability which constitute three indispensable parts of the evaluation expert selection indicator system [57]. The indicators’ weights are assumed to be η= {0.4, 0.25, 0.35} defined by the academic committee based on different industry backgrounds. The academic committee gives his evaluations of each evaluation expert with respect to each indicator shown as in Table 6.
Evaluations of the academic committee with respect to each indicator
Evaluations of the academic committee with respect to each indicator
The four evaluation experts D1, D2, D3 and D4 provide their personal preference relations on four projects X1, X2, X3 and X4. The four preference relations are denoted by R(1), R(2), R(3) and R(4) shown as:
Phase I: The selection process
The weight of each indicator is shown as follows:
According to Equations (3)–(5), the final aggregated evaluation for D1 can be obtained, namely.
The values of
The final aggregated belief structure for each evaluation expert
Similarly, other utility values can be calculated as u2 = 0.5274, u3 = 0.7277, u4 = 0.5217.
This leads to the normalized weights of evaluation experts calculated respectively as follows:
p1 = 0.2218, p2 = 0.2310, p3 = 0.3187, p4 = 0.2285.
The projects’ weights of D1 can be determined by Equation (11) as
The consistency index of D1 is calculated by Equation (12) as
Matrix R(1) is an acceptable consistent preference relation because FCR(1) = 0.0006 < 0.1. Similarly, the projects’ weights with respect to D2, D3 and D4 are determined as:
A consistency check is conducted for D2, D3 and D4. Similarly, the consistency index of D2, D3 and D4 can be calculated as follows:
The matrices R(3) and R(4) are acceptable consistent preference relations because FCR(3) and FCR(4) are less than 0.1. However, the matrix R(2) is not acceptable due to FCR(2) = 0.1949 > 0.1. This matrix is returned to the D2 to reconsider. A new matrix is developed as follows (where r14 = 0.4 → 0.6, r41 = 0.6 → 0.4):
In the similar manner,
The temporal overall ranking of the four projects can then be obtained as follows:
The final project approved is project X3.
Phase II: The consensus process
Based on Equation (14), the group consensus degree (GCD) in this situation can be calculated as follows:
To further demonstrate the effectiveness of the proposed approach in solving GDM problems under uncertainty, a comparative analysis between the proposed approach and the logarithmic least squares approach [39] is conducted. The differences between these two approaches is whether the weights of decision makers are considered and whether the group consensus is reached.
With the use of the logarithmic least squares approach [39], the overall ranking of the four projects can be determined in the following. On the basis of the given preference relations R(1), R(2), R(3), R(4) and Equations (28) and (30) in [39], the following can be determined as (where n = 4):
The consistency index of D1, D2, D3 and D4 are determined respectively by Equation (51) in [39],
The results of the comparative analysis
The results of the comparative analysis
In order to further illustrate the important role of decision makers’ weights in group decision making. Refers to the literature [23], it is assumed that all decision makers are of equal importance as the weight vectors of the decision makers are not given. Here, five different weight assignments (the sum is 1) are randomly given, and then the change trend of alternative ranking results and group consensus degree is observed. The detailed results are shown in Table 9.
The adjusted ranking and GCD value with different p k
It can be seen from the Table 9 that when the weights of decision makers change in group decision making, the total ranking results of alternatives and the level of group consensus will change accordingly. From the fifth random weight in Table 9, it can be found that the ranking result is consistent with the result in reference [39], but the consensus degree is reduced to less than 90%, which proves the significance of the proposed method to calculate the consensus degree considering the weights of decision makers. It can be found that the weights of decision makers have a certain influence on the decision making results, which demonstrates that it is necessary to consider the weights of decision makers in selection and consensus reaching processes.
Based on the above comparative analysis, the advantages of the proposed approach can be summarized as follows: In order to get a precise superiority index for each alternative, it is necessary to determine the decision makers’ weights. In this study, it has considerable practical value for us to use evidence theory to identify the weights of decision makers due to the belief structure which can express the uncertainty involving fuzzy and probability simultaneously. The process to the uncertainty problem is more in accordance with people’s way of thinking which bring a new insight to carry out specific process in identifying decision makers’ weights. The proposed approach can be used under the condition where the preference information is partially unknown. It is closer to the actual situation to consider incomplete fuzzy preference relations owing to the lack of information grasped by decision makers. The proposed method takes the weights of decision makers into consideration for the measurement of group consensus degree. It is also worth mentioning that the proposed method not only verifies the group consensus degree among all decision makers, also conducts the consistency check. Such mechanisms are essential for obtaining a more reasonable and accurate GDM outcomes. It is worth pointing out that this method can cope with more situations and are more reasonable than some existing methods.
This paper presents a novel approach for GDM with fuzzy preference relations based on the evidence theory and the logarithmic least squares approach. Such an approach is capable of adequately considering the weights of decision makers while appropriately handling the uncertainty and imprecision in an effective manner. Such a way of identifying decision makers’ weights is more in accordance with the decision maker’s way of thinking. Furthermore, the proposed approach can be used under the condition in which the preference information is partially unknown. It is closer to the actual GDM situation in which both complete and incomplete fuzzy preference relations are often present. In addition, a consensus index is developed for facilitate the consensus building in GDM under uncertainty. More importantly it can be used to facilitate the interaction between the decision maker and the decision making process so that the final group decision can be better accepted. An example is given for illustrating the applicability of the proposed approach in solving similar GDM problems in real world. A comparative study shows that the proposed approach is favorable in solving real world GDM problems due to various advantages that it has over comparable approach.
However, there are still some limitations which need to be further studied:
With the development of information technology, more and more people participate in GDM problems, which makes large-scale group decision making (LSGDM) problems become a research hotspot [58, 59]. In addition, in the actual decision making process, decision makers are often bounded rational. Self-confidence, as one of the human psychological behaviors, has an important impact on decision making [60]. Thus, in future work, we will address to extend the study to LSGDM problems and discuss the influence of decision makers’ self-confidence levels on decision making.
Footnotes
Acknowledgments
This research was supported by the National Natural Science Foundation of China (Nos.71971218, 71671188); Talent introduction project of Anhui Science and Technology University (No. GLYJ201902).
