Abstract
From the perspective of multiple attribute decision analysis, the evaluation of decision alternatives should be based on the performance scores determined with respect to more than one attribute. Fuzzy logic concepts can equip the evaluation process with different scales of linguistic terms to let the decision-makers point out their ideas and preferences. A more recent one of fuzzy sets is the picture fuzzy set which covers three separately allocable elements: positive, neutral, and negative membership degrees. The novel and distinctive element included by a picture fuzzy set is the refusal degree which is equal to the difference between 1 and the sum of the other three. In this study, we aim to contribute to the literature of the picture fuzzy sets by (i) proposing two novel entropy measures that can be used in objective attribute weighting and (ii) developing a novel picture fuzzy version of CODAS (COmbinative Distance-based ASsessment) method which is empowered with entropy-based attribute weighting. The applicability of the method is shown in a green supplier selection problem. To clarify the differences of the proposed method, a comparative analysis is provided by considering traditional CODAS, spherical fuzzy CODAS, and spherical fuzzy TOPSIS with different entropy-based scenarios.
Keywords
Introduction
Many Multiple Attribute Decision Making (MADM) problems do not involve appropriate data which are directly measurable such as cost, net profit, any financial ratio, volume or weight of an item, etc. To deal with the quantification problems, the decision-makers can benefit from linguistic terms in stating their thoughts and preferences regarding the problem. Linguistic terms are often defined in different fuzzy environments. Zadeh (1965) launched the domain of fuzzy sets for symbolizing human judgments. In conventional fuzzy set definition, the opinions can be represented by a single membership degree (μ) which ranges between 0 and 1. This membership degree measures the optimism or agreement level and possesses a positive perspective.
To smooth the representation challenge of the uncertainty in human judgments, fuzzy set domain has been extended by researchers from different fields. Atanassov (1986) introduced the intuitionistic fuzzy sets (IFS) by defining a negative membership (or non-membership) degree (v). This new element in the fuzzy set definition brings resilience to the uncertainty representation issue because the experts are able to specify their pessimistic views or disagreements in this way. Hence, non-membership degree points out a negative perspective. Atanassov (1986) also defined a new element regarding the indeterminacy (or hesitancy) which shows the experts’ neutral preference:
After the introduction of the horizon widening features of fuzzy sets and IFSs, new fuzzy concepts have been proposed in the literature. Pythagorean fuzzy sets (Yager, 2013), q-Rung orthopair fuzzy sets (Yager, 2017), and Fermatean fuzzy sets (Senapati and Yager, 2020) have extended the representation domain of the expert by just considering the independently assignable positive and negative membership degrees. The independently assignable hesitancy degree is considered in neutrosophic sets (Smarandache, 1999) and spherical fuzzy sets (Kutlu Gündoğdu and Kahraman, 2019a). Many researchers work on developing aggregation operators, information measures such as entropy, distance, inclusion (subsethood), and knowledge measures for easing the uncertainty handling issue in decision-making problems.
The most recent fuzzy set concept considering all the three independently assignable membership degrees was presented by Cuong and Kreinovich (2013). This novel concept is called picture fuzzy sets (PFS) as a logical reasoning of fuzzy sets and IFSs. A PFS is characterized by three independently assignable degrees expressing the positive (μ), the neutral (η – which means hesitancy), and the negative (v – which is an equivalent to non-membership) membership degrees. The sole constraint defined in PFS enforces that their sum must not exceed 1. The gap between their sum and 1 is called refusal degree. The expert’s choice of refusing the idea sharing is quantified in PFS by this novel element. The refusal degree is here defined as
PFS exhibits its importance in voting environments. Cuong (2014) clarifies the items in PFS for the voting case. The voters can be divided into four groups: vote for the candidate, abstain, vote against the candidate, and refusal of the voting, i.e. casting a veto. It is obvious that PFS has a broader representation power than previous extensions of fuzzy sets since it involves a fourth component called refusal degree. PFS is the only fuzzy set definition handling this issue. Son (2016) introduced an example showing the importance of PFS for MADM. The personnel selection activity needs information about the candidates for understanding whether they are eligible for the job or not. The result of this selection could be one of the 4 classes: true positive, true negative, false negative, and false positive which can be accepted as the equivalents to the membership degrees of PFS. Each candidate is evaluated by considering 4 classes. The selection is based on these evaluations. Assume that two candidates are evaluated: A took (50%, 20%, 20%, 10%) and B took (40%, 10%, 30%, 20%). The most appropriate candidate can be selected by applying the score function defined for PFS. As given in Definition 3, score value of A is
Most of the business and management issues are MADM problems because the companies, institutions, even societies, and governments are enforced to take a lot of features of the decisions they should take into account. The problem definition of any MADM problem involves the determination of three basic elements: the attributes which can possess a potential impact on the results, the decision-makers who will be consulted due to their expertise, and the alternatives that are the potential solutions.
In MADM understanding, each alternative is evaluated by the decision-makers with respect to attributes, and the very first issue that should be addressed in decision analysis emerges after this data collection activity: how will we process these data to obtain the overall performance of each alternative? The motivation behind this question is that the decision analyst has many methodologies that can be used in reflecting the importance of the attributes to the decision. Each attribute has its own mean with discrete and changing significance for the problem at hand.
The requirement explained above is also called attribute weighting and it can be handled via applying one of two basic methods or a mixture of them: (1) subjective methods such as AHP-Analytic Hierarchy Process, SWARA-Stepwise Weight Assessment Ratio Analysis and Simos’ procedure are based on the experts’ evaluations; (2) objective methods do not demand these individualistic preferences and thoughts. In calculating the attribute weights, they just examine the performances of the alternatives with the aim of removing or at least limiting the risk of manipulative preferential actions of decision-makers or too long data collection periods. Particularly, in auditing the companies in terms of the quality assurance performance of their business processes, occupational health issues, and their financial strength, the subjectivity in attribute weighting may be misleading. Therefore, objective attribute weighting tools can be used to handle these issues.
Entropy measure which is based on the performance scores can support the objective attribute weighting effort. In this study, two new entropy measures are developed for PFSs and their applicability in MADM is manifested in integration to a novel extension of CODAS (COmbinative Distance-based ASsessment) method under picture fuzzy environment. The main contributions of the study are listed as follows:
Two novel entropy measures for PFSs are proposed as a contribution to the literature of PFS and their validity is demonstrated via comparisons with previously developed entropy measures.
CODAS method which is established by Keshavarz-Ghorabaee et al. (2016) is modified with the operational rules of PFSs for allowing the MADM process to handle the picture fuzzy type data. This is the first attempt at this topic. The attribute weights are calculated in this version via a methodology that is based on newly defined entropy measures, but it is applicable with subjective attribute weights.
There are 7 sections in the study. After this first section regarding the introduction, Section 2 covers the preliminaries of PFS and the results of an extensive literature review on the recent fuzzy extension of CODAS. Novel entropy measures for PFS are demonstrated and proved in Section 3. Section 4 presents the novel picture fuzzy extension of CODAS (PF-CODAS) and the integration of entropy measures into the model. In section 5, the newly proposed PF-CODAS version with entropy-based objective weighting is implemented in an example that was previously studied by Meksavang et al. (2019). The results of various implementations are compared in order to show the validity of the novel entropy-based PF-CODAS approach in Section 6. Section 7 concludes the study with some remarks and the future research possibilities are also mentioned.
First, the PFS concept is introduced and the defined operations on PFS are specified in this section. Then, CODAS is introduced, and the results of a comprehensive literature overview on CODAS are summarized in order to understand and clarify the state-of-the-art. We limit our research on CODAS here in order not to distort the flow of the paper.
Picture Fuzzy Sets
PFS theory is introduced by Cuong and Kreinovich (2013) as a generalization and synthesis of Zadeh’s fuzzy set theory and Atanassov’s intuitionistic fuzzy set theory. A PFS has three independently assignable informative elements, i.e. the degree of positive membership (μ), the degree of neutral membership (η), the degree of negative membership (ν). Due to the definition’s sole limitation forcing that their sum should be smaller than or equal to 1, the remaining part is presented as a novelty and a distinctive feature of PFS, which is called the degree of refusal membership (π). These four elements comprise the potential vote types such as yes, no, abstain, and refuse.
Let X be a universal set. Then a PFS A on X is defined as follows:
Cuong (2014) defined the subsethood, equality, union, intersection, and complement for every two PFSs A and B as follow:
Let
Let If If
Let
The distance, similarity, and subsethood measures are important tools to compare two fuzzy sets. Therefore, many researchers studied the concept of these measures for PFSs.
Let
Euclidean (
Wang et al. (2018) introduced the definition of entropy for PFSs in the following. Let
For any
Let
PF entropy measure
The following entropy measures
Keshavarz-Ghorabaee et al. (2016) developed CODAS method as a novel MADM tool in order to support decision-analysts in their efforts of analysing the alternatives which are evaluated with respect to the appropriate attributes in the decision problem at hand. The distinctive feature of the method is the simultaneous consideration of two well-known distance measures. The performance of an alternative is evaluated by the Euclidean and Taxicab distances from the negative-ideal point. The CODAS utilizes the Euclidean distance as the primary measure for assessing the alternatives. When the Euclidean distances of two alternatives to the negative-ideal point are very close to each other, the Taxicab distance is also considered in comparing them. The degree of closeness of Euclidean distances is set by a threshold parameter. The CODAS algorithm is as follows:
Linear normalization is conducted to standardize the decision matrix. If attribute j is a cost type attribute,
In order to consider the importance of attributes, the normalized values are multiplied by the weights:
As a comparison measure, CODAS uses the distances to the negative-ideal point. This is derived from
Euclidean and Taxicab distances of each alternative i to
The square relative assessment matrix
The assessment score of alternative i is calculated via
The alternatives are ranked in ascending order of their
When we search for fuzzy extensions of CODAS in the SCOPUS platform, it is seen that 32 studies have appeared since 2017. Table A1 in Appendix A summarizes the findings on the state-of-the-art of fuzzy versions of CODAS. In the second column of the table, the fuzzy set concepts used in studies are given. The most utilized version is intuitionistic fuzzy sets with 11 publications. 2-tuple, Pythagorean, spherical, neutrosophic, hesitant, and linguistic term-based fuzzy versions are the other concepts used. From this finding, it is understood that any picture fuzzy version of CODAS has not been developed yet. Even though spherical and neutrosophic versions handle the hesitancy representation issue in CODAS, both hesitancy and refusal degree representation power of PFS has not already been considered. The current study aims at filling this gap.
While the third column shows the hybridized MADM methods for different purposes, the fourth column shows the application fields of the studies. The versions of AHP (Analytic Hierarchy Process) are usually employed for subjectively weighting of the attributes. Another important finding is that no study applies for the option of objective weighting of the attributes. To show the applicability of objective weighting methods with CODAS, entropy-based weighting is proposed and used in the study. First, two entropy measures developed in Section 3 are respectively integrated into the modified CODAS version for PFS. Then, some entropy measures given in Section 2.1 and the knowledge measure given in Definition 7 are comparatively exploited for monitoring the differences or the similarities among them. Also, some MADM methods in the literature are used for comparison of the results to show the validity of the propositions.
In this section, we propose two new entropy measures for PFSs. Let
The function
To prove that Eq. (53) is an entropy measure for PFSs, we show that it satisfies the axioms shown in Definition 8. Suppose that A is a crisp set. This refers either
or or or If If Due to the definition of the complement of A, it is clear that For any two PFSs A and B, if For any
If we have either
The function
To prove Eq. (54) is an entropy measure for PFSs, we show that it satisfies the axioms in Definition 6. □
□
The study has extended CODAS method into the picture fuzzy environment as a contribution to the literature. In this novel proposition, PFNs provide a better opportunity of independency to the decision-makers since it is allowed to express independent degrees for positive, negative, and hesitant preferences. The refusal degrees can also be calculated as the fourth element in PFS. Especially, the consideration of the refusal degree in decision analysis is scarce in the literature of MADM. Moreover, entropy-based objective weighting process is joint to the method in case that the initial problem definition does not have the attribute weights. The algorithm is given as follows:
Step 1. Decision-makers
Linguistic terms for expert evaluations (Meksavang et al., 2019).
Linguistic terms for expert evaluations (Meksavang et al., 2019).
After gathering evaluations from decision-makers, there will be k decision matrices
Step 2. The attribute considered in any decision problem can be a cost or a benefit type attribute. To convert cost attributes to benefit ones, the positive (
Step 3. After normalization, the weights of attributes representing their importance and significance should be considered. 4 possibilities might be thought of in weighting: If the weights are already known as prior information, we can directly use them; If the decision-makers’ preferences are important for the analyst, their expertise can be gathered, and the subjective weights are computed via various MADM tools such as AHP, Analytic Network Process (ANP), SWARA, Simos’ procedure, etc.; When the subjectivity is not desired with the purpose of eliminating manipulation risk or when there is not enough time for data collection or when the analyst does not have the weights of any kind, the weights can be objectively calculated from the current data by referring to the methods such as entropy-based approaches or maximizing standard deviation method; When required, a mixture of objective and subjective methods can be exploited (Kabak and Ruan, 2011; Çalışkan et al., 2013; Li et al., 2014; Freeman and Chen, 2015).
This proposition aims at showing the applicability of entropy-based objective weighting with the integration of CODAS under PF environment. Therefore, the method requires first the calculation of the entropies of each attribute via Eq. (57) or Eq. (58). Then, the weights are obtained as formulated in Eq. (59) (Aydoğdu and Gül, 2020)
Step 4. The distinctive feature of CODAS is the consideration of the distance of each alternative from the negative-ideal solution which can be obtained via Eq. (60)
Step 5. Euclidean and Hamming distances of each alternative i to
Step 6. Identical to Step 6 of CODAS given in Section 2.2.
Step 7. Identical to Step 7 of CODAS given in Section 2.2.
Step 8. Identical to Step 8 of CODAS given in Section 2.2.
In the study, we have developed a novel PFS version of CODAS with the integration of entropy-based objective attribute weighting. We have also tried to keep the computations picture fuzzy until the very end of the method. The proposed PF-CODAS is here applied in a supplier selection problem for the beef industry previously defined and analysed by Meksavang et al. (2019).
Büyüközkan and Çifçi (2012) stated that even if material, funds, and information flows establish a supply chain system, due to governmental rules and growing consciousness in the society about keeping the environment safe, organizations must be more sensitive to environmental issues, particularly if they want to keep their existence in global markets. Supplier selection issue has gained greater attraction today because organizations focus on improving their core competence and they need to outsource less profitable activities to supply chain partners for this reason (Govindan et al., 2015). In this selection process, environmental issues have been emphasized from a perspective of green supply chain management. In the literature, green supplier selection problem is very fruitful. Govindan et al. (2015) presented a very extensive literature review on MADM applications on green supplier selection problem. Liou et al. (2021) integrated support vector machines, fuzzy best-worst method, and fuzzy TOPSIS method and presented the model’s applicability in a real case of a Taiwanese electronics company. Wei et al. (2021) developed a probabilistic uncertain linguistic version of CODAS and applied it to a green supplier selection problem. Kumar and Barman (2021) applied and compared the results of fuzzy VIKOR and fuzzy TOPSIS methods in the green supplier selection issue of India’s small-scale iron and steel industry. Çalık (2021) proposed a Pythagorean fuzzy extension of AHP and TOPSIS integration for green supply chain management in the Industry 4.0 era and made a trial for agricultural tool manufacturers in Turkey.
After a brief explanation about MADM in green supply chain management field, we can return to the application of the proposed method in a case that was previously defined by Meksavang et al. (2019). The authors stated that carbon footprint reduction received great attention throughout the world, and the agriculture sector is one of the main contributors to global carbon emission. They also mentioned the increasing pressure on the beef industry from the government and clients to reduce carbon emissions in its supply chain. For mitigating carbon emission, the proposed entropy-based PF-CODAS approach is here applied to the selection of a supplier for a beef abattoir company.
Step 1. Ten potential beef farmers are considered as supplier alternatives and denoted as
The aggregated picture fuzzy decision matrix.
The aggregated picture fuzzy decision matrix.
Table 2 shows the aggregated decision matrix (Eq. (55)). As an illustration, the aggregated performance value (
Step 2. In normalization step, the normalized decision matrix is constructed as given in Table 3. There is only one cost attribute in this problem: price (
Step 3. Entropy-based objective weights of the attributes are calculated in this step. For each attribute j, Eq. (57) or Eq. (58) is performed for computing entropies and the weights are gathered after making a normalization which is formulated in Eq. (59). The related entropies and weights of the attributes are given in Table 4. Generating from the definitions of the entropy measures, there are few differences between the importance rankings of the attributes as well as the weights. Therefore, in further steps, we will see the impact of this difference on the solution of the problem.
The normalized picture fuzzy decision matrix.
The weights of the attributes which are based on two novel entropy measures.
By considering the weights of the attributes, the normalized matrix is weighted by using the formula in Eq. (60). For simplicity, the application of the further steps will be explained for the weight set which is found by Eq. (57): [0.156, 0.130, 0.154, 0.164, 0.184, 0.150, 0.062]. Table 5 shows the weighted normalized picture fuzzy decision matrix.
Step 4. In CODAS, the origin point for the comparison of alternatives is the negative-ideal solution. By performing Eq. (60),
Step 5. The ranking of the alternatives is based on the distances between the alternatives and the negative-ideal solution. Euclidean and Hamming distances are found via Eq. (62) and Eq. (63), respectively, and shown in Table 6. These distances are now crisp numbers.
The weighted normalized picture fuzzy decision matrix.
Step 6. The pairwise comparison matrix including the combinative distances is built by performing the procedure explained by the algorithm in Section 2.2. Table 7 gives the comparison matrix. The required parameter of Θ is set to 0.05.
Euclidean and Hamming distances to the negative-ideal solution.
Step 7. The assessment score generated by summing the row values of the comparison matrix is computed for each alternative. These
Step 8. The highest separation measure refers to the best alternative. So, the alternatives are ranked in descending order of
In Step 3, there are two sets of attribute weights and we have shown the calculations for the first weight set until now for simplicity. The application of PF-CODAS with the second weight set determined via Eq. (58) is not shown in detail but the tables constituted are given in Appendix A. While Table A4 shows the weighted normalized picture fuzzy decision matrix, Table A5 depicts the distances obtained. Table A6 summarizes the comparison results, assessment scores, and the rankings of the alternatives which is
Comparison of distances and the ranking of alternatives.
In order to check the validity of the proposed entropy-based PF-CODAS method, we have analysed two cases. In the first analysis, the rankings of the alternatives which are found by different entropy measures are compared. In the second one, a similar comparison is done for the applications with various versions of CODAS and TOPSIS methods.
The weights of the attributes which are based on several measures.
The weights of the attributes which are based on several measures.
The comparison of assessment scores and alternative rankings.
In terms of entropy-based comparison, the weight sets are determined. Table 8 gives the results of the comparison of weights and Table 9 shows the rankings of the alternatives. The entropy measures used are represented on the columns. The last two are the novel entropy measures proposed in the study and the first three are the existing ones in the literature: Eq. (44) defined by Wang et al. (2018), Eq. (48) defined by Joshi (2020a), and the knowledge measure in Eq. (52) defined by Lin et al. (2020). The third one provides a knowledge measure which is based on entropy measure and hesitancy degrees. The stepwise methodology is summarized as follows:
The entropy matrix showing the entropies for each pair of alternative and attribute is derived as follows:
The knowledge matrix is derived as follows:
Comparison of the ranks of the attributes.
If the knowledge measure of a criterion is larger across the alternative, it means that the value of this criterion has a smaller variation. Hence, this one shows a greater impact on the overall ratings of the alternatives. From this understanding, Eq. (66) is used for attribute weighting:
The importance ranking of the attributes is presented in Fig. 1. It is seen that there are few differences among the weight sets. Throughout the five sets, while

Comparison of the ranks of alternatives for different weight sets.
The second analysis aims to compare the rankings of the alternatives of various approaches. Traditional CODAS developed by Keshavraz Ghorabaee et al. (2016), spherical fuzzy version of CODAS developed by Kutlu Gündoğdu and Kahraman (2019b), and spherical fuzzy extension of TOPSIS (Technique for Order Preference by Similarity to an Ideal Solution) developed by Kutlu Gündoğdu (2020) are utilized for this purpose. Each method is performed by considering two entropy measure propositions of the study, separately. To keep the flow of the study, the details of the methods are not given. The interested readers can look at the referred studies.

Comparison of the ranks of alternatives for CODAS and TOPSIS versions.
Fig. 3 shows the results of the comparisons. SF-TOPSIS, CODAS, and SF-CODAS give slightly different results while the proposed PF-CODAS generates different rankings of the alternatives. In terms of

A comprehensive comparison.
As Fig. 4 indicates, the most rank fluctuating alternatives are
For a deeper understanding of the differences generated by the proposed entropy-based SF-CODAS, Spearman’s rank correlation coefficients are also computed. Kahraman et al. (2009) proposed the usage of this statistical tool for revealing the differences between the rankings of various methods under group environment. Eq. (67) shows Spearman’s rank correlation coefficient. A larger coefficient indicates a larger level of consensus among the results of the compared approaches.
Table 10 shows the sum of the squared differences among the ranking results of CODAS and TOPSIS versions and PF-CODAS method while Table 11 shows the correlation coefficients of ρ. Except for 2 comparisons [CODAS-1 & PF-CODAS with Eq. (57) and SF-CODAS-2 & PF-CODAS with Eq. (57)], ρ coefficients are higher than 0.60. For this case, it is concluded that there are medium to high level positive correlations among the rankings of the methods used.
Sum of the squared differences between methods.
Spearman rank correlation coefficients between methods.
PFS has been recently accepted by the MADM domain as one of the useful fuzzy environments because of its extensive representation power of the preferences and opinions of decision-makers. PFS is defined by four elements, namely positive, negative, neutral, and refusal membership degrees and the first three elements can be independently assignable. The only rule that must be satisfied is that the sum of these four elements should be equal to 1.
Entropy is a very important information measure of fuzzy sets such as distance, inclusion, or similarity. In the literature, there are few entropy measures developed for PFSs. Entropy measures are exploited for determining the objective weights of attributes or the importance of decision-makers. These objective weights are found beneficial in case the subjective evaluation of weights is not desired or needed. The contributions of the study may be listed as follows:
Two novel entropy measures for PFSs are developed and their proofs are given.
CODAS, which is based on two different distance measures from the negative-ideal solution such as Euclidean and Hamming distance, is extended into PFS for the first time in the literature. Although spherical fuzzy and neutrosophic versions of CODAS can handle the hesitancy degree of the decision-makers, none of the current versions of CODAS are capable of handling their refusal degrees. The most powerful aspect of the novel extension is the simultaneous consideration of both the hesitancy and refusal degrees of the decision-makers.
To validate the novel PF-CODAS, a real green supplier selection application for the beef industry is conducted. The rankings are compared with different applications’ rankings such as SF-TOPSIS, CODAS, and SF-CODAS. It is found that the proposed method generates different rankings of the alternatives due to the consideration of refusal degree.
To understand the meaning of the differences in alternative rankings better, Spearman’s rank correlation coefficient is used, and it is seen that there are medium to high correlations among the alternative ranking results of the methods compared in the study. In future applications, this situation should be investigated deeply.
In the proposed method, there are some limitations that should be handled. To cope with the disadvantageous parts of the study, the possible improvements are listed as follows:
Rather than enforcing the decision-makers to use a fixed and not-flexible linguistic term set that has PFN correspondences, a future study may work on allowing the decision-makers to directly allocate positive, neutral, and negative membership degrees so that the data collection process becomes more realistic.
Further studies should investigate the reason behind the finding of generating different rankings of alternatives by PF-based MADM methods. In order to make more comprehensive comparisons, novel fuzzy set definitions such as Fermatean fuzzy sets (Senapati and Yager, 2020), diophantine fuzzy sets (Riaz and Hashmi, 2019), and bipolar soft sets (Mahmood, 2020) may be utilized.
The entropy-based attribute weighting technique has some drawbacks. In some cases requiring expert opinions about the importance of attributes, subjective and objective methods can be incorporated. In this manner, the subjectivity can be kept in control while respecting the expertise of the decision-makers.
In the literature, a few studies (Wang, 2009; Han and Xiao, 2009) criticized the entropy definitions from a probability perspective and claimed that entropy measure is not enough to measure information in a data set. To deal with these sorts of problems, future works can focus on studying newer objective attribute weighting methods, such as MEREC, SECA, CRITIC, maximizing standard deviation, etc. under picture fuzzy environment.
The literature on fuzzy extensions of CODAS and their applications.
Footnotes
Appendix
Comparison of distances and the ranking of alternatives for Eq. (58).
|
|
|
|
|
|
|
|
|
|
|
|
Rank | |
|
|
0.000 | 0.025 | 1.007 | 0.115 | 0.033 | −0.079 | 1.216 | 0.606 | 0.044 | 0.302 | 3.271 | 2 |
|
|
−0.025 | 0.000 | 0.926 | 0.025 | 0.008 | −0.104 | 1.135 | 0.526 | 0.019 | 0.222 | 2.731 | 3 |
|
|
−0.493 | −0.467 | 0.000 | −0.442 | −0.459 | −0.571 | 0.208 | −0.230 | −0.448 | −0.357 | −3.260 | 9 |
|
|
−0.050 | −0.025 | 0.893 | 0.000 | −0.017 | −0.129 | 1.101 | 0.492 | −0.006 | 0.188 | 2.447 | 5 |
|
|
−0.033 | −0.008 | 0.895 | 0.017 | 0.000 | −0.112 | 1.103 | 0.494 | 0.011 | 0.190 | 2.558 | 4 |
|
|
0.198 | 0.279 | 1.205 | 0.312 | 0.310 | 0.000 | 1.413 | 0.804 | 0.385 | 0.500 | 5.406 | 1 |
|
|
−0.588 | −0.562 | −0.095 | −0.538 | −0.555 | −0.666 | 0.000 | −0.326 | −0.544 | −0.452 | −4.326 | 10 |
|
|
−0.262 | −0.237 | 0.401 | −0.212 | −0.229 | −0.341 | 0.609 | 0.000 | −0.218 | −0.126 | −0.615 | 8 |
|
|
−0.044 | −0.019 | 0.820 | 0.006 | −0.011 | −0.123 | 1.028 | 0.419 | 0.000 | 0.115 | 2.192 | 6 |
|
|
−0.136 | −0.111 | 0.705 | −0.086 | −0.103 | −0.215 | 0.913 | 0.304 | −0.092 | 0.000 | 1.180 | 7 |
