Abstract
Suppliers significantly affect the effectiveness of sustainable supply chain management. Hence, it is extremely important to evaluate and select suppliers scientifically and objectively. Based on the theory of triple bottom line (economic, social, and environmental dimension) and a balanced scorecard, a measureable supplier evaluation framework in a sustainable supply chain is first formulated. Second, to reduce the defects of the single weight method, the subjective and objective weights of evaluation indicators are determined by combining the fuzzy best-worst method (BWM) and the entropy method, and then the combination weights are obtained through linear weighting. Third, the grey relational technique for order performance by similarity to ideal solution (TOPSIS) method is further adopted to evaluate and rank the suppliers. Finally, a case study illustrates and demonstrates the availability of the proposed supplier evaluation index system and evaluation method. Subsequently, some suggestions are proposed according to the results.
Introduction
Owing to the fierce market competition, rigorous regulations, and increasing sustainable demand from stakeholders, sustainability has been integrated into organizational strategy, such as supply chain strategy.
However, the sustainable supply chain management (SSCM) involves several issues, typically from their suppliers [10, 16], as they provide raw materials, services and finished products as inputs to the supply chain to meet operation needs [7, 14]. For example, poor testing of material by suppliers may cause dangerous and harmful products flowing to consumers, with incalculable losses, poorer corporate reputation, and lowered revenue as outcomes [33].
Supplier behavior directly affects the performance of organization [7, 42]. With the closer relationship between organization and suppliers, it is imperative for organization to evaluate and select their suppliers with sustainable performance. For example, the Rana Plaza disaster in Bangladesh in 2013, which involved perilous working conditions at a garment supplier that lead to the death of more than 1100 people. It turned out that the supplier selection processes of the organization were inadequate [27]. Therefore, selection of sustainable suppliers is of paramount significance for organization in their pursuit of SSCM and sustainable performance.
As a result, the supplier evaluation framework and methods are particular significant. The early supplier evaluation criteria only involved economic sustainability, for instance, dominated by criteria such as price, quality, and delivery [6, 39]. With more attention paid to environmental issues, sustainable supplier evaluation has adapted environmental factor. The implement of Solar Roadways Technology proved it [2]. Like environmental sustainability, social sustainability of suppliers also affects the financial performance, market competitiveness, and anti-risk ability of purchasers [25]. Owing to the difficulty and challenge of social sustainability and because it is difficult to equate high social sustainability with high performance, the organization often hesitates to invest in and implement social sustainability. Thus, in this paper we aim to present a sustainable supplier evaluation indicator framework based on Triple Bottom Line (TBL). At the same time, since all current evaluation methods have certain deficiencies, and there is no optimal evaluation method in the field of supplier evaluation, on the basis of the proposed evaluation framework, we propose combination approach of fuzzy-BWM and grey relational TOPSIS to evaluate the sustainability of suppliers.
The rest of the paper is organized as follows. In Section 2, we reviewed the related literature. Section 3 presents a sustainable supplier evaluation indicator framework and proposes a methodology to evaluate the sustainability of suppliers. Section 4 provides a case application adopting the proposed framework to prove the methodology’s availability. Finally, Section 5 summarizes the conclusions and presents future research.
Literature review
The literature related to this study mainly includes the supplier evaluation framework and methods.
The supplier evaluation framework
The early supplier evaluation criteria only involved economic sustainability, for instance, dominated by criteria such as price, quality, and delivery [6, 39]. With more attention paid to environmental issues, sustainable supplier evaluation has adapted environmental factor. Noci [13] introduced environmental sustainability into the supplier evaluation framework. Kumar et al. [4] established a supplier evaluation framework including eight modules: cost, distance, carbon emissions, industry status and reputation, historical cooperation, and so on. These studies take into account environmental sustainability but not refer to social sustainability.
However, Ferri and Pedrini [24] proposed that both social and environmental sustainability of suppliers affect the financial performance, market competitiveness, and anti-risk ability of purchasers. Owing to the difficulty and challenge of social sustainability and because it is difficult to equate high social sustainability with high performance, the organization often hesitates to invest in and implement social sustainability. In recent years, there were some studies on social sustainability, but it mostly referred to qualitative indicators. For example, Nouri et al. [11] developed a framework for evaluating sustainable service supply chains based on a balanced scorecard, which includes four aspects—finance, service supply chain operation, stakeholders, and learning, growth, and innovation. Neri et al. [5] proposed a set of key performance indicators that are balanced on TBL based on the balanced scorecard and supply chain operations to measure the sustainability performance of industrial supply chains. As a result, our work constructs a framework including quantitative indicators in economic, social and environmental performance.
The supplier evaluation method
To better evaluate and select suppliers, it is important to adopt appropriate evaluation methods. There are many multi-criteria decision support tools to build and support supplier evaluation and selection [9], such as grey relational analysis (GRA), fuzzy set theory (FST), TOPSIS, analytic hierarchy process (AHP), fuzzy analytic hierarchy process (FAHP); and their improvement and their hybrids [23].
Many studies have adopted these classical methods [38]. However, classical methods have deficiencies or shortcomings when faced with fuzzy situation. Compared with precise system, fuzzy system is more common. For example, Fuzzy logic system is an intelligent system, which is easy to understand, simple to design and better than using the other type of controller [26]. In addition, researchers also introduce hybrid evaluation method to meet with different needs. A brief summary of fuzzy or hybrid methodologies by various researchers and practitioners in supplier selection towards green and sustainable practices is given in Table 1.
Summary of the methodologies/techniques by various researchers and practitioners in supplier selection
Summary of the methodologies/techniques by various researchers and practitioners in supplier selection
As shown in Table 1, Fuzzy-BWM and grey correction TOPSIS are widely used in green or sustainable supplier evaluation and selection. Mohammed et al. [3] calculated the weight of criteria using the AHP method and evaluated the suppliers using the TOPSIS method. However, compared with the BWM, more pairwise compassion data are required in the AHP method. TOPSIS method cannot show the closeness between the decision and the ideal solution from the shape. Amiri et al. [25] presented a new model with a triangular fuzzy approach for sustainable supplier selection. The proposed model is based on the BWM and α-cut analysis, which is greatly influenced by subjective factors. As a result, our work adopted a combination approach of the fuzzy-BWM and entropy method. The approach takes advantage of both methods. In the fuzzy-BWM method, less pairwise compassion data are required, which can adapt to uncertain situation. The entropy method has objectivity. The grey relational TOPSIS show the closeness between the decision and the ideal solution form the shape and distance.
Therefore, the contributions of our work are summarized as follows: First, based on the summary of the previous sustainable supplier evaluation indicators, this study adopts the balanced scorecard, measurability, and consistency with public policies to screen the indicators to build a quantitative, sustainable (economic, social and environmental) supplier evaluation indicator framework. Second, considering the uncertainty and ambiguity of objective things, the ambiguity of human thinking and the cognitive biases of some evaluators, the group aggregation value of fuzzy preference combined with fuzzy-BWM is determined to eliminate the impact of ambiguity on evaluation results. Third, owing to the shortcomings of the subjective evaluation method, the fuzzy BWM is combined with the entropy method to determine the combined weight of the indicators, and the grey relational TOPSIS method is adopted to rank and select sustainable suppliers.
In order to evaluate the overall sustainability of suppliers, this paper formulates the supplier evaluation model. First, we determine the subjective weight of the evaluation indicators based on the fuzzy BWM. Second, we determine the objective weight of the evaluation indicators based on the entropy method. Third, to compensate for the shortcomings of the single weighting method, we obtain the combination weight by combining the subjective and objective weight. Finally, we evaluate and select suppliers based on the grey relational TOPSIS method. The procedure is shown in Fig. 1.

The research procedure.
In evaluation framework, the indicator selection directly impacts the accuracy and reliability of the evaluation results. For example, during damage evaluation in beam-like structures, the Local Frequencies Change Ratio (LFCR) indicator and damage indicator were selected to locate damaged elements more effectively [41]. Similarly, Zenzen [36] adopted new indicator combining LFCR and Transmissibility with mode shape together, which can be sensitive enough to evaluate and identify damage. In this sustainable supplier evaluation framework, we first selected sustainability indicators by summarizing the relevant literature on the sustainable supplier evaluation and selection. Based on the TBL principle, we divided the evaluation indicators into three categories: economic, environmental, and social bottom line. Second, we screened the indicators based on the balanced scorecard, measurability, and consistency with public policies. Among them, measurability is a necessary condition, and the number of conditions that the indicator meets must be greater than or equal to 2. Third, we formulated a more objective and easier-to-measure sustainable supplier evaluation framework that comprised measurable indicators, which is shown in Table 2, and the measurable criteria are shown inTable 3.
Supplier evaluation framework in a sustainable supply chain
Supplier evaluation framework in a sustainable supply chain
Supplier evaluation criteria in a sustainable supply chain
Compared with the typical AHP method, less pairwise comparison data are required in the BWM, and the results generated by the BWM are more robust and reliable [20, 21]. Considering the vagueness frequently represented in decision data due to incomplete information and the ambiguity arising from the qualitative judgment of decision-makers, the crisp values of criteria may be inadequate to model the real-life MCDM issues. In this context, the BWM is extended to the fuzzy environment. Guo and Zhao [40] established a fuzzy BWM model by introducing triangular fuzzy numbers (TFNs) and verified its comparison consistency. As fuzzy sets and TFNs are the basis of the fuzzy BWM, we first introduce their definitions.
A fuzzy set
A fuzzy number
Suppose that there are indicators for a research object, and the fuzzy pairwise comparison on these indicators can be performed based on the linguistic variables (terms) of decision-makers, such as ‘Equally import-ant (EI)’, ‘Weakly important (WI)’, ‘Fairly Important (FI)’, ‘Very important (VI)’, and ‘Absolutely important (AI)’. Subsequently, the linguistic evaluations of decision-makers need to be transformed to fuzzy ratings (represented by TFNs) [30], which is (1,1,1), (2/3,1,3/2), (3/2,2,5/2), (5/2,3,7/2), (7/2,4,9/2), respectively.
In order to reduce the influence of personal subjective preferences on the results, we adopt group aggregation value to aggregate fuzzy group evaluation information. The smaller the difference D (x, y) and the greater the similarity S (x, y) between the group aggregation value and the original data, the better the results. Here
The steps to determine the subjective weights of the evaluation indicators by the fuzzy BWM are as follows.
The entropy method calculates the weights of different indicators based on the original objective data and does not involve the personal opinions of the decision-makers. Thus, we adopt the entropy method to determine the objective weight of the indicators. Supposed that there are m suppliers. We therefore need to evaluate these m suppliers through n indicators. The procedures are as follows.
Where x ij is the original value of the jth indicator under the ith supplier. Thus, we can obtain a standardised decision matrix Y = (y ij ) m×n.
Step 4. Calculate the objective weight of each indicator using Equation (11).
The entropy method has the advantage of objectivity, which makes it more credible and accurate than the BWM method. However, the weight of each indicator varies over the number of samples and data, which makes matters worse—the weighting result may not match the actual situation. The BWM method compensates for this shortcoming. Therefore, we combine the subjective and objective weights by adopting both the BWM and entropy methods to avoid the shortcoming of single weighting, increase the rationality and accuracy of the evaluation process, and improve the reliability of the evaluation results.
The combination weight of each indicator can be calculated by
As the TOPSIS method cannot show the closeness between the decision and the ideal solution from the shape, we combine the grey relational with TOPSIS method to overcome the deficiencies of the TOPSIS method and improve the accuracy of decision-making results. By this method, the procedures to evaluate and rank suppliers are as follows.
According to the principle of the TOPSIS method, the greater the values of
In Equations (23) and (24), the values of ξ1 and ξ2 represent the preference of evaluators on location and shape, and ξ1 + ξ2 = 1.
The greater the value of S i , the closer the evaluation result to the ideal solution.
We now provide a case study to illustrate the availability of the evaluation indicator system and evaluation method proposed in this study.
Introduction of company H
Company H is a construction machinery manufacturer, selling excavators, bulldozers, etc. Purchase parts from suppliers, such as lead batteries, sensors, turbochargers, etc., assemble them and produce finished products in their own factories. To comply with the development trend of the sustainable supply chain and enhance its competitiveness in the market, Company H needs to choose the best sustainable supplier among four suppliers to purchase lead batteries. It needs to establish a sustainable strategic partnership with this supplier to achieve the coordination and unification of economic, social, and environmental benefits.
Supplier sustainability implementation levels are used to evaluate the suppliers [7]. First, an evaluation team is formed, which is consisted of two relevant academic experts, one financial manager, one supply chain manager, one reliability manager, one material manager, one purchaser, one product manager, and two senior quality engineers.
The original data of the evaluation indicators are quantitative data obtained through suppliers’ and Company H’s historical data. Original evaluation data to four suppliers are listed in Table 4.
Original data of the four suppliers
Original data of the four suppliers
Sustainability is the harmonization of economic, social, and environmental performance. All indicators in TBL are significant in evaluating sustainable suppliers. Since it is difficult to compare the indicators among the three categories, we only compare the importance of the indicators within the same category. As shown in Table 1, there are seven indicators in each category. We adopt the fuzzy BWM method to determine the subjective weight of the indicators in different categories.
The data collection process is as follows. First, introducing the specific meaning of each indicator to experts, and then surveying some questions from them. Taking economic bottom line indicators as an example, each expert in the evaluation team was asked to choose the most and least important indicator among all the seven indicators. Table 5 shows the best and worst indicators determined by Experts 1–10 in the economic bottom line.
Best and worst indicators in the economic bottom line determined by experts
Best and worst indicators in the economic bottom line determined by experts
According to the majority principle, the indicator with the most votes is selected. As shown in Table 4, the most important economic performance indicator is F4-Flexibility of supply chain, and the least important indicator is F5-Delivery time.
Second, issue the questionnaire, introduce the content of each indicator to the experts before filling out the questionnaire, and explain the scoring rules of fuzzy BWM in detail to ensure the rationality and accuracy of the scoring results. Each expert was then asked to determine the best indicator’s fuzzy preference over all other indicators based on the determined most important and least important indicators. Further, each expert was asked to determine the fuzzy preference of all indicators over the least important indicator. To reduce the influence of the evaluators’ personal cognitive bias on the evaluation results, the group aggregation value of the evaluation results is taken—ten experts respectively determine the fuzzy preference of F5 versus F1 to obtain ten vectors. Subsequently, we determine the group aggregation value using Equation (5), which is the final fuzzy preference result. This processing method synthesizes the experience and opinions of various experts and reduces the influence of the cognitive bias of individual evaluators on the evaluation results.
The fuzzy BWM implement result
In this case, there are 10 BO and 10 OW evaluation preferences for 10 experts in the economic performance dimension. We need to determine the group aggregation value. Taking Expert 1 as an example, the BO evaluation preference is presented in Table 6. For brevity, the remaining 19 evaluation fuzzy preference languages are not shown.
Best-to-Others evaluation fuzzy preference language for Expert 1
Then we need to determine the group aggregation value of the fuzzy preference language and transform it into a TFN.
Therefore, the evaluation fuzzy preference matrix of F4 to all the other indicators and all the other indicators over F5 are
According to Equation (6), the fuzzy preference vector and weight of each indicator can be obtained.
The fuzzy preference vector = [(1641,0.1857,0.2469), (0.0720,0.0730,0.0853), (0.0977,0.1108,0.1433), (0.2386,0.2408,0.2733), (0.0650,0.0650,0.0745), (0.1641,0.1857,0.2469), (0.0977,0.1108,0.1433)]; the weights of F1 to F7 in economical bottom line are
wF1 ∼ wF7=(0.1923, 0.0749,0.1140, 0.2458, 0.0666, 0.1923, 0.1140)
Similarly, the weights of F1 to F7 in environmental and social bottom line are
wE1 ∼ wE7=(0.0920, 0.2167, 0.0759, 0.2077, 0.1234, 0.0711, 0.2133)
wS1 ∼ wS7=(0.2021, 0.1821, 0.2433, 0.0928, 0.1380, 0.0821, 0.0596)
The weights of the three categories (economic, social and environmental performance) are
wF,S,E=(0.4235, 0.3261, 0.2504)
Weighting the above matrix, the final weight of each indicator determined by the fuzzy BWM is
w BWM =(0.0814, 0.0317, 0.0483, 0.1041, 0.0282, 0.0815, 0.0483, 0.0659, 0.0594, 0.0793, 0.0303, 0.0450, 0.0268, 0.0194, 0.0230, 0.0542, 0.0190, 0.0520, 0.0309, 0.0179, 0.0534).
Table 7 shows the implement of the fuzzy-BWM and the results of weighting.
According to Equations (7) and (8), the original data is processed dimensionless to obtain a standardized decision matrix and are translated by 0.0001. Then, it is normalized to obtain a normalized decision matrix according to Equation (9). Some calculation results are shown in Table 8.
Normalised decision matrix (partial)
Normalised decision matrix (partial)
The entropy and weight of each indicator are calculated through Equations (10) and (11) , respectively. The results are
E=(0.6641, 0.7030, 0.7313, 0.7895, 0.4601, 0.6671, 0.7266, 0.7790, 0.7613, 0.5007, 0.6263, 0.5949, 0.7927, 0.7436, 0.6588, 0.6281, 0.7648, 0.6466, 0.5007, 0.6706, 0.7181)
wentropy =(0.0489, 0.0432, 0.0391, 0.0306, 0.0786, 0.0484, 0.0398, 0.0322, 0.0347, 0.0727, 0.0544, 0.0589, 0.0302, 0.0373, 0.0497, 0.0541, 0.0342, 0.0514, 0.0727, 0.0479, 0.0410)
With α=0.5, β=0.5, based on Equation (12), the combination weights are
W=(0.0652, 0.0375, 0.0437, 0.0674, 0.0534, 0.0649, 0.0440, 0.0491, 0.0470, 0.0760, 0.0423, 0.0519, 0.0285, 0.0284, 0.0364, 0.0542, 0.0266, 0.0517, 0.0518, 0.0329, 0.0472)
Evaluation results
According to Equation (13), the weighted standardized decision matrix is obtained as in Table 9.
Weighted standardised decision matrix (partial)
Weighted standardised decision matrix (partial)
Based on Equations (14)and (15), the positive-ideal solution F+ and negative-ideal solution F- are easily obtained. Through Equation (16), the Euclidean distance
Similarly,
According to Equations (18) and (19), the grey relational matrices (
According to Equation (22), the dimensionless processing is performed on T+, T-, R+, and R- respectively, and the results are
T+=(1.0000, 0.9032, 0.5986 0.9554)
T-=(0.5500, 0.7045, 1.0000, 0.5765)
R+=(0.6736, 0.7386, 1.0000, 0.6782)
R-=(1.0000, 0.9494, 0.7242, 0.9826)
By Equations (23)–(25) and ξ1 = 0.5, ξ2 = 0.5,
S i =(0.3796, 0.4379, 0.6019, 0.3930)
The larger the value of S i , the closer the results to the optimal ideal solution. Thus, we conduct supplier selection with order C > B>D>A. It is obvious that Supplier C is the most sustainable supplier, which is consistent with the actual situation. In addition, the selection order of the remaining three is Supplier B, Supplier D and Supplier A.
We now alter the values of the position preference parameter ξ1 and shape preference parameter ξ2 to investigate the results’ robustness in the grey relational TOPSIS method based on the combination weights. We select different values of ξ1 and ξ2 in increments of 0.1, where 0≤ξ1≤1, 0≤ξ2≤1 and ξ1+ξ2 = 1. The results are represented in Fig. 2.
From Fig. 2, regardless of how ξ1 and ξ2 vary, Supplier C is the best. The ranking is relatively stable.

The results when ξ1 and ξ2 changes.
With the increasing emphasis on sustainability at home and abroad, SSCM has become a trending topic. The sustainable supplier evaluation and selection is a significant link in a SSC. This study formulated a scientific and reasonable supplier evaluation framework based on the theory of sustainable supply chain, TBL, and balanced scorecard. The fuzzy BWM and entropy methods are adopted to determine the subjective and objective weights of the evaluation indicators, respectively. The combination weights of the subjective and objective weights are integrated to decrease the shortcomings of a single evaluation method. Finally, a case study verifies the effectiveness and stability of the proposed evaluation index system and evaluation method.
Compared with the existing methods, such as FAHP-TOPSIS and BWM-TOPSIS, the proposed approach has more advantages. BWM-TOPSIS cannot adapt to the fuzzy situation, while FAHP-TOPSIS needs more pair-wise comparison. The proposed approach in this paper has more advantages, which determines the weights of evaluation indicators more objective, and also can demonstrate the closeness between the decision and the ideal solution from the shape and distance.
In this case, even though Supplier C is considered to be the best sustainable supplier from the result and is recommended for contracting, some sustainability indicators had low ratings for supplier C. For the implementation of this selection recommendation, Company H may require specific post-selection negotiations with Supplier C for possible improvements in these indicators with low ratings by setting the other suppliers as benchmarks. For example, Supplier B has the highest rated performance for the indicator ‘price of material’ (F1). As a result, Company H can consider to negotiate with Supplier C to improve this indicator. Given the possibilities of interactions and trade-offs, care must be taken not to compromise the overall performance of supplier C. Thus, a supplier development process may be put into place that may help improve supplier C in a balanced way. Besides, based on the evaluation team’ s opinion, the most important indicator in economic bottom line is ‘flexibility of supply chain’ (F4), in social bottom line is ‘number of health and safety incidents’ (S3) and in environmental bottom line is ‘clean energy efficiency’ (E2). Suppliers should focus on improving these performance indicators.
The results of this study provide the following suggestions for the future development of sustainable suppliers. First, sustainability is the harmonization of economic, social, and environmental performances. Suppliers should make overall consideration in future development. Second, sustainable suppliers should not only focus on the present but also consider the future. A sustainable organization should formulate and implement actively sustainable strategies that meet the relevant requirements. Finally, sustainable suppliers must actively cooperate with upstream and downstream enterprises to jointly promote the sustainability of the entire supply chain.
Every study has certain limitations, and this study is no exception. One limitation is that we do not consider the influence of different cognitive biases of experts on the evaluation results when we determine the subjective weights by the fuzzy-BWM method. Another limitation is that the interrelationship among the indicators is not considered for the complexity. There is a certain synergetic relationship among them. Therefore, it is suggested to study the interrelationship in future research.
Funding
This work was supported by the National Natural Science Foundation of China with Grant Nos. 71971064 and 71801045, the Social Science Foundation of Fujian Province with Grant No. FJ2022B071, and the National Natural Science Foundation of Fujian Province with Grant No. 2020J01460.
Footnotes
Acknowledgments
The authors are very thankful for constructive comments and suggestions from anonymous reviewers and editors.
