Abstract
Improvement of the production process presents a very important management task for both researchers and practitioners and enables a better market position of the enterprise. Key Performance Indicators (KPIs) of the production process can provide useful information on the current state of the ongoing process. In this paper, the relative importance of KPIs and their values at the enterprise level were assessed by the experts and decision-makers. Their estimates are described by the linguistic variables which were modeled by intuitionistic fuzzy numbers. The weights vector of KPIs at the level of the considered enterprise is given by the Fuzzy Analytic Hierarchical Process (FAHP) with Triangular Intuitionistic Fuzzy Numbers (TIFNs). The rank of enterprises with respect to KPIs’ values and their weights was calculated using the modified TOPSIS with TIFNs. The developed model was tested on 30 enterprises from Serbia, belonging to the sector of small and medium-sized (SME) production enterprises. The improvement strategies of KPIs should be proposed at the level of each enterprise, separately, respecting the KPIs’ values of the first-ranked enterprise.
Introduction
Within business processes activities in each organization, very important task of the manager is continuous improvement by applying appropriate analysis tools, followed by management initiatives required to achieve long-term business goals [24]. Therefore, the improvement of the business processes, primarily the production process in industrial enterprises, has become an important topic of research for both industry and academia in the last decades.
In the literature, as well as in practice, there are models and frameworks that provide guidelines for the development of performance measurement system and review of performance measurement problems from different perspectives [2]. It is a common practice that performance with known current value is the one that can be improved [38], so numerous performance measurement systems have been deployed by using the different logical and mathematical ground [13, 23]. Also, it is worth mentioning that some performances’ values cannot be determined precisely so they should be decomposed to their constituents which are represented by appropriate indicators. Performance indicators provide an important link between strategies and management actions and in this way support the implementation and execution of the improvement actions [38]. The performance indicators are categorised [10] as: Result Indicators-RIs, Key Result Indicators-KRIs, Performance Indicators-PIs and Key Performance Indicators-KPIs. Having that in mind, KPIs may be seen as quantifiable measurements used to help an organization measure the success of critical factors [10]. KPI-based performance measurement is the basis for successful business systems management [3]. Based on their values, it is possible to monitor the realization of the process and determine the management activities focused on improvement. The assessment of the production process performances should be based on determining KPIs [37]. In the literature, there are no rules on how to determine KPIs, so the widely used approaches are the decision maker’s assessment and the results of the best practices [36].
Besides determining the finite number of KPIs within one business process, there is another issue – determining the relative importance of each KPI. This issue may be stated as a fuzzy group decision-making problem [35, 36]. It may be assumed that it is closer to a human way of thinking to consider each pair of KPIs separately during the evaluation of their relative importance. Starting from this assumption, many authors have constructed a fuzzy pair-wise comparison matrix of the relative importance and used different procedures to determine the weights vector [11, 30]. In this paper, the relative importance of each pair of KPIs at the level of each SME is described by TIFNs, and the weights vector is calculated using FAHP [30]. The aggregated weights of KPIs are calculated using the Fuzzy Averaging Operator with TIFNs [19].
It is assumed that the decision-makers in enterprises can make their estimates more precisely by employing linguistic expressions compared to crisp values. Many authors consider that applying the theory of fuzzy sets [7, 17] can be the best and the least complex way to quantitatively describe uncertain variables. The modeling of uncertainties may be based on type-1 fuzzy sets applications [30, 36]. The higher degree of flexibility may be achieved by applying type-2 fuzzy sets while describing uncertainties, but at the same time, type-2 fuzzy sets have more complex calculations [4]. Since the intuitionistic fuzzy sets (IFSs) are characterized by the membership and non-membership functions, they can be designated as the best solution to represent the human way of thinking in solving different MCDM problems [41]. In this research, all existing uncertainties are modeled by TIFNs.
The ranking of enterprises with respect to the relative importance and values of defined KPIs under uncertainties can be stated as the fuzzy multi-criteria decision making (MCDM) problem [11]. The choice of an appropriate method for the ranking of considered items can be viewed as a particular problem. One of the most used MCDM is the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS) method [39]. In this research, the rank of SMEs with respect to the production processes’ KPIs is determined by using the modified TOPSIS with TIFNs. As a result, the decision-makers may use the obtained rank and KPIs of the first-ranked SME as a benchmark for defining the priorities and appropriate management initiatives. These initiatives should lead to the improvement of the overall efficiency of the production process in other SMEs.
This paper is organized as follows: The literature review is presented in Section 2. The evaluation framework is presented in Section 3. Modeling of existing uncertainties with TIFNs and modified TOPSIS are described in Section 4. In Section 5, data from the Serbian production SMEs were used to verify the developed model. Conclusions are presented in Section 6.
Literature review
There are no literature recommendations or standards that designate the most appropriate KPIs for a certain business process. It is common practice to determine KPIs based on the literature data, the results of good practice, knowledge and experience of the management team, etc. In this paper, the KPIs of the production process in SMEs are determined in compliance with the existing literature [37].
In order to have the information necessary for the realization of an enterprise’s vision, decision-makers need to establish an effective method of evaluating the performance of their business processes [38]. To make this evaluation possible, KPIs must be determined, measured and managed for each identified process [36]. It is very important for business managers to identify on time the KPIs with low values and to determine ways to improve them.
Evaluation of business processes performance itself is a very complex task [13]. Some data used in evaluation can be obtained by measuring or reviewing records and thus can be precisely represented by precise numbers. However, there are many ambiguities and uncertainties in decision-making problems. Also, KPIs can have a different nature (be cost-type or benefit-type) and be presented in different measurement units [7]. In multi-criteria decision-making problems, the criteria considered (in this paper, these are KPIs) may not have the same importance or weight. Determining these values and weights is based on the subjective judgment of decision-makers and it is difficult to express them in precise numbers. These are the reasons why the KPIs’ values and weights in this paper were modeled using the fuzzy sets.
The modeling of uncertainties and imprecisions that exist in the considered decision-making problem can be performed more precisely using IFSs than using the type-1 fuzzy sets [28, 33]. These fuzzy sets are characterized by their membership and non-membership functions. The most common shapes of their membership functions are triangular and trapezoidal membership functions, so in this research, existing uncertainties are modeled by TIFNs.
The good practice implies that decision-makers can make their assessments more easily and accurately if they consider each pair of attributes individually rather than all of them at once. A significant number of conducted research describes the extensions of the conventional AHP method with fuzzy sets theory [4] and AHP with TIFNs [22, 31].
The relative importance of criteria may be described by TIFNs and the domains of these TIFNs may be defined into the interval from 1 to 9 [31], or from 0.8 to 8.2 [30], or from 1 to 10 [26], or from 0 to 9 [22], etc. In this research, the FAHP with TIFNs is used to determine the KPIs’ weights of the production process in SMEs. The domain of used TIFNs is defined on the common measurement scale [40].
It is known that the decision-makers can make unintentional mistakes in the decision making process. Consistency should be checked to determine whether the errors significantly affect the results or they can be ignored. When precise numbers are employed during the group decision-making process, consistency checking may be determined by the appropriate procedure [5]. Consistency checking of the decisionmakers’ fuzzy assessments is usually performed by using the eigenvalue vector method after applying the defuzzification procedure [25, 31]. Also, it should be mentioned that a consistency check may be performed according to other proposed procedures [22, 42] based on the eigenvalue vector method [40]. On the other hand, some researchers did not perform a consistency check of decision-makers’ assessments [26]. In this research, a consistency check of the stated fuzzy pair-wise comparison matrix is performed according to the conventional AHP.
The weights vector of KPIs can be calculated by using a fuzzy geometric mean [30, 31], extent analyses [26], or some other procedure [42]. In this paper, the weights vector of KPIs is determined according to the existing procedure [30].
As a goal of the research, the rank of alternatives should be obtained. Frequently, in the literature, the rank of different items is calculated by using the modified TOPSIS with IFSs. The combination of TOPSIS and IFSs has been employed in different areas [8, 39].
In the scope of the research regarding supplier selection [15], the ratings of each alternative, with respect to each criterion and their weights, are given as linguistic terms and modeled by IFSs. In order to aggregate individual decision-makers’ opinions, an intuitionistic fuzzy weighted averaging operator is used. Intuitionistic Fuzzy Positive Ideal Solution (IFPIS) and Intuitionistic Fuzzy Negative Ideal Solution (IFNIS) are calculated according to intuitionistic fuzzy theory and the principle of classical TOPSIS [6]. Determining the distances from IFPIS and IFNIS is based on the Euclidean distance.
The research on personnel selection problem is based on TOPSIS with TIFNs [39]; TIFNs are used to describe the criteria weights and their values for each considered alternative. The domains of TIFNs used are defined on a scale of 0 to 1, i.e. 0 to 10, respectively. The normalized values of the fuzzy decision matrix elements are calculated by using the appropriate procedure [16]. The magnitudes of membership and non-membership function for TIFNs are given by using the existing procedure [32]. IFPIS and IFNIS are obtained by the ranking of the calculated magnitudes. The distances of each alternative from the IFPIS and IFNIS are calculated by existing literature [32].
TOPSIS with IFNs is used for the ranking problem of different types of conventional and alternative passenger vehicles in the US [27]. The criteria weights are described by IFNs and given as normalized values. The assessment of elements’ values in the fuzzy decision matrix is stated as a fuzzy group decision-making problem. The aggregation of fuzzy assessments of the decision-makers is performed using IFWA (Intuitionistic Fuzzy Weighted Averaging) operator. IFPIS and IFNIST are calculated in compliance with existing literature [15]. A fuzzy normalized Euclidean distance formula is used to calculate distance measures.
TOPSIS with IFNs is also used for the portfolio selection problem in [8]. The criteria weights are determined by using the procedure developed in [29]. IFPIS and IFNIS are determined in compliance with the described research (see [15]). The calculation of distances in that paper is based on the Hausdorff metric [29].
TOPSIS with picture fuzzy sets (PFS) is employed for the project selection problem in [20]. It is shown that PFSs are more suitable for this kind of problem than type-1 fuzzy sets since PFSs can be applied to the situation where human opinions include more answer types. The values of alternatives are described by PFSs and the fuzzy decision matrix is constructed by using fuzzy algebra rules. The PIS and NIS are defined according to the procedure developed by Chen [33] and the distances according to the procedure proposed by Ye [18].
In this paper, the IFPIS and IFNIS are defined according to the weighted normalized fuzzy decision matrix by applying a similar procedure as in described research [15]. In order to determine the distances from IFPIS and IFNIS, the Hamming distance [14, 29] is calculated. In all of the analyzed papers, as well as in this research, the closeness coefficient is calculated with respect to conventional TOPSIS. The rank of considered items is determined according to the obtained values of the closeness coefficient.
Evaluation framework
In this paper, the problem of ranking the SMEs by respecting the production processes’ KPIs is presented. SMEs can be seen as a set E = {1,..., e,...,E}, where e is the SME index, and E is the total number of SMEs.
KPIs of the production process can be formally represented by the set ς= {1,..., i,...,I}, where i is the KPI’s index, and I is the total number of KPIs considered. In the scope of this research, the expert team that defined the set of KPIs, as well as their relative importance, was consisted of six quality management auditors from a consulting and auditing agency in Serbia. KPIs were adopted according to the existing literature [37] and filtered by the expert team due to the size and business activity of the SMEs: Percentage of customer complaints caused by non-conformities (i = 1), Percentage of non-conformities (i = 2), Percentage of production plan realization (quantity) (i = 3), Percentage of scrap and treatment costs in production (i = 4) and Time of unplanned delays/total production cycle time (i = 5).
It is assumed that the importance of these KPIs is not the same compared to each other. The estimates of the relative importance of KPIs at the level of each concerned SME are given by the expert team and they can be formally presented by the set of indices ψ = {1,..., k,...,K}, where k is the expert’s index, and K is the total number of experts.
In compliance with the existing data in this area, which is not well known, the use of an appropriate mathematical tool should be considered. TIFNs are a good solution for the above mentioned problem since their elements are described with membership function and non-membership function at the same time. The assessments are based on experts’ team knowledge and experience, where experts use the linguistic expressions modeled by TIFNs. The relative importance of KPIs is given by the comparison matrix with TIFNs, by analogy to the conventional AHP method. The elements of the fuzzy pair-wise matrix of the KPIs’ relative importance are:
If the relative importance of KPI i’ over the KPI i is higher, then the element in the fuzzy pair-wise -matrix of the relative importance of KPIs is the triangular TIFN:
The mapping of the fuzzy pair-wise comparison matrix of KPIs into the pair-wise comparison matrix of KPIs is performed by using the developed defuzzification procedure [1]. The consistency of the assessment is verified by using the eigenvector [40]. The weights vector is calculated by applying the appropriate procedure [30]. The weight of each KPI at the level of each expert is denoted as
The KPIs’ values at the level of individual SMEs are estimated by the decision-makers from each SME. Within the scope of business activity, the quality manager in each SME is denoted as a decision-maker who assessed the values of the proposed KPIs. They use seven pre-defined linguistic expressions which are modeled by TIFNs,
As the KPIs may be benefit-type or cost-type, it is necessary to determine their normalized value,
The elements of the weighted normalized fuzzy decision matrix,
Fuzzy Positive Ideal Solution with TIFNs (TIFPIS) and Fuzzy Negative Ideal Solution with TIFNs (TIFNIS) under each KPI present the highest and the lowest values of the weighted normalized KPI values, respectively. They are determined by using the procedure for the ranking of TIFNs [34]. Determining the distance from TIFPIS and TIFNIS is based on the existing procedure [18]. The rank of the enterprises is determined according to closeness coefficient values given by the conventional TOPSIS method. It may be assumed that the effectiveness of the production process is the highest in the first-ranked SME. This procedure enables benchmarking, i.e. comparison of each enterprise with the best-ranked one, allowing managers to specify and choose projects to improve the production process in their SMEs [12].
Methodology
In this section, the procedure for modeling of uncertainties using IFSs is presented. Also, the proposed Algorithm for ranking KPIs with TIFNs is presented by respecting TIFNs’ algebra (Appendix A).
Modeling of uncertain variables
Uncertainties that exist in determining the relative importance of KPIs and their values are described by linguistic expressions modeled by TIFNs. The relative importance of production process KPIs at the level of each enterprise is stated by the fuzzy pair-wise comparison matrix with TIFNs, similar to the AHP method [40]. Fuzzy ratings of the relative importance of KPIs at the level of each expert are performed.
Considering the size of the problem, it is assumed that the relative importance of KPIs can be described well enough by using five linguistic expressions, as presented in Table 1.
Linguistic expressions for the relative importance of KPIs
Linguistic expressions for the relative importance of KPIs
Domains of these TIFNs are defined on the interval from 1 to 5. Value 1, i.e. value 5, means equal, i.e. extremely important, respectively.
Determining the values of KPIs observed in the production process, at the level of each enterprise, is based on the knowledge, experience and assessment of the decision-makers in SMEs.
The values of these KPIs are described using seven linguistic terms. Those linguistic terms are modeled by TIFNs, as shown in Table 2.
Linguistic expressions for the relative importance of KPIs
Domains of these TIFNs are defined on the common measurement scale, from 1 to 9. Value 1 indicates that KPI has very low value and value 9 that KPI has very high value.
In this section, the proposed procedure for evaluation and ranking of SMEs is presented in detail, respecting the values and weights of all KPIs of the production process. The solution of the defined problem can be graphically presented, as shown in Fig. 1.

The proposed procedure with TIFNs for the production process assessment.
Step 1. Each expert expressed his/her assessment by answering the questionnaire (Appendix B) and the fuzzy pair-wise comparison matrix of the relative importance of KPIs is stated as:
Step 2. In order to check the consistency of the matrix, it is necessary to calculate the representative scalars of its elements by using the defuzzification procedure [1]:
The consistency index (CI) for this matrix is calculated according to the existing procedure [40]. It is known that if CI <10%, it is considered that the matrix is consistent and that errors made by the decision-makers are insignificant so they do not affect the accuracy of the estimation.
In this way, the fuzzy pair-wise comparison matrices at the level of each expert involved in determining the KPIs’ weights are checked.
Step 3. Using the known methodology [30], the weights of each KPI at the level of each expert are calculated:
Step 4. The aggregated values of the weights of each KPI are calculated by using Fuzzy Averaging Operator with TIFNs [19]:
Step 5. Fuzzy ratings of the KPIs’ values,
Step 6. By using the linear normalization procedure [34], all of the f KPIs’ values become comparable:
a) benefit-type of KPIs
b) cost-type of KPIs
Step 7. The weighted normalized KPIs values are calculated as:
Step 8. Under each KPI, the TIFPIS,
If
In compliance with the calculations,
Step 9. The total distances from TIFPIS and TIFNIS at the level of each SME are determined using the Hamming distance measure:
The obtained values of these distances are crisps.
Step 10. Closeness coefficients at the level of each SME are calculated as:
Step 11. The closeness coefficients, c e , e = 1,..,E, are sorted into a monotone non-increasing sequence. The enterprises with the largest and the lowest values of c e , e = 1,..,E, were the first- and the last-ranked, respectively. The maximum effectiveness of the production process is achieved in first-ranked SME. After the overall calculation, the rank of the production SMEs is obtained.
This information represents the baseline for the activity of benchmarking and proposes the projects [12] for the improvement of the production process in the SMEs that are ranked below the first one.
Production SMEs in the Republic of Serbia play a very important role in country’s economy because they are important generators of employment and economic growth. The proposed procedure is tested on the data from 30 production SMEs. At the same time, the values of KPIs are assessed by the decision-makers at the level of each of 30 considered SMEs. All data were obtained through the questionnaires (see Appendix B). The decision-makers personally delivered filled-in questionnaires to researchers who transformed data into Tables shown in Appendix C. The fuzzy pair-wise comparison matrices of the relative importance of KPIs are presented in Appendix C.
The demonstration of the methodology
The fuzzy pair-wise comparison matrix of the relative importance of KPIs at the level of expert (k = 4) is given and shown (Step 1 of the proposed Algorithm) (Table 3).
The fuzzy pair-wise comparison matrix of the relative importance of KPIs at the level of expert (k = 4)
The fuzzy pair-wise comparison matrix of the relative importance of KPIs at the level of expert (k = 4)
The proposed procedure (Step 2 of the proposed Algorithm) is illustrated as the expert (k = 4) makes an assessment. Defuzzification of the TIFN
In this way, the pair-wise comparison matrix of the relative importance of KPIs can be constructed at the level of expert (k = 4). By applying the method of the Eigen vector, it is calculated that the consistency index (CI) is 0.033. T csistency check of other experts is performed in a similar way (Appendix C). It can be considered that evaluation errors of decision-makers do not affect the accuracy of assessing the relative importance of KPIs.
By using the proposed procedure (Step 3 of the proposed Algorithm), the weights vector of KPIs at the level of expert (k = 4) is calculated as:
where by
In the same way, the weights of the rest of the considered KPIs are calculated.
By applying Step 4 of the proposed Algorithm aggregated values of weights of each KPI are calculated:
The fuzzy ratings of the KPIs values at the level of each of 30 SMEs are presented in Table b7 (Step 5 of the Algorithm).
The procedure (Step 6 of the proposed Algorithm) is illustrated for KPI (i = 1) at the level of SME (e = 4).
The value of KPI (i = 1) is
The values of all KPIs are determined in a similar way (see Appendix D).
The normalized value of this cost-type KPI (i = 1) is calculated:
The weighted normalized value of KPI (i = 1) is calculated using the Step 7 of the Algorithm, as:
The weighted normalized fuzzy decision matrix is presented in Appendix E.
Similarly, weighted normalized values of other KPIs at the level of SME (e = 4) are calculated:
By applying Step 8 of the proposed Algorithm the fuzzy positive and negative ideal solutions are calculated, with respect to the weighted normalized values of KPIs in all SMEs:
By applying the Algorithm (Step 9) distances from TIFPIS and TNISs are calculated. The proposed procedure ilustrated by using calculated data at the level of SME (e = 4). The proposed procedure is illustrated in the following example:
In the same way, the distances of all KPIs to TIFPIS and TIFNIS are calculated.
By using the Step 10 of the proposed Algorithm, for SME (e = 4) the closeness coefficient is calculated:
The rank of SMEs with respect to the obtained closeness coefficients’ values is presented in Fig. 2.

The rank of SMEs respecting the closeness coefficients
Based on the calculated rank of the considered SMEs it can be seen that the first-ranked SME is SME (e = 10). It can be assumed that the effectiveness of the production process is the highest in this SME, with respect to the considered KPIs and their weights. In compliance with the obtained results and the values of the KPIs in the SME (e = 10), the decision-makers at the level of each considered SME should perform process benchmarking and define activities for the improvement of production process effectiveness.
A comparative view of the crisp weighted normalized KPIs for SME (e = 10) and (e = 4) is shown in Fig. 3.

Comparative view of the crisp weighted normalized KPIs for SME (e = 10) and (e = 4).
It can be seen that the highest value difference is defined for KPI (i = 3) and KPI (i = 5). In the considered SME (e = 4), it is necessary to define the strategies that should lead to the improvement of the denoted KPIs.
By analyzing the KPI (i = 3), it can be said that achieving the planned quantity in production while maintaining low production costs at the same time, is very important. While analyzing KPI (i = 5), which represents the average time of unplanned delays compared to the total production cycle time, it may be useful to determine the reason for the delay (a breakdown of machines, a lack of labor, a delay in the procurement process, etc.). More time to complete the production process means more costs. The short time of unplanned delays leads to more efficient results of the business. In other words, the existence of unnecessary delays leads to the reduction of the profit and to the enterprise’s inability to be successful. One of the management strategies that can be adequate in this case is the implementation of the Lean concept since in enterprises where the Lean concept is applied, delays are almost eliminated.
In the second step, if there are financial resources available, the decision-makers of SME (e = 4) can decide to implement strategies that should lead to the increases of the remaining two KPIs, KPI (i = 2) and KPI (i = 4). One of the improvement strategies that can be applied to KPI (i = 2) is improving the control. By doing this, it is possible to discover products, types of materials and workplaces where the conflict occurs and the causes that lead to deviation of quality. With the increasing deployment of Industry 4.0 procedures, the automation of the entire production process is introduced, and the examination of defects on the products is carried out serially. Using ultrasonic technologies, particle testing, vibration testing and automated resistance testing, rigorous tests are performed in order to ensure that there are no discrepancies between products that pass the control. By implementing these procedures, the production time should be decreased and the product’s series should be in compliance with the planned quality. Also, with the appropriate proactive maintenance of production machines and tools, these problems can be identified and eliminated before affecting the product users. In order to improve KPI (i = 4) it is necessary to make a difference between internal and external costs of the scrap. Internal costs are related to the shortcomings detected before delivery, while external costs are related to the defects discovered after delivery. In the case of a decrease in product quality and increased scrap, corrective maintenance should be applied. The value of KPI (i = 1) is equal in both enterprises, so this KPI does not need to be improved. All other KPIs have lower values in SME (e = 4) than in SME (e = 10).
Conclusion and future work
In an environment that is constantly and rapidly changing, very important business goals are oriented toward achieving business competitiveness and sustainability. In order to accomplish these goals, the enterprise should establish stable business processes that should be monitored and improved over time. During this process, it is necessary to define, assess, analyze and improve the business performances. As business performances are not always suitable for direct measurement or assessment, in practice many enterprises analyze the appropriate KPIs that constitute performances.
In the domain of the production process enhancement, it is important to choose the right KPIs that need to be improved by applying the appropriate strategy. The definition of KPIs in this paper was performed by the expert team and the relevant literature. In the presented research, the decision-makers used pre-defined linguistic expressions because it was assumed that, it would have been easier for them to express their assessments than to use precise numbers. The existing linguistic variables were modeled by TIFNs since it was assumed that TIFNs described the treated uncertainty in a far better way than some other fuzzy numbers employed in the scope of other research such as type 1 fuzzy numbers [37]. As business practice indicates, determining the relative importance of KPIs could be stated as a group decision-making problem which was more comprehensive compared to the situation where only one expert was making the decision [26, 31]. In compliance with the experts’ assessment, the fuzzy pair-wise comparison matrices of the relative importance of KPIs were constructed with TIFNs. As the mistakes made during the process of determining relative importance might significantly impact the final results, the consistency check was performed in contrast to some previous research [26]. Also, it should be noted that there are complex and time-consuming procedures for the consistency check [25] which have not been discussed since the conventional procedure [40] was conducted. As the experts were denoted as equally important, the aggregated KPIs weights were calculated using the Fuzzy Averaging Operator with TIFNs [19]. The rank of SMEs was calculated by applying the modified TOPSIS with TIFNs. The existing procedure for defining TIFPIS and TIFNIS [34] was applied in this research since it was more suitable in the domain of complex mathematical operations of other examined research [27, 39]. The calculation of distances from TIFPIS and TIFNIS was performed using the Hamming distance. The ranking of SMEs was calculated according to the closeness coefficient by analogy to conventional TOPSIS.
The main contribution of this research provides a solid baseline for the definition of the management initiatives which should lead to the production process improvement. This activity should be performed by applying the benchmarking. In this way, the improvement costs could be significantly reduced. By comparing the calculated values of KPIs of any enterprise and KPIs of the best-ranked enterprise, it is possible to determine both KPIs that require improvement and the appropriate improvement strategies. It can be assumed that the time needed for efficiency improvement of the production process is reduced as well.
The accuracy of input data (the relative importance of KPIs and their values) depends on the knowledge and experience of the decision-makers. Hence, it can be indicated as the main disadvantage of the proposed method. Also, data collection should be further examined to increase the overall accuracy of the solution.
Future research should examine whether the uncertain data in the proposed model could be more suitably and appropriately described by some other intuitionistic fuzzy numbers. The proposed model should be applied to other business processes for their assessment and improvement. It is worth mentioning that obtained data could be further analyzed from the perspective of the strategic regional development area where the treated enterprises operate. This would contribute to a faster and more efficient improvement of the competitiveness of enterprises in the market.
Footnotes
Appendix A. Basic definitions of intuitionistic fuzzy sets
Functions μ
A
(x) , v
A
(x) ∈ [0, 1] define the degree of membership and the degree of non-membership of the element x ∈ X to the set A, respectively. For every intuitionistic fuzzy set A in X there is hesitation index:
of the real line is called an intuitionistic fuzzy number if: there are at least two points x0, x1 ∈ X such that μA (x0) = 1 i νA (x1) = 1, its membership function μis fuzzy convex and its non-membership function ν is fuzzy concave, μA is upper semi continuous and νA is lower semi continuous, suppA = {x ∈ X|νA (x) < 1} is bounded.
Appendix B. Questionnaire
Relative importance of KPIs
Respecting Table B1 rate the relative importance of KPIs for production process.
Ratings:
Values of KPIs
Respecting the Table B2 rate values of KPIs for production process.
Ratings:
Appendix C. The fuzzy rating of the relative importance of KPIs
Fuzzy pair-wise comparison matrix from (k = 1) Fuzzy pair-wise comparison matrix from (k = 2) Fuzzy pair-wise comparison matrix from (k = 3) Fuzzy pair-wise comparison matrix from (k = 4) Fuzzy pair-wise comparison matrix from (k = 5) Fuzzy pair-wise comparison matrix from (k = 6)
(k = 1), CI = 0.0312
i = 1
i = 2
i = 3
i = 4
i = 5
i = 1
1
1
i = 2
1
1
i = 3
1
i = 4
1
1
i = 5
1
1
(k = 2), CI = 0.0381
i = 1
i = 2
i = 3
i = 4
i = 5
i = 1
1
i = 2
1
i = 3
1
1
1
i = 4
1
1
1
i = 5
1
1
1
(k = 3), CI = 0.0220
i = 1
i = 2
i = 3
i = 4
i = 5
i = 1
1
i = 2
1
1
i = 3
1
1
i = 4
1
1
i = 5
1
1
(k = 4), CI = 0.033
i = 1
i = 2
i = 3
i = 4
i = 5
i = 1
1
i = 2
1
i = 3
1
i = 4
1
1
i = 5
1
1
(k = 5), CI = 0.0381
i = 1
i = 2
i = 3
i = 4
i = 5
i = 1
1
i = 2
1
i = 3
1
1
1
i = 4
1
1
1
i = 5
1
1
1
(k = 6), CI = 0.0203
i = 1
i = 2
i = 3
i = 4
i = 5
i = 1
1
1
1
i = 2
1
1
1
i = 3
1
1
1
i = 4
1
1
i = 5
1
1
Appendix D. The fuzzy assessment of KPIs’ values
Values of all KPIs for all SMEs
e = 1
e = 2
e = 3
e = 4
e = 5
e = 6
e = 7
e = 8
e = 9
e = 10
e = 11
e = 12
e = 13
e=14
e=15
e=16
e=17
e=18
e=19
e=20
e=21
e=22
e=23
e=24
e=25
e=26
e=27
e=28
e=29
e=30
i=1
i=2
i=3
i=4
i=5
Appendix E The weighted normalized fuzzy decision matrix.
Weighted normalized value of KPI (i = 1)
e = 1
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 2
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 3
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 4
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 5
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 6
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 7
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 8
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 9
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 10
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 11
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 12
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 13
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 14
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 15
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 16
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 17
{ (0.038, 0.085, 0.192) , (0.034, 0.085, 0.230)}
e = 18
{ (0.038, 0.085, 0.192) , (0.034, 0.085, 0.230)}
e = 19
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 20
{ (0.038, 0.085, 0.192) , (0.034, 0.085, 0.230)}
e = 21
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 22
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 23
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 24
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 25
{ (0.057, 0.148, 0.479) , (0.048, 0.148, 0.528)}
e = 26
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 27
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 28
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 29
{ (0.085, 0.296, 0.479) , (0.069, 0.296, 0.528)}
e = 30
{ (0.038, 0.085, 0.192) , (0.034, 0.085, 0.230)}
Weighted normalized value of KPI (i = 2)
e = 1
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 2
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 3
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 4
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 5
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 6
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 7
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 8
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 9
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 10
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 11
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 12
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 13
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 14
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 15
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 16
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 17
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 18
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 19
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 20
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 21
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 22
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
e = 23
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 24
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 25
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 26
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 27
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 28
{ (0.082, 0.262, 0.408) , (0.065, 0.262, 0.450)}
e = 29
{ (0.054, 0.131, 0.408) , (0.048, 0.131, 0.449)}
e = 30
{ (0.036, 0.075, 0.163) , (0.032, 0.075, 0.195)}
Weighted normalized value of KPI (i = 3)
e = 1
{ (0.115, 0.195, 0.301) , (0.103, 0.195, 0.326)}
e = 2
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 3
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 4
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 5
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 6
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 7
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 8
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 9
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 10
{ (0.115, 0.195, 0.301) , (0.103, 0.195, 0.326)}
e = 11
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 12
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 13
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 14
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 15
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 16
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 17
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 18
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 19
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 20
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 21
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 22
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 23
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 24
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 25
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 26
{ (0.058, 0.108, 0.201) , (0.051, 0.108, 0.225)}
e = 27
{ (0.101, 0.173, 0.301) , (0.089, 0.173, 0.326)}
e = 28
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 29
{ (0.079, 0.141, 0.251) , (0.071, 0.141, 0.279)}
e = 30
{ (0.036, 0.075, 0.151) , (0.031, 0.075, 0.170)}
Weighted normalized value of KPI (i = 4)
e = 1
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 2
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 3
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 4
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 5
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 6
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 7
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 8
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 9
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 10
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 11
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 12
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 13
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 14
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 15
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 16
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 17
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 18
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 19
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 20
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 21
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 22
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 23
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 24
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 25
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 26
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 27
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 28
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 29
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 30
{ (0.018, 0.035, 0.078) , (0.016, 0.035, 0.090)}
Weighted normalized value of KPI (i = 5)
e = 1
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 2
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 3
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 4
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 5
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 6
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 7
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 8
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 9
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 10
{ (0.042, 0.123, 0.196) , (0.033, 0.123, 0.207)}
e = 11
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 12
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 13
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 14
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 15
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 16
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 17
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 18
{ (0.014, 0.024, 0.049) , (0.012, 0.024, 0.054)}
e = 19
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 20
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 21
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 22
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
e = 23
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 24
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 25
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 26
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 27
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 28
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 29
{ (0.028, 0.061, 0.196) , (0.023, 0.061, 0.207)}
e = 30
{ (0.019, 0.035, 0.078) , (0.016, 0.035, 0.090)}
