Abstract
Recently, the reform practice of government procurement of public service (GPPS) in China has been promoted gradually and got great breakthrough. Meanwhile, in order to guarantee that the expected goal of this reform achieved, mature and effective regulation is of vital importance. Considering the practical demand, the capability maturity model is applied into the evaluation of quality regulatory capability in GPPS. The concept of quality regulatory capability maturity is proposed, and the evaluation model based on TODIM (an acronym in Portuguese of interactive and multiple attribute decision making) method for probabilistic linguistic term sets (PLTSs) is provided. Taking Jiangsu Province as an example, an empirical study of its quality regulatory capability evaluation for GPPS is conducted, through which, not only comparative results of maturity levels of different cities in Jiangsu is obtained, but the improving measures are also determined. The proposed maturity evaluation model fully reflects experts’ preferences and evaluation information, and is able to point out the direction for regulatory capability’s future promotion level by level, as well as its continual improvement.
Keywords
Introduction
Government procurement of public service (GPPS) is an effective practice for government to improve the quality of public service and the efficiency of financial fund, and can transfer the provision of public service from governments themselves to social organizations. Meanwhile, the focus of governments’ function is shifting from “supplier” to “supervisor” [1]. In China, with deepening of economic system reform, providing public service in the way of government procurement from social force has become more and more important [2, 3]. Jiangsu province, launched GPPS in 2013, has established a preliminary institution system composed of promotion mechanism, top layer design and practice. In 2013, 21 projects were selected to be piloted by Jiangsu Finance, and by the end of 2015, the 61 key projects have been done. Taking projects of cities and counties in Jiangsu into account, the cumulative projects add up to 3778, with budget as high as 15.896 billion RMB. This amount reached 67.888 billion in 2016. Compared with previous years, not only the number of GPPS projects grows notably, but also the sum value increases sharply, as well as the coverage expands. Legal aid, social consultation service, community aid, shantytowns’ reconstruction and the PPP projects appear in the list for the first time. With the development of practice in GPPS, the top layer design is also strengthened in Jiangsu province, and the institution system is continuously being improved [4]. Jiangsu Finance and Civil Affairs Departments have jointly made and issued several normative documents such as ‘Implementation guidelines for GPPS’, ‘Management of the fund for GPPS’ and ‘Performance evaluation method for GPPS’, which actually regulate and promote the work of GPPS in Jiangsu.
Meanwhile, to ensure the effect and efficiency of public service provision under government procurement, a comparatively perfect regulatory system is being established. At present, there are three critical transformations in constructing the supervision system of GPPS. The first one is the transformation from static regulatory capability building to dynamic capability improving. A certain foundation has been built in quality supervision for GPPS nationwide. Therefore, it is essential to improve the general communication and coordination capability of regulatory capability. There is an urgent need in improving such capabilities as quality control, resource distribution and collaborative supervision between different interest groups, all of which should face dynamic process [5]. The second transformation is to transform from passive supervision to active supervision. Through establishing a quality supervision system covering the whole process, active measures are taken to identify, reduce and stop the quality risks and potential quality problems in the whole process of GPPS, which will strengthen prior forecast and in-process quality control. The third transformation is to transform from fragmentation to systemized supervision. The supervision should be transformed from single evaluation to omnibus quality supervision, which is multi-agent, multi-link and multi-way, thus constructing a perfect network of quality control system step by step [6]. For these transformations, the focus of quality regulation in GPPS should be better controlling and coordinating the process, as well as improving the degree of scientific and standardization [7]. Therefore, it is necessary to explore a regulatory capability evaluation method for GPPS, which is able to identify the governments’ capability level of quality regulation in public service procurement, timely detect weak points and areas to be improved. Through that, targeted measures are taken to improve the quality regulatory capability in public service procurement, as well as to promote further development of China’s reform in GPPS. The purpose of this paper is to provide a regulatory capability evaluation method for GPPS. Our contributions include: (1) Constructing evaluation criteria for quality regulatory capability in GPPS based on capability maturity model (CMM); (2) Proposing an evaluation model based on TODIM method for PLTSs, which better reflects the experts’ preferences and evaluation information in evaluating quality regulatory capability in GPPS.
When evaluating quality regulatory capability maturity in GPPS, experts may feel comfortable to express their opinions with linguistic terms, such as good, perfect or poor, rather than quantitative evaluations because some criteria are difficult to describe with crisp numbers. Owing to the uncertainty of evaluation problems in real life, the evaluation process needs more than one expert to make it more reasonable. Different experts may express different opinions on the same evaluation object. To cope with this issue, Rodriguez et al. [8] proposed the definition of hesitant fuzzy linguistic term sets by continuous linguistic terms (HFLTSs). However, the method of HFLTS did not consider the situation that the number of experts expressing different opinions may be different. For example, there are 10 experts to evaluate a car. We assume that there are 4 experts thinking it is good and 6 perfect. The method of HFLTS can’t describe such situation. Zhang et al. [9] (2014) proposed the linguistic distribution (LD). Dong et al. [10] generalized the LD and proposed the multi-granular unbalanced linguistic distribution with interval symbolic. Numerical scale model [11, 12] and personalized individual semantics model [13–15] are the main types of methods for LD problems. Additionally, Pang et al. [16] expanded the HFLTS to probabilistic linguistic term sets (PLTSs) by using two dimensions: linguistic term and probability of the linguistic term. For the aforementioned example, we can use the PLTS to describe the situation: L (p) = {(s1, 0.4) , (s3, 0.6)} (Here we assume that the number of language granularity is 7). The difference between PLTS and LD is minor. The sum of symbolic proportions in PLTSs can be smaller than 1, while that in LD is 1. What is more, PLTS can be transformed into linguistic distributions.
The PLTS has attracted lots of researchers owing to its strong practicality. There are many studies concerning the PLTS from theories and applications. Zhang et al. [17] proposed novel probabilistic linguistic preference relations and analyzed the consensus process of group decision making problems. Yu et al. [18] put forward a new multiple criteria decision making (MCDM) method for PLTS and applied it to hotel selection. Wu and Liao [19] designed a new way to deal with the problem of selecting innovative product design through quality function deployment and PLTS. Peng et al. [20] established a cloud decision support model using PLTS to select hotels according to online reviews. Bai et al. [21] proposed a new possibility degree formula by a diagram method to compare different PLTSs. Gou and Xu [22] proposed some basic operational laws for PLTs and studied the relations of PLTS and HFLTS. The above studies focus more on theory study on PLTSs. There is little research on evaluation model for quality regulatory capability maturity in GPPS. In this paper, we will propose a TODIM method for PLTSs and apply it to the evaluation of quality regulatory capability maturity in GPPS.
The remainder of the paper is structured as follows. Section 2 is a literature review. Section 3 develops the evaluation criteria for quality regulatory capability in GPPS based on CMM, and the establishment of the evaluation model based on TODIM method for PLTSs is described in Section 4. Section 5 provides a case study to illustrate and verify our proposed evaluation model. A conclusion is provided in Section 6.
Literature review
Evaluation of regulatory capability
Regulatory capability, as one of governments’ capabilities, mainly focuses on implementing supervising policies, and ensuring supervisory quality through executing these policies. Supervisory capability is different from supervisory performance. However, sound supervisory performance needs powerful regulatory capability as a guarantee. All factors should be comprehensively taken into consideration to evaluate the regulatory capability, such as the building of regulatory organizations, application of supervisory tools, and policy making for regulation [23]. Scientific and logical evaluating index system is necessary to make a precise assessment, so that weak links and relative gaps in the regulation system can be found out. The regulation level will be increased through implementation of effective improving measures, which are to the point. In 1995, the Organization for Economic Co-operation and Development (OECD) issued the first international standard on construction of regulation system and evaluation of regulatory capability, which made it clear that regulatory capability should composite of three ingredients: organizations, policies and tools for regulation. There are plenty of studies on composition and evaluation of regulatory capability in recent academic world. According to current literature, evaluation of regulatory capability may stick to one specific organization, or to one certain area or industry. Subjects and matters to be evaluated are generally set from their composition, including extent of resources’ abundance, relationship between subjects and objects in supervision, establishment and implementation of regulation policies, relative independence of regulation organizations. Kjekshus and Veggeland [24] suggested that supervision capability is the capability for formal regulation organizations to carry out a series of measures to ensure that the goal of supervision correspondence to a nation’s decision-making. Therefore, performance of regulation policies’ implementation should be an important constitutive of regulatory capability. Yadav [25] showed that firms used a systematic process to build capabilities for managing regulations, and offered a process model for firms to build regulatory capabilities. Mcallister [26] proposed that the extent of resources’ abundance is the base for regulatory capability evaluation. Rooij [27] suggested that the extent of resources’ abundance restricted improvement of local governments’ environmental regulatory capability, as well as the improvement of supervision performance. Liu et al. [28] established a graduated measurement indicator system on regulatory capability which includes the building of regulatory institution, the using of regulatory tools and quality of regulatory policies. The Ministry of Environmental Protection (MEP), China Food and Drug Administration (CFDA) and the Center of Inspection and Supervision of National Health and Family Planning Commission (CISNHFPC) were chosen to be measured and graduated by their proposed system. Aiming at the regulatory capability of urban public utility, Li [29] summarized the enlightenment and reference of American evaluation system of urban public utilities regulation. Yang [30] suggests learning from the idea of responsive regulation that emerged recently in western countries and creating a new paradigm of collaborative regulation between state and non-state actors. Hu [31] established a structural model of institutional capacity of drug administration as well as an appraisal index system based on the concepts of potential capacity and realized capacity by Nielsen. Ten provincial drug administrations’ regulation capacities were then evaluated and compared based on the established model. Wu [32] proposed an evaluation index system of regulatory capability including three dimensions: constitute elements of governments’ regulatory capability, explicit form and influence factors, which provides scientific standard for governments’ judgement.
In summary, there are many researches on governments’ regulatory capability, as well as its evaluation. In this field, great achievements have been made and abundant experience has been accumulated both in theoretical research and practice. However, imperfections still exist. Studies on evaluation indicators and methods hold out a situation of hundreds of flowers in blossom, which is low in consensus about these research findings, and relatively stable evaluation mode hasn’t yet been developed. For one thing, most researches in evaluation of regulatory capability try to find out key factors influencing the regulatory capability through one-time evaluation, against which measures are taken to improve the capability, while evaluations considering dynamic condition are ignored. Therefore, it is difficult to establish a dynamic improving mode due to lack of continuous improving idea. For another thing, theoretical research on regulatory capability evaluation tends to be disconnected from practice, and many evaluation methods in theoretical research is hard to attain good results from practice, which is low in promotional value.
Regulation in government procurement of public service (GPPS)
As to the regulation in GPPS, there have been plenty of relative studies. Lodi et al. [33], Johansson et al. [34] both focused on the contract design and control to better regulate the process of GPPS. Wu et al. [32] tried to establish a relatively complete regulatory system of GPPS, and took a close look at the role transition of government in GPPS, thus underlining government’s supervision and regulation role. Cunningham and James [35] analyzed GPPS from the value of a regulatory perspective. They revealed that a ‘soft’ regulatory framework that offered little support to partnership relations between voluntary organizations and local authorities. Ainuddin et al. [36] indicated that the principle of transparency in procurement of goods and government services was important to be accommodated for the purpose of better regulation. Maciejewski [37] discussed some applications of big data methods in public administration, which also drew attention of big data application in regulation in GPPS. Ida and Talit [38] looked into structural reforms in the regulation of public bus services in Israel. They studied and examined the reasons and effectiveness of different measures taken to regulate outsourced the public service.
Academic research in the field of regulation and management in GPPS has mainly dealt with regulation mechanisms, risks, systems and the implementation of governments’ regulation responsibilities, etc. However, little research has been done in respect to evaluation of the regulatory capability in GPPS, as well as the capability maturity. At present, China is still in primary stage in GPPS, the overall level of which is rather low. In present practice, restricted by many factors such as ideological understanding, human resource, technological equipment, legal basis, etc., regulation in GPPS is still a weak link which hasn’t received adequate attention.
The evaluation criteria development for quality regulatory capability in GPPS based on CMM
CMM and the feasibility analysis of its application into quality regulatory capability evaluation criteria development
Proposed by Carnegie Mellon University, CMM was initially applied to deal with software development and management process. It is a description on each stage for defining, implementing, measuring, controlling and improving the software’s process. The initiator, Institute of Software Engineering of Carnegie Mellon University, divided the capability maturity of software development into 5 levels, 18 key process areas, 52 objectives and 316 key practices. CMM made it clearer and more convenient to identify the capability of present process, as well as the important problems of software quality and process improvement, thus providing guidelines to make decisions on selecting process improvement strategies. As software development itself is a project management process, it is undoubtedly logical to apply CMM into the field of project management. After that, CMM was successively applied into areas such as knowledge management [39], Risk management [40], service management [41, 42], public management and logistics management [43]. CMM has now become a relatively mature tool to define the stage of development, characteristics of stages and the direction of development. The five-level maturity model for project management proposed by Kerzner includes general terms, general processes, single method, baseline comparison and continual improvement. Each level has specific evaluation method and criterion, so that the maturity degree of this level could be obtained by aggregation, based on which deficiencies are then analyzed and improving measures are thus made to get into the next stage. Krishnan et al. [44] used CMM to assess the process maturity of technology projects management in the US federal government. Pongsuwan [45] proposed a measurement model called “Procurement Competitive Capability Maturity” (PCCM) for a company to assess current practices of procurement function and perceive the level of its capabilities. Rendon [46] presented an assessment of contract management process maturity in the US Navy based on CMM, which is used to benchmark an organization’s contract management process maturity.
Quality supervision and regulation of GPPS is a system engineering, which develops from disorder to order, from passive to active supervision, from fragmented to systematic. Therefore, it is a process which is gradually getting maturity and the comprehensive capability of management is gradually improving. Meanwhile, the core idea of CMM is just to find out and work on the disadvantages through evaluating the process of an organization and its capability maturity level, thus forming a continuous improving mode. Applying CMM into criteria development of quality regulatory capability evaluation in GPPS is feasible and reasonable. For one thing, CMM is particularly suitable for evaluating process or management capability, and here what we want to assess is just the regulatory capability in GPPS. The weak links in GPPS can be found out through maturity evaluation, which provides direction and effective guidance for departments concerned to make out appropriate improving measures and to perfect the quality supervision system. For another thing, it can provide references for senior governments and the public to evaluate local governments’ performance in their procurement of public service, as well as their supervision performance, thus urging local governments continuously improving their quality regulatory capability in the process of promoting the practice of GPPS. Therefore, it is not only feasible, but also very necessary to introduce CMM theory into evaluation and enhancement of quality regulatory capability of GPPS. Through determining the maturity level of local governments’ quality regulatory capability in its procurement of public service, and defining the weak links facing process areas, aiming at which improvements are made and capability is developed stage by stage. Governments’ regulatory capability in their procurement of public service is consequently enhanced step-by-step, and effective improving mode is thus developed.
Evaluation criteria development of regulatory capability maturity in GPPS
Levels of regulatory capability maturity
Using Software capability maturity levels and project management maturity levels’ classification for reference and combined with the characteristics of the quality supervision of GPPS itself, we divide the quality regulatory capability maturity of GPPS into 5 levels. They are defined as follows according to actual situation of quality regulation: initial stage (L1), repeatable stage (L2), already-defined stage (L3), quantitative management stage (L4) and continuous improvement stage (L5). In order to better describe the characteristics of each level in quality regulation of GPPS, key links of quality regulation including the general characteristics (C1) of each level, regulation process management (C2), multi-party participation (C3), policy making and implementation (C4) and effectiveness (C5) are selected as the evaluation dimensions to compose the criteria system. Typical characteristics of each level in view of the evaluation criteria are extracted in Table 1.
Different levels’ characteristics for quality regulatory capability maturity of GPPS
Different levels’ characteristics for quality regulatory capability maturity of GPPS
The proposed framework of quality regulatory capability maturity evaluation in GPPS is described as follows (Fig. 1): Developing evaluation criteria, which means determining the critical indexes to evaluate the quality regulatory capability maturity on basis of the key links in quality supervision in GPPS. Identifying maturity levels, which means dividing the capability governments should have to regulate the quality of their procurement of public service into different levels, as well as the characteristics of these levels. Implementing the evaluation, which means that various experts (selected as assessors) make a judgement based on the developed criteria and characteristics of different levels. The judgement is about which level the evaluated object currently belongs to corresponding to each evaluation index in the criteria. Aggregation of different experts’ judgements. An expertise aggregation method is designed to fully reflect the experts’ preferences and evaluation information. Determining the order for improvement, which means that in view of the advantages and disadvantages in the process of quality supervision of GPPS, and according to the evaluation results, specific direction for next work for improvement is determined, and the capability enhancement is implemented with emphasis.

Flow chart of quality regulatory capability maturity evaluation in GPPS.
According to Section 3.2, we can easily find that the characteristics for quality regulatory capability maturity of GPPS are described by linguistic terms with 5 levels. Therefore, the theory of PLTSs is applied to evaluate the quality regulatory capability maturity in GPPS in this paper.
Preliminaries
Firstly, some basic definitions and operations for PLTSs are reviewed in this section.
Where # L (p) is the number of all different linguistic terms in L (p).
From the Def. 1, we can easily observe that the sum of probabilistic distribution of all possible linguistic terms is not more than 1. If
In order to compare different PLTSs, the score function and deviation function are defined by Pang et al. (2016) as follows.
Where
Given arbitrary two PLTSs L1 (p) and L2 (p), then the following comparative conclusions hold: if E (L1 (p)) < E (L2 (p)), then L1 (p) ≺ L2 (p); if E (L1 (p)) > E (L2 (p)), then L1 (p) ≻ L2 (p); if E (L1 (p)) = E (L2 (p)),then if Δ (L1 (p)) < Δ (L2 (p)), then L1 (p) ≻ L2 (p); if Δ (L1 (p)) > Δ (L2 (p)), then L1 (p) ≺ L2 (p); if Δ (L1 (p)) = Δ (L2 (p)), then L1 (p) = L2 (p).
Distance measure is very important and necessary in solving MCDM problems. The Euclidean distance for PLTS proposed by Pang et al. (2016) can be described as follows:
Let
Remark 1. If # L1 (p) < # L2 (p), then add corresponding elements for # L1 (p) until # L1 (p) = # L2 (p).
Given an evaluation problem for quality regulatory capability maturity in GPPS, we assume that there are m criteria C1, C2, ⋯ , C
m
, n alternatives A1, A2, ⋯ , A
n
to be evaluated, and experts provide evaluated value by linguistic terms for every alternative in terms of all criteria. Based on processing the data, a decision-making matrix B = (b
ij
) m×n was obtained, where b
ij
is a PLTS indicating the value for alternative A
i
with respect to criterion C
j
. The criteria weighting vector w = (w1, w2, ⋯ , w
n
) is completely unknown satisfying
Obtaining the criteria weights by maximizing deviation method
As the criteria weights are completely unknown, we need a way to compute the criteria weights. Maximizing deviation method, used by a mathematical programming, is an effective way to obtain the criteria weights.
On basis of the idea of maximizing deviation method [16], the deviation value for criterion C
j
can be obtained as
The criteria weights can be computed by the following optimization model
According to construct Lagrange function, we can easily obtain
When decision makers face with uncertain environment, they are usually bounded rational. Prospect theory is a famous way to cope with this issue. TODIM, firstly proposed by Gomes et al. [47], and based on prospect theory, is another effective method for solving MCDM problems. Owing to the capacity of curving decision makers’ bounded rationality, it has attracted many researchers and many studies have been emerged. Hu et al. [31] proposed a new TODIM method for three-way decision model using a novel possibility degree. Ji et al. [48] proposed a project-based TODIM method for neutrosophic information. Llamazares [49] generalized traditional TODIM method by using a series of functions and proved some properties. The key idea lies in that the dominance value of one alternative over others. There are two main types of methods: distance measure and outranking value. In this paper, to compute simply, we use the former method. The main steps are shown as follows.
Firstly, calculate the relative weights of criterion C
j
according to the criteria weights obtained by Equation (7) as follows
Then calculate the dominance degree for alternative A
i
over A
k
in terms of criterion C
j
Then, calculate the dominance degree for A
i
over A
k
in all criteria
Finally, compute the overall dominance degree for A
i
as follows
Rank the alternatives according the overall dominance degree.
Step 1. Calculate the criteria weights w = (w1, w2, ⋯ , w n ) according to Equation (7)
Step 2. Compute the relative weights w r = (w1r, w2r, ⋯ , w nr ) based on Equation (8)
Step 3. Calculate the dominance degree for A i over A k in all criteria Φ (A i , A k ) according to Equations (9-10)
Step 4. Compute the overall dominance degree Z (A k ) based on Equation (11)
Step 5. Rank the alternatives based on the overall dominance degree Z (A k ).
Case study
Description
The quality regulatory capability evaluation for GPPS in Jiangsu Province of China is taken as an example here to illustrate the specific evaluation procedure. Six typical cities in Jiangsu are selected to be evaluated. They are Nanjing (A1), Wuxi (A2), Suzhou (A3), Nantong (A4), Lianyungang (A5) and Xuzhou (A6), among which two (Suzhou and Wuxi) are from South of Jiangsu, two (Nanjing and Nantong) Middle of Jiangsu, and two (Xuzhou and Lianyungang) the Northern part. Therefore, these 6 cities are representative of the current condition of quality regulation in Jiangsu Province.
Evaluations
(1) Building an evaluation group of experts
To ensure the reliability and accuracy of the evaluation, our evaluation group is composed of 10 experts in the field of public management from different universities such as Nanjing University, Nanjing University of Aeronautics and Astronautics, Yangzhou University, Jiangsu University. Officials from governments concerned who are in charge of the work of procurement of public service and personnel from service suppliers are also included in our expert group. The whole group constitutes 10 experts.
(2) Collecting materials for evaluation
Materials for references involved in evaluating quality supervisory capability maturity in government procurement of public can be classified into three categories. The first category is materials about construction condition of government concerned, such as the establishment of governments’ regulation and coordination agency and special regulating organization, as well as the allocation and training of staffs, documents of policies and relative institutions, and so on. The second category is materials collected through searching on the internet such as policy information about GPPS in the 6 evaluated cities in Jiangsu, the bidding information, information from platforms of governments’ work on internet, etc. The third category is typical examples and cases about quality regulation in GPPS in these 6 cities provided by local governments or through search from the internet. All of the above information considered, initial questionnaire is designed according to different key process areas and their goals, which are delivered to all members in our evaluation group through internet, as well as all the materials for references.
(3) The expert group making a judgement (evaluation)
Members of the evaluation group go over all relative material received carefully, and they can communicate with each other anytime on line to gain further insight or discuss with each other when they have different opinions. Finally, evaluation information is collected from experts. All members in our group should make a judgment in view of each cities’ current maturity level out of the five levels (L1-L5) in CMM corresponding to the five criteria (C1, C2, C3, C4, C5).
When judgments from each expert are all collected (Table 2), the evaluation results are sorted out and analyzed. Here, A1, A2, A3, A4, A5, A6 represent the six cities respectively: Nanjing, Wuxi, Suzhou, Nantong, Lianyungang and Xuzhou.
Experts’ judgements about the 6 cities’ current level corresponding to different criteria
Experts’ judgements about the 6 cities’ current level corresponding to different criteria
(4) Aggregation of experts’ evaluation
According to the definition of PLTS, Table 2 can be translated into the following decision matrix B with PLTSs. Here, we assume that the five levels (L1, L2, L3, L4, L5) are the corresponding linguistic fuzzy terms s0, s1, s2, s3, s4. The probability for the linguistic fuzzy term is calculated by ratio of the members of experts choosing this level out of the total members of experts.
Next, quality regulatory capability maturity in GPPS of the six cities will be evaluated and ranked based on the TODIM method for PLTSs.
Step 1. Calculate the criteria weights w = (0.18, 0.2, 0.12, 0.21, 0.28) according to Equation (7)
Step 2. Compute the relative weights w r = (0.63, 0.69, 0.44, 0.76, 1) based on Equation (8).
Step 3. Calculate the dominance degree for A i over A k in all criteria Φ (A i , A k ) according to Equations (9-10) (shown in Table 3).
Dominance degrees for 6 cities
Step 4. Compute the overall dominance degree
Therefore, the ranking result is A3 ≻ A2 ≻ A1 ≻ A4 ≻ A5 ≻ A6.
To illustrate the advantage and feasibility of our method, we carry out a comparative analysis with TOPSIS method proposed by Pang et al. [16], in which the main decision-making procedure is shown as follows:
Compute the criteria weights w = (w1, w2, ⋯ , w n );
Determine the positive ideal solution (PIS) L (p) + and the negative ideal solution (NIS) L (p) -;
Compute the deviation degree
Compute the deviation degree
Compute the closeness coefficient for alternative A
i
as
Rank the alternatives according to the closeness coefficient CI (A i ).
We apply the above procedure to solve our decision problem as follows: The criteria weights are w = (0.18, 0.2, 0.12, 0.21, 0.28); The PIS and NIS are computed as
The deviation degrees between each alternative A
i
and L (p) + are
The deviation degrees between each alternative A
i
and L (p) - are
The closeness coefficients for alternative A
i
are
The ranking result is A1 ≻ A2 ≻ A6 ≻ A5 ≻ A3 ≻ A4.
Comparison with VIKOR method proposed by Wang et al. (2018)
The main decision steps of VIKOR method proposed by Wang et al. (2018) can be described as follows. Calculate the criteria weights w = (w1, w2, ⋯ , w
n
) ; Determine the PIS where Compute the group utility Computer the individual regret value Compute the value where θ is parameter and usually equal to 0.5; Rank the alternatives based on Q
i
and choose the compromise solution(s) according to VIKOR rules (See Wang et al. (2018)).
We use the VIKOR method to solve our decision problem as follows. To make the comparison reasonable we choose the weights w = (0.18, 0.2, 0.12, 0.21, 0.28) ; The PIS and NIS are computed as
The group utility can be obtained as
The individual regret value can be obtained as
We can obtain Q1 = 0.402, Q2 = 0.805, Q3 = 0, Q4 = 0.642, Q5 = 0.761, Q6 = 0.741 .. As Q3 < Q1 < Q4 < Q6 < Q5 < Q2, we can easily obtain the ranking result A3 ≻ A1 ≻ A4 ≻ A6 ≻ A5 ≻ A2. Furthermore, as
It can be easily found that the results are different between our proposed method and the two existing methods, as shown in Table 4. The main reason lies in the fact that our proposed method uses TODIM considering the bounded rationality of decision makers. In fact, in most cases, decision makers may be bounded rational and focus more on changes between the reference point and the actual evaluation. Therefore, our method may be more reasonable than the above existing methods.
Ranking results of different methods
Ranking results of different methods
From the results in Table 3, we can see that Suzhou ranks first among these 6 cities, while Xuzhou ranks the 6th. In fact, as a developed city not only in Jiangsu, but also in China, Suzhou also has done very well in the implementation of the policy of GPPS. Suzhou has published different kinds of guidelines and measures to implement and promote the policy of GPPS. “Guidelines for implementation of GPPS”, “Methods for cost regulation in GPPS”, “Rules for the implementation of GPPS”, et al. have been issued in succession recent years, which contribute a lot to the successful promotion and effective management of GPPS in Suzhou. Meanwhile, there’re many innovations and good practices of GPPS in Suzhou, and plenty of experiences related to the quality supervision and regulation have also been gained. Suzhou excels not only in policy making, but also in process management, multi-part participation, as well as in the effectiveness. So, it is quite reasonable and understandable that Suzhou ranks the first. Then, we can see from Table 12 that Nanjing ranks the 3rd among these 6 cities. Nanjing is the provincial capital of Jiangsu. It should have done well in GPPS in most peoples’ opinions. As a matter of fact, it indeed has done well in certain aspects, especially in policy making and implementation, as well as in multi-party participation. As shown in Table 3, in policy making and implementation, Nanjing overmatches the other 5 cities, ranking the first. In multi-participation, Nanjing ranks 2nd, only slightly weaker than Suzhou. In order to enhance the quality regulation capability in GPPS, Nanjing should do much more in process management, and focus on the improvement of effectiveness. We also take a close look at Lianyungang and Xuzhou, which rank the 5th and 6th among the 6 cities. Although Lianyungang is better than Xuzhou in this ranking list, the advantage is rather minor. The two are almost the similar in quality regulation in GPPS. Much remains to do for them to enhance their capability. Effective policies needed to be made and issued to guide the practice, more attention should be paid to multi-party participation of the quality regulation, and they should also learn from others to do more efficiently in process management, so as to improve the effectiveness at last.
Conclusions
Existing research on regulatory capability evaluation focuses on evaluation of static capability, which guides less in the practice of building and improving the regulatory capability. The quality supervision capability maturity evaluation model for GPPS proposed in this paper is a dynamic evaluation method facing processes, which can better reflect the comprehensive effect in quality regulation for GPPS. Meanwhile, the evaluation model based on TODIM method for PLTSs fully reflects experts’ preferences and evaluation information. The established maturity evaluation model for quality supervision capability can not only evaluate and determine the maturity level, but also can help local governments discover their current weaknesses, thus coming up with individualized solutions for improvement, which will surely make the quality supervision capability promoted level by level, and help the formulation of the continuously improving mode for quality supervision capability in GPPS. Our research is of positive significance to perfect the regulation system and enhance the supervision capability in the practice of GPPS. Comparable evaluation results could be got through the evaluation of supervision process, giving consideration to both static and dynamic effectiveness, which will help local governments establish the continuously improving mode for supervision capability in the practice of GPPS, thus efficiently enhancing the quality supervision effectiveness. Meanwhile, combined with the practical requirement of GPPS, we have explored the new application field of CMM, as well as the improvement to this model, which will help develop the CMM theory, and enrich its theoretical system. The problem of supervision capability evaluation in GPPS is addressed in this paper. However, how to improve the quality supervision capability maturity is not addressed. In the future, we will study the mechanism of quality control for GPPS, as well as the establishment of quality management system.
Footnotes
Acknowledgments
The authors would like to thank the National Natural Science Foundation of China (71403109, 71401064), the Humanities and Social Sciences Foundation of Jiangsu Province (16JYC002), Ministry of Education Foundation of Humanities and Social Sciences (Nos. 19YJA630039, 19YJA880068).
