Abstract
An interactive α-satisfactory method via relaxed order of desirable α-satisfactory degrees is proposed for multi-objective optimization with fuzzy parameters and linguistic preference in this paper. Fuzzy parameters existing in objectives and constraints of multi-objective optimization are defined as fuzzy numbers and α-level set is used to build the feasible domain of parameters. On the basis, the original problem with fuzzy parameters is transformed into multi-objective optimization with fuzzy goals. Linguistic preference of decision-maker is modelled by the relaxed order of desirable α-satisfactory degrees of all the objectives. In order to achieve a compromise between optimization and preference, the multi-objective optimization problem is divided into two single-objective sub-problems: the preliminary optimization and the linguistic preference optimization. A preferred solution can be found by parameter adjustment of inner-outer loop. The minimum stable relaxation algorithm of parameter is developed for calculating the relaxation bound of maximum desirable satisfaction difference. The M-α-Pareto optimality of solution is guaranteed by the test model. The effectiveness, flexibility and sensitivity of the proposed method are well demonstrated by numerical example and application example to heat conduction system.
Introduction
In industry, production management decision-making, and national defense, the optimization of multiple objectives, i.e. multi-objective optimization(MOO), is commonly involved. For the feasible region of constraints, it is necessary to select the most satisfactory decision in terms of intention of decision-maker. In reality, multiple objectives are commonly conflicting, incommensurable, and even uncertain. Hence solving the MOO becomes an iterative decision-making process. It is very difficult to optimize all objectives. In order to seek a most preferred solution, a wide variety of methods and techniques have been developed [1–7].
In MOO problems, objectives and constraints generally contain many parameters given by experiments or subjective judgments of decision-maker. However, in the real world, these parameters are often implicit due to decision-maker’s insufficient understanding to the system. For example, in economic application, some parameters are not clear, such as the investment return being about 2000 dollars. Possibly, decision-maker can only give the range of some coefficients of objectives and constraints. These coefficients are often uncertain but bounded. In 1970, Bellman and Zadeh [8] proposed the basic model of fuzzy decision-making. All the parameters, concepts and events that cannot be precisely defined by decision-maker are transformed into fuzzy sets containing a series of possible choices with different confidence levels. Hence it is more appropriate to regard these fuzzy parameter as fuzzy number. Diverse fuzzy optimization problems and fuzzy solutions are founded. Many scholars have proposed different interactive methods. The typical interactive satisfactory optimization method was proposed by Sakawa et al. [9]. Mohan and Nguyen [10] improved the algorithm further. Jafarian et al. [11] proposed a novel method integrating the concepts of intuitionistic fuzzy sets, interactive decision-making and geometric programming. Kannan et al. [12] combined fuzzy mathematical programming with multi-objective particle swarm optimization to deal with uncertain parameters and obtain solutions on Pareto frontier. To solve combinatorial MOO problems with fuzzy data, Bahri et al. [13] defined a fuzzy Pareto dominance for ranking the generated fuzzy solutions. Maysam [14] designed fuzzy adaptive multi-objective cat swarm optimization algorithm to estimate the Pareto frontier, where its parameters are tuned to new environment by Mamdani fuzzy rules when a change occurs.
In order to select specific results from Pareto solution set, preference information given by decision-maker plays an important role. A lot of research has been done in this field [15–18]. Different preference information may produce different Pareto optimal solutions. In light of the expressions of preference information proposed by Huang and Masud in 1979, MOO problems can be divided into three categories: prior preference, interactive preference and posteriori preference [19].
Prior preference means that decision-maker can present adequate preference understanding for the optimization problem in advance. New optimization evaluation conditions or optimization rules can be built in light of preference. This kind of preference is usually characterized by the relative importance or priority requirement of the goal. Base on p-norm formulation, evaluation of objective functions can be transformed into a scalar criterion using weights to express preferrence. The weighted additive model is equivalent to 1-norm, while the weighted min-max approaches are on ∞-norm. Li et al. [20] developed a systematic way to incorporate decision-maker’s preference information into the decomposition-based evolutionary MOO methods. Thiele et al. [21] proposed a preference-based evolutionary approach being used as an integral part of interactive algorithm. Interactive preference means that the preference is not explicit. Due to the complexity of the problem, decision-maker does not know the optimization fully and has to adjust the preference information gradually in terms of the progressive results of optimization. Therefore the objectives’ preference becomes gradually clear until the optimal solution is obtained. The interactive techniques allow the solution to progress toward a preferred solution through an adaptive process during which the decision-maker’s preference is progressively elicited. Zionts et al. [22] proposed a human-machine interactive mathematical programming method to solve the multiple criteria problem. Liu et al. [23] developed a novel multi-objective evolutionary algorithm based on multi-layer interaction preference through decomposition. Posteriori preference means that the MOO problem is solved without preference firstly, and afterwards the preferred result is selected in light of decision-maker’s intention. In this case, it is very important to generate a large number of Pareto optimal solutions. It is required that all the solutions satisfy the Pareto optimality. Cheng et al. [24] defined a reference vector-guided evolutionary algorithm to decompose the original MOO into a number of single-objective sub-problems, and elucidate preference information for a preferred subset of the whole Pareto frontier. Wang et al. [25] proposed a improved two-archive algorithm to assign two selection principles (indicator-based and Pareto-based) to the two archives.
In all the preferences, the importance requirement of objectives is a kind of typical prior preference. Generally the relative importance can be expressed quantitatively, and the weighted model is conventional approach [26–30]. The weight coefficients reflect the importance extents of objectives. The more important the objective is, the greater the weight coefficient value is. In actual production and decision-making, it is more convenient for decision-maker to express preference information in linguistic form. Many linguistic preference measurement methods have been developed in recent years. For example, Herrera et al. [31] expressed linguistic information by means of 2-tuples. Xu et al. [32, 33] focus on deviation measures of linguistic of linguistic preference relations and proposed virtual linguistic terms based on the syntax and semantics. Wang et al. [34] presents a novel linguistic representational and computational model in which the linguistic terms are weakened hedges. Gou et al. [35] defined a double hierarchy linguistic term set to express complex linguistic information. On the basis, they defined the concept of double hierarchy linguistic preference relation to reflect the relationships of any two alternatives and further proposed self-confident double hierarchy linguistic preference relation [36, 37]. Most models mentioned above are based of linguistic term set (LTS) denoted by S = {α|α = 0, 1, . . . , τ}, and the semantics of each S α ∈ S is presented by a fuzzy membership function. These methods are wildly used in group decision making. However, in this paper, we mainly focus on the fuzzy importance toward multiple objectives with linguistic preference by only one decision-maker. Narasimhan [38] used language values such as “important”, “somewhat important”, “very important” to describe importance. And he defined the membership function for the fuzzy importance. Chen and Tsai [39] used the expected satisfaction to represent the fuzzy importance of objectives, and proposed the idea that the more important objective should have the higher expected satisfaction. A two-phase interactive satisfying optimization method was developed for fuzzy multiple objectives optimization with linguistic preference [40].
In this paper, fuzzy parameters and fuzzy importance defined by linguistic preference are both addressed in MOO. The fuzzy parameters are represented as fuzzy numbers. Correspondingly fuzzy systems are redefined by α-level set, so that the fuzzy parameters are used as variables to participate in the optimization. The relaxed order of desirable α-satisfactory degrees is defined to denote different linguistic preference. The original MOO model is transformed into two sub-problems, namely, preliminary optimization model and linguistic preference model. By solving the preliminary optimization model, the maximum comprehensive satisfaction λ* is obtained, and then optimization and importance preference are balanced by the slack parameter Δδ in the preference model. When decision-maker is not satisfied with the optimization result, Δδ can be increased further to relax the constraint. When the adjustment of Δδ still does not meet the requirement of decision-maker, the confidence of fuzzy parameters α can be decreased to obtain a larger feasible region. On the basis, constraint confidence α and slack parameter Δδ are combined to form an interactive satisfactory optimization algorithm with inner-outer loop.Through the inner-outer loop interaction, the freedom degree of optimization is increased, and the more flexible and satisfactory solution can be found. Moreover, the minimum stable relaxation algorithm of Δδ is developed to calculate its relaxation bound corresponding to maximum desirable satisfaction difference. The M-α-Pareto optimality test model is design to guarantee the optimality of solution.
The innovations of this paper can be summarized as:
(1) In order to achieve the balance between optimization and preference, the MOO problem with preference is converted into two single-objective sub-problems including the preliminary optimization and the linguistic preference optimization.
(2) The relaxed order of desirable α-satisfactory degree is used to model the linguistic preference of decision-maker. Two freedom degrees of parameter adjustment resulting from inner-outer loop is built to improve the satisfaction of solution.
(3) Since the importance difference cannot be enlarged, the minimum stable relaxation algorithm is designed to obtain the relaxation bound.
In this paper, Section 2 describes MOO problem with fuzzy parameters and linguistic preferences. The interactive α-satisfactory algorithm with inner-outer loop is introduced in Section 3. Section 4 demonstrates its power by the numerical example and application. In Section 5 the conclusions are drawn.
MOO problem with fuzzy parameters and linguistic preference
MOO problem with fuzzy parameters
Correspondingly the MOO problem with fuzzy parameters can be expressed as follows:

The triangular fuzzy number.

The trapezoidal fuzzy number.
It can be known that the α-level set of the fuzzy number
For the fuzzy parameters
The value of α corresponds to the size of feasible domain. When α = 1, the constraint is the most accurate, but the feasible range is the smallest. With the decrease of α, the constraint satisfaction becomes smaller, but the feasible domain gradually increases. In the case of α = 0, the constraint confidence is the weakest and the feasible range is the largest.
In the MOO, there are often strong conflicts among multiple goals. The conflict among multiple objectives may lead to the unsatisfactory optimization result. In order to reduce this conflict, decision-maker can assign the expectation value and tolerance degree for each objective in advance and convert the objective optimization into the goal satisfaction. The decision goal composed of expectation and tolerance is called fuzzy goal. Fuzzy goal is one kind of vague requirement of decision-maker. Consequently, the multi-objective optimization problem with fuzzy parameters can be transformed into a α-based MOO problem with fuzzy goals.
“

Membership function μ
f
i
(x, a
i
) for fuzzy relation “
The fuzzy relation “

Membership function μ
f
i
(x, a
i
) for fuzzy relation “
“

Membership function μ
f
i
(x, a
i
) for fuzzy relation “
When the objective function f
i
is inferior to the tolerance limit, μ = 0. This means that the optimization result is completely unsatisfactory. When it reaches or exceeds
Combining the definitions of membership function, fuzzy multi-objective optimization model with α-level can be presented as:
For different α, different optimal solutions can be obtained. When α is fixed, a certain confidence level of fuzzy parameters is determined and the feasible region is fixed. In the feasible region, the objectives corresponding to each solution have their own membership value, which indicates satisfaction of decision-maker to the objective optimization. Hence, the definition of α-satisfactory degree is presented as:
By the introduction of α, the MOO problem with fuzzy parameters can be regarded as a typical parametric programming problem, where α provides a freedom degree of regulation. In this case, the analyzer gives the initial value of α in advance, and then continuously adjusts it according to the intention of decision-maker.
Simular to the traditional multi-objective optimal solution, the new definitions for the optimal solution of MOO problem with fuzzy parameters are presented as follows.
Prior preference is often characterized by its relative importance or priority. In order to reflect the difference of relative importance between objectives, weight coefficient ω
i
, (i = 1, . . . , k) is used to build the evaluation form z
i
(ω
i
, f
i
(x)) of each objective.
In light of optimization strategy, interactive methods can be roughly divided into interactive optimization method and interactive satisfaction method. The interactive optimization method requires decision-maker to give the trade-off ratio between the objectives according to the local information in the process of iterative calculation. The interactive satisfaction method requires decision-maker to judge the objectives that need to be improved, maintained and sacrificed in each iteration
For posteriori preference, in order to obtain the Pareto optimal solution set containing all the characteristics of optimization, the most commonly used methods are weighting method and ɛ-constraint method as (12) and (13). At present, some evolutionary algorithms are also developed to generate Pareto optimal frontier [24, 25].
The importance of objectives is generally expressed by accurate weight information. In actual decision-making, however, due to the influence of environment and subjective understanding, decision-maker is not able to give accurate weights for all objectives. Moreover, the linguistic importance preference is more convenient for presentation of decision-maker’ intention. The fuzzy characteristics of linguistic information is more suitable for compromise of objectives.
In this paper, a unified language is used to describe the fuzzy importance preference. The following seven common linguistic terms are used to express different fuzzy importance information, that is
(1) “very important”
(2) “somewhat important”
(3) “important”
(4) “general”
(5) “unimportant”
(6) “somewhat unimportant”
(7) “very unimportant”
From (1) to (7), importance is decreasing. The above seven linguistic terms basically represent all the fuzzy description of importance.
Relaxed order of desirable α-Satisfactory degrees
For conventional importance preference, Chen and Tsai [39] defined the desirable satisfaction for each objective to present the relative importance. Hence the objective satisfaction should comply with
In this paper, the desirable satisfaction is not constant, and treated as an optimization variable. The order of desirable α-satisfactory degree is established to present the importance difference of objectives. Such as the objective f
j
is “very important”, and f
q
is “somewhat important”, j, q ∈ { 1, . . . , k } , j ≠ q. The crisp comparison relation is formulated
The above formula only shows the desirable difference between relative importance.Nevertheless its comparative relationship is quite strict so that finding a more satisfactory solution becomes difficult. Therefore the difference variable γ is introduced to relax the desirable importance preference, so there is:
In this case, whether the desirable importance requirement is satisfied depends on inequality (16). When γ ≤ 0, the basic importance requirement (linguistic terms order) is conformed; on the contrary, when γ > 0, the fuzzy importance requirement is violated.
In order to balance objective optimization and importance difference, this paper decomposes the fuzzy multi-objective problem with linguistic preference into two sub-problems: preliminary optimization and linguistic preference optimization. Decision-maker is required to participate in optimization process.
Preliminary optimization
In this step, the purpose of preliminary optimization is to optimize all the objectives as much as possible regardless of linguistic preference. Once the structure of membership function is determined, the preliminary optimization model does not contain preference information. This guarantees that the satisfaction of the most conflicting objective is not too low. In this paper, the max-min formulation is utilized and the preliminary model is formulated as:
With the inequality (14), the feasible region of solution is reduced greatly. Especially when decision-maker pays special attention to a certain objective or some objectives, too high desriable satisfaction will be given. The preliminary optimization will make the feasible domain under linguistic preference become very small, even lead to no solution. So it may fail to meet the basic fuzzy importance requirement. Therefore, in order to obtain a satisfactory solution, it is necessary to give appropriate tolerance on the basis of the preliminary optimization model to expand the feasible region. The degree of relaxation depends on the intention of decision-maker. Consequently the following equation is proposed to relax the maximum comprehensive satisfactory degree λ*.
To satisfy the fuzzy importance requirement of multiple objectives, it is necessary to establish the second model, i.e. the linguistic preference model. Combining the desirable α-satisfactory relaxation constraint (18), there is
In this method, the slack parameter Δδ is used to control the feasible domain. Besides, the feasible domain can also be expanded by reducing α. When γ ≤ 0, the result satisfies the expected satisfaction order. That is different relaxation can correspond to different solutions.
From the model (19), it can be seen that with the increase of Δδ, the constraints of real satisfaction and desirable satisfaction are relaxed. However, the desirable satisfaction difference between objectives will not increase any more. In this paper, the relaxation (Δδ*) is called the minimum stable relaxation.
Step1: let Δδ=λ*, then the optimal solution x*,
Step2: find the lowest satisfactory degree in all objectives
M-α-Pareto optimality test
The above model aims at achieving the desired α-satisfaction order, which may cause the actual optimal solution not to meet the M-α-Pareto characteristics. Hence it is also necessary to use the following M-α-Pareto test model to ensure the optimality.
Theorem 1. If any component ɛ
i
of ɛ is equal to zero, then x* is M-α-Pareto optimal. If at least one ɛ
i
is not zero, then
Proof. If x* is not M-α-Pareto optimal when all ɛ
i
are zero,
If at least one ɛ
i
is not zero, then
For the fuzzy multi-objective optimization problem with fuzzy parameters, its fuzziness is shown by the fuzzy coefficients in the objective and constraint functions. According to the Section 2, the fuzzy numbers can be used to describe the uncertain characteristics of fuzzy parameters. When linguistic preference information is encountered, it is still handled by fuzzy concept and an interactive α-satisfactory algorithm with Inner-outer loop can be formed.
In the proposed method, the constraint confidence degree α of fuzzy parameters corresponds to different size of constraint domains. To find the preferred solution, the optimization is constructed as inner-outer loop. The inner loop is used to regulate the tradeoff between the two sub-problems under a fixed α. The outer loop is a parametric programming layer of α. Optimization starts from the inner loop. If the optimization result of inner loop cannot meet the preference requirements of decision-maker, the value of α in outer loop can be changed to improve the result further. The range of α is 1-0, and its value is gradually adjusted from large to small.
Algorithms
1: Calculate
2: Decision-maker chooses the objective desirable value and the initial tolerance to build the membership function μ f i ;
3: Initialize α;
4:
5: Establish the preliminary optimization model and get λ*;
6: Initialize Δδ = 0 and formulate the relaxed order of desirable α-satisfactory degrees;
7: Establish the linguistic preference opimization model;
8:
9: Substitute Δδ and solve the linguistic preference optimization model to get γ;
10: Test M-α-Pareto optimality of the solution and get x;
11: Increase Δδ by 0.05;
12:
13: Decrease α;
14:
The following algorithm for MOO problem with fuzzy parameters and linguistic preference (as shown in Figure 6 and Algorithm 1):

Flow chart of algorithms.
Step 1. Calculate the maximum value
Step 2. According to the four optimal values of the individual objective, decision-maker gives the objective desirable value and the initial tolerance to formulate the membership function, and then gives the initial value to the confidence α.
Step 3. Establish the preliminary optimization model and compute the maximum comprehensive satisfaction λ*.
Step 4. Assume Δδ = 0, build the relaxed order of desirable α-satisfactory degrees according to the linguistic preference, and establish the linguistic preference opimization model.
Step 5. Substitute λ* and solve the linguistic preference optimization model.
Step 6. Test M-α-Pareto optimality of the solution by (20).
Step 7. Judge: if optimization result meets the importance difference and decision-maker is satisfied, the optimization stops; otherwise, go to step 8.
Step 8. Increase Δδ to further relax λ*, then return to step 5; or decrease α, and then go back to step 3.
The effectiveness of the proposed interactive α-satisfactory method with inner-outer loop is demonstrated by numerical example and application example to head conduction system.
Numerical example
The following numerical example generally originates from industry problems, e.g. production planning, where production cost is minimized and profit is maximized [9, 10]. Some parameters of the objective functions and constraints are imprecise.
Fuzzy parameters
The linguistic preference requirement is
To show its power, the proposed method is implemented and compared with Chen’s method in [39].
Firstly, when α = 0 and α = 1, calculate the minimum and maximum values of each objective. Four optimal values of all objectives are shown in Table 2.
Optimum of individual objective
As shown in Table 3, decision-maker takes the minimum and maximum of the four optimal values of each objective as the expected value and the allowable limit value.
Perspective value and original tolerance of individual objective
Therefore, the following membership functions are formed as:
Using the above equations, the preliminary optimization model is constructed and solved. Then λ* = 0.6562 is obtained. The following linguistic preference optimization model is established based on the given linguistic preference.
Initialize α = 0.9 and Δδ = 0, then the result is shown in Table 4. Obviously, the result λ* needs to be relaxed by properly increasing Δδ. Then reformulate (23) and solve it again. Further, α is decreased to improve the optimization result. The solutions are listed in Table 4. When α = 0.9 and Δδ = 0.1282, the optimization results of all objectives are consistent with decision-maker’s linguistic preference. Refer to the approach proposed by Chen and Tsai [39], and suppose the desirable satisfactory degrees of the three fuzzy goals are (0.6, 0.5, 0.4), and the satisfactory degrees are obtained as (0.6000, 0.5000, 0.6773) when α = 0.9 and (0.6112, 0.5000, 0.7309) when α = 0.7.
Optimization results for original linguistic preference
The 2D and 3D Pareto frontier of the proposed method can be seen in Figure 7 when α = 0.7 and α = 0.9.

Pareto frontier.
Let Δδ=λ*, and solve the model (23), γ* = -0.2570 is obtained and the satisfactory degrees of all objectives are (0.6065, 0.4542, 0.7203). According to the lowest satisfaction
Efficiency
If decision-maker puts forward new linguistic preference requirement for MOO:
Flexibility
Flexibility needs to be verified by dealing with different degrees of preference (the minimum difference between the desirable satisfaction). Assume that decision-maker does not change the order of linguistic values, but just change the degree of preference, e.g.
Comparing the results of these two methods, it can be found that the method proposed by this paper is better than Chen’s. The reason is that Chen’s method is actually single one fixed optimization in the inner loop. It can only give the desire of satisfactory degrees in terms of preference for each objective. However, the adjustment of inner loop in this paper is interactive. Hence, when the optimization results cannot meet the preference well, the preference degree can be enlarged by relaxing the constraints by outer-loop.
Sensitivity
The sensitivity of this algorithm is validated when the order of linguistic values changes. It is assumed that the new linguistic preference is:
Solve (24) and get Table 5. When γ = -0.0863, the result meets the requirement.
Optimization results of sensitivity
To illustrate the proposed method, a four objective linear optimal control problem of one dimensional heat conduction to control temperature distribution is used as test example. The simulation result is compared with LTS-based model [31]. A LTS with 7 linguistic term of importance defined in the interval in [0,1] is shown in Fig. 8.

LTS of importance.
A multi-objective optimal control problem in a linear distributed-parameter system governed by the process of one-sided heating of metal in a furnace is considered [41, 42]. It is described by the diffusion equation
The initial condition about heating time and boundary conditions about space coordinate are given by
The temperature distribution q (y, t) can be calculated for a given control function u (t) with the function g (y, t), which is shown as follow:
Some of the most popular performance indices are used for linear distributed-parameter systems on the basis of saving the energy as far as possible.
(1) Minimum total fuel.
(2) Minimum amplitude of the fuel flow.
(3) Minimum sum of temperature error in the whole space.
(4) Minimum temperature error of any space coordinate.
q* is the expected spatial temperature distribution. Correspondingly a MOO problem is formulated. In order to simplify this optimal control problem, the continuous objectives are discretized by means of Simpson’s numerical integration formula. Therefore, the MOO model with linguistic preference can be written as follows:
Here, decision-maker gives the linguistic preference in light of real requirement of industry:
f1 (x) is important;
f2 (x) is important;
f3 (x) is very important;
f4 (x) is very important.
Let H = 20, N = 20,
The preliminary optimization model is built and solved. Then λ* is obtained. Hence, the linguistic preference optimization model is
The corresponding satisfactory degrees in the optimization results of (39) for different α and Δδ are given to reflect the various decision making requirements in Table 6. And the satisfactory degrees of LTS-based method are (0.2445,0.5126,0.8415,0.6278) when α = 0.5 and (0.261,0.5259,0.831,0.6069) when α = 0.9.
Optimization results for application example
Figs. 9 and 10 are the curves of the temperature distribution q (y, T) and the control function u (t) when α = 0.5 and Δδ = 0.4071 by these two method. The results of application further prove the effectiveness of the proposed method.

Temperature distribution q (y, T).

Flow control function u (t).
Comparing the results of the two methods, it can be seen that the method proposed by this paper is better than LTS-based method. The results of the proposed method present the fuzzy importance more reasonably. In LTS-based method, once the linguistic preference is given by decision-maker, the optimization result is fixed. However, decision-maker can balance optimization and importance through interactive parameter adjustment by the proposed method. Therefore, this method can express intention of decision-maker more reasonably and conveniently.
This paper presents an interactive α-satisfactory method for MOO problem with fuzzy parameters and linguistic preference. An inner-outer loop optimal adjustment structure is formulated with the α-level set and the slack parameter Δδ. In inner loop, two sum-problems are established by introducing the relaxation variable Δδ and the preference difference variable γ. The satisfactory solution is obtained by repeatedly adjusting the parameters and solving the models. The minimum stable relaxation algorithm is designed for relaxation bound and the M-α-Pareto optimality of solution is ensured by test model. The optimization results of the numerical example and application example to heat conduction system verify the effectiveness, flexibility and sensitivity of the algorithm.
Footnotes
Acknowledgments
This work is supported by National Natural Science Foundation of China under Grant (No. 61773279) and Key Technologies Program of Tianjin (19YFHBQY00040). The authors are grateful to the anonymous reviewers for their helpful comments and constructive suggestions with regard to this paper.
