Abstract
Threat evaluation (TE) is essential in battlefield situation awareness and military decision-making. The current processing methods for uncertain information are not effective enough for their excessive subjectivity and difficulty to obtain detailed information about enemy weapons. In order to optimize TE on uncertain information, an approach based on interval Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) and the interval SD-G1 (SD standard deviation) method is proposed in this article. By interval SD-G1 method, interval number comprehensive weights can be calculated by combining subjective and objective weights. Specifically, the subjective weight is calculated by interval G1 method, which is an extension of G1 method into interval numbers. And the objective weight is calculated by interval SD method, which is an extension of SD method with the mean and SD of the interval array defined in this paper. Sample evaluation results show that with the interval SD-G1 method, weights of target threat attributes can be better calculated, and the approach combining interval TOPSIS and interval SD-G1 can lead to more reasonable results. Additionally, the mean and SD of interval arrays can provide a reference for other fields such as interval analysis and decision-making.
Keywords
Introduction
TE is a process to calculate the extent of a target’s threat according to its motion, type, equipment, operational intention etc. The extent of targets’ threat is the key information for battlefield situation awareness and the foundation of firepower allocation [1] There are two main types of TE methods, those based on machine learning and rule-based evaluation methods.
TE methods based on machine learning work by learning the nonlinear relationship between attributes and extents of the threats by machine learning algorithms [2–4]. These methods predominantly involve neural network (NN) [5] and support vector machine (SVM) [6]. NN based methods are advantageous for their strong capability for nonlinear fitting, while they may suffer from lack of reliable training sets and the need for a great number of training samples. In contrast, SVM based methods do not need a large number of samples for training. But still, the acquisition of reliable training sets is a problem for SVM-based TE, at the same time, a long training time is required when faced with a large amount of training samples. Therefore, in order to improve the effectiveness of TE, researchers combine the advantages of machine learning algorithms with other theoretical methods. Yue proposed a GNNM model [5]. It’s a predictive model that combines the advantages of small sample prediction with gray system theory and the advantages of self-learning of NN. Yang conducted threat assessment based on BP-BN [7]. It uses the powerful reasoning ability of Bayesian networks to analyze qualitative indicators to obtain threat values.
TE methods based on rule-based evaluation are engaged with clear calculation rules for the threat extents and rankings, including Bayesian network (BN), fuzzy evaluation (FE) and multiple attribute decision making [8] (MADM). BN based methods in TE [9] have been demonstrated to be effective for dealing with uncertain information, but the determination of prior probabilities in BN-based TE depends on subjective expert experience [5]. FE in TE [10–12] is good at processing qualitative indicators, but the determination of membership functions and evaluation rules still depends on subjective expert experience. By contrast, MADM in TE is not affected by the specific types or attribute ranges, and it is a strongly versatile method and is easy for calculations. In addition, MADM can reduce the subjectivity during evaluation by an objective weighting method. Therefore, it can be deduced that MADM is more general, more flexible and simpler than other TE methods.
There are many kinds of uncertain information in TE [9, 14], such as expert experience, measurement errors of target parameters, qualitative indices, etc. However, the methods mentioned previously are not sufficient to effectively process these information. Specifically, the machine learning-based methods can not directly deal with uncertain information. They need to integrate with other processing methods, such as grey system theory [5], Bayesian network [9], to fulfill this job. As for rule-based evaluation methods, BN deals with uncertain information by priori probabilities, and FE tackles such information by fuzzy theories such as intuitionistic fuzzy sets (IFS) [11] and GIFSS [10]. The priori probabilities in BN and the membership function in fuzzy theory are the key to process uncertain information in their individual framework, but they are determined by subjective judgments in current TE methods.
In addition, MADM is integrated with other methods to deal with uncertain information in TE, such as IFS [13], HFS (hesitant fuzzy sets) [15–17] and interval number theory [20]. Therefore, a more reliable, more objective and simpler method is needed to deal with uncertain information in TE.
In MADM, the weighting methods brings an important impact on the decision results. The weighting methods in interval MADM can be categorized as subjective [21, 22], objective and comprehensive methods [23]. In subjective weighting methods, the preferences of decision makers can be reflected, but their experience and knowledge restrict the weight rationality. By contrast, the results of objective weighting methods are completely determined by the actual and objective attributes, but they are easily affected by outliers, which becomes more serious when processing uncertain information. By contrast, comprehensive weighting methods combine the other two methods together to maximize the advantages of both. In practical application, the weights can be assigned as either real numbers [23] or interval numbers [20].
It has been demonstrated that interval number theory [24] is suitable to process uncertain information in TE. It only requires two parameters for calculation, which are the upper and lower bounds. No additional subjective information is involved when modeling uncertain information as interval numbers, which utilizes the known information to the utmost extent and minimizes the deviation between the model and reality. TOPSIS [25] is an alternative ranking algorithm for MADM proposed by Hwang and Yoon [18]. Since uncertain information is not considered in classical TOPSIS, TOPSIS has been modified and optimized by integrating with other uncertainty theories, giving birth to algorithms like fuzzy TOPSIS [19], interval TOPSIS [20], AHP-TOPSIS [26]. In this paper, an interval MADM model based on interval TOPSIS and interval comprehensive weighting method is established to deal with uncertain information in TE. The comprehensive weights of threat attributes are calculated as interval numbers by the interval SD-G1 method. The results of the comparative analysis based on the evaluation index system indicate that the proposed method has the feasibility for practical applications.
Preliminaries
Interval Numbers and its operations [5, 27]
An interval number is denoted as
Possibility degrees based ranking method is most widely used to determine the order of interval numbers.
Suppose that
However, such ranking method would sometimes bring unreasonable ranking orders. In order to solve this problem, another ranking strategy based on the Boolean matrix has been proposed [30]. The actual steps for this strategy are as follows. In order to rank a group of interval numbers A Boolean matrix Q = {q
ij
} n×n, named as the ranking matrix, is constructed from P, where
Calculate Rank the interval numbers according to the element order of
The purpose of TE is to calculate the extent of target threat based on the observed target attributes. A TE problem with uncertain information can be modeled as a MADM one with interval numbers.
Suppose that m threat targets are observed, and the threat target set
The threat assessment system consists of n attributes for evaluation, and the index set
A threat variable X ij is defined to show the threat extent of target T i on attribute A j , and the weight w j is defined to indicate the importance of A j in TE. In order to process uncertain information, X ij and w j are expressed as interval numbers.
The structure of an interval MADM model for TE with uncertain information is illustrated in Fig. 1. TE based on interval MADM is carried out in the following steps.

Interval MADM model for TE with uncertain information.
Threats with uncertain information are quantified as interval numbers based on the evaluation index system. By taking A decision matrix is established with both target and attribute dimensions based on the threats expressed as interval numbers. The extent of target threat is calculated by interval MADM based on the decision matrix.
TE is a complex operation. When the early warning detection system finds enemy threats, multiple observation platforms will be activated to record their attributes and obtain threat information about the target, followed by subsequent TE accordingly. TE results can be used as a reference for operational decision-making or firepower allocation. Specifically, the TE process based on our proposed method is described in Fig. 2.

Overview of the TE process based on our proposed method.
As can be seen from Fig. 2, this process mainly includes four steps, the details of the proposed TE method are as follows.
(1) Decision matrix establishment
The observed threat attributes about the target are quantified into interval numbers by the evaluation index system. Then an interval attribute decision matrix
(2) Decision matrix normalization
In this paper, vector normalization is used to normalize
According to [31], If an attribute A j is a benefit attribute, then
If an attribute A j is a cost attribute, then
In this way, a normalized decision matrix
(3) Threat attribute weighting
The attribute weights are calculated based on the normalized decision matrix
(4) Evaluation by interval TOPSIS
➀ Determination of ideal solutions. The positive ideal solution S+ is composed of maximum threat attributes
➁ Calculate the distances between each target and the ideal solutions.
The distance between a target T
i
and S+ is labeled as
According to Equation (2),
➂ Calculate the relative closeness C i between each target and S+.
C i is positively related to the threat extent of target T i . Therefore, C i is denoted as the target threat value TV i in the following sections [1, 20].
➃ Rank the targets according to their threat values.
TE results can be obtained by ranking threats, where sort (C i ) (i = 1, ⋯ , m).
The proposed TE method contains these four steps. Among them, the details about the threat attribute weighting and the interval SD-G1 method are introduced in section 5.
The comprehensive weights of threat attributes are calculated as interval numbers by the interval SD-G1 method. Specifically, SD is an objective weighting method, while G1 is a subjective weighting method. Interval SD-G1 method is proposed as an extension and integration of SD and G1 methods in this paper.
Determination of subjective weights
The subjective weights in TE with uncertain information can be calculated by the interval G1 method. The G1 method is an enhancement over the AHP method proposed by Guo [32]. With the increasing of threat attributes, calculations in AHP consistency tests become more complex, and experts’ judgments on weight importance turn less accurate. On the other hand, consistency is not a problem of concern in the G1 method, which evades complicated calculations. Furthermore, in the G1 method, experts judge the importance of weights more easily by ranking and relative comparisons. Therefore, the G1 method is suitable for TE.
Since both the threat attributes and their weights are interval numbers, the interval G1 method has been proposed by extending the G1 method into interval numbers, so as to enable weight calculation even with uncertain information. The actual steps of the interval G1 method are as follows [21, 22]. Determine the order relationship among the attributes. Determine the relative importance between adjacent attributes [21].
Decision makers sort out attributes based on their importance. The relationship between A
i
and A
k
in an attribute set
The weights in this paper are interval numbers, so the weight of attribute
In reality,
It should be noted that although Calculate the weight for each attribute.
According to the traditional G1 method [32], and interval number arithmetic rules, the equations to calculate the subjective weight of each attribute are
Corresponding to the above weight results according to the order relationship, a subjective weight vector is obtained as
The objective weights of threat attributes can be calculated by the interval SD method, which is the extension of the SD method with the means and SD numbers of interval arrays defined later in this paper.
The SD method
Suppose an attribute X ij is a real number. Its objective weight calculated by the SD method is
SD measures the deviation of the attributes in a set from their average, and it is positively correlated with the differentiation among the attributes. Additionally, a larger SD is more helpful for decision-making. In addition, comparing with other objective weighting methods such as entropy method [33] and Criteria Importance Through Intercriteria Correlation (CRITIC) [34], the calculation of SD method is more convenient.
In this paper, the attributes are interval numbers, so the SD method needs to be enhanced to involve interval numbers. Since square and square root operations are needed to calculate SD, it is necessary to give the definition of these operations for interval numbers to calculate the SD of interval arrays.
The theory of interval functions has been studied in [28]. Based on the theory of interval power functions, the square and square root of interval numbers are calculated in this section.
(1) The square of interval numbers
Suppose that
If
So, its power function
Therefore, when n = 2, the square of an interval number can be calculated as
In this paper, Equation (20) is unified by the operation of maximum and minimum.
(2) The square root of interval numbers
Suppose a positive interval number
The square root operation requires the interval number to be positive. When n = 2, the square root
Based on Equations (21) and (23), the mean and SD of an interval array
(1) The mean of interval arrays
The mean of an interval array
When
(2) The SD of interval arrays
The SD of an interval array
When
Based on the calculation equations given in Section 5.2.3, the equation to find out the objective weights when the attributes are interval numbers is obtained and named as the interval SD method.
Suppose an attribute
The objective weight of attribute A j is calculated by
Consequently, the objective weight vector is
The interval G1 method can calculate the weights of threat attributes as interval numbers, and its calculation, as well as the judgment of weight importance, is relatively easy. However, as is shown in the Fig. 3, the order relationship among all attributes and the relative importance between adjacent attributes are completely dependent on experts’ subjective judgments [21]. Therefore, the interval G1 method is flawed for its excessive subjectivity.

The flaw of the interval G1 method.
As the foundation of weight calculation, determinations about order relationship and relative importance are vulnerable to subjective factors. When a strong subjectivity is involved in weight calculation, the results will become unstable.
In order to determine the attribute weights more accurately based on the advantages of the interval G1 method, this paper combines subjective and objective weights together to calculate comprehensive weights, weakening the impact from subjective factors. The idea of comprehensive weights is shown in Fig. 4.

The idea of comprehensive weights.
In this paper, objective weights are introduced by the interval SD method to overcome the subjectivity problem in the interval G1 method, creating the interval SD-G1 method as a consequence. Specifically, the interval SD-G1 method is performed as follows. The objective weight vector The weights of The weight vector
Evaluation index system
This evaluation example is a TE problem of air targets. The first step of TE is to establish an evaluation index system. In this example, three aspects are considered during system establishment, including overall combat capability, target position and motion of air targets [5, 13]. The index system is established shown in Fig. 5.

Evaluation index system of air target.
Overall combat capability. Target type (A1) is an important index to measure the targets’ overall combat capability and their threat. In this paper, target types are mainly considered as one of the five representative target aircrafts, namely missile, fighter, bomber, attack helicopter and early warning aircraft. In addition, jamming ability (A2) is another important indicator of combat capability. A higher jamming ability can provide an advantage in electromagnetic air combats. A1 and A2 are quantified by Miller’s quantitative theory [35], where levels of extremely strong, strong, moderate, weak and extremely weak are assigned numbers of 0.9, 0.7, 0.5, 0.3 and 0.1, respectively. The details are shown in Table 1. Target position is determined by target deviation (A3) and target distance (A4), which are both cost attributes. A3 is an important index to measure the approach intention of both sides. And A4 is an important index related to target weapon and equipment action distance. Target motion includes target velocity (A5) and maneuvering ability (A6). Specifically, target velocity is a benefit attribute. It is a movement index that reflects the target’s intention of combat. And, Maneuvering ability is a qualitative index expressed as linguistic values, which is quantified in the same way as A1 and A2 (Table 1). The more maneuverable the enemy target is, the better it can track and hit friendly targets, as well as evade attacks.
Quantification of qualitative indexes
In all the threat attributes mentioned above, A1, A2 and A6 are constant. These constant attributes indicate the targets’ threats regardless of battlefield situations, which are called static threats in this paper. However, A3, A4 and A5 are variable attributes. They reflect the targets’ movements, actions and direct threats in real battlefields, which are dynamic threats.
Suppose there are 5 air targets in the combat airspace, labeled as T1-T5. Based on the air battle data from Longfei Yue and Gaige Wang [5, 37], target parameters from 2 observation platforms O a and O b are shown in Tables 2 and 3. Due to uncertainties caused by data transmission delays, as well as measurement errors and reliability problems of the sensors, data obtained from 2 observation platforms are different.
Air target parameters from O
a
<sub>
Air target parameters from O a <sub>
Air target parameters from O<sub>b
(1) Decision matrix establishment
Based on the target parameters in Tables 2–3 and the quantification results in Table 1, a decision matrix M0 is obtained.
(2) Decision matrix normalization
The normalized decision matrix M is obtained by Equations (5) and (6).
(3) Threat attribute value weighting
Comprehensive weights for the threats are calculated by the interval SD-G1 method mentioned in previous sections.
First, the objective weight vector W
σ
is calculated by the interval SD method based on the normalized decision matrix M. (Equation (31))
Then, the comprehensive weight vector W
c
is calculated by the interval G1 method based on W
σ
through Equation (14).
Finally, the weighted normalized decision matrix M w is obtained based on the normalized decision matrix weighted by W c .
(4) Evaluation by interval TOPSIS
The distance D+ between targets and the positive ideal solutions (Equation (10)), the distance D– between targets and the negative ideal solutions (Equation (11)) and their relative closeness C are shown in Fig. 6.

Variables in interval TOPSIS.
In this paper, the relative closeness C i is regarded as the threat value TV i . And the TE result of T5 > T2 > T4 > T3 > T1 could be obtained by ranking all TV i in Fig. 6. T5 (missile) is found to exhibit the highest comprehensive threat. The evaluation results are consistent with the actual situation of air combat [1, 11]. Consequently, based on the assessment results, our fighting groups need to make operational decisions and firepower allocations accordingly.
Comparison with non-comprehensive weights
In order to verify the effectiveness of the interval SD-G1 method, it is compared with non-weighting, G1 subjective weighting and interval SD objective weighting strategies. The weights generated from the G1, interval SD and interval SD-G1 methods are as follows From Equation (31), the weights from interval SD objective weighting is:
The weights from the interval SD-G1 method is:
The TE results obtained from these weighting methods are shown in Table 4.
Comparative results obtained from non-comprehensive and comprehensive weights
Comparative results obtained from non-comprehensive and comprehensive weights
As is shown in Table 4, the difference lay in the rankings of T1, T3, and T2, T4. The most intrinsic reason behind such difference is differed importance evaluation results for threat attributes as a consequence of varied weighting methods.
In the non-weighting strategy, the weight for all attributes is 1, and the importance of different threat attributes is evaluated as the same. For the G1 method, threat attributes’ weights are given as, A1 > A6 > A5 > A2 > A3 > A4 and the ranks of these attributes in interval SD and interval SD-G1 methods are both A3 > A4 > A5 > A2 = A1 > A6. Judging from the TE results, T2 and T4 are ranked correctly by interval SD and interval SD-G1 methods, suggesting these two strategies can assign weights to threat attributes that resemble to the actual situations more closely than the other two. In addition, it has also demonstrated that the ranks of T2 and T4 are mainly affected by dynamic threat attributes A3, A4 and A5, since both non-weighting and G1 strategies do not use interval numbers to represent uncertainties.
In order to further compare the weighting results from interval SD and interval SD-G1 strategies, the weights of each attribute are sorted and shown in Fig. The lower bounds, upper bounds and midpoints of the weights correspond to the bottom, top and horizontal line in the middle of the bar.
As is shown in Fig. 7, the weight results for dynamic threats A3, A4 and A5 in two strategies are interval numbers, whose relative size relationships are close. But the weight results for static threat attributes A1, A2 and A6 are obviously different between two methods. A1, A2 and A6 are quantified as real numbers in the interval SD method, but they are expressed as interval numbers in the interval SD-G1 method as a result of interval G1 processing. In addition, the results from the interval SD method are close to the midpoint of those from the interval SD-G1 method. Nevertheless, the interval SD-G1 method can express uncertain information in static threats A1, A2 and A6 as interval numbers by interval G1 processing.

Weights of interval SD and interval SD-G1 methods.
When comparing between T1 and T3, the main parameter difference lay in the static threats: A1, A2 and A6. Furthermore, interval number weights from the interval SD-G1 method make the difference more significant in TE. Therefore, the interval SD-G1 strategy is more favorable to calculate the weights of real attributes. The differences of expressing weights as interval numbers or real numbers will be discussed in section 6.4.2.
In conclusion, compared with non-comprehensive weighting strategies, the interval SD-G1 method could produce better evaluation results on the importance of threat attributes and provide more reasonable weights, which is helpful for higher TE accuracy. In addition, the ranks of T1 and T3 are mainly affected by static threats: A1, A2 and A6, while those of T2 and T4 are mainly affected by dynamic threats: A3, A4 and A5.
In order to verify the idea that weights expressed as interval numbers can lead to better TE outcomes than real numbers, those obtained from the interval SD-G1 method are compared with other real number weights.
The degradation operation takes the midpoint of an interval number X
ij
as its degraded value, which is labeled as DEGR (X
ij
). For an interval array
The interval number weights for comparison come from the interval SD-G1 and interval SD methods, and the real number weights are obtained from DEGR (interval SD-G1), DEGR (interval SD) and non-weighting.
The weight vector of DEGR (interval SD-G1) is:
The weight vector of DEGR (interval SD) is:
TE results obtained from the weighting methods above are shown in Fig. 8 and Table 5 TE differences lay in the ranks of T1, T2, T3 and T4. Such differences in ranks are caused by varied weights.

Threat value (TV) compared with real number weights.
Comparative results with real number weights
TE results from non-weighting strategy and DEGR (interval SD) method are found to be identical. Specifically, SD of the weights obtained from DEGR (interval SD) is 0.3000, suggesting little difference among weights.
When comparing DEGR (interval SD) and interval SD methods, the difference between them is the ranks of T2 and T4. It has been demonstrated in 6.4.1 that these ranks are mainly affected by dynamic threat attributes A3, A4 and A5. Specifically, in DEGR (interval SD), the weights for dynamic threat attributes are expressed as real numbers. As the degraded result of the interval SD method, DEGR (interval SD) fails to rank T2 and T4 correctly. Therefore, the loss of uncertain information caused by degradation makes the evaluation on the importance of dynamic threat attributes inaccurate, and the interval number weights from the interval SD method are more favored to cope with uncertain information.
Among the interval SD, DEGR (interval SD-G1) and the interval SD-G1 strategies, the attribute ranks in the former two methods are identical. Analysis in previous sections has shown that the ranks of T1 and T3 are mainly affected by the static threat attributes, and interval SD-G1 method can better evaluate the importance of these attributes compared to real number weights from interval SD.
In conclusion, compared with real number weights, interval number weights can express and help cope with uncertainties, and evaluation results on attribute importance are more accurate with them.
In order to verify the advantages of the proposed method, some existing MADM methods are selected to assess the five targets.
SAW [36] and Original TOPSIS are non-interval MADM methods. Specifically, the threat values in SAW are calculated as
Besides, Sahin [13] dealed with uncertain information based on IVIFS (Interval-Valued Intuitionistic Fuzzy Set). He combines the characteristics of IVIFS and TOPSIS to solve the MADM problem. And Beskese [15] developed a MADM tool integrating HFS with TOPSIS. Table 6 presents the TE results of the five MADM methods based on air target parameters in Tables 2 and 3.
Threat value (TV) compared with non-interval MADM methods
Threat value (TV) compared with non-interval MADM methods
In the comparison of SAW and Original TOPSIS, Original TOPSIS can rank the top threat target T5, whose effect is better than SAW. The reason is that the threat value of TOPSIS is relative closeness, which comprehensively considers the threats of different attributes, while the threat value of SAW is the sum of weighted threat attribute values. But the threat variables of Original TOPSIS are real numbers, which cannot express uncertain information correctly. IVIFS-TOPSIS provides a very good TE result. Although IVIFS-TOPSIS and HFS-TOPSIS can describe the uncertain information very well, it is greatly influenced by subjective factors of experts. Our proposed method is more reliable and effective because it combines the interval value theory and the synthetic weight method.
TE problems with uncertain information are addressed in this paper, an interval MADM model based on interval TOPSIS and interval comprehensive weighting method is established to deal with information uncertainties in TE.
Interval number theory can help deal with uncertain information obtained from multiple observation platforms. In addition, threats from different attributes can be comprehensively considered via TOPSIS. The proposed TE method based on interval TOPSIS integrates the advantages of both, which can produce more reasonable ranking results. Specifically, the interval SD-G1 method is proposed to calculate the comprehensive weights of threat attributes, which integrates the objective weights from the interval SD method and the subjective weights from the interval G1 method. The feasibility and advantages of the proposed method are demonstrated in an evaluation example: (1) Compared with non-comprehensive weighting strategies, the interval SD-G1 method can produce more promising evaluation results on the importance of the threat attributes, which is helpful for accurate TE. (2) Compared with real number weights and other MADM methods, interval number weights could better represent and assist in the operations on uncertain information, producing more accurate evaluations on the importance of threat attributes. Finally, based on the assessment results, it can be used as a reference for operational decision-making or firepower allocation accordingly.
Compared with the weighting methods of certain MADM, there is less research on weighting methods of interval MADM. Referring to the idea of this paper, some weighting methods can be extended with interval numbers in the future. Specifically, the mean and SD of interval arrays defined in this paper are of reference value for other fields, such as interval analysis, MADM problems and decision-making. In addition, interval number theory is used to represent and cope with information uncertainties, which is mainly feasible in the situations where detailed information about enemy weapons is insufficient. However, when information is adequate, it is more suitable to establish an accurate random model or fuzzy model for TE. Therefore, the evaluation outcomes from different models under varied degrees of information adequacy about the TE remain a good research point in the future, so as to optimize the evaluation results.
Appendix A
When only real numbers are involved, based on the idea of the interval SD-G1 method, the weights of the SD method are taken as the reference value for the G1 method to determine the order relationships and relative importance. Weight calculations are performed as follows. Suppose an objective weight vector W
SD
of The weights of W
SD
are sorted by their sizes. Suppose the order relationship is Calculate the subjective weight by the G1 method.
The relative importance r k is calculated by
Then calculate the weight of
Finally calculate the weight of each attribute.
Therefore, the weights calculated by the SD-G1 method are consistent with those obtained from the SD method when no interval numbers are involved.
