Abstract
Success behind nature inspired evolutionary metaheuristic algorithms lies in its seemly combination of operator’s castoff for smooth balance between exploration and exploitation. The deficit in such combination leads to untimely convergence of an algorithm, simultaneously failed to attain global optimum by stocking in local optimum. This work represents atypical algorithm termed as OBL-MO-SHO to improve the performance of existing SHO. To deal with more intricate realistic problems and to enhance the explorative and exploitative strength of SHO, we have integrated the oppositional learning concept with mutation operator. The proposed algorithm OBL-MO-SHO (oppositional spotted hyena optimizer with mutation operator) reveals promising performance in terms of achieving global optimum and superior convergence rate which confirms its improved exploration and exploitation capability within searching region. To establish competency of proposed OBL-MO-SHO algorithm the same is appraised by means of standard functions set belongs to IEEE CEC 2017. The efficacy of said method has been proven by means of various performance metrics and the outcomes also compared with state-of-the-art algorithms. To scrutinize its uniqueness statistically, Friedman and Holms test has been performed as one non-parametric test. Additionally as an application to unravel real world intricate difficulties the said OBL-MO-SHO algorithm has been castoff to train wavelet neural network by considering datasets selected from UCI depository. The reported results unveils that the evolved OBL-MO-SHO might be one potential algorithm for enlightening different optimization difficulties effectively.
Keywords
Introduction
Optimization is course of generating all probable consequences confined to a predetermined search region by considering applied constraints and opt for the finest outcome. Currently optimization has been widely used across disciplines of engineering and sciences. To deal with intricate real world optimization glitches, nature influenced evolutionary metaheuristic methods are predominantly employed. The higher acceptance of such algorithms is due to its underlying advantages and disadvantages associated with deterministic algorithms which prefers a predefined input set of parameters which leads to unsuccessful attainment of global optimum. In addition to this metaheuristic methods make use of stochastic technique which in turn avoids local optima stagnation problem satisfactorily and succeeding towards global optimum [1]. In the year 1997 scientist Wolpert and Macready stated a theorem termed as “No free lunch theorem” which is the cause of evolvement of new metaheuristic algorithm. According to the theorem all the optimization difficulties can’t be resolved by a single metaheuristic algorithm due to their undergoing differences [2]. Metaheuristic algorithms are also termed as nature inspired evolutionary techniques because it draws their motivation from different natural phenomenon. Some popular approach follows Darwinians concept of evolution i.e. “legacy of good qualities” and competition for the “survival of the fittest”. Some popular approaches which falls to this category are, Genetic algorithm [3], Differential evolution [4] and evolutionary strategies [5]. The other categories of algorithms rely on locomotion, foraging and chasing pattern of swarm. Popular methods belong to this category are particle swarm optimization (PSO) [6], salp swarm algorithm (SSA) [7], grey wolf optimization (GWO) [8], improved salp swarm algorithm with space transformation search [9] and artificial bee colony algorithm (ABC) [10] etc. Apart from this some approaches are also rely on natural laws of universe e.g. gravitational search algorithm (GSA) [11], central force optimization algorithm (CRO) [12] and big bang big crunch algorithm [13] etc. The spotted hyena optimizer (SHO) is one of the recently developed nature inspired evolutionary algorithm proposed by Dhiman et al. for resolving constrained and unconstrained continuous optimization glitches. SHO imitates the social and hunting pattern of spotted hyena. Although there are a huge number of metaheuristic algorithms are available, but we have chosen SHO due to its superior explorative strength inside search region as compared to other state-of-the-art algorithm. The inspiration behind the work is to improve the explorative strength and to enhance the convergence rate of SHO. The ultimate aim of improved exploration is to disclose better solutions which are still unexplored within the search region. The metaheuristic approach is well accepted due to the underlying randomness associated for the selection of input factors [14]. Due to this advantage this is always a chance to improve the explorative strength for continuous optimization difficulties. Hence in the proposed OBL-MO-SHO algorithm we have integrated oppositional learning approach along with mutation operation to enhance the explorative and exploitative strength of classical SHO. The efficacy of the proposed method has been validated by using benchmark function sets belongs to IEEE CEC 2017 [15], along with the outcome is scrutinized over other recent algorithms. Furthermore, the proposed OBL-MO-SHO algorithm has been utilized as a trainer to train wavelet neural network over selected benchmark datasets taken from UCI depository to resolve genuine real world optimizations [16]. Though SHO is a very recently developed metaheuristic algorithm, but it is attracting researchers due to its capacity to resolve various complicated optimization tasks. The real world convoluted engineering complications can be tackled by hybridizing SHO with PSO [17] and also by using the multi objective version of SHO [18]. The same algorithm also castoff to solve various engineering problem and the practicability is demonstrated in high dimensional environment [19]. Feature selection task are also handled by considering binary version of SHO [20].The same algorithm SHO also used in electrical engineering to solve OPF problems [21]. It has been also castoff to solve monetary dispatch issue. To prove its effectiveness as a trainer Li et al. castoff SHO for training FFNN [22]. It has also verified as a successful trainer algorithm to train multilayer perceptron’s network concurrently proving its uniqueness by considering nonparametric tests [23]. The above applications in multidisciplinary fields within a very short span of time confirms its suitability for solving various complex optimization glitches.
The rest part of the paper is organized as follows: Subsection 2 characterises the details behind SHO algorithm, the oppositional learning concept, mutation operator and the proposed oppositional SHO with mutation operator algorithm. Subsection 3 characterises details about the benchmark functions used along with the environment inclusive of experimentation settings. Subsection 4 characterises the depth analysis of conquered results, comparison of conquered results with state-of-the-art algorithms, complexity and convergence analysis. Subsection 5 characterises the statistical significance of the proposed method by the consideration of nonparametric tests. Subsection 5 characterises the realistic application of proposed method as a trainer algorithm over chosen benchmark datasets by considering wavelet neural network. In conclusion the overall summary of the carried work and future directions has been presented.
Basic preliminaries
The current subsection represents social and chasing behaviour of hyenas and proposed oppositional SHO with mutation operator.
Outline of SHO
The spotted hyena or laughing hyena is a greatly successful social carnivorous animal who lives in groups and exhibits most complex social behaviour. Spotted hyenas are complicated, clever and capability to battle unendingly for foodstuff and territory. In the group the female members are the dominance over the male members. Newly born male member have to leave the group when becoming adult and joins in a new searched group as a lowest ranked member in the group to consume food. But the female members will assured a stable position in their own clan. Based on the social behaviour recently Dhiman et al. developed the Spotted Hyena Optimizer (SHO) as a nature inspired metaheuristic algorithm in 2017 [24]. The design of SHO also is based on the social relationship and haunting nature i.e. tracking, chasing, encircling and attacking of spotted hyenas which modelled mathematically to solve optimization problems. Due to the lack of knowledge about the search region priori, the location of prey is considered as the current best or objective as it is closed to optimum. The other search agents in the space update their locations after conforming the location of best candidate solution about the global optimum solution. The behaviour is represented by Equations (1) and (2).
To outline the chasing behavior mathematically, the location of target is acknowledged to the finest agent which considered as optimum. The other search agent’s formulates a collection of reliable associates and holds back the finest consequence acquired until that point to alter their places. The Equations (3), (4), and (5) are accountable to alter place of spotted hyenas.
The ultimate finest result can be estimated by Equation (6).
In case of stochastic algorithms which relies on randomness, offers optimum result and quicker convergence if the optimum solution is not far away. But assuming a worst scenario where the global optimum is present just in the opposite direction of considered random initial guesses position, at this point the optimization process will consume more time or sometimes stuck in local optimum. So considering pre-knowledge, is impossible for a best random guess, the search process should continue among all directions or more accurately, in the opposite directions. The concept was first introduced by Tizhoosh in the year of 2005 [25]. Opposite numbers using OBL model can be stated as follows:
Let p∈[m, n], then opposite number can be expressed as,
To enhance the explorative strength of evolutionary based stochastic methods mutation operator has been used [26]. Here we have used normal distributed uniform mutation operator rather random mutation operator. Because by applying random mutation operators, to the stochastic algorithms, it leads towards local optima stagnation many times due to random selection. So to avoid limitations associated with random mutation, normal distributed uniform mutation has been integrated with oppositional learning for achieving superior outcome. This approach leads to balanced motion considering lesser to larger mutants around the best search agent in ongoing as well as opposite directions. Mathematically, normal distributed uniform mutation can be represented as,
The current segment depicts the proposed oppositional learning mutated spotted hyena optimizer algorithm (OBL-MO-SHO). This OBL-MO-SHO incorporates the oppositional learning model along with normal distributed uniform mutation operator represented in Equation (7 & 9). In the first step, oppositional learning method has been applied by considering possible candidate solution to generate reversed candidate solutions for further iteration. At the outcome the approach improves the exploration ability by taking advantage of initial randomly achieved solutions as well as opposite solutions also, which improves the rate of convergence. In the second approach, the normal distributed uniform mutation operator is applied in continuation with oppositional learning model to establish counter balance between exploration and exploitation. To achieve the purpose smaller mutant factors has been utilized for current and reverse directions, which boost the controlling factors for better exploitation and speed up the convergence rate with growth of iterations. The considered mutant is 0.2. The pseudocode for proposed OBL-MO-SHO algorithm is represented in Table 1.
Proposed Oppositional SHO with Mutation Operator
Proposed Oppositional SHO with Mutation Operator
IEEE CEC 2017 benchmark functions set has been employed to endorse the proficiency of presented OBL-MO-SHO [15]. The set covers 28 diversified constrained optimization difficulties essentially unimodal, multimodal, composite and hybrid in nature. The results reported after executing the proposed method inclusive of SHO, by allowing 500 reiterations for individual trial and 25 such trials considered for problem dimension 10 and 30 over 20 search agents. The searching region boundary values has been considered as per CEC 2017 as: [–10, 10], [–20, 20], [–50, 50] and [–100, 100]. For the simulation purpose we have considered tool as (MATLAB 2016a) with system specification as Intel (R) Core i7 CPU @ 3.7GHz, Attached memory 4 GB inclusive of OS 64 bit.
Outcome analysis
The recorded results expressed are according to the substructure provisioned in IEEE CEC 2017. The obtained result from existing SHO and proposed OBL-MO-SHO algorithm has been represented by assuming 28 constrained functions set pertaining to CEC 2017 applied over dimensions 10 and 30, conferred in Tables 2 and 3. The diverse efficacy measures experienced by executing objective functions from CEC 2017 are accorded in respect of minimum, maximum, mean, median and STD (standard deviation) value. The CEC 2017 function set incorporates 4 varieties of functions such as unimodal, multimodal, hybrid and composite. Unimodal functions are well suited to probe the exploitation competence and multimodal functions are convenient for exploration proficiency. Unimodal functions are appeared as F1 to F3 and F4 to F10 signifies multimodal function in the CEC 2017 objective functions set. The proposed OBL-MO-SHO illustrates superior outcomes as counter to SHO algorithm, which confirms the concrete compliance of the said method. The rest of the functions i.e. F11 to F28falls to the category of hybrid and composite functions in nature. The evolvement of new metaheuristic algorithms day by day is due to the cause for attaining global optimum, by escaping successfully from local minima stuck problem. This important characteristics of metaheuristic algorithm has been assessed by both hybrid and composite functions. In our reported result from Tables 2 and 3, Proposed OBL-MO-SHO outperforms over SHO in all directions.
Mean, Standard Deviation, Median, Minimum, Maximum error value of objective functions conquered by OBL-MO-SHO and SHO for IEEE CEC 2017 problems having dimension 10. Bold mark indicates superior result
Mean, Standard Deviation, Median, Minimum, Maximum error value of objective functions conquered by OBL-MO-SHO and SHO for IEEE CEC 2017 problems having dimension 10. Bold mark indicates superior result
Mean, Standard Deviation, Median, Minimum, Maximum error value of objective functions conquered by OBL-MO-SHO and SHO for IEEE CEC 2017 problems having dimension 30. Bold mark indicates superior result
The metaheuristic methods differ among each other on various factors, starting from number of regulating parameters, framework of algorithm and flow of execution. So the purpose of each evolved algorithm is specific in its use to resolve optimization complications. But to analyse the explorative power, exploitative power, convergence rate and figure out the differences of considered algorithms, such methods have executed over unimodal, multimodal, composite and hybrid functions. All the algorithms chosen have passed through an open resemblance among each other by employing standard functions belonging to CEC 2017 over dimension 10. The absolute count of iterations over the functions is restricted to 104∗specified dimensions. The examined algorithms such as SCA [27], MFO [28], GWO [8], ALO [29], WOA [30] inclusive of proposed OBL-MO-SHO and their observed outcomes has been conferred in Table 4. From the announced outcome proposed OBL-MO-SHO algorithm outperforms over others.
Scrutinizing performance of state-of-art algorithms for IEEE CEC 2017 benchmark complications having dimension 10. Bold mark specifies superior outcome
Scrutinizing performance of state-of-art algorithms for IEEE CEC 2017 benchmark complications having dimension 10. Bold mark specifies superior outcome
The commencing of parameters related to SHO as well as OBL-MO-SHO taken time as 0(TIN∗DN), where TINconnotes complete iteration total for generating arbitrary masses and DNconnotes the inputted problem measure. Fitness estimation consumes extreme time as 0(maxitern∗TIN∗DN), where maxiternconnotes complete reiterations sum. Over-all optimal counting entails time as 0(maxitern∗NoH), where NoHconnotes hyena population. The process, fitness estimation and re-initialization of parameters lingers until desired consequences attained, which consumes time as 0(n). Hence the complete time disbursed by OBL-MO-SHO algorithm is 0(n∗TIN∗maxitern∗DN∗NoH).
The convergence chart of proposed OBL-MO-SHO and existing SHO algorithm has been presented as shown in Fig. 1 in view of CEC 2017 problems set over dimension 10. The flat axis of the chart illustrates complete reiterations and perpendicular axis illustrates customary value functions indicated. Scrutinising the presented chart, proposed OBL-MO-SHO algorithm proves it’s worth concerning to faster convergence rate towards conquering global peak value, at the same time not falling in local optima stagnation.

Convergence curve acquired from benchmark functions from IEEE CEC 2017.
Statistical analysis has been carried out to certify that the underlying data interpreted accurately and the established relationships are significant and not just a possibility occurrences. Here we have proved the notable distinction exists among considered metaheuristic methods. To achieve the purpose we have considered two nonparametric test, first one is Friedman’s test and later one is Holms test. To carry out Friedman’s test, we consider one null hypothesis H0stated by: there exists no substantial heterogeneity among inspected metaheuristic methods. To establish the hypothesis considered significance level ∝ is 0.05. For evaluation purpose one rank is allocated to all metaheuristic method used, ranging from 1 to m based on the result obtained from benchmark function sets. The average of rank can be computed by Equation 10.
The Friedman’s statistics can be computed by Equation 11.
Where
Here m depicts the entire number of objective test functions set and T depicts castoff optimization methods count. The Friedman’s statistics F s is disseminated specifying to F-distribution inclusive of (T–1) and (T–1)(m–1)degree of freedom. The computed degree of freedom considering 6 metaheuristic algorithms and 28 objective functions set is in the scope 5 to 135. The perceived critical value for F(5,135)over αtaken as 0.05 is 4.3650 [31]. The assessed F s value is 16.640 which is much greater than observed critical value. So the null hypothesis is rejected due to observed greater F s value than critical value, confirming presence of notable distinctions among castoff algorithms. Then to establish the uniqueness of proposed method we have to go for another test i.e. Holms test. The null hypothesis may be stated by: the algorithm compared behaves equally. For this we require z r value which is reflected in Equation 12.
Where
By considering the above computed z
r
value possibly of p
r
value can be determined from normal distribution table [32]. The considered hypothesis may be allowed or discarded by computing the reported p
r
values with
Average rank of recent metaheuristic algorithms concentrated on average error obtained from objective functions pertaining to CEC 2017
Outcome conquered from Holm’s Test
(T - 1) values, leads towards rejection of the hypothesis. From the above analysis, the proposed OBL-MO-SHO algorithm proves its supremacy among all considered metaheuristic methods.
Wavelet theory was developed by Grossman and Morlett in the year of 1980 [33]. There are 7 mother wavelet functions available. The challenge is to incorporate the benefits of wavelet transform concept and neural network to resolve realistic complications. So the term wavelet neural network (WNN) is the combination of two approaches i.e. neural network and wavelet transformations. This was suggested by Q. Zhang in the year of 1992 [34]. WNN employs mother wavelet functions as activation function rather than considering sigmoid. Basically WNN comprises of 3 layers: input, hidden and output layer [35]. Input layer contains the descriptive parameters initialized to the network. The middle layer i.e. the hidden layer consists of hidden units. The hidden units are similar to the neurons present in sigmoid based neural network and termed as wavelons. The inputted parameters to the hidden layer are converted to, expanded and interpreted form of mother wavelet functions. At the end the desired outcome is computed in the output layer. We have considered the Gaussian wavelet function for the computation purpose, which is presented in Equation 13.
Here SHO algorithm and suggested OBL-MO-SHO algorithm has been cast-off to train wavelet neural network together with other metaheuristic algorithms such as DE, GA, PSO and GWO. For classification purpose 8-benchmark datasets has been picked from UCI depository [16]. The observed outcome has been analysed in respect of numerous performance metrics represented in Tables 9 and 10. The value of RMSE can be considered by determining the variance between desired outcome and estimated outcome observed from WNN symbolised in Equation (14). Simple architecture of WNN and narrative of diverse datasets are indicated in Fig. 2 and Tables 7 and 8 as well. For any meta-heuristic algorithm reduced RMSE value, reduced standard deviation and increased average value endorses its solid exploitable ability. From the reported result in Table 9, superior outcome approves the suitability of proposed OBL-MO-SHO algorithm concerning to exploitation. The enhanced specificity and sensitivity consequence connotes the proper classification skill of the recommended technique as classifier. The finest accuracy value conquered in respect to all other castoff algorithms presented in Table 10, endorses supremacy of proposed method for accomplishing global best at the same time not trapped in local optima stuck which favours the solid approval of OBL-MO-SHO algorithm.

Basic architecture of WNN.
Structure of WNN for diverse datasets
Depiction of cast-off standard datasets
Performance assessment of OBL-MO-SHO w.r.t SHO, DE, GA, GWO and PSO
Accuracy conquered from standard data sets
The proposed OBL-MO-SHO algorithm is a refined variant of SHO algorithm. The prime concern of the developed algorithm is to amplify the exploration strength as well as achieving better exploitation capability. The said method has been verified in terms of exploration, exploitation, avoidance from local optima stuck, convergence speed and application in realistic environments. The various performance measures reported by scrutinizing proposed OBL-MO-SHO, are superior in comparison with SHO and other considered algorithms. Finally observing and analysing the outcomes reported by OBL-MO-SHO and existing SHO, some significant conclusive points are highlighted as follows: The integration of oppositional learning with mutation operator enhances the explorative strength of proposed algorithm which confirms exploration about more search region than SHO. Successfully avoids local optima stagnation problem and faster convergence speed confirms its better exploration ability. Statistically proved by Friedman and Holm’s test, confirming its uniqueness among other state-of-art algorithms. Successfully applied to resolve realistic classification problems, as a trainer algorithm to train wavelet neural network. Observed lesser RMSE and higher average value confirms its solid exploitative strength. Superior accuracy attained confirms its improved ability not to trap in local optima.
In future, the proposed algorithm will be applied to resolve various realistic problems. In addition to this it might be applied to train all higher order neural networks to establish as a suitable trainer algorithm.
