Abstract
This paper proposes a novel Multi-Objective Optimization based Fuzzy Switching Median Filter (MOOFASMF) to remove high density Random Valued Impulse Noise (RVIN), “Salt & Pepper” Impulse Noise (SPIN) and Mixed Impulse Noise (MIN). In this work, multi-objective optimization technique is used to find out the fuzzy switching median filter threshold values for accurate detection of corrupted pixels. The proposed multi-objective framework uses Decomposition based Multi Objective Evolutionary Algorithm (MOEA/D) to obtain optimized fuzzy switching median filter drives the threshold values with the objectives Mean Square Error (MSE) and inverse of Structural Similarity Index Metrics (SSIM) as optimization objectives. Even though the MSE and SSIM are not closely related parameters, the optimized threshold value gives better results in terms of both PSNR and SSIM. The advantages of the proposed framework are that it works effectively on RVIN, SPIN, and MIN-affected images. The effectiveness of the proposed framework is outstanding for high-density RVIN, SPIN, and MIN, which makes it more advantageous over other existing methods. Experimental results in terms of visual and quantitative metrics such as Peak Signal to Noise Ratio (PSNR), Mean Square Error (MSE), Structural Similarity Index Metrics (SSIM), and Edge Preservation Index (EPI) clearly demonstrates the better performance of the proposed algorithm over the state of art techniques. The proposed framework performed 6.02% and 32.11% better than the best existing methods in terms of PSNR and SSIM for the mixture of 40% SPIN & 50% RVIN affected image.
Introduction
Digital images and videos may undergo different types of degradation during acquisition, processing and transmission (Wang & Lu, 2011). Hence, there is a need for developing novel filters to remove such type of degradation before further processing. Impulse noise is a type of random noise which corrupts certain pixels in the image randomly, and follows a uniform distribution (Brownrigg, 1984). The impulse noise is further classified into fixed valued impulse noise or “Salt & Pepper” Impulse Noise (SPIN) and Random Valued Impulse Noise (RVIN) respectively (Ko & Lee, 1991). SPIN corrupts the image pixels with two different noise values such as 0 and 255 whereas RVIN corrupts the image by any random value in the range of 0 to 255 i.e., dynamic range of the image.
The detection of SPIN corrupted pixels is comparatively easier than the detection of RVIN corrupted pixel. Earlier, filters such as Standard Median Filter (SMF) (Wang & Lu, 2011), Weighted Median Filter (WMF) (Brownrigg, 1984) and Center Weighted Median Filter (CWMF) (Ko & Lee, 1991) etc., are applied directly on the noisy image without any detection of noisy pixel before filtering and those filters works only for low density noise level (Chen & Wu, 2001). Later, filters are proposed to incorporate detection stage which detects the noisy pixels and filtering process is applied only to the detected noisy pixels which leaves the remaining pixels unaltered. Those such filters are more popular because of better edge preservation and high density noise removal (Chen et al., 1999).
In recent days, high density impulse noise removal is more popular (Abreu et al., 1996). There are several state of art works such as Median Type Noise Detector (MTND) (Chan et al., 2005), Boundary Discriminative Noise Detector (BDND) (Ng & Ma, 2006), Decision Based Algorithm (DBA) (Srinivasan & Ebenezer, 2007), Adaptive Switching Median Filter (ASMF) (Akkoul et al., 2010), Modified Decision Based Unsymmetric Trimmed Median Filter (MDBUTMF) (Esakkirajan et al., 2011), Rank Order Absolute Difference (ROAD) (Garnett et al., 2005) and Rank Order Logarithmic Difference (ROLD) (Dong et al., 2007) etc., for the removal of impulse noise. In addition, there are two types of switching based filters namely fixed window based and adaptive window based filters. In order to remove very high noise densities, adaptive window algorithms such as MTND, BDND and ASMF are proposed. The above techniques for impulse noise removal somehow fail either in high noise densities or better edge preservation.
In this paper, an attempt to remove high density SPIN, RVIN and mixture of both noise (Wang et al., 2020). It employs two stage detection and filtering to remove both types of impulse noise Zhang and Li (2007) and Niu and Shen (2007). In the first stage, histogram approach (Toh & Isa, 2010) is used to detect SPIN and second stage a fuzzy membership function is used to detect the RVIN corrupted pixels based on multi objective optimized threshold values (Miettinen et al., 2008).
The threshold optimization itself a significantly wide domain. The wide range of classification in the optimization techniques provides flexibility to choose it based on the context and nature of the problem. The Genghis Khan Shark Optimizer (Hu et al., 2023), Geyser inspired optimization algorithm (Ghasemi et al., 2023), Prairie Dog Optimization Algorithm (Ezugwu et al., 2022), Dwarf Mongoose Optimization Algorithm (Agushaka et al., 2022), Gazelle optimization algorithm (Agushaka et al., 2022), and adaptive hybrid dandelion optimizer (Hu et al., 2023) are the recent popular optimization techniques. Even though, all these optimization techniques are effective they are based on single objective models. The constraint and effectiveness of the optimization are based on the problem. The main objective of our proposed approach is to determine the threshold value for distinguishing noisy pixels. Furthermore, the assessment of the denoised image quality relies on several parameters, including PSNR, MSE, and SSIM. PSNR serves as a conventional measure for evaluating image quality, while SSIM has emerged as a more accurate assessment metric in recent times. Thus, the problem addressed by our proposed scheme necessitates the utilization of a multi-objective optimization technique. Decomposition based Multi-Objective Evolutionary Algorithm (MOEA/D) (Zhang & Li, 2007) is used for optimizing the multiple objectives in finding the optimal threshold values of fuzzy switching filter.
The rest of the paper is structured as the literature review of the related works in Section 2, the multi-objective optimization technique is proposed in 3, the Multi-Objective Optimization based Fuzzy Switching Median Filter (MOOFSMF) is proposed in Section 4, the visual and quantitative results are discussed in Section 5, and concluding remarks are mentioned in Section 6.
Related Works
There are different nonlinear and linear filters have been proposed in the literature to remove either SPIN or RVIN. Among these algorithms, some of the popular and related algorithms are outlined in this section. Fuzzy based filters are working well in discriminating noisy and noiseless pixels than the other types of filters.
A two stage median filter to remove high density SPIN is proposed by Thanh et al. (2020). It classifies the noise density initially into low and high. In the first stage, to remove low density noise pixels, the median of highly recurring pixels in the window is used. To remove high noise density, the median of uncorrupted pixels in the window is used. It uses fixed and adaptive window size for filtering. It shows better performance on high density SPIN, but it is poor on RVIN corrupted images.
In paper Srinivasan and Ebenezer (2007), a popular fixed window, Decision Based Algorithm (DBA) for image denoising to remove SPIN using a small
In paper Veerakumar et al. (2018), an Iterative Adaptive Unsymmetric Trimmed Shock Filter (IAUTSF) based on Partial Differential Equation (PDE) for the removal of SPIN is proposed. This algorithm consists of two steps namely detection and recovery of the noisy pixels. This algorithm works based on a morphological image analysis method. The performance of IAUTSF is better for low density SPIN removal.
In paper Mahalakshmi and Sreenivas (2020), an image denoising method which have three stages namely noise identification, noise correction and image enhancement is proposed. Initially, a type-II fuzzy system is used to identify the noisy pixels and the noise correction is done with the help of Adaptive Non-Local Mean Filter (ANLMF). Finally, the image enhancement is done with the help of Jaya optimization algorithm. The image enhancement is based on the single objective optimization framework. This denoising work also considers three stage image denoising framework. In this work, the noise identification and correction are included during the multi-objective optimization process. MOEA/D is used to identify the threshold values of a fuzzy system which is responsible for noise identification.
A Weighted Schatten p-Norm Minimization (WSNM) (Wang et al., 2021) algorithm is proposed for the removal of impulse noise. Here, the anisotropic Total Variation (TV) regularization was incorporated to preserve edge information and The Alternating Direction Method of Multipliers (ADMM) algorithm was adopted for solving the formulated non-convex optimization problem. This work is mainly for the natural clinical images. The main objective of this algorithm is achieved for upto 40% of RVIN removal.
The performance of recent related works is consolidated and observed. The removal of high density impulse noise is required. The proposed work mainly focus on the high density impulse noise removal. It is described in the following sections.
Proposed Multi-objective Optimization Framework
The design of fuzzy switching median filter is formulated as multi objective problem by considering the minimization of Mean Square Error (MSE) and maximization of Structural Similarity Index Metrics (SSIM) and represented mathematically in equation (1).
Decomposition based MOEA (MOEA/D) decomposes the Multi-Objective Problems (MOP) into
The SOSP
Equation (2) is used only for normalized objectives in the MOP. However, real-time problems are disparately scaled objectives, hence, equation (3) is derived from equation (2), for disparately scaled objectives.
Here,
This section introduces the principle and pseudo-code of the proposed filter. It employs a multi-objective optimization based two stage impulse noise detection algorithm. The first stage uses the noisy image histogram to mark pixels that are corrupted by SPIN. The second stage assigns a Fuzzy flag value that pertains to the probability of RVIN corruption for remaining pixels. The filtered output pixel is a weighted linear combination of the original center pixel value and median value of uncorrupted pixels in the window, with the weight based on its flag value. It removes RVIN upto a noise density of 70% and also a mixture of RVIN & SPIN . The main feature of this algorithm is that it has good detail preserving capability. The steps involved in the proposed technique is discussed in algorithm 2.
Let
Results and Discussion
In this section, the proposed multi-objective denoising framework is evaluated using Matlab installed computer with configuration of Intel core i3 processor and 4GB RAM. In order to verify the performance of proposed framework, the following test images namely Lena, Bridge and Peppers are considered. Similarly, the performance of proposed work is compared with the recent state-of-art algorithms. The quantitative metrics namely PSNR, MSE, SSIM, and EPI are considered for evaluating the denoising performance.
Parameter Configuration
The window size,
Parameter Specification for PSDBMF.
Parameter Specification for PSDBMF.
Parameter Setting for MOEA/D and DE Operator.
The proposed MOEA/D algorithm is executed for solving the multi-objective de-noising problem as given in equation (1) for different images. In this work, three different images are considered and they are: 1) Lena, 2) Bridge, and 3) Pepper. MOEA/D is executed for each image separately to find the optimal threshold by solving the multi-objective de-noising problem. The parameter setting for MOEA/D and DE mutation operator is given in the Table 2.
After the Maximum Function Evaluations (MFE), MOEA/D is stopped and the points in the objective space are filtered by a Pareto filter to identify the non-dominated solutions. In the filtered non-dominated solutions, three points are considered and they are: 1) Anchor point-1, 2) Compromised solution, and 3) Anchor point-2. Anchor point-1 and -2 are solutions at the ends of Pareto front graph which provides extremely good denoising result in terms of SSIM and MSE over each other respectively. Compromised solutions are having balance between the two objectives. Hence, compromised solution is considered for image de-noising analysis. A fuzzy system proposed by Abido (2006) is used to identify the compromised solution in the Pareto Front. After MFE, MOEA/D is identified totally 15, 7, and 7 non-dominated solutions in the Pareto front for Lena, Bridge and Peppers images respectively. The Pareto front for Lena, Bridge and Peppers image is given in Figure 1 to 3 respectively.

Pareto Front Graph for Lena Image.

Pareto Front Graph for Bridge Image.

Pareto Front Graph for Peppers Image.
The Anchor point-1, Anchor point-2, and compromised solutions are identified from the Pareto front for each image and they are shown in the Tables 3 to 5 respectively.
Threshold Values for Lena Image from Pareto Front Chart.
Threshold Values for Bridge Image from Pareto Front Chart.
Threshold Values for Peppers Image from Pareto Front Chart.
In order to test the performance of proposed framework for RVIN noise corrupted “Lena” image of size

Performance of the Proposed Algorithm (a) Original Image, (b) Noisy Image (50% RVIN), (c) Denoised Image (PSNR=25.68dB).

Visual Image Comparison of all Algorithms (a) Original Image, (b) Noisy Image (with 70% RVIN), (c) SMF, (d) ACWMF, (e) TSMF, (f) PSMF, (g) 2-state SD ROM, (h) Trilateral Filter, (i) BDND, (j) ROLD, (k) IMF, (l) NAFSM, (m) TSF, (n) MMPAPF, (o) IAUTSF, (p) BCNNDM, (q) LSTSA and (r) Proposed.
Comparison of Performance Metric Values (PSNR, MSE, SSIM & EPI) of Restored Lena Image Using Various Algorithms for the Different Low Density RVIN.
Comparison of Performance Metric Values (PSNR, MSE, SSIM & EPI) of Restored Lena Image Using Various Algorithms for the Different High Density RVIN.
From Table 7, for 70% RVIN corrupted Lena image, 3.8% high PSNR and 7.5% high SSIM than the BCNNDM algorithm. From Table 8, for 70% RVIN corrupted Bridge image, 0.5% high PSNR and 4.6% high SSIM than the LSTSA algorithm. Similarly, from Table 9, for 70% RVIN corrupted Peppers image, 7.2% high PSNR and 3.8% high SSIM than the WSNM algorithm. This confirms that proposed de-noising framework can preserve the structure of the image even in high noise density. Eventhough, the trade-off characteristics between SSIM and PSNR, proposed method also produce good results based on PSNR or MSE.
Comparison of Performance Metric Values (PSNR, MSE, SSIM & EPI) of Restored Bridge Image Using Various Algorithms for the Different High Density RVIN.
Comparison of Performance Metric Values (PSNR, MSE, SSIM & EPI) of Restored Peppers Image Using Various Algorithms for the Different High Density RVIN.
In order to test the performance of the proposed algorithm for SPIN corrupted image, Bridge image of size

Visual Image Comparison of all Algorithms (a) Original Image, (b) Noisy Image (with 95% SPIN), (c) SMF, (d) WMF, (e) CWMF, (f) ACWMF, (g) AMF, (h) PSMF, (i) FIDT, (j) BDND, (k) DBA, (l) IMF, (m) NAFSM, (n) TSF, (o) MMPAPF, (p) IAUTSF and (q) Proposed.

Performance of the Proposed Algorithm (a) Original Image, (b) Noisy Image (90% SPIN), (c) Denoised Image (PSNR=27.67dB).
The mixture of SPIN and RVIN are applied in few combinations of noise densities to Peppers image of size

Visual Image Comparison of all Algorithms (a) Original Image, (b) Noisy Image (Mixed noise (40% SPIN and 50% RVIN)), (c) SMF, (d) ACWMF, (e) PSMF, (f) 2-State SD ROM, (g) BDND, (h) ROLD, (i) Trilateral, (j) IMF, (k) NAFSM, (l) TSF, (m) MMP, (n) IAUTSF, (o) Proposed.

Performance of the Proposed Algorithm (a) Original Image, (b) Noisy Image (Mixed Impulse Noise (30% SPIN & 30% RVIN)), (c) Denoised Image (PSNR=24.86dB).
Comparison of PSNR & MSE Values of Restored Peppers Image using Various Algorithms for the Different Mixed Noise Densities.
Comparison of SSIM Values of Restored Peppers Image.
This paper introduces a new approach to fix the fuzzy switching median filter threshold values using multi-objective optimization frame work. It uses two different multi-objective functions in order to fix the threshold values. The main highlight of the research is to detect and restore the impulse corrupted images. Not many techniques in literature are capable of removing the mixture of high density RVIN or mixed noise. This problem has been overcome in the proposed techniques by using an efficient two stage detection procedure with the use of optimized threshold using MOEA/D. The objectives of optimization methods are MSE and SSIM. So, both the quantitative result and visual quality are predominantly good for high noise density. The proposed framework performed 6.02% and 32.11% better than the best existing methods in terms of PSNR and SSIM for the mixture of 40% SPIN & 50% RVIN affected image. In future, the framework can be improved further, by increasing the number of non-dominated solutions in optimization.
Footnotes
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
