Abstract
Contrast enhancement is an essential primary part of computer vision in all fields of engineering including aerospace, agriculture, electrical, mechanical, medical, surveillance, etc. Annoying side effect in the enhanced images due to variation of gray levels is a key concern in the existing contrast enhancement techniques. In this paper, a new method for contrast enhancement is proposed, which captures the variation in the gray level distribution using skewness of the pixels distribution of the input image to avoid annoying side effects in order to produce contrast enhanced image with entropy close to that of the input image. In the proposed method, the given image is decomposed into two sub-images using a bisecting gray scale value which is determined based on the shape of the histogram of the input image. The desired Gaussian based histograms for sub-images are determined dynamically by controlling the parameters (mean and standard deviation). The performance of the proposed Histogram shape based Gaussian Sub-Histogram Specification technique (HGSHS) is evaluated on the images taken from standard databases and NASA database using the quality metrics: contrast, entropy and gradient. The performance of the proposed technique is found to be better than that of the existing contrast enhancement techniques.
Introduction
Image enhancement is an inevitable process to transform the original or acquired image more appropriate for specific applications by altering certain features of the image such as contrast, brightness, etc. [1]. Contrast being one of the key feature used in image processessing such as classification, segmentation, object recognition [2], etc., the requirement for contrast enhancement is significant. Usually, enhancement of contrast is attained by histogram processing technique, which is majorly categorized into Histogram Equalization (HE) and Histogram Specification (HS). The concept of enhancing the contrast of an image by spreading the intensity levels of the image into a wider range of intensity scale to attain a uniform histogram is well known as histogram equalization [1]. While spreading the intensity levels during histogram equalization, the shifting of mean of the original image becomes unavoidable, due to which contrary effects such as over-enhancement [3, 4] with augmented noise and intensity saturation, come to existence [5]. To overcome these problems, researchers working in contrast enhancement (CE) techniques have proposed various techniques.
In an attempt to get rid of the problem of over-enhancement due to mean shifting, Kim [6] has proposed mean preserving Bi-HE (BBHE) technique in which the input image is segmented into two subimages using the mean as bisecting point before equalization. Even then, the problem of intensity saturation was not fully resolved, hence Wang et al. [7] have proposed a Dualistic Sub-Image HE (DSIHE) technique, in which two sub-images are formed by equally dividing the image using the median as bisecting point and equalized separately. In order to address the same intensity saturation problem, Chen and Ramli [8] have proposed Minimum Mean Brightness Error Bi-HE (MMBEBHE) method in which a calculated threshold level is used as splitting point for HE. Further, to reduce the problem of augmented noise, the concept of dividing the histogram recursively into preferred sub-histograms before HE is used by Chen and Ramli [9] in their technique: Recursive Mean-Separate HE (RMSHE). Sim et al. [10] have used medians instead mean for segmentation of subimages in their Recursive Sub-Image HE (RSIHE) technique. However, both the recursive type HE techniques RMSHE and RSIHE are found to be inefficient with increased number of recursive. To avoid the problem of over amplification, the concepts of bisecting and clipping the histograms are hybridized in the technique Bi-HE Plateau Limit (BHEPL) proposed by Ooi et al. [11]. Later, an efficient algorithm for enhancing different natural gray scale images called Adaptive CE Based on modified Sigmoid Function (ACEBSF), has been proposed by Lal and Chandra [12].
It is observed from the existing techniques [3, 4, 5, 6, 7, 8] that creating uniform histogram alone does not always provide the best solution, instead, the transformation of the histogram into a specified histogram known as Histogram Specification (HS) or matching is well suited for providing better solutions especially for contrast enhancement problems. As an attempt of refining the accuracy of HS, Zhang [13] has proposed a new grey-level mapping law for direct HS, which is found to be a universal version of HE technique. Later, to enhance contrast without modifying the original histogram distribution features, Chi-Chia et al. [14] have developed a Dynamic HS (DHS) algorithm. Further, to preserve the information content of images during image enhancement, Coltuc et al. [15] have proposed a technique of exact HS using strict ordering.
To accomplish exact HS concurrently with better image enhancement, Wan and Shi [16] have developed a wavelet-based histogram specification technique. To maximize the structural similarity index of the output image, Nasiri et al. [17] have developed a gradient ascent based exact global HS technique. To obtain increased image information after modifying the histogram, an automatic exact HS technique has been developed by Sen and Pal [18]. In an effort to reduce noise through attainment of strict ordering by quantization, Nikolova et al. [19] have developed an exact HS with variational approach. To obtain well-approximated target histogram, Jung [20] has proposed a two-dimensional HS technique with 2D cumulative distribution function based pixel-value mapping.
However, the problems of identifying the optimum desired histogram and appearance of undesirable checkerboard effects on the enhanced images are not fully addressed by the above mentioned histogram specification techniques. Hence an algorithm, which utilizes the contextual information of the histogram to control the brightness and contrast using two parameters known as Brightness and Contrast Controllable HS (BCCHS), has been developed by Xiao et al. [21]. In BCCHS, as the information of neighbouring pixels are gathered for computing the contextual information of the image, the computational part became more complicated. From various existing CE techniques, it is observed that appearance of annoying side effects in the enhanced images due to variation of gray levels is a major issue in the existing CE techniques. Hence, to eradicate this major issue, the proposed work, called as Histogram shape based Gaussian Sub-Histogram Specification (HGSHS) technique, formulates a novel contrast enhancement model using the shape of the histogram of the input image, which helps in avoiding the appearance of annoying side effects in the enhanced image. In the proposed technique, initially, the given image is classified based on its histogram shape by determining the skewness (symmetry, left skewed and right skewed) of the statistical distribution of gray scales in the image.
Based on the nature of the skewness, the given image is segmented into two sub-images namely lower and upper sub-histograms using appropriate Bisecting Gray Scale (BGS). The concept of Sub-Histogram is evolved based on Brightness preserving Bi-Histogram Equalization (BBHE) [6]. Where as in order to increase the search for better enhancement in a wider range, in the proposed work apart from the original mean, the BGS values (i.e. dividing gray scale values) are taken as
Overall diagram illustrating the complete work.
The rest of the paper is organized as follows. The proposed technique is presented in Section 2. Experimental results are discussed in Section 3. Section 4 concludes the paper.
Let
The main aim of the proposed technique’s is to attain an enriched image
where,
The mean (
where,
The standard deviation (
The histogram shape of the input image is determined using the skewness (
In order to split the input image ‘
Based on the BGS value, the input image ‘
where,
The probability distributions of the subimages
where
where
In Eqs (9) and (10),
where
where
To determine the specified Gaussian distributions for the subimages, the lower and upper means (
It is noted from the Eq. (2) that the sigma values for both symmetrically skewed and left skewed histogram are selected as 1 to
The probability distributions of the specified Gaussian distributions of the subimages are computed using Eqs (17) and (18).
where
where
In Eqs (17) and (18),
The cumulative distributions of the specified Gaussian distributions of the subimages are determined using Eqs (19) and (20).
where
where
After deciding the range of
Where,
The transformation functions used to map each gray level in the input subimages to the specified gray level to obtain the desired output subimages with the histogram similar to the specified histogram are given in Eqs (23) and (24).
The decomposed subimages with respect to BGS are enriched independently using Eqs (23) and (24) that can be combined together to obtain enhanced output image.
The enhanced output image
To evaluate the performance of the proposed technique and compare with the existing techniques, the performance metrics such as contrast, entropy, and gradient given in Eqs (26)–(29) are used in this paper.
Contrast
The metric,
Where,
Taking logarithm of
The measure of richness of information known as entropy [23] in an image is normally modified during contrast enhancement. In general, entropy higher than that of the original image is not anticipated, as the increase in information more than that of the original image, which leads to increase in file size leading to complication in compression of the image and sometimes even higher entropy produces undesirable artifacts. The decrease in entropy is also not anticipated, as it may lead to loss of details pertaining to the quality of the image.
Owing to the above concepts, during analysis of entropy, instead of directly using the value of entropy before and after enhancements, the nearness of the entropy value of the enhanced image to the entropy value of the input image is calculated for evaluation of optimum contrast enhancement. In other words, the degree of preservation of details in an image is determined by evaluating the Difference In Entropy (DIE) using the entropies of the images before and after enhancements. The image enhancement is said to be better if the value of the DIE is close to zero. To calculate DIE, the entropy of the image is determined using Eq. (28).
Where,
The measure of sharpness of the image called gradient [24] is computed using Eq. (29)
where,
The optimal values of the parameters BGS,
The experimental evaluations for the proposed HGSHS are carried out on various images taken from USC-SIPI [25], LIVE [26], CSIQ [27], Toyama [28] and Kodak [29] and the results are compared with the existing contrast enhancement techniques. In HGSHS, the images are classified as symmetry, left skewed and right skewed based on the skewness of gray scale distribution of the images, then the histogram of the given image is bisected to obtain the sub-histograms of the image. To bisect the histogram of the given image, the Bisecting Gray Scale (BGS) values are identified. As the distribution of gray scale in an image is not always uniform, the selection of BGS should be done by considering the distribution of gray scale of the image.
It should also be noted that even if a BGS falls outside the gray scale range of distribution of any image, limited stretching of gray scale occurs in the sub-histogram containing the distribution, which reduces the occurrence of undesirable over enhancement. Hence, for an effective sub-histogram bisection, the choice of BGS is done based on the skewness of the given image as per Eqs (2)–(2) given in Section 2. The standard images used for implementation are all 256 grayscale images. Hence the BGS values for symmetrically skewed
The specified Gaussian sub-histograms along with parameters for differently skewed images are shown in Fig. 2, in which it is witnessed that higher standard deviation of the specified sub-histograms widely stretches the range of distribution of grey level of the sub-histograms, which apparently results in contrast enhancement.
Whereas, the increase in the standard deviation higher than
Statistical parameters of input histogram and specified Gaussian sub-histograms
Statistical parameters of input histogram and specified Gaussian sub-histograms
The histograms of input and enhanced images with specified Gaussian sub-histograms for (a) symmetrically (Roadside) (b) left (Aerial1) and (c) right (Plant) skewed images.
Statistical parameters of specified Gaussian sub-histograms for NASA database [30]
Enhanced images with histograms obtained by different techniques for symmetrically skewed Boston image (a) Original Image (b) BBHE (c) DSIHE (d) MMBEBHE (e) RMSHE (f) RSIHE (g) BHEPL (h) ACEBSF (i) HGSHS.
Enhanced images with histograms obtained by different techniques for left skewed Lady_liberty image (a) Original Image (b) BBHE (c) DSIHE (d) MMBEBHE (e) RMSHE (f) RSIHE (g) BHEPL (h) ACEBSF (i) HGSHS.
For performance comparison, the experimental results of the proposed HGSHS are compared with the state-of-the-art image enhancement techniques such as BBHE [6], DSIHE [7], MMBEBHE [8], RMSHE [9], RSIHE [10], BHEPL [11] and ACEBSF [12] for various differently skewed input images obtained from standard databases. Also to compare the performance of the proposed HGSHS technique with another recent BCCHS technique [21], the images from NASA database [30] have been enhanced using the proposed HGSHS and BCCHS techniques.
The qualitative comparison of the images enhanced by different CE methods is presented in this section. To demonstrate the performance, the enhanced images of three differently skewed input images are chosen. The variation in performance are primarily assessed by subjective spectator perception to evaluate the levels of preservation of details, enhancement of contrast and appearance of sharp edges around the objects. The symmetrically skewed original Boston image, its enhanced images and corresponding histograms are shown in Fig. 3. Though the images enhanced using MMBEBHE and BHEPL techniques appears subjectively good, the details such as building and reflections in door glasses are lost in the encircled regions due to over enhancement and intensity saturation. The images processed using BBHE, DSIHE, RMSHE, RSIHE and ACEBSF techniques are found to be poorly enhanced and most of the details are lost due to brightness degradation. Though the existing methods result in marginal contrast improvement, the proposed HGSHS technique produces enhanced image with higher contrast improvement together with preservation of details in the encircled regions of the image.
In addition, the proposed HGSHS sharpens the edges around the objects, which makes the boundary of each object clearly visible. The Left skewed original Lady_liberty image, its enhanced images and corresponding histograms are shown in Fig. 4. It is observed that during enhancement all the existing methods produce brightness degradation in sky, face and tabula ansata as shown in the encircled regions. However, the proposed HGSHS technique enhances the image with preservation of details as observed in the encircled regions.
Enhanced images with histograms obtained by different techniques for right skewed Couple image (a) Original Image (b) BBHE (c) DSIHE (d) MMBEBHE (e) RMSHE (f) RSIHE (g) BHEPL (h) ACEBSF (i) HGSHS.
Sample images from NASA database [30] enhanced by BCCHS and HGSHS (a) Original (Image No. 5), BCCHS (k1 
The Right skewed original Couple image, its enhanced images and corresponding histograms are shown in Fig. 5. It is observed that the existing techniques poorly enhanced the images with loss of details due to intensity saturation as shown in the encircled regions. But the proposed HGSHS technique effectively enhances the image with improved contrast and the details in dark regions are also made visible such as the edges of the man’s coat and legs of the furniture behind the couple as observed in the encircled regions.
For qualitative comparison, few sample images enhanced using the proposed HGSHS and BCCHS are shown in Fig. 6. In some of the images enhanced by BCCHS technique, the occurrence of brightness degradation and over enhancement are clearly observed in the encircled regions as shown in Fig. 6. Whereas, in the images enhanced by the proposed HGSHS technique the enhancement of visibility of objects in dark regions with sharper edges around the objects are observed in the encircled regions.
To evaluate the performance of the CE techniques quantitatively, the contrast, DIE and gradient values produced by these techniques are calculated for all the differently skewed input images and are given in Tables 3–5.
Contrast of images enhanced by various techniques
Contrast of images enhanced by various techniques
DIE of images enhanced by various techniques
Gradient of images enhanced by various techniques
Contrast of images enhanced by BCCHS and HGSHS techniques on NASA database [30]
DIE of images enhanced by BCCHS and HGSHS techniques on NASA database [30]
Gradient of images enhanced by BCCHS and HGSHS techniques on NASA database [30]
From Table 3, it is observed for all the types of skewness, the contrast values obtained by the proposed HGSHS technique are higher than that of other existing techniques. It is evident that because of the higher contrast obtained the details in the encircled regions of Figs 2–4 corresponding to HGSHS are more visible than that of the other existing techniques. From Table 4, it is observed that for symmetrically skewed images, the closeness of the entropy values of the images enhanced by the proposed HGSHS technique given as DIE values are found to be very less (close to zero) compared with that of the other techniques is an evidence of the preservation of details. Hence, it is very clear that the symmetrically skewed images are efficiently enhanced by the proposed HGSHS technique. For left and right skewed images, though the DIE values obtained by the proposed HGSHS is slightly worse than RSIHE technique, the details in dark regions of the image obtained by HGSHS technique is better visible than the RSIHE technique as the contrast obtained is significantly high. In addition, the DIE values obtained by the proposed HGSHS is found to be better than that of remaining existing techniques.
The values of gradient, the measure of sharpness obtained for the images enhanced by various techniques are shown in Table 5. The average increase in gradient with respect to original image for the proposed HGSHS technique is above 50%, however the details in dark regions are found to be better visible due to high contrast achieved by the proposed HGSHS when compared to ACEBSF, BHEPL and MMBEBHE as shown in Figs 2–4. In addition, the average increase in gradient obtained by the proposed HGSHS technique is found to be higher than that of BBHE, DSIHE, RMSHE and RSIHE.
The contrast, DIE and gradient values obtained for NASA database images enhanced using HGSHS and BCCHS techniques are shown in Tables 6–8. It is observed that the average contrast improvement obtained by the proposed HGSHS technique is 29.13%, which is higher than that of the BCCHS technique (21.75 %). Further, it is observed that the DIE values obtained by the proposed HGSHS technique are also better than that of BCCHS, due to which the details in the images enhanced by the proposed HGSHS technique are found to be highly preserved. It is observed that for all the NASA images, the gradient values obtained for images enhanced using HGSHS is higher than that of the original images. Whereas for BCCHS, the gradient values obtained for some of the images are lower than that of the original images which results in brightness degradation and annoying artifacts. Based on the results obtained and the analysis, it is evident that the Histogram shape based Gaussian Sub-Histogram Specification (HGSHS) technique is best suitable for enhancement of contrast of differently skewed images.
In the present work the search for optimum statistical parameters is limited for BGS,
In this paper, a new histogram shape based Gaussian sub-histogram specification technique for contrast enhancement is proposed. To enrich the visual quality of the enhanced image without annoying side effects, the Gaussian parameters of the proposed technique is determined relative to the shape of the histogram of the given image. To evaluate the performance of the proposed technique, images from standard databases and NASA database were enhanced and compared. The overall experimental results showed that the proposed HGSHS technique can give better results than the existing contrast enhancement techniques.
