Abstract
Mammogram image analysis is a crucial domain in the image-based diagnosis process. It is a trusted modality of non-invasive imaging for detecting tumour regions in the breast mass. However, poor contrast in the mammogram images is a key challenging issue. To address the issue, a brightness preserving gradient based joint histogram equalization (BPGJHE) method is suggested for enhancing the image quality while restoring the actual brightness and the structural information. The key contributions of the proposed method are (1) preserve the actual brightness of the mammogram images, (2) preserve the multi-scale structural details using an improved gradient filtering approach, (3) enrich the performance of the histogram equalization approach by incorporating the spatial information in the histogram. The suggested method is assessed using a series of mammogram images from standard datasets. The performance of the suggested method is validated in competence to the cutting-edge schemes. The quantitative assessment is performed using extensive validation metrics. The results indicate the efficacy of the suggested method.
Introduction
Based on the report of World Health Organization, breast cancer is found to be an alarming disease in the women [1]. Early detection plays a vital role in assisting the treatment planning and reducing the mortality rate. Image based diagnosis is an effective alternative in detecting and analysing the cancerous cells in the breast mass. Mammogram imaging is useful and potentially life-saving tool in the disease diagnosis and treatment planning process [2, 3, 4]. However, discriminating the normal and malignant tissues in a poor contrast environment is a major challenging factor in the image-based diagnosis process. Poor contrast may occur due to low dose of X-ray on the breast mass, which is applied for keeping the patient safe from radiation hazard. Enhancement of the mammogram image using a suitable retrospective technique is helpful for extracting more significant features and improving the malignant detection accuracy. It may also help in predicting the developmental stage of the cancerous cells in the breast mass and aiding the radiologists in the diagnosis process [5, 6, 7]. Therefore, the enhancement of contrast in the mammogram images is an important concern.
In the literature, many histogram equalization (HE) based techniques are reported for addressing the problem at hand. The improvements to the HE technique, such as: adaptive HE (AHE), Contrast Limited AHE (CLAHE), etc., are also reported. A common problem with the HE based approaches is over enhancement. They don’t preserve the actual brightness of the images. In addition to this, preserving the structural details is a key concern for the image based diagnosis. In this work, a brightness preserving gradient based joint histogram equalization (BPGJHE) method is suggested for enhancing the mammogram image quality, restoring the actual brightness and the multi-scale structural details. The input mammogram image is reformed into two sub-images before the enhancement process. It helps in preserving the actual brightness. An improved Gaussian pyramid based gradient filter is designed for retaining the multi-scale edge details of the image. Finally, the sub-images are enhanced using a modified joint histogram equalization (JHE) technique [8, 9]. The suggested technique is experimented with the use of several mammogram images from prevailing datasets. The performance comparison is carried-out with cutting-edge schemes. It appears to be a straightforward and operative formulation for enhancing mammogram images while restoring the structural information.
The upcoming sections are arranged as follows: a synopsis of the related studies is presented in Section 2. In Section 3, the formulation of the proposed method is briefly described. The simulation results with discussion are presented in Section 4. Lastly, the proposed work is concluded with the future direction in Section 5.
Related studies
In the last decade, a numeral method has been reported for addressing the problem at hand. Histogram equalization (HE) is reported as an initial solution for the enhancement of mammogram images. Adaptive HE (AHE) and contrast limited AHE (CLAHE) are the common progresses reported in the literature [10]. In addition to this, many advanced image processing tools such as machine learning, neural networks, fuzzy rules, etc., are integrated with the HE for solving the problem. Heinlein et al. [11] proposed an integrated wavelet transform with HE (IW-HE) for enhancing the microcalcification in mammogram images. They employed a model based method for improving the general contrast enhancement approaches. Christopher and Simon [12] proposed a nonlinear unsharp masking and L0 gradient minimization for mammogram enhancement. Their technique enhances the fine details in mammograms by subtracting a smoothed image using L0 gradient minimization from the original image. This helps in improving contrast and visibility of hidden masses in mammograms.
Sundaram et al. [13] reported an optimization technique based two stage process for contrast enhancement. They used HE and local contrast enhancement (HE-LCE) mechanism for addressing the problem. In [14], Burhan et al. presented a study that aims to enhance mammogram images by utilizing denoising filtering techniques. Their work demonstrated the effectiveness of various filters such as the median filter, CLAHE, and Wiener filter for reducing noise, enhancing contrast, and improving image quality. Dabass et al. [15] reported a CLAHE based method for contrast enhancement in mammogram images. They used intuitionistic fuzzy model for anticipating the entropy based features. Suradi et al. [16] reported a fuzzy anisotropic diffusion HE (FADHE) method for enhancing of mammogram images while restoring the actual brightness. They used fuzzy inference system for clipping the intensity levels in the enhancement process. Jenifer et al. [17] proposed a fuzzy clipped CLAHE method for enhancing the poor contrast while preserving the structural details. However, it does not address the poor contrast in the mammogram images with lesion regions. Chaira calculated the degree of hesitation in [18] in order to generate an interval type 2 fuzzy set for enhancing mammogram images. Zadeh’s fuzzy t-conorm is used to combine the membership functions to form a new one. Using intuitionistic fuzzy divergence and the restricted equivalence function, the thresholding value is calculated. An improved fuzzy hyperbolization process is performed using the computed thresholding value and a limited fuzzifier value for the problem at hand. Mohan et al. [19] integrated the fuzzy C-means (FCM) algorithm with CLAHE for enhancing contrast. The morphological gradient is employed for enhancement and accomplish segmentation at different scales, highlighting different features in the image. However, the above methods involve computational complexity and are parameter dependent.
Duan et al. [20] suggested a multiscale contrast enhancement technique using unsharp masking (UME) in Laplacian pyramid. They used the Laplacian pyramid for preserving the structural details in each scale. In [21], the authors suggested a mammogram image enhancement in the Dyadic wavelet transform domain. However, the approach is limited to analyze micro-calcification in the infant mammogram images. In [22], the authors proposed a s-curve transformation approach for contrast enhancement in mammograms. They showed the effect of sigmoidal function on genetic algorithm for enhancing the lesion regions. Their method aimed to abate the effect of poor contrast on the insight of the abnormalities. In [23, 24], the authors employed CLAHE and morphological operators for improvising the identification of microcalcifications, which are crucial markings of breast cancer. In [25, 26], the authors proposed metaheuristic approaches for medical image segmentation. They stochastically employed the metaheuristic (PSO, DE, ABC) on each sub-population, providing flexibility and adaptability in the optimization process. In [27, 28], the authors employed the CLAHE approach for enhancing the contrast in the mammogram images in the wavelet domain. They employed seam carving for removing the unnecessary pixels and preserving important information requiring manual intervention in the automated process.
Pawar and Talbar [29] proposed a strategy by fusing the discrete wavelet transform coefficients of original and enhanced images through CLAHE. The detail coefficients are combined using a maximum entropy based fusion rule. Their process aims to retain the maximum information pixels for enhanced contrast. In [30, 31], the authors applied Laplacian filtering for denoising or enhancing the mammogram images. Their methods extracted many statistical texture features such as contrast, correlation, etc. Tripathy and Swarnkar [32] proposed a CLAHE based mammogram enhancement technique based on statistical features. They employed a contrast improvement index (CII) to percept artifacts in the mammogram images. Thresholding values are utilized to identify the boundaries of breast masses, facilitating the identification of abnormalities such as calcifications.
In [33, 34], the authors proposed contrast enhancement methods that suppresses normal breast parenchyma and focusing on areas that deviate from the typical tissue density. They help in isolating suspicious regions for further analysis. Kumar et al. [35] combined the contrast adaptive gamma correction (CAGC) and support vector machine (SVM) for mammogram image enhancement. The CAGC balances the overall luminosity of poor-quality mammogram images affected by uneven illumination and low lighting conditions. The SVM in wavelet domain dynamically estimates the intensity transform function based on mammograms statistical features and enhances the contrast. Alshamrani et al. [36] proposed a histogram intensity windowing (HEIW) technique for contrast enhancement in the mammograms. It improves the detection and classification of breast abnormalities, potentially aiding in early diagnosis and treatment planning. Ghosh et al. [37] proposed a CNN based intuitionistic fuzzy special set for mammogram enhancement. Their method particularly focused on improving the visibility of abnormalities such as lesions, lumps, and tumors in low-dose mammogram images. In [38, 39], the authors proposed non-parametric methods for the classification of clinical images. The training data in the feature space is associated with pre-defined classes, and each element is classified based on its K-nearest neighbors. However, the method may be sensitive to noise present in the mammogram, which can affect the accuracy. In [40], we proposed an improved gradient based JHE approach, in which an improved gradient filter is developed using the Gaussian pyramidal filters.
Summary of different mammogram enhancement methods
Summary of different mammogram enhancement methods
A brief summary in terms of databases used, merits and demerits of the above discussed methods is tabulated in Table 1.
The above discussion depicts the following marks, (1) Over enhancement is a fundamental issue with the use of HE based approaches in mammogram images. (2) Parameter initialization and updating are major issues while using clustering based techniques. (3) The learning based methods need a larger amount of annotated training data for effective performance. To address these issues, the BPGJHE technique is proposed for effective enhancement of poor contrast in the mammogram images, while preserving the actual brightness and structural details.
An architectural representation of the suggested BPGJHE method.
The suggested method is implemented in three-steps. In step-1, the mean intensity value of the mammogram image is calculated. Using this mean intensity value, the image is reformed into two sub-images. In step-2, the gradient images are generated using an improved gradient filter. In step-3, image enhancement is accomplished using a modified joint histogram equalization technique. An architectural representation of the suggested BPGJHE method for mammogram contrast enhancement is shown in Fig. 1.
Let
In this stage, the mean intensity value (
and
Now, the sub-image
In this stage, the gradient information of the mammogram image is extracted for incorporating the multiscale features. It is calculated in two steps. In the first step, an adaptive dark pass filter is employed on the mammogram image to abstract multiscale features. The multiscale images are obtained using an improved Gaussian pyramid. In the second step, in each succeeding stages, the Gaussian pyramid decomposes the low contrast image by down sampling. The first-level decomposition results in the bottom-level image of the multiscale pyramid. Initially, a Gaussian kernel size of 5
By satisfying these limiting conditions, the kernel coefficients are computed as:
Here,
Therefore, the dark pass filter
Here,
where,
Here,
The JHE approach incorporates the neighboring intensity values of a data point in the equalization process. A weighted Gaussian filter is used for generating an approximated image from the gradient image. The pixel value and its neighboring data points are considered for estimating the intensity pair counts. As in Fig. 1,
Here,
Similarly, the data point
Here,
The 2D cumulative distribution functions (CDF) for the two sub-images are calculated from the pixel pair population, as:
and
Evaluation indices used for validating the contrast enhancement techniques
Here, the calculation of 2D CDF does not depend on the image size. They are utilized for estimating the contrast enhanced intensity values. The enhanced intensities at location
and
where
and
This process increases the dynamic range of the input image, thereby preserving the structural details. Now the mammogram image intensity values
The suggested method enhances both the sub-images uniquely as per the gradient based joint histograms. Here, the intensity values of the sub-image
In this section, the experimental outcomes and a brief note on them is reported. The suggested BPGJHE technique is simulated in a standard computer with MATLAB. For validating the efficacy of the proposed approach, a comprehensive quantitative assessment is carried out. The state-of-the-art schemes, such as: CLAHE [10], IW-HE [11], HE-LCE [13], FADHE [16], FCM-CLAHE [19], UME [20], ASFO-CLAHE [24], RICE [33], CAGC [35], WEIW [36] and IGJHE [40] are taken for comparison. The mammogram images from the standard datasets, such as: DDSM [41], INbreast [42], MIAS [43] and CBIS-DDSM [44]are used. For quantitative analysis, validation indices (“mean square error (MSE) [45], normalised discrete entropy (DE
Simulation results with the use of DDSM dataset.
Simulation results with the use of INbreast dataset.
Simulation results with the use of MIAS dataset.
Simulation results with the use of CBIS-DDSM dataset.
The subjective assessment of the proposed method is presented in Fig. 2 to Fig. 5. In Fig. 2, the experimental results of mammograms (benign and malignant) from the DDSM dataset are shown. In this figure, the simulation outcomes for the input images D1_A_1413_1. LEFT_CC (4) (benign) and D1_A_1169_1. LEFT_CC (malignant) are presented. Row 1 of the figure shows the mammogram image and its contrast improved image using the suggested technique. In the second row, the 2D histogram of each image is shown. In the contrast enhanced benign class of mammogram images, the fatty region is observed as a nested bright structure, whereas in the malignant class, the lesion region is observed as a deep white mass. The 2D histograms show the equalization of the intensity pixels, which is relatively better. Similarly, Figs 3, 4, and 5 present the simulation results for the mammogram images from the INbreast, MIAS, CBIS-DDSM databases, respectively. The simulation results of the input images 20586934 (4) (benign) and 20586908 (60) (malignant) from the INbreast dataset are presented. From the MIAS dataset, the input images mdb005 (35) (benign) and mdb023 (3) (malignant) are used. Similarly, the input images P_00038_RIGHT_CC_1(13) (benign) and P_00062_LEFT_CC_1 (3) (malignant) are shown from the CBIS-DDSM database.
Quantitative assessment with the use of DDSM dataset
Quantitative assessment with the use of INbreast dataset
Quantitative assessment with the use of MIAS dataset
Quantitative assessment with the use of CBIS-DDSM dataset
The quantitative assessment of the suggested method is presented in Table 3to Table 6 using the mammogram images from DDSM, INbreast, MIAS and CBIS-DDSM databases, respectively. The values in the tables present an average of 50 randomly selected benign and malignant class mammogram images. These tables show the comparison in terms of MSE, DEN, AMBE, EBCM and RCM. From the outcomes, it is observed that the suggested method is clearly the best in terms of most of the evaluation indices. However, in few cases, the suggested method is the second contestant.
Performance comparison of different approaches using (a) MSE, (b) DEN, (c) AMBE, (d) EBCM, (e) RCM.
A graphical analysis is also presented in Fig. 6. Figure 6(a) presents the comparison of the methods using the MSE. From the graph, it is reported that the suggested approach shows least values for both benign and malignant mammogram images, which ensures minimum error in the enhanced image. Figure 6(b) presents a comparison of the discussed techniques in terms of DEN. The maximum value of this parameter ensures better preservation of structural details in the enhanced images. Figure 6(c) presents the comparison of the enhancement assessment using AMBE. The lower value of AMBE with the use of the suggested approach ensures better restoration of the actual brightness in the mammogram images. Finally, Fig. 6(d) and 6(e) show the assessment of different approaches using EBCM and RCM, respectively. The maximum value in these indices also ensure better contrast enhancement as compared to the cutting-edge approaches.
In this work, a brightness preserving gradient based joint histogram equalization method is suggested for enhancement of the contrast in mammogram images. The approach shows a higher relative contrast measure in the quantitative assessment. It may be due to the process of sub-image HE, which restores the actual brightness of the images. The improved gradient pyramid based dark pass filter is employed for incorporating the spatial and multi-scale features in the contrast enhancement process, which increases its performance. The representation of 2D histograms show the equalization of intensity values more appropriately. The performance of the suggested method is depicted in contrast to many cutting-edge approaches. The comparison is done based on a set of standard evaluation metrics and tested over multiple mammogram images from standard datasets. From the qualitative and quantitative assessments, the superiority of the suggested method is claimed. The outcomes obtained will enhance the research in mammogram image analysis in future.
