Abstract
Sparse-view imaging is a promising scanning approach which has fast scanning rate and low-radiation dose in X-ray computed tomography (CT). Conventional L1-norm based total variation (TV) has been widely used in image reconstruction since the advent of compressive sensing theory. However, with only the first order information of the image used, the TV often generates dissatisfactory image for some applications. As is widely known, image curvature is among the most important second order features of images and can potentially be applied in image reconstruction for quality improvement. This study incorporates the curvature in the optimization model and proposes a new total absolute curvature (TAC) based reconstruction method. The proposed model contains both total absolute curvature and total variation (TAC-TV), which are intended for better description of the featured complicated image. As for the practical algorithm development, the efficient alternating direction method of multipliers (ADMM) is utilized, which generates a practical and easy-coded algorithm. The TAC-TV iterations mainly contain FFTs, soft-thresholding and projection operations and can be launched on graphics processing unit, which leads to relatively high performance. To evaluate the presented algorithm, both qualitative and quantitative studies were performed using various few view datasets. The results illustrated that the proposed approach yielded better reconstruction quality and satisfied convergence property compared with TV-based methods.
Keywords
Introduction
X-ray computed tomography (CT) has been widely used in medical diagnosis and industrial nondestructive testing. However, the ionizing radiation with excessive dose can do serious harm to living tissue cells [1]. On the other hand, the data acquisition may be restricted by the condition of scanning situation, such as time or space limitations. Therefore, sparse-view scanning scheme is proposed to tackle this type of reconstruction procedure. However, reconstruction from sparse- view, in fact, is an ill-posed problem which has put forward challenges for the design of reconstruction algorithms. The quality of the CT image construction with the sparse data sampling could be degraded if improper methods are applied. Because of the violation of Tuy-Smith condition [2] in sparse-view data acquisition, iterative techniques are often used to provide better reconstructions than analytical methods [3]. In dealing with ill-posed problems, iterative algorithms based on the variational principle of regularization algorithm are the most common methods. For regularization method, the choice of the appropriate regularization term is the first issue to be considered.
Compressive sensing (CS) [4–6] has been developed as a powerful tool for exact recovery of signals or images from under-sampled observations. The exact reconstruction is based on the fact that there is a sparse representation of an image in transformed domain, such as image gradient. In this case, total variation (TV) regularization and the L1-norm of frame coefficients is often applied in image reconstructions and denoising applications [7, 8]. However, conventional TV has several unfavorable features, such as stair-case effect, that is, the recovery image has piecewise-constant blocks even if the original image is smooth [9]. To eliminate stair-case effect, the straightforward way is involving higher order image derivative into regularizer to provide better edge preservation while reducing the staircase effect in smooth regions of image [10]. In previous work, higher order regularization models which constitute valid extensions of TV are effectively introduced for more image processing tasks [11, 12]. However, higher order regularization models based on second order derivatives are difficult to solve the numerical problems with fourth-order partial differential equations (PDE). Besides, the results generated by some fourth-order problems may still look patchy in smooth regions [10].
It is also highly desirable to provide such regularization term with strong geometric foundations in such a way that mathematical tools from the fields of geometry can be properly analyzed. Recently, there has been some improvement in this field with the development of geometric entities such as the total curvature (TC) approach for surface fairing [13], the mean curvature (MC) method for imaging denoising [14] and the work of Carlos and Chen using Gaussian curvature (GC) for denoising [15]. Applying the L1-norm, TV regularization term merely utilizes the sparsity of gradient (first-order information). Beyond the gradient information, there are many other geometric attributes, such as curvature, which can serve as characteristic description of the featured complicated images. In this paper, the curvature information with the L1-norm is adapted into regularization term to penalize sparsity more effectively and a new hybrid model containing TAC and TV of the image surface is proposed.
For variational model containing the second derivative, it is a nontrivial issue to construct efficient numerical algorithms to deal with the corresponding fourth order Euler-Lagrangian equation. In the recent years, there have been some improvements in the development of algorithms such as the nonlinear multi-grid method of Chumchob [16] and the two-step (TS) algorithm of Tasdizen [17], the convexity splitting method [18] and the fixed-point homotopy method of Yang [19].
There is also the Augmented Lagrangian (AL) method which has already been successfully utilized in the variational models in image processing [20, 21]. Tai and Hahn 20] proposed a fast and efficient algorithm to solve the minimization problem related to Euler’s Elastica (EE) energy. This method decomposed the original minimization problem into a few simple ones, some of which can be solved by the FFT, while the other ones can be quickly dealt with due to existing explicit solutions. An alternating direction total variation minimization (TV-ADM) algorithm [22] for sparse-view CT reconstruction has been proposed, using alternating direction method (ADM) based on ALM. Wang [23] proposed an inexact-TV-ADM algorithm which efficiently computed the pseudo inverse and hence reduced the computing time with little loss of accuracy. Inspire by [20, 21], in this paper, we propose a fast and efficient algorithm to solve the minimization problem related to TAC-TV energy.
The rest of this paper is organized as follows. In section 2, the proposed model is introduced in detail. We review the variational geometry and propose a total absolute curvature combining total variation model. A detailed procedure is discussed for solving this model utilizing ALM, and numerical implementation is also developed. To evaluate performance of the proposed method, we also propose the parameter selection strategy, stopping criterion based on KKT conditions, and texture distance of ROI regions. In section 3, the numerical results are demonstrated to test the proposed method. We list numerical experiments for our model, and compare our results with those obtained by the alternating direction total variation minimization (TV-ADM). Finally in section 4, we present our discussion and conclusion.
Method
Some backgrounds for variational methods and curvature-based regularization
In computed tomography image reconstruction, conventionally, satisfying images are obtained from a large number of projection views [2]. It is of practical value to develop imaging techniques capable of yielding accurate reconstructions from sparse projections (referred to as sparse-view data). However, image reconstructions from few-view projections are actually ill-posed inverse problems, which generally are quite not easy to find the satisfying solutions, especially due to the lack of sufficient measurements and the presence of noise in the observation.
To this end, variational models are often taken to address the above mentioned concerns in both image processing and CT image reconstructions. Such models are built on the minimization of a well-chosen energy function, typically as
One of the most popular variational model is proposed by Rudin, Osher, and Fatemi (ROF) [7], known as the total variation (TV) methods which are first proposed to recover images contaminated by noise. Although its mathematical expression is simple and intuitive, yet it can be explained from the view of differential geometry. Let u (x) be a parametric curve L defined on x ∈ Ω. A first natural geometric measure is the length [24]:
Moreover, since the advent of compressed sensing, TV-based reconstructions have become the mainstream of the research focus for CT image reconstruction. Conventional TV-based methods apply the first order information of the images in the form of L1-norm. Although the ROF model has been studied and utilized popularly, but it still has several unfavorable features such as stair-case effect, corner smearing and loss of image contrast. It is known that the ROF model contains only the first order information. Therefore, in order to remedy these unfavorable properties of this model, one can consider incorporating second order derivative information into energy term E (u).
Curves and surfaces are basic geometric elements in image and vision analysis, and computer graphics. In vision psychology, it has been observed that human subjects can easily observe and process convex or concave features of shapes and boundaries [24], which can be conveniently described by the curvature. That is to say, curvature plays an important role in biological vision networks. In two dimensional situations, for instance, a general second order measure based on curvature measurement for a smooth curve is given by
For a function u (x), the curvature of the level curve l
c
: = {x|u (x) = c} is
Using the co-area formula to integrate all the curves [24], the TAC-TV energy is as follows:
TAC-TV minimization for CT Image reconstructions
Under the discrete-to-discrete model, the computed tomography (CT) imaging model can be expressed using the following discrete linear system:
As discussed in the above context, it can be pointed out that TAC-TV energy is a more suitable model for featured complicated CT image reconstruction than TV term. Therefore, we proposed a hybrid model containing both TV and the TAC for obtaining the intended CT image, termed as TAC-TV optimization which can be expressed as:
As is well known, the augmented Lagrangian method (ALM) has been successfully applied to the constraint optimization problem. Furthermore, we apply the ALM to tackle with the above optimization. Specifically speaking, we first convert the optimization problem (1) as a multi-constraint optimization problem by introducing two new variables
An unconstrained form of the above optimization problem, using the ALM, can be expressed as follows:
However, inspired by previous studies [20, 21], instead of dealing with optimization problem as (1.3), we here consider a more relaxed and easily handled problem. Beforehand, the following useful results are given in [21], and for the self-completeness we include them here:
Then we have
As a consequence of Lemma 1, it is easy to see that minimization of (1) is equivalent to the following constrained minimization problem by introducing variables
The corresponding augmented Lagrangian function can be formulated as
The introduction of the variable
Augmented Lagrangian method for the TAC-TV model
The augmented Lagrangian function (5) can be split into five sub-problems with respect to
In the following subsections, we will discuss the minimizers of all the above sub-problems and the update formula of the multipliers. In kth iteration for example, for each variable in (4), we fix all the other variables and seek the solution for them to update the corresponding variable. Once all the variables are updated, the multipliers will also be updated. All the process will be repeated until the variables are converged.
The
By setting the derivative to 0, we get
Note that, under the periodic boundary conditions for ∇, the coefficient
To obtain the minimization of ɛ2 (
Note that
The
As for the sub-problem ɛ4 (
where C4 is a constant independent of the variable
The
The relationship between the proposed TAC-TV minimization and the conventional TV one is clear: the proposed TAC-TV model includes the TV model, TAC-TV turns to TV reconstruction when b = 0. In this paper, a more relaxed technique is used and the augmented Lagrangian function (5) is transformed into five sub-problems which are iterated in ADM scheme. The general algorithm is summarized in Table 2. In this paper, the proposed method is termed as TAC-TV algorithm.
ADM to solve the sub-problems
The augmented Lagrangian penalty parameters r0, r1, r2, r3 and r4 are used to balance the data fidelity and four regularization terms. Actually, they are often empirically selected by visual inspection. To get the optimal performance, the values of them should be set in accordance with both the noise level and the sparsity level of the underlying image. Generally speaking, the higher the noise level is, the smaller r0 should be. In order to guarantee the reconstruction image
It is important to identify a reasonable and effective stopping criterion for the iteration listed in Table 2 and adapting strategy for the regularization parameter selection in ADMM algorithm. Based on the procedure used in the basic ADMM algorithm [28], we will carry out some theoretical analysis based on the Karush-Kuhn-Tucker (KKT) conditions.
The KKT conditions are satisfied by optimal solutions of constrained optimization problems. Based on (1), an optimal solution
Based on (28) and (29), the residuals of the iteration sequence (
In the same manner the optimality condition for the dual feasibility conditions is:
Based on relations (30) and (31), the iteration sequence in the ADMM should be terminated when the residuals for the feasibility conditions (at least one i.e. the smaller of the two) should be small in an predetermined value.
The residuals also offer a strategy to adjust the AL penalty parameters: r0 and r1. Considering the AL function, it can be observed that large value of r0 will induce a small primal residual of
Both quantitative and qualitative analysis will be included in our discussion for the evaluation of the TAC-TV algorithm. The root-mean-square error (RMSE), peak signal to noise ratio (PSNR), and normalized root mean square distance (NRMSD) are used as measures of the reconstruction quality. The RMSE, PSNR and NRMSD are defined as follows:
Where u and I denote the reconstruction image and the ideal phantom, respectively. And N denotes the total numbers of the pixels, and i is the index of the pixels. The smaller the RMSE and NRMSD value, the better the performance of image reconstruction. The higher PSNR shows that the reconstruction image is of higher quality.
In order to quantify the similar texture benefit of the proposed method, the often used Haralick texture distance (HTD) is taken [29]. The region of interest (ROI) is selected from the truth background images and the Euclidean distance between the textures of the truth background image and reconstructed images is used as the quantitative measure. The closer the distance is, the better the image texture preservation of the ROI region is.
In this section, a series of experiments are conducted to investigate the proposed algorithm. It should be noted that as we have not proven and discussed the convergence of the TAC-TV algorithm, we first carry out the inverse-crime study to verify that for the pseudo real CT data the proposed method can reach the nearly converged and approximately exact reconstruction within the error tolerance. Moreover, the comparisons between the typical and the state-of-the-art methods are also conducted for both simulation dataset and the real CT projections.
The experiments are conducted on a PC equipped with dual-core Intel Core i5-2400 CPU at 3.10 GHz, with a memory size of 8.00 Gigabytes. The codes are written in MATLAB 2014b, and some of them are in C and CUDA with the “mex” interface provided by MATLAB and interacting with MATLAB code. The graphics processing unit (GPU) used is NVidia GeForce GTX 570 with 1.25 Gigabytes global memory and 480 CUDA cores.
In the running program, the choices of the values of some important parameters should be emphasized. In the proposed reconstruction model, the choices of a and b which control the relative strength of the first and the second order information of image. In our trials, it should be noted that it is usually a better choice to set a > b in order to achieve appropriate performances. In all of the experiments of this paper, we set a = 1 and b = 0.4.
Inverse-crime studies
In the subsection, the inverse-crime studies on the CT image of an anthropomorphic head phantom are performed to test the reconstruction precision and the convergence. We assume that if the reconstructed images are identical to the original CT image, the algorithm is seen as convergent. However, the exact reconstruction may take numerous iterations, and we argue that when the difference between the images is within the tolerance the reconstruction can be regarded as nearly convergent.
Here we present the original image in the left of Fig. 1. The projections are generated using a fast and parallel algorithm proposed by Gao [30], and thus the projection data

Background in truth image and the corresponding sinogram for inverse-crime studies.
In the inverse-crime studies, the stop criterion is set as: 1) if the change in RMSE is less than 10-5 or 2) the iteration reach the maximum iteration number (set to 2000) the iteration is terminated. When either the above conditions is satisfied, the program terminated. The running time for each iterative loop is about 0.43 seconds. The reconstructed image is shown in Fig. 2, and the RMSE of the result compared to the standard image is 3.2E-4. For better visual comparison, both a full display window and a much narrower window are chosen for the result. The result suggests that for both windows the reconstructed image can be regarded as a nearly convergent result which implies that the proposed algorithm may reach a stratifying reconstruction.

Reconstruction and comparison of the inverse-crime studies: the top left is the reconstructed image in a display window of [0, 0.0629]. The top right is the error image between the reconstruction and the background truth image with the display window of [–0.0001, 0.0001]. The bottom left is the background in truth image in a much narrower window of [0.0095, 0.0285]. The bottom right is the reconstructed image in the same window as its left.
A series of tests under both noiseless and noisy datasets with different levels are conducted in this subsection. A slice of CT images from scanning of a rabbit head is taken into usage which is shown in Fig. 3. Four ROI regions are selected and marked with red rectangles in Fig. 3. We focus on the test of sparse-view reconstructions. The rotation radius is 164.86 mm, and the source to the center of the detector is 1052 mm. The phantom is of the size of 308×308 with 0.148 mm×0.148 mm for each pixel. The detector has 308 bins with length of 0.74 mm for each. The reconstruction programs are terminated when either of the following conditions is satisfied: 1) the residual for the feasibility conditions is less than 0.01 and 2) the iteration reaches the maximum number 2000. The reconstruction with noise free is shown in Fig. 4, which shows the residuals of the TAC-TV method is lower than 0.01 after about 1530 iterations.

Digital Rabbit head used in simulation study: from the left to right is truth background image in a display window of [0, 1] and [0, 0.34], the ROIs in display windows [0,0.34], respectively. The zooming images of ROIs are placed at the right portion.

Behavior of KKT residual norm for TAC-TV experiments from noise-free dataset.
In the first test, 72 views of projection, within the 360 degrees around the circle trajectory, are acquired for reconstruction. In the following, the performance of the proposed method by comparing it with the recent state-of-the-art algorithm TV-ADM is illustrated in Fig. 5. All methods could recover image well from sparse projection in visual inspection.

Image reconstruction (with zoomed ROIs) of the Rabbit head from noise-free projection dataset. Results of the A) TV-ADM, B) TAC-TV-ADM. Display window is [0, 0.34].
Table 3 lists the RMSE, PSNR, and the NRMSD measures of the image reconstructed by different algorithms with 2000 iterations. Since the reconstructed images in Fig. 5 have little difference from visual sense, the texture distance of ROI regions are employed and the results listed in Table 4 indicate that the proposed method outperforms TV method in image texture preservation of the ROI region.
Evaluations of the results reconstructed by different method from noise-free projection data in digital Rabbit head experiments
Texture distance of ROIs: Texture distance between the reference truth background image and the reconstructed images
To visualize the difference in detail, besides the texture distance of ROI regions, horizontal profiles of the resulting images (Fig. 6) are drawn along the 128th column from the 90th row to the 170th row. The images obtained by use of the proposed algorithm are reasonably accurate with only small distortions, and the zoom-in images may indicate that the proposed method can effectively capture the curvature of image.

Horizontal profiles (128th column) in the reconstruction results of the Rabbit head from noise-free projection dataset. Result of the A) TV-ADM and B) TAC-TV-ADM method.
In this subsection, we carried out the experiments from the projection dataset at different noise levels to further illustrate the practicality of the algorithm. And the Poisson noise is considered:
Three cases with different noise level are considered, and the initial numbers of photons N0 are set to 3 × 106, 106, and 5 × 105 for noise level 1, 2 and 3, respectively. For the noise level 1 and 2, parameter r0 was set to 200, and for noise level 3, r0 was set to 100 in TAC-TV-ADM algorithm. For the TAC-TV method, λ1, λ2, λ3 and λ4 are set to 1, 0.02, 180 and 180, respectively.
The images reconstructed by TV and TAC-TV methods from different noisy projection are shown in Fig. 7 and the RMSE, PSNR and NRMSD are listed in Table 5. The reconstructed images in Fig. 7 are very similar to each other, so the comparison of ROI regions are shown in Fig. 8 and the corresponding texture distance are listed in Table 6. Horizontal profiles of these images along the 128th column of the different noisy cases are shown in Figs. 9, 10 and 11, respectively. The presented TAC-TV image reconstruction has better performance on texture preservation, as expected.

Image reconstruction of the Rabbit head from noisy projection data. Images in the upper and the bottom row are the TV-ADM and the proposed method. From the left column to the right column are the reconstruction results from three different noise levels (level1, 2 and 3, respectively). Display window is [0, 0.34].

Reconstruction and comparison of the ROIs: from the top row to the bottom row are the TV-ADM reconstruction and the TAC-TV reconstruction by 2000 iterations. From the left column to the right column are the reconstruction results from three different noise levels (level 1, 2 and 3, respectively). Display window is [0, 0.34].

Horizontal profiles (128th column) in the reconstruction results of the Rabbit head from the noisy projection dataset (N0 = 3 ×106). Results of the A) TV-ADM and B) TAC-TV-ADM.

Horizontal profiles (128th column) in the reconstruction results of the Rabbit head from the noisy projection dataset (N0 = 106). Results of the A) TV-ADM and B) TAC-TV-ADM.

Horizontal profiles (128th column) in the reconstruction results of the Rabbit head from the noisy projection dataset (N0 = 5 ×105). Results of the A) TV-ADM and B) TAC-TV-ADM.
Evaluations of the results reconstructed by different methods under three noise levels in digital Rabbit head studies
Texture distance of ROIs between the reference truth background image and the reconstructed images under three noise levels
In this subsection, real CT verifications are carried out to test the proposed algorithm. These projections are acquired from an adult male rabbit in vivo on a CBCT imaging system. We declare and guarantee that this rabbit has never been tortured in the data acquisition and this data set is only for academic research. However, in order to obtain effective projection data, anesthetics with the minimum and safe dose is applied on this rabbit. The data acquisition takes only 4 minutes when this rabbit is under the quiet and rest state. The radiation dose and the exposure duration are strictly controlled to not make more harm to the rabbit. The breath of rabbit always existing, and thus we only acquired the projections of its head. More details of the data acquisition are omitted and we focus on the results of the experiments.
The distance of the source to the rotation center is 502.8 mm, and the distance of the source to the center of the detector is 1434.7 mm. The detector has 1024 bins with pixel size of 0.3810 mm for each. The reconstructed image is of 512×512 with 0.2671 mm×0.2671 mm for each image pixel. There are 360 projections acquired within the range of 360 degrees. Note that in this first test of the real CT data experiments all of the 360 projections are used for FBP, TV-ADM and the proposed method. For the second test, only 180 projections are taken to use with angle increment of 2 degrees.The reconstructions of FBP, TV-ADM and the proposed method from 360 views and 180 views are as shown in Figs. 12 and 13, respectively. We set the FDK result as the background reference image, and compared the RMSEs of the results of the iterative ones. In Fig. 9, the RMSEs for TV-ADM and the proposed method are 1.27E-4 and 0.94E-4. Moreover, in Fig. 10, the RMSEs are 2.7E-3 and 1.563E-3.

360 views reconstructions for FBP, TV-ADM and the proposed method: from the left column to the right column there are FBP reconstruction, TV-ADM reconstruction and the TAC-TV reconstruction by 500 iterations, respectively. The top and bottom row are the same image displayed windows [0, 0.133] and [0.0095, 0.0665].

180 views reconstructions for FBP, TV-ADM and the proposed method: from the left column to the right column there are FBP reconstruction, TV-ADM reconstruction and the TAC-TV reconstruction by 100 iterations, respectively. The top and bottom column are the same image displayed windows [0, 0.133] and [0.0095, 0.0665].
In this paper, we introduce a new TAC-TV model for CT image reconstruction for sparse-view data and develop an efficient and fast numerical algorithm based on the Augmented Lagrangian method and alternating direction method. The proposed algorithm was investigated by inverse-crime studies, sparse-view reconstructions experiments, and real CT data.
Different from the previous TV-based regularization strategies, the absolute value of curvature is introduced and incorporated in the TAC-TV model. The key motivation for the TAC-TV model is to utilize the second order information of the intended images for sparse-view reconstruction, which aims at reducing the radiation dose in sparse-view CT reconstruction and relieving the piecewise constant assumption of TV-based methods. Compared with the TV-based method, the proposed TAC-TV method shows better image quality in ROI regions and reducing the stair-case effect in sparse-view CT image reconstruction. In addition, the proposed method is robust to noise and shows better results than TV method. The view number of projection has significant influence on sparse-view CT reconstruction. Reconstruction under different views yields different levels of image quality. In this study, the view number is set as 72 and the gains from the proposed method are outstanding compared with those from TV method. By comparing the reconstructed image of ROI regions, the proposed method does have some advantages over the TV method. Parameter selection is another important issue in ADM scheme. Generally speaking, they are often empirically selected by quantity evaluation and visual inspection. In this paper, the parameter adapting strategy based on KKT conditions as a supplementary is investigated. The better selection strategy can help us achieve a good and stable performance of balancing the accuracy and efficiency.
Moreover, the convergence of the TAC-TV algorithm is verified by numerical experiments without strict theoretical proof. Future work will focus on the theoretical analysis of the proposed algorithm. Furthermore, more investigations for the comprehensive performances of the proposed algorithm should be studied as well.
Footnotes
Acknowledgments
This work is supported by the National Natural Science Foundation of China (No. 61372172 and 61601518). We also want to thank the anonymous referees for giving us useful comments and suggestions to improve this paper. The contents of this paper are solely the responsibility of the authors and do not necessarily represent the official views of the NSFC.
