Abstract
Due to the point cloud of oral scan denture has a large amount of data and redundant points. A point cloud simplification algorithm based on feature preserving is proposed to solve the problem that the feature preserving is incomplete when processing point cloud data and cavities occur in relatively flat regions. Firstly, the algorithm uses kd-tree to construct the point cloud spatial topological to search the k-Neighborhood of the sampling point. On the basis of that to calculate the curvature of each point, the angle between the normal vector, the distance from the point to the neighborhood centroid, as well as the standard deviation and the average distance from the point to the neighborhood on this basis, therefore, the detailed features of point cloud can be extracted by multi-feature extraction and threshold determination. For the non-characteristic region, the non-characteristic point cloud is spatially divided through Octree to obtain the K-value of K-means clustering algorithm and the initial clustering center point. The simplified results of non-characteristic regions are obtained after further subdivision. Finally, the extracted detail features and the reduced result of non-featured region will be merged to obtain the final simplification result. The experimental results show that the algorithm can retain the characteristic information of point cloud model better, and effectively avoid the phenomenon of holes in the simplification process. The simplified results have better smoothness, simplicity and precision, and are of high practical value.
Introduction
With the continuous aggravation of the aging population in China, the oral health problems are becoming more serious. Moreover, the oral health awareness and behavior ability of the masses are constantly improving with the further improvement of the medical insurance system, which brings great challenges to the oral health service system in China [1]. The rapid development of 3D laser scanning technology and breakthroughs in various key technologies have made the digital oral diagnosis and treatment model become a mainstream trend in the field of dental medicine of the future [2]. But with the application of high-precision scanners in the field of stomatology, especially when performing intraoral scans, it is usually necessary to change different orientations for scanning so that obtain an accurate and complete oral model. That inevitably leads to the redundancy of a large amount of data and brings difficulties to the storage, display and 3D reconstruction of point cloud data [3]. Therefore, the data simplification is an essential step in point cloud processing on the premise of ensuring the detailed characteristics of the measured denture point cloud data.
The principle of point cloud simplification is to reduce redundant point clouds as much as possible on the basis of accurately extracting point cloud feature points. The effective extraction of point cloud feature points will greatly reduce the error of simplification and improve the simplification efficiency [4]. At present, point cloud reduction algorithms can be roughly divided into two types: grid-based simplification and point cloud-based simplification. The essence of grid-based simplification algorithm is to construct the polygon mesh, then merge and compress the mesh according to the rules, and delete the redundant polygon mesh and vertices to achieve the purpose of point cloud simplification. The disadvantage of this method is that the grid topology needs to be consistent with each other, and the grid generation requires a large amount of computation, which will consume a lot of time and memory resources [5].
With the characteristic of fast speed and high efficiency, the simplification directly based on point cloud only needs to calculate the geometric information of point cloud, which has attracted more and more attention. Shi et al. [6] firstly extracted the edge features of point clouds, and then used the K-means algorithm to cluster the similarity point clouds. Finally, a subdivision algorithm is proposed to simplify the point cloud data and the simplified results are relatively uniform. But the point cloud features cannot be accurately extracted by using this method, which also affects the accuracy of reconstruction. Xuan et al. [7] extracted the feature points of point cloud based on normal angle and information entropy theory on the base of the estimation of normal vector, and gradually moved the non-feature point cloud to achieve the simplification, but the applicability of this method was not clear enough. Ji et al. [8] proposed a simplified algorithm based on multi-feature extraction, which measured the importance of sample points by constructing a feature formula, so as to retain the detailed features of the point cloud, and construct an octree to simplify the non-feature point cloud. Ma et al. [9] used the method based on edge curvature and area error to extract the detailed features of the point cloud, simplify the point cloud data, which has good robustness. But the accuracy of the simplified data will decrease as the reduction rate increases. Markovic et al. [10] used support vector regression algorithm to identify the points in the high zone rate region of point cloud data, so as to realize feature sensitivity and simplification of point cloud data. Dong and Tian [11] preserved feature points and simplified point cloud data by constructing the information entropy of weight product with different features of observation points.
Although the above algorithms can simplify and completely retain the details of the point cloud model, they are not applicable to the more complex oral model. Aiming at the above problems, this paper proposes a point cloud simplification algorithm based on feature preserving.
Description of algorithm
Defining the input denture model data as
The simplification algorithm flowchart of denture point cloud.
Search of
-Neighborhood
Point cloud neighborhood is a set of points that the sampling points of point cloud data and its adjacent points satisfy a certain spatial geometric relationship [12]. In this paper, there is no obvious topological relationship between the data of intraoral denture point cloud obtained by using an intraoral scanner, which has unstructured characteristics. In order to extract geometric features of point cloud data effectively, k-Neighborhood is needed to search for point cloud. The commonly methods used to search the k-Neighborhood of scattered point cloud include spatial raster method, octree method and kd-tree method.
Compared with spatial raster method and octree method, kd-tree method has the advantages of fast speed, strong adaptability, which is seldom influenced by point cloud density, and has small footprint on computer memory, etc. Therefore, kd-tree method is used in this paper to construct the denture point cloud data space topology structure.
Characteristic discriminant parameter calculation
Traditional feature point extraction of point cloud is relatively simple and usually only considers unilateral features, such as the curvature difference between the sampling point and the neighborhood point. In order to retain the detailed features of the oral scan denture model, a multi-feature mixed extraction method is used to extract the features of scattered point clouds in this paper.
The distance from the point to the neighborhood centroid
It is easy to lose edge features when simplifying the data model of non-closed dentures, resulting in boundary shrinkage and distortion. Therefore, in order to avoid the error of deleting the boundary features in the subsequent simplification. the boundary features of the denture model should be detected and protected before the simplification operation. The traditional idea of boundary feature extraction is based on the distribution characteristics of spatial point clouds. If the sampling point
We define the set
The distance from the sampling point
The normal included angle and curvature of the point cloud in the neighborhood are the key rigid features of the scattered point cloud, which can fully reflect the uneven degree of the surface of the point cloud model and the change of the local surface. It is an important reference to detect and identify the feature points of the point cloud and simplify the point cloud data. At present, the existing methods for calculating the angle and curvature of normal vectors can be roughly divided into three categories: the method based on robust statistics, the method based on Delaunay/Voronoi and the method based on local surface fitting [14]. Principal component analysis (PCA) based on local surface fitting was first proposed by Hoppe et al. [15]. This method does not need to triangulate scattered point clouds, it is very suitable for the algorithm proposed in this paper, and the code is simple to write, easy to operate and runs faster. n this paper, distance weights are added on the basis of the original algorithm to obtain relatively smooth calculation results of the included angle and curvature of normal vectors.
Assuming that the local region of the point cloud can be approximated as a smooth plane, Then the normal vector of any sampling point
where
When the fitting plane
Considering that the distance between the neighborhood point and the sampling point will affect the result, we assign the Gaussian distance weight
The three eigenvalues of the matrix
Define the
The research of Pauly et al. [16] showed that the change of the surface of the point cloud model is equal to the curvature of the model. The eigenvalues represent the changes of the surface along the direction of the respective eigenvectors, so we can extract the curvature characteristics of the denture model according to the eigenvalues previously solved. Define the curvature at the sampling point
The smaller the value of
For complex denture point cloud data, the distribution of point cloud data will change with the surface complexity of the model. The density of denture point cloud distribution is usually higher than flat regions of point cloud data in the characteristic areas of cusp, ridge and molar occlusal surface, etc. Therefore, it can help to identify the characteristic region of point cloud by judging the difference of density degree of point cloud in different regions of the model. In this paper, the standard deviation of the distance between the point and its neighboring points is used as the discriminant factor. The denser its neighborhood point distribution is when the sampling point is in the characteristic region. The smaller the dispersion degree between the sampling point and its k-Neighborhood point, the smaller the standard deviation. The distance between the sampling point
The average distance from the sampling point to the neighborhood point is
Then the standard deviation of the distance between the sampling point and its k-Neighborhood point is:
In order to detect and protect the edge features of the denture model, we obtained the distance
For the sampling point
where
This paper defines the characteristic discrimination threshold as:
where
The complex digital denture model not only contains characteristic areas such as tooth tip, tooth edge and molar occlusal surface, but also contains a large number of flat and smooth non-characteristic areas. If only use the feature points to simplify the point cloud data, it will cause a lot of holes on the reconstructed surface model. Therefore, we need to preserve a certain number of non-feature points while protecting feature points.
The method of cluster simplification can achieve good effect in the flat area of the model. The simplification algorithm based on K-means takes Euclidean distance as the correlation measurement. Through continuous iteration, the evaluation function value is minimized to divide K clusters. Finally, the cluster center is used to replace the whole cluster to obtain the final simplification result. The quality of the result of simplification largely depends on choosing K-value and initialization cluster center. Both the K-value and the initial clustering center of the traditional algorithm are set randomly, and the uncertainty of the initial clustering center will make the clustering results different each time, as well as make the evaluation function fall into the local convergence, which will not get the optimal clustering simplification result.
In order to solve the above problems, this paper uses octree to conduct spatial division of non-characteristic point clouds. The number of partitioned leaf nodes need to be obtained by setting the octree to divide the stopping condition which is the number of point clouds contained in the minimum leaf node. The number of non-empty leaf nodes in the obtained octree and the data points that is closest to the cube center in the non-empty leaf nodes will be regarded as the K-value of K-means clustering algorithm and the initial clustering center point respectively. Therefore, the initial clustering center can change with the density of different data models to ensure the distribution of the initial clustering center is relatively uniform. Then the simplified results of the non-characteristic areas can be obtained by determining whether each maximum normal angle meets threshold
Results and analysis of experiment
In order to verify the performance of this algorithm, we applied this algorithm to canine data (3 644 points), molars data (4 053 points) and bridges data (36 388 points). The data of incisors contain a few detail features, but more plane features. The data of molars contain a few details, but has a high degree of concavity on the surface. The dental bridge data contains many detailed features and many edge features. In order to verify the effectiveness of the algorithm, the simplified results of the proposed algorithm in this paper will be compared with random sampling method, the simplified method based on curvature and the simplified method based on adaptive octree clustering. This paper uses Matlab to test the algorithm with Windows10 system, i5 3.0ghz processor and 8 GB memory.
Parameter setting
This paper sets different values for the edge threshold
The K-value of K-means clustering algorithm and the initial clustering center point are determined by setting the stop condition of octree division which is the number of point clouds contained in the minimum leaf node. The simplified result of the non-characteristic area will be obtained by judging whether the maximum normal angle between clusters meets the threshold
Feature extraction parameters of denture model
Feature extraction parameters of denture model
Feature extraction effect of different denture models (a) Canine data (b) Molar data (c) Bridge data.
Simplification effect of different simplification rate in denture model (a) Canine data (b) Molar data (c) Bridge data.
Figure 2 shows the feature extraction a different denture model. As can be seen from the Table 1 and Fig. 2, we have extracted the characteristic areas of the denture model well after the threshold determination. The features of the canine data model are mainly distributed around the model, especially the occlusal surface and the bottom of the canines. The characteristic area of the molar data model is mainly the concave and convex part of the occlusal surface and the tooth wall. The bridge model contains many feature types, which mainly located at the gingival margin (the part between the crown and the gingival), the edge features and the concave and convex parts on the occlusal surface of teeth.
In this paper, the simplified point cloud data are obtained through data fusion after extracting the feature point and simplifying the non-feature. In order to verify the validity of the algorithm, this paper simplified denture model by setting different simplification rates. The Geomagic software was used to reconstruct the denture point cloud data at different simplification rates. The simplification rate of defining the point cloud is represented by
where
The reconstruction effect of different simplification rate in denture model (a) Canine data (b) Molar data (c) Bridge data.
This section mainly studies the influence of different simplification rates on the simplification effect of denture model. From Fig. 3, the simplification results of denture point cloud at different simplification rates save more point data in the feature area of the model, which can completely reflect the outline and detailed features of the denture model.
The point clouds in the non-characteristic region of the model are less preserved, but the point clouds are uniformly distributed in the space, which can avoid the occurrence of holes in the simplified results very well. Figure 4 shows the reconstruction results of point cloud surface under different simplification rates of the denture model. Comparing the reconstruction effect of the original denture point cloud data and the denture model with different reduction rates. The surface reconstruction effect of the model is very good when the simplification rate is 20%, 50% and 70%, the detailed features of the model can be completely retained, and the simplified reconstruction model has a high smoothness. When the simplification rate reaches 80%, some texture information and local detail features will be lost due to the high simplification rate. For example, the surface of the reconstructed model is not smooth enough, and there is a cavity in the tooth space like the bridge data. However, on the whole, the simplified model retains the outline and detailed features of the model well.
In order to further verify the superiority of the proposed algorithm, the random sampling method, the simplified method based on curvature and adaptive octree clustering are respectively used to be compared with the proposed algorithm in this paper. The experimental object is the denture bridge model with more features. In order to judge the simplification results of different simplification algorithms more accurately, each simplification algorithm has a similar simplification rate and it should be set to about 70%. Figure 5 shows the simplified results of the bridge model with different algorithms:
Simplified results of bridge models with different algorithms (a) Original data (b) The algorithm in this paper (c) Random sampling method (d) The simplified method based on curvature (e) The simplified method based on adaptive octree clustering.
Figure 5(a) is the original dental bridge data model. The number of point clouds is 36 388, which contains a lot of redundant data. Figure 5(b) is the result of the point cloud simplification algorithm based on feature preserving in this paper. The number of point clouds is 10 954 after simplification. The algorithm in this paper concentrates more points on the feature region of the model through multi-feature extraction. The edge of the model was completely retained, the tooth contour was clear, and the detailed features of the denture occlusal surface were maintained well, the points number retained in the non-characteristic area was significantly reduced, as well as the distribution was relatively uniform, so as to ensure smooth and cave-free reconstruction results. Figure 5(c) adopts the random sampling method; The simplified result can be obtained by establishing a function that can generate random numbers to delete the corresponding points of random numbers from the original data. The number of point clouds is 12 130 after simplification, and the simplification rate is 67%. The algorithm has great randomness. As a result, only the basic contour points of teeth are retained, but the detailed features are seriously lost. Figure 5(d) is the result of the simplified method based on curvature. The number of point clouds retained is 11798. This method highlights the curvature of the model, but it retains too many points where the curvature is higher, and too few the points where the curvature is lower. Moreover, this method does not consider the boundary so that the simplification effect is poor. Figure 5(e) shows the results of the simplified method based on adaptive octree clustering, with 11 178 reserved points. This method cannot fully extract the detailed features of the model from the point cloud, and considers boundary conditions, but the simplified results are relatively good.
The Geomagic software was used to reconstruct the 3D surface focusing on the original cloud data of bridge point and the point cloud data simplified by different algorithms. The reconstruction results of the tooth bridge model with different simplified algorithms are shown in Fig. 6 by comparing the reconstruction effects of different algorithms.
xIn this paper, the execution time of different algorithms is recorded under the same system environment. Moreover, in order to quantitatively analyze the results of different simplification algorithms, we take advantage of the standard deviation value after simplification between the reconstructed surface and the original surface to measure the precision of point cloud simplification. The running time and standard deviation of different algorithms are shown in Table 2.
Running time and standard deviation of different algorithms
Reconstruction results of tooth bridge model with different simplified algorithms (a) Original data (b) The algorithm in this paper (c) The simplified method based on random sampling (d) The simplified method based on curvature (e) The simplified method based on adaptive octree clustering.
According to the reconstruction results in Fig. 6 and Table 2, the effect of model reconstruction in this algorithm is obviously better than other algorithms under the premise of similar simplification rate. In this paper, the algorithm does not directly simplify the point cloud data, but considers the characteristic region and non-characteristic region of the model respectively. For the feature area, this paper adopts the method of multi-feature discrimination to retain the detailed features of the denture model. It makes the simplified data better highlight the features of the point cloud model, thus improves the accuracy of the algorithm. For non-characteristic regions, this paper adopts the method of octree K-means clustering subdivision to simplify the non-characteristic point cloud. The simplified results are more uniform and smoother in the non-characteristic region, and the cavitation phenomenon can be effectively avoided. Moreover, the simplified model has better smoothness, and the accuracy is obviously better than other algorithms. The algorithm in this paper runs slowly because the multi-feature calculation reduces the overall operating efficiency. The simplified method based on random sampling runs faster. However, combined with the above experimental results, the algorithm sacrifices simplified accuracy. The simplification of feature area and non-feature area of model is similar, the effect of detail feature preserving is not good, and the loss of the data between teeth is serious. The reconstruction effect of the simplified method based on curvature is the worst and the algorithm accuracy are the lowest. The over-simplification of non-characteristic region leads to the cavity problem and the loss of edge features. The simplified method based on adaptive octree clustering can obtain smoother simplification results, but it also fails to consider the edge characteristics of the model so that the edge part of the model is lost and the interdental data is not fully retained. Moreover, the complexity of the algorithm time is the highest because the feature region and the non-feature region are not considered separately.
Compared with other algorithms, the algorithm in this paper not only can retain the detailed features of the model completely, but also effectively simplify the non-feature areas of the model. It can simplify complex denture models while ensuring the accuracy of simplification.
In this paper, a point cloud simplification algorithm based on feature preserving is proposed, which can be effectively applied to complex oral scan denture model. Through analysis of the acquired denture data, it is found that the detailed features are mostly located in dental occlusion part, margin and the connection part of the teeth. There are few sharp features around the tooth wall. Therefore, the difficulty in the study of the simplification algorithm based on the denture data is how to extract the detailed features and how to use fewer points to replace the non-characteristic areas of the denture. According to the structure of the denture model, multiple features are specifically extracted to construct the feature discriminant function. The detailed features of the denture model are retained in the way of multi-feature discrimination, so that the simplified data can better highlight the features of the point cloud model, thus improving the accuracy of the algorithm. For the non-feature region of the model, K-means clustering method based on adaptive octree is proposed. Octree provides K value and initialized clustering center for K-means clustering algorithm, and then further iteratively subdivide by determining whether the maximum normal angle of data among clustering clusters meets the threshold value. This method can effectively improve the efficiency of the algorithm and obtain uniform simplification results of non-feature region.
In order to verify the validity of the algorithm, different simplification rates are adopted to simplify different denture models. Moreover, the simplification effects of the proposed algorithm are compared with other algorithms. The experiments show that the proposed algorithm in this paper is more suitable for complex digital denture models. The detailed features of denture point cloud can be clearly and accurately retained through multi-feature discrimination. It also can effectively solve the problem that the feature is easy to loss in the traditional simplification algorithm. The point cloud in the flat non-characteristic area is uniformly distributed without holes. And the reconstruction fitting model has higher smoothness, better edge information preserving, the accuracy is significantly higher than other algorithms. The algorithm can also effectively solve the problem that the feature preserving is incomplete and cavitation is easy to occur in relatively flat area when using other algorithms to process digital denture point cloud data. The simplified results have good smoothness, simplicity and precision, and it also have high practical value.
Footnotes
Acknowledgments
This work was supported by Liuzhou Science and Technology Project, Guangxi Province, China (Grant No. 2018DH10501) and Innovation Project of Guangxi Graduate Education (Grant No. YCSW2020218).
