3D LIDAR–camera intrinsic and extrinsic calibration: Identifiability and analytical least-squares-based initialization

Abstract

In this paper we address the problem of estimating the intrinsic parameters of a 3D LIDAR while at the same time computing its extrinsic calibration with respect to a rigidly connected camera. Existing approaches to solve this nonlinear estimation problem are based on iterative minimization of nonlinear cost functions. In such cases, the accuracy of the resulting solution hinges on the availability of a precise initial estimate, which is often not available. In order to address this issue, we divide the problem into two least-squares sub-problems, and analytically solve each one to determine a precise initial estimate for the unknown parameters. We further increase the accuracy of these initial estimates by iteratively minimizing a batch nonlinear least-squares cost function. In addition, we provide the minimal identifiability conditions, under which it is possible to accurately estimate the unknown parameters. Experimental results consisting of photorealistic 3D reconstruction of indoor and outdoor scenes, as well as standard metrics of the calibration errors, are used to assess the validity of our approach.

Keywords

Sensing and perception computer vision range sensing calibration and identification

Get full access to this article

View all access options for this article.

References

Ansar

Daniilidis

(2003) Linear pose estimation from points or lines. IEEE Transactions on Pattern Analysis and Machine Intelligence 25: 578–589.

Auzinger

Stetter

(1988) An elimination algorithm for the computation of all zeros of a system of multivariate polynomial equations. In Proceedings of the International Conference on Numerical Mathematics, Singapore, pp. 11–30.

Byröd

Josephson

Åström

(2008) A column-pivoting based strategy for monomial ordering in numerical Gröbner basis calculations. In Proceedings of the European Conference on Computer Vision, Marseille, France, pp. 130–143.

Chen

(1991) Pose determination from line-to-plane correspondences: existence condition and closed-form solutions. IEEE Transactions on Pattern Analysis and Machine Intelligence 13: 530–541.

Cox

Little

O’Shea

(2004) Using Algebraic Geometry. Berlin: Springer.

de Berg

Cheong

van Kreveld

Overmars

(2008) Computational Geometry: Algorithms and Applications. Berlin: Springer-Verlag.

Fischler

Bolles

(1981) Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24: 381–395.

Golub

van Loan

(1996) Matrix Computations. Baltimore, MD: Johns Hopkins University Press.

Hartley

Zisserman

(2004) Multiple View Geometry in Computer Vision, 2nd edn. Cambridge: Cambridge University Press.

10.

Hesch

Roumeliotis

(2011) A direct least-squares (DLS) solution for PnP. In Proceedings of the International Conference on Computer Vision, Barcelona, Spain.

11.

Naroditsky

Patterson

IV Daniilidis

(2011) Automatic alignment of a camera with a line scan lidar system. In Proceedings IEEE International Conference on Robotics and Automation, Shanghai, China.

12.

Pandey

McBride

Savarese

Eustice

(2010) Extrinsic calibration of a 3D laser scanner and an omnidirectional camera. In Proceedings IFAC Symposium on Intelligent Autonomous Vehicles, Lecce, Italy.

13.

Press

Teukolsky

Vetterling

Flannery

(1992) Numerical Recipes in C. Cambridge: Cambridge University Press.

14.

Quan

Lan

Z-D

(1999) Linear n-point camera pose determination. IEEE Transactions on Pattern Analysis and Machine Intelligence 21: 774–780.

15.

Reid

Zhi

(2009) Solving polynomial systems via symbolic–numeric reduction to geometric involutive form. Journal of Symbolic Computation 44: 280–291.

16.

Scaramuzza

Harati

Siegwart

(2007) Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes. In Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, pp. 4164–4169.

17.

Shuster

(1993) A survey of attitude representations. Journal of Astronautical Science 41: 439–517.

18.

Stamos

Liu

Chen

Wolberg

Zokai

(2008) Integrating automated range registration with multiview geometry for the photorealistic modeling of large-scale scenes. International Journal of Computer Vision 78: 237–260.

19.

Trawny

Roumeliotis

(2010) On the global optimum of planar, range-based robot-to-robot relative pose estimation. In Proceedings IEEE International Conference on Robotics and Automation, Anchorage, AK, pp. 3200–3206.

20.

Trawny

Zhou

Roumeliotis

(2009) 3D relative pose estimation from six distances. In Proceedings of Robotics Science and Systems, Seattle, WA.

21.

Unnikrishnan

Hebert

(2005) Fast Extrinsic Calibration of a Laser Rangefinder to a Camera. Technical report, Carnegie Mellon University, Robotics Institute.

22.

Zhang

Pless

(2004) Extrinsic calibration of a camera and laser range finder (improves camera calibration). In Proceedings IEEE/RSJ International Conference Intelligent Robots and Systems, Sendai, Japan, pp. 2301–2306.