Design and calibration of a three-dimensional localization system for automatic measurement of long and thin tube based on camera and laser displacement sensor

Abstract

An integrated system consisting of robot and laser scanner is considered as a promising alternative measurement device for three-dimensional tube which is long and thin. A key to achieving automatic measurement is to locate tube accurately and robustly, which is precondition for scanning path planning. Thus, a novel three-dimensional localization system consisting of camera and laser displacement senor is proposed. When fixed on robot, the camera can search tube quickly in large view and the laser displacement sensor obtains depth information of key points. Measurement principles are presented firstly, including four main steps: camera shooting, key points extraction, laser displacement sensor shooting, and coordinate calculation. Then, the location error influenced by parameters of camera model and laser displacement sensor is analyzed and illustrated by a specific camera and laser displacement sensor. Furthermore, a scan strategy is proposed for quite thin tube localization. Location error caused by perspective is also analyzed and a compensation method is proposed for decreasing the error. Additionally, a sensor transformation calibration method is presented for identifying the relationship between camera and laser displacement sensor, which is verified with high accuracy by calibration experiments. A contrast experiment of a cylinder bar localization shows that the maximum location error of the camera and laser displacement sensor is no more than 3.5 mm, which is only one-eighth of that of Kinect sensor. The mean and maximum location errors are within 2 mm and 3 mm when locating a car brake and fuel tube with about 1300 mm long, indicating high accuracy and good robustness of designed localization system.

Keywords

Tube three-dimensional localization system laser displacement sensor camera articulated robot

Get full access to this article

View all access options for this article.

References

Grimson WEL, Lozano-Perez T, Noble N, et al. An automatic tube inspection system that finds cylinders in range data. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA, 15–17 June 1993, pp.446–452. Piscataway: IEEE.

Zhang T. Research on muti-vision-based digitized measurement method for pipelines. PhD Thesis, Beijing Institute of Technology, Beijing, China, 2014.

Daniel

Joaquín

Eduardo

, et al. Influence of human factor in the AACMM performance: a new evaluation methodology. Int J Precis Eng Manuf 2014; 15: 1283–1291.

Yin

Ren

Guo

, et al. Development and calibration of an integrated 3D scanning system for high-accuracy large-scale metrology. Measurement 2014; 54: 65–76.

Rahayem

Kjellander

JAP

. Quadric segmentation and fitting of data captured by a laser profile scanner mounted on an industrial robot. Int J Adv Manuf 2011; 52: 155–169.

Granshaw

. Close range photogrammetry: principles, methods and applications: book reviews. Photogramm Rec 2010; 25: 203–204.

Luis

Pérez

Íñigo

Rodríguez

Nuria

Rodríguez

, et al. Robot guidance using machine vision techniques in industrial environments: a comparative review. Sensors 2016; 16: 1–26.

Konolige K. Projected texture stereo. In: IEEE International Conference on Robotics and Automation, Anchorage, AK, USA, 3–7 May 2010, pp.148–155. Piscataway: IEEE.

Pochyly A, Kubela T, Singule V, et al. 3D vision systems for industrial bin-picking applications. In: Mechatronika, 2012 15th International Symposium, Prague, Czech Republic, 5–7 December 2012, pp.1–6. Piscataway: IEEE.

10.

Lim J. Optimized projection pattern supplementing stereo systems. In: IEEE International Conference on Robotics and Automation, Kobe, Japan, 12–17 May 2009, pp.2823–2829. Piscataway: IEEE.

11.

Tang

Zhang

Song

, et al. Three-dimensional surface reconstruction via a robust binary shape-coded structured light method. Optic Eng 2017; 56: 014102.

12.

Kuehnle JU, Xue Z, Stotz M, et al. Grasping in depth maps of time-of-flight cameras. In: International Workshop on Robotic and Sensors Environments, Ottawa, ON, Canada, 17–18 October 2008, pp.132–137. Piscataway: IEEE.

13.

Maldonado A, Klank U and Beetz M. Robotic grasping of unmodeled objects using time-of-flight range data and finger torque information. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 October 2010, pp.2586–2591. Piscataway: IEEE.

14.

Han

Shao

, et al. Enhanced computer vision with Microsoft Kinect sensor: a review. IEEE Trans Cybern 2013; 43: 1318–1334.

15.

Khoshelham

Oude

. Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 2012; 12: 1437.

16.

Shiu

Zhuang

. Pose determination of cylinders, cones, and spheres from perspective projections. Proc SPIE—Int Soc Optic Eng 1992; 1708: 771–782.

17.

Nubiola

Bonev

. Absolute calibration of an ABB IRB 1600 robot using a laser tracker. Robot Comp Integ Manuf 2013; 29: 236–245.

18.

Zhang

. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 2000; 22: 1330–1334.

19.

Dornaika

Horaud

. Simultaneous robot-world and hand-eye calibration. IEEE Trans Robot Autom 1998; 14: 617–622.