Predictive Visual Tracking of Lines by Industrial Robots

Abstract

Many tasks for industrial robots can be described by high precision line following at high speed. This can be executed accurately if the lines are sensed by a camera since then not only the desired pose at the current time step is sensable, but also a segment of the desired path can be predicted. We propose polynomials to represent the progression of the elements of the desired pose. This allows us to realize a dynamical sensor control architecture that considers the two main problems: low sampling rate and delays in image processing, and deviations from commanded paths due to the robot dynamics. In contrast to previous publications we now present the complete formulae to control translation and orientation of the robot by tracking (curved) lines that are visible for a single eye-in-hand camera. Experiments using off-the-shelf hardware show that the robot can be precisely controlled at high speed.

Keywords

vision control industrial robots robot dynamics prediction

Get full access to this article

View all access options for this article.

References

Andreff, N. , Espiau, B. , and Horaud, R. 2000. Visual servoing from lines . In Proceedings of the IEEE International Conference on Robotics and Automation, San Francisco, CA, pp. 2070-2075 .

Baeten, J. , and De Schutter, J. 2001. Combined vision/force control at corners in planar robotic contour following . In Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Como, Italy.

Baeten, J. , Verdonck, W. , Bruyninckx, H. , and De Schutter, J. 2000. Combining force control and visual servoing for planar contour following . Machine Intelligence and Robotic Control 2(2): 69-75 .

Chroust, S. , Zimmer, E. , and Vincze, M. 2001. Pros and cons of control methods of visual servoing . In Proceedings of the 10th International Workshop on Robotics in the Alpe-Adria-Danube Region, Vienna, Austria.

Clarke, D. W. , Mohtadi, C. , and Tuff, P. S. 1987. Generalized predictive control—Part I. The basic algorithm . Automatica 23(2): 137-148 .

Conticelli, F. , and Allotta, B. 2000. Two-level visual control of dynamic look-and-move systems . In Proceedings of the IEEE International Conference on Robotics and Automation, San Francisco, CA, pp. 3784-3789 .

Corke, P. I. , and Good, M. C. 1996. Dynamic effects in visual closed-loop systems . IEEE Transactions on Robotics and Automation 12(5): 671-683 .

Craig, J. J. 1986. Introduction to Robotics—Mechanics and Control. Addison-Wesley, Reading, MA .

Frese, U. , Bäuml, B. , Haidacher, S. , Schreiber, G. , Schäfer, I. , Hähnle, M. , and Hirzinger, G. 2001. Off-the-shelf vision for a robotic ball catcher . In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Maui, Hawaii, pp. 1623-1629 .

10.

Gangloff, J. A. , and de Mathelin, M. F. 2000. High speed visual servoing of a 6 DoF manipulator using MIMO predictive control . In Proceedings of the IEEE International Conference on Robotics and Automation, San Francisco, CA, pp. 3751-3756 .

11.

Gangloff, J. A. , and de Mathelin, M. F. 2002. Visual servoing of a 6-dof manipulator for unknown 3-d profile following . IEEE Transactions on Robotics and Automation 18(4): 511-520 .

12.

Hutchinson, S. , Hager, G. D. , and Corke, P. I. 1996. A tutorial on visual servo control . IEEE Transactions on Robotics and Automation 12(5): 651-670 .

13.

Jacubasch, A. , Kuntze, H.-B. , Arber, C. , and Richalet, J. 1987. Anwendung eines neuen Verfahrens zur schnellen und robusten Positionsregelung von Industrierobotern (Application of a new concept of fast and robust position control of industrial robots) . Robotersysteme 3: 129-138 (in German).

14.

Lange, F. September 1995. Fast and accurate training of multilayer perceptrons using an extended Kalman filter (EKFNet). http://www.robotic.dlr.de/Friedrich.Lange/.

15.

Lange, F. , and Hirzinger, G. 1996. Learning of a controller for non-recurring fast movements . Advanced Robotics 10(2): 229-244 .

16.

Lange, F. , and Hirzinger, G. 1999. Learning accurate path control of industrial robots with joint elasticity . In Proceedings of the IEEE International Conference on Robotics and Automation, Detroit, MI, pp. 2084-2089 .

17.

Lange, F. , and Hirzinger, G. 2001. A universal sensor control architecture considering robot dynamics . In Proceedings of the International Conference on Multisensor Fusion and Integration for Intelligent Systems, Baden-Baden, Germany, pp. 277-282 .

18.

Mahony, R. , and Hamel, T. 2001. Visual servoing using linear features for under-actuated rigid body dynamics . In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Maui, Hawaii, pp. 1153-1158 .

19.

Nakabo, Y. , Ishii, I. , and Ishikawa, M. 2002. 3D tracking using two high-speed vision systems . In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Lausanne, Switzerland, pp. 360-365 .

20.

Pritschow, G. , Horn, A. , and Grefen, K. 1992. Dynamisches Verhalten und Grenzen sensorgeführter Industrieroboter mit vorausblickendem Sensor (Dynamic behaviour and limitation of sensor guided industrial robots with look ahead mounted sensor) . Robotersysteme 8: 155-161 (in German).

21.

Rives, P. , and Borrelly, J.-J. 2000. Real-time image processing for image-based visual servoing. In M. Vincze and G. D. Hager , eds., Robust Vision for Vision-Based Control of Motion. IEEE Press, Piscataway, NJ , pp. 99-107.

22.

Weng, J. , Cohen, P. , and Herniou, M. 1992. Camera calibration with distortion models and accuracy analysis . IEEE Transactions on Pattern Analysis and Machine Intelligence 14(10): 965-980 .

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB