A hybrid control scheme based on adaptive visual servoing and direct force control is proposed for robot manipulators to perform interaction tasks on smooth surfaces. The camera parameters, as well as the constraint surface, are considered to be uncertain. A fixed camera with optical axis non-perpendicular to the robot workspace is used for position control, while a force sensor mounted on the robot wrist is used for force regulation. In order to solve the interaction problem on unknown surfaces, a method is developed to estimate the constraint geometry and keep the end-effector orthogonal to the surface at the contact point, during the task execution. Experimental results are presented to illustrate the performance and feasibility of the proposed scheme.
Baeten, J. and De Schutter, J. (2002). Hybrid vision/force control at corners in planar robotic-contour following. ASME Transactions on Mechatronics , 7(2): 143-150.
2.
Carelli, R., Oliva, E., Soria, C. and Nasisi, O. (2004). Combined force and visual control of an industrial robot. Robotica, 22: 163-171.
3.
Chang, W.-C. (2004). Cartesian-based planar contour following with automatic hybrid force and visual feedback. Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 3062-3067.
4.
Costa, R.R., Hsu, L., Imai, A.K. and Kokotovic, P. (2003). Lyapunov-based adaptive control of MIMO systems . Automatica, 39(5): 1251-1257.
5.
De Schutter, J., De Laet, T., Rutgeerts, J., Decré, W., Smits, R., Aertbeliën, E., Claes, K. and Bruyninckx, H. (2007). Constraint-based task specification and estimation for sensor-based robot systems in the presence of geometric uncertainty. The International Journal of Robotics Research, 26(5): 433-455.
6.
Dean-León, E.C., Parra-Vega, V. and Espinosa-Romero, A. (2006). Visual servoing for constrained planar robots subject to complex friction. IEEE/ASME Transactions on Mechatronics, 11(4): 389-400.
7.
Duffy, J. (1990). The fallacy of modern hybrid control theory that is based on orthogonal complements of twist and wrench spaces. Journal of Robotic Systems, 7(2): 139-144.
8.
Guenther, R. and Hsu, L. (1993). Variable structure adaptive cascade control of rigid-link electrically-driven robot manipulator. Proceedings IEEE Conference on Decision and Control, pp. 2137-2142.
9.
Haralick, R.M. and Shapiro, L.G. (1993). Computer and Robot Vision, vol. II. Reading, MA, Addison-Wesley .
10.
Hosoda, K., Igarashi, K. and Asada, M. (1998). Adaptive hybrid control for visual and force servoing in unknown environment. IEEE Robotics and Automation Magazine , 5(4): 39-43.
11.
Hsu, L. and Aquino, P. (1999). Adaptive visual tracking with uncertain manipulator dynamic and uncalibrated camera. Proceedings IEEE Conference on Decision and Control, pp. 1248-1253.
12.
Hsu, L., Costa, R.R. and Lizarralde, F. (2007). Lyapunov/passivity-based adaptive control of relative degree two mimo systems with an application to visual servoing. IEEE Transactions on Automatic Control, 52(2): 364-371.
13.
Hutchinson, S., Hager, G. and Corke, P. (1996). A tutorial on visual servo control. IEEE Transactions Robotics and Automation, 12(5): 651-670.
14.
Karayiannidis, Y. and Doulgeri, Z. (2006). An adaptive law for slope identification and force position regulation using motion variables. Proceedings IEEE International Conference on Robotics and Automation, pp. 3538-3543.
Leite, A.C. and Lizarralde, F. (2006). Application of Tcl/Tk for a robotic system. Proceedings of 13th Annual Tcl/Tk Conference, pp. 1-3.
17.
Leite, A.C., Lizarralde, F. and Hsu, L. (2006). Hybrid visionforce robot control for tasks on unknown smooth surfaces. ProceedingsIEEE International Conference on Robotics and Automation, pp. 2244-2249.
18.
Lippielo, V., Siciliano, B. and Villani, L. (2006). Robot interaction control using force and vision . Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 1470-1475.
19.
Mason, M. (1981). Compliance and force control for computer controlled manipulators. IEEE Transactions on Systems, Man, and Cybernetics , 11(6): 418-432.
20.
Murray, M., Li, Z. and Sastry, S.S. (1994). A Mathematical Introduction to Robotic Manipulation (1stedn). Boca Raton, FL , CRC Press.
21.
Namvar, M. and Aghili, F. (2004). Adaptive force-motion control of coordinated robots interacting with geometrically unknown environments. Proceedings IEEE International Conference on Robotics and Automation, vol. 3, pp. 3061- 3068.
22.
Nelson, B.J., Morrow, J.D. and Khosla, P.K. (1995). Improved force control through visual servoing . Proceedings of the American Control Conference , pp. 380-386.
23.
Olsson, T., Bengtsson, J., Johansson, R. and Malm, H. (2002). Force control and visual servoing using planar surface identification. Proceedings IEEE International Conference on Robotics and Automation, vol. 4, pp. 4211-4216.
24.
Pichler, A. and Jägersand, M. (2000). Uncalibrated hybrid force-vision manipulation . Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 1866-1871.
25.
Raibert, M.H. and Craig, J.J. (1981). Hybrid position/force control of manipulators. Journal of Dynamic Systems, Measurement and Control, 102: 126-133.
26.
Sciavicco, L. and Siciliano, B. (2000). Modelling and Control of Robot Manipulators (2nd edn). Berlin, Springer.
27.
Spong, M.W. and Vidyasagar, M. (1989). Robot Dynamics and Control (1stedn). New York, John Wiley & Sons.
28.
Wen, J.T. and Kreutz-Delgado, K. (1991). The attitude control problem. IEEE Transactions on Automatic Control, 36(10): 1148-1162.
29.
Wilfinger, L.S., Wen, J.T. and Murphy, S.H. (1994). Integral force control with robustness enhancement . IEEE Control System Magazine, 14(1): 31-40.
30.
Xiao, D., Ghosh, B.K.D., Xi, N. and Tarn, T.J. (2000). Sensor-based hybrid position/force control of a robot manipulator in an uncalibrated environment. IEEE Transactions on Control Systems Technology, 8(4): 634-645.
31.
Yoshikawa, T. and Sudou, A. (1993). Dynamic hybrid position/force control of robot manipulators-online estimation of unknown constraint. IEEE Transactions on Control Systems Technology, 9(2): 220-226.
32.
Zachi, A.R.L., Hsu, L., Ortega, R. and Lizarralde, F. (2006). Dynamic control of uncertain manipulators through immersion and invariance adaptive visual servoing. The International Journal of Robotics Research, 25(11): 1149- 1159.
33.
Zergeroglu, E., Dawson, D., de Queiroz, M. and Nagarkatti, S. (1999). Robust visual-servo control of robot manipulators in the presence of uncertainty. Proceedings IEEE Conference on Decision and Control, pp. 4137-4142.
34.
Zhao, Y. and Cheah, C.C. (2004). Hybrid vision-force control for robot with uncertainties . Proceedings IEEE International Conference on Robotics and Automation, pp. 261- 266.
