Output feedback image-based visual servoing control of an underactuated unmanned aerial vehicle

Abstract

In this article, image-based visual servoing control of an underactuated unmanned aerial vehicle is considered for the three-dimensional translational motion. Taking into account the low quality of accelerometers’ data, the main objective of this article is to only use information of rate gyroscopes and a camera, as the sensor suite, in order to design an image-based visual servoing controller. Kinematics and dynamics of the unmanned aerial vehicle are expressed in terms of visual information, which make it possible to design dynamic image-based visual servoing controllers without using linear velocity information obtained from accelerometers. Image features are selected through perspective image moments of a flat target plane in which no geometric information is required, and therefore, the approach can be applied in unknown environments. Two output feedback controllers that deal with uncertainties in dynamics of the system related to the motion of the target and also unknown depth information of the image are proposed using a linear observer. Stability analysis guarantees that the errors of the system remain uniformly ultimately bounded during a tracking mission and converge to 0 when the target is stationary. Simulation results are presented to validate the designed controllers.

Keywords

Visual servoing unmanned aerial vehicle observer image moments

Get full access to this article

View all access options for this article.

References

Shakernia

Koo

. Landing an unmanned air vehicle: vision based motion estimation and nonlinear control. Asian J Control 1999; 1: 128–145.

Mondragon

Campoy

Martinez

. 3D pose estimation based on planar object tracking for UAVs control. In: Proceedings of the 2010 IEEE international conference on robotics and automation, Anchorage, AK, 3–7 May 2010, pp.35–41. New York: IEEE.

Artieda

Sebastian

Campoy

. Visual 3D SLAM from UAVs. J Intell Robot Syst 2009; 55: 299–321.

Lee

Ryan

Kim

. Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing. In: Proceedings of the 2012 IEEE international conference on robotics and automation, Saint Paul, MN, 14–18 May 2012, pp.971–976. New York: IEEE.

Hamel

Mahony

. Visual servoing of an under-actuated dynamic rigid-body system: an image-based approach. IEEE T Robotic Autom 2002; 18: 187–198.

Saunders

Beard

Byrne

. Vision-based reactive multiple obstacle avoidance for micro air vehicles. In: Proceedings of the 2009 American control conference, St. Louis, MO, 10–12 June 2009, pp.5253–5258. New York: IEEE.

Altug

Ostrowski

Mahony

. Control of a quadrotor helicopter using visual feedback. In: Proceedings of the 2002 IEEE international conference on robotics and automation, vol. 1, 11–15 May 2002, Washington, DC, USA, pp.72–77. New York: IEEE.

Altug

Ostrowski

Taylor

. Control of a quadrotor helicopter using dual camera visual feedback. Int J Robot Res 2005; 24: 329–341.

Garca Carrillo

Rondon

Sanchez

. Stabilization and trajectory tracking of a quad-rotor using vision. J Intell Robot Syst 2011; 61: 103–118.

10.

Janabi-Shari

Marey

. A Kalman-filter-based method for pose estimation in visual servoing. IEEE T Robot 2010; 26: 939–947.

11.

Hamel

Mahony

. Image based visual servo control for a class of aerial robotic systems. Automatica 2007; 43: 1975–1983.

12.

Guenard

Hamel

Mahony

. A practical visual servo control for an unmanned aerial vehicle. IEEE T Robot 2008; 24: 331–340.

13.

Bourquardez

Mahony

Guenard

. Image-based visual servo control of the translation kinematics of a quadrotor aerial vehicle. IEEE T Robot 2009; 25: 743–749.

14.

Jabbari Asl

Oriolo

Bolandi

. Dynamic IBVS control of an underactuated UAV. In: Proceedings of the 2012 IEEE international conference on robotics and biomimetics, Guangzhou, China, 11–14 December 2012, pp.1158–1163. New York: IEEE.

15.

Mahony

Corke

Hamel

. Dynamic image-based visual servo control using centroid and optic flow features. J Dyn Syst: T ASME 2008; 130: 011005 (12 pp.).

16.

Le Bras

Hamel

Mahony

. Output feedback observation and control for visual servoing of VTOL UAVs. Int J Robust Nonlin 2011; 21: 1008–1030.

17.

Jabbari Asl

Oriolo

Bolandi

. An adaptive scheme for image-based visual servoing of an underactuated UAV. Int J Robot Autom 2014; 29: 92–104.

18.

Tayebi

McGilvray

. Attitude stabilization of a VTOL quadrotor aircraft. IEEE T Contr Syst T 2006; 14: 562–571.

19.

Bertrand

Hamel

Piet-Lahanier

. Stability analysis of an UAV controller using singular perturbation theory. In: Proceedings of the 17th IFAC world congress, Seoul, South Korea, 6–11 July 2008, pp.5706–5711. New York: IFAC.

20.

Ozawa

Chaumette

. Dynamic visual servoing with image moments for a quadrotor using a virtual spring approach. In: Proceedings of the 2011 IEEE international conference on robotics and automation, Shanghai, China, 9–13 May 2011, pp.5670–5676. New York: IEEE.

21.

Tahri

Chaumette

. Point-based and region-based image moments for visual servoing of planar objects. IEEE T Robot 2005; 21: 1116–1127.

22.

Srinivasan

Zhang

. Visual motor computations in insects. Annu Rev Neurosci 2004; 27: 679–696.

23.

Zufferey

Floreano

. Fly-inspired visual steering of an ultralight indoor aircraft. IEEE T Robot 2006; 22: 137–146.

24.

Berghuis

Nijmeijer

. Robust control of robots via linear estimated state feedback. IEEE T Automat Contr 1994; 39: 2159–2162.

25.

Abdessameud

Tayebi

. Global trajectory tracking control of VTOL-UAVs without linear velocity measurements. Automatica 2010; 46(6): 1053–1059.

26.

Erlic

. A reduced-order adaptive velocity observer for manipulator control. IEEE T Robotic Autom 1995; 11: 293–303.

27.

Das

Lewis

Subbarao

. Backstepping approach for controlling a quadrotor using Lagrange form dynamics. J Intell Robot Syst 2009; 56: 127–151.

28.

Bryson

Sukkarieh

. Vehicle model aided inertial navigation for a UAV using low-cost sensors. In: Proceedings of the 2004 Australasian conference on robotics and automation, Canberra, ACT, Australia, 6–8 December 2004, vol. 1, pp.72–77.

29.

Ceren

Altug

. Vision-based servo control of a quadrotor air vehicle. In: Proceedings of the 2009 computational intelligence in robotics and automation, Daejeon, South Korea, 15–18 December 2009, pp.84–89. New York: IEEE.