This paper investigates the problem of confirming the identity of a candidate object (expected to be a target based on some crude visual clues) with a mobile robot equipped with visual sensing capabilities. We present a method whose main novelty is to mix localization of the robot relative to the candidate object and to confirm that it is the sought target. This twofold approach drastically reduces false positives. Identity confirmation with this twofold goal is modeled as a Partially-Observable Markov Decision Process, where the states are the cells of the space decomposition. It is solved using Stochastic Dynamic Programming with imperfect state information. A robotic system using this method has been implemented and tests have been carried out both in simulation and with a real robot. The experiments empirically validate the use of various metrics, and demonstrate their ability to perform well in different settings.
AloimonosJWeissIBandyopadhyayA (1988) Active vision. International Journal of Computer Vision1(4): 333–356.
2.
AtanasovNSankaranBLe NyJ. (2014) Nonmyopic view planning for active object classification and pose estimation. IEEE Transactions on Robotics30(5): 1078–1090.
3.
BajcsyR (1988) Active perception. Proceedings of the IEEE76(8): 966–1005.
4.
BakhtariAMackayMBenhabibB (2009) Active-vision for the autonomous surveillance of dynamic, multi-object environments. Journal of Intelligent and Robotic Systems54(4): 567–593.
5.
BarretoJPPerdigotoLCaseiroR. (2010) Active stereo tracking of N ≤ 3 targets using line scan cameras. IEEE Transactions on Robotics26(3): 442–457.
6.
BecerraIValentinLMurrieta-CidR. (2014) Appearance-based Motion Strategies for Object Detection. In: Proceedings of the IEEE International Conference on Robotics and Automation, Hong Kong, China, 31 May–7 June 2014, pp. 6455–6461.
BrowatzkiBTikhanoffVMettaG. (2012) Active object recognition on a humanoid robot. In: IEEE International Conference on Robotics and Automation, St. Paul, Minnesota, USA, 14–18 May 2012, pp. 2021–2028.
9.
CandidoSHutchinsonS (2011) Minimum uncertainty robot navigation using information-guided POMDP planning. In: Proceedings of the IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011, pp. 6102–6108.
10.
ChenSLiYKwokNM (2011) Active vision in robotic systems: A survey of recent developments. International Journal of Robotics Research30(11): 1343–1377.
11.
ChungTHollingerGIslerV (2011) Search and pursuit-evasion in mobile robotics. Autonomous Robots31(3): 299–316.
12.
EidenbergerRScharingerJ (2010) Active perception and scene modeling by planning with probabilistic 6D object poses. In: IEEE International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 18–22 October 2010, pp. 1036–1043.
13.
EspinozaJSarmientoAMurrieta-CidR. (2011) A motion planning strategy for finding an object with a mobile manipulator in 3D environmentsAdvanced Robotics25(13–14): 1627–1650.
14.
FelzenszwalbPFGirshickRBMcAllesterD. (2010) Object detection with discriminatively trained part based models. IEEE Transactions on Pattern Analysis and Machine Intelligence32(9): 1627–1645.
15.
FelzenszwalbPFMcAllesterDRamananD (2008) A discriminatively trained, multiscale, deformable part model. In: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, USA, June 2008, pp. 1–8.
16.
FrintropSJensfeltP (2008) Attentional landmarks and active gaze control for visual SLAM. IEEE Transactions on Robotics24(5): 1054–1065.
17.
GuibasLLatombeJLavalleS. (1999) Visibility-based pursuit-evasion in a polygonal environment. International Journal of Computational Geometry and Applications9(5): 471–494.
18.
GraumanKDarrellT (2005) The pyramid match kernel: Discriminative classification with sets of image features. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), Beijing, China, 17–21 October 2005, pp. 1458–1465.
19.
IslerVKannanSKhannaS (2005) Randomized pursuit-evasion in a polygonal environment. IEEE Transactions on Robotics21(5): 875–884.
20.
JangHYMoradiHLe MinhP. (2008) Visibility-based spatial reasoning for object manipulation in cluttered environments. Computer-Aided Design40(4): 422–438.
21.
KaelblingLPLittmanMLCasandraAR (1998) Planning and acting in partially observable stochastic domains. Artificial Intelligence101(1–2): 99–134.
22.
KaessMDellaertF (2010) Probabilistic structure matching for visual SLAM with a multi-camera rig. Computer Vision and Image Understanding114(2): 286–296.
23.
KrotkovEBajcsyR (1993) Active vision for reliable ranging: Cooperating focus, stereo, and vergence. International Journal of Computer Vision, 11(2): 187–203.
24.
LaporteCArbelT (2006) Efficient discriminant viewpoint selection for active Bayesian recognition. International Journal of Computer Vision68(3): 1405–1573.
25.
LaValleSM (2006) Planning Algorithms. Cambridge: Cambridge University Press.
26.
LeeJHParkSMChwaKY (2002) Simple algorithms for searching a polygon with flashlights. Information Processing Letters81(5): 265–270.
27.
LoweDG (2004) Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision60(2): 91–110.
28.
MegerDGuptaALittleJ (2010) Viewpoint detection models for sequential embodied object category recognition. In: IEEE International Conference on Robotics and Automation, Anchorage, AK, 3 May 2010, pp. 5055–5061.
29.
MotaiYKosakaA (2008) Hand-eye calibration applied to viewpoint selection for robotic vision. Transactions on Industrial Electronics55(10): 3731–3741.
30.
ParkSMLeeJHChwaKY (2011) Searching a room by two guards. International Journal of Computational Geometry & Applications12(4): 339–352.
31.
PitoR (1999) A solution to the next best view problem for automated surface acquisition. IEEE Transactions on Pattern Analysis and Machine Intelligence21(10): 1016–1030.
32.
SarmientoAMurrieta-CidRHutchinsonS (2003) An efficient strategy for rapidly finding an object in a polygonal world. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, USA, 27–31 October 2003, pp. 1153–1158.
33.
SchroeterCHoechemerMMuellerS. (2009) Autonomous robot cameraman - observation pose optimization for a mobile service robot in indoor living space. In: Proceedings of the IEEE International Conference on Robotics and Automation, Kobe, Japan, 12–17 May 2009, pp. 424–429.
34.
TovarBLaValleSM (2008) Visibility-based pursuit evasion with bounded speed. International Journal of Robotics Research27(11–12): 1350–1360.
35.
ThrunSBurgardWFoxD (2005) Probabilistic Robotics. Cambridge, MA: MIT Press.
36.
TsotsosJKShubinaK (2007) Attention and visual search: Active robotic vision systems that search. In: Proceedings of the International Conference on Computer Vision Systems, Washington, USA, March 2007, pp. 539.
37.
YeYTsotsosJK (1999) Sensor planning for 3D object search. Computer Vision and Image Understanding73(2): 145–168.
38.
ZingarettiPFrontoniE (2006) Appearance based robotics. IEEE Robotics and Automation Magazine13(1): 59–68.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
