In this paper we present a visual navigation algorithm for the six-legged walking robot DLR Crawler in rough terrain. The algorithm is based on stereo images from which depth images are computed using the semi-global matching (SGM) method. Further, a visual odometry is calculated along with an error measure. Pose estimates are obtained by fusing inertial data with relative leg odometry and visual odometry measurements using an indirect information filter. The visual odometry error measure is used in the filtering process to put lower weights on erroneous visual odometry data, hence, improving the robustness of pose estimation. From the estimated poses and the depth images, a dense digital terrain map is created by applying the locus method. The traversability of the terrain is estimated by a plane fitting approach and paths are planned using a D* Lite planner taking the traversability of the terrain and the current motion capabilities of the robot into account. Motion commands and the traversability measures of the upcoming terrain are sent to the walking layer of the robot so that it can choose an appropriate gait for the terrain. Experimental results show the accuracy of the navigation algorithm and its robustness against visual disturbances.
ArunKSHunagTSBlosteinSD (1987) Least-squares fitting of two 3-D point sets. IEEE Transactions on Pattern Analysis and Machine Intelligence9: 698–700.
2.
BaileyTNebotERosenblattJDurrant-WhyteH (2000) Data association for mobile robot navigation: a graph theoretic approach. In Proceedings. ICRA ’00. IEEE International Conference on Robotics and Automation, 2000, vol. 3, pp. 2512–2517.
3.
BortzJ (1971) A new mathematical formulation for strapdown inertial navigation. IEEE Transactions on Aerospace Electronic Systems7: 61–66.
4.
BrooksR (1986) A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation2: 14–23.
5.
CarstenJRankinAFergusonDStentzA (2007) Global path planning on board the Mars Exploration Rovers. In 2007 IEEE Aerospace Conference, pp. 1–11.
6.
ChilianAHirschmüllerH (2009) Stereo camera based navigation of mobile robots on rough terrain. In IROS, International Conference on Intelligent Robots and Systems, pp. 4571–4576.
7.
ChilianAHirschmüllerHGörnerM (2011) Multisensor data fusion for robust pose estimation of a six-legged walking robot. In Proceedings of the IEEE International Conference on Intelligent Robotic Systems (IROS) 2011, pp. 2497–2504.
8.
DailyMHarrisJKeirseyDOlinDPaytonDReiserK. (1988) Autonomous cross-country navigation with the ALV. In Proceedings 1988 IEEE International Conference on Robotics and Automation, 1988, vol. 2, pp. 718–726.
9.
DissanayakeGSukkariehSNebotEDurrant-WhyteH (2002) The aiding of a low-cost strapdown inertial measurement unit using vehicle model constraints for land vehicle applications. IEEE Transactions on Robotics and Automation17: 731–747.
10.
ErnstIHirschmüllerH (2008) Mutual information based semi-global stereo matching on the gpu. In International Symposium on Visual Computing (ISVC08), Las Vegas, NV ( Lecture Notes in Computer Science, vol. 5358, Part 1). Berlin: Springer, pp. 228–239.
11.
GehrigSEberliFMeyerT (2009) A real-time low-power stereo vision engine using semi-global matching. In International Conference on Computer Vision Systems (ICVS), Liege, Belgium (Lecture Notes in Computer Science, vol. 5815). Berlin: Springer, pp. 134–143.
12.
GoldbergSBMaimoneMWMatthiesL (2002) Stereo vision and rover navigation software for planetary exploration. In IEEE Aerospace Conference Proceedings, 2002, vol. 5, pp. 2025–2036.
13.
GörnerMChilianAHirschmüllerH (2010) Towards an autonomous walking robot for planetary surfaces. In Proceedings of the 10th International Symposium on Artificial Intelligence, Robotics and Automation in Space (i-SAIRAS).
14.
GörnerMWimböckTBaumannAFuchsMBahlsTGrebensteinM. (2008) The DLR-Crawler: a testbed for actively compliant hexapod walking based on the fingers of DLR-Hand II. In IEEE/RSJ 2008 International Conference on Intelligent Robots and Systems, pp. 1525–1531.
15.
GörnerMWimböckTHirzingerG (2009) The DLR Crawler: evaluation of gaits and control of an actively compliant six-legged walking robot. Industrial Robot: An International Journal36: 344–351.
16.
HaralickRJooHLeeC-NZhuangXVaidyaVGKimMB (1989) Pose estimation from corresponding point data. IEEE Transactions on Systems, Man, and Cybernetics19: 1426–1446.
17.
HarrisCStephensM (1988) A combined corner and edge detector. In Proceedings of the 4th Alvey Vision Conference, pp. 147–151.
18.
HirschmüllerH (2003) Stereo Vision Based Mapping and Immediate Virtual Walkthroughs. PhD thesis, School of Computing, De Montfort University, Leicester, UK.
19.
HirschmüllerH (2008) Stereo processing by semi-global matching and mutual information. IEEE Transactions on Pattern Analysis and Machine Intelligence30: 328–341.
20.
HirschmüllerHInnocentPGaribaldiJ (2002) Fast, unconstrained camera motion estimation from stereo without tracking and robust statistics. In Proceedings of the 7th International Conference on Control, Automation, Robotics and Vision, pp. 1099–1104.
21.
HirschmüllerHInnocentPRGaribaldiJM (2002) Real-time correlation-based stereo vision with reduced border errors. International Journal of Computer Vision47: 229–246.
22.
HirschmüllerHScharsteinD (2009) Evaluation of stereo matching costs on images with radiometric differences. IEEE Transactions on Pattern Analysis and Machine Intelligence31: 1582–1599.
23.
KellyA (1995) An Intelligent Predictive Control Approach to the High-Speed Cross-Country Autonomous Navigation Problem. PhD thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA.
24.
KoenigSLikhachevM (2002) Improved fast replanning for robot navigation in unknown terrain. In Proceedings of the International Conference on Robotics and Automation, pp. 968–975.
25.
KonoligeKAgrawalMBollesRCowanCFischlerMGerkeyB (2007) Outdoor mapping and navigation using stereo vision. In Proceedings of the International Symposium on Experimental Robotics (ISER).
26.
KweonIKanadeT (1992) High-resolution terrain map from multiple sensor data. IEEE Transactions on Pattern Analysis and Machine Intelligence14(2): 278–292.
27.
LaubachSLBurdickJMatthiesL (1998) An autonomous path planner implemented on the Rocky7 prototype microrover. In IEEE Conference on Robotics and Automation, pp. 292–297.
28.
MaimoneMChengYMatthiesL (2007) Two years of visual odometry on the Mars Exploration Rovers. Journal of Field Robotics24: 169–186.
29.
MatthiesLShaferSA (1987) Error modeling in stereo navigation. IEEE Journal on Robotics and Automation3: 239–248.
30.
MillerDPDesaiRSGatEIvlevRLochJ (1992) Reactive navigation through rough terrain: experimental results. In Proceedings of the 1992 National Conference on Artificial Intelligence, pp. 823–828.
31.
MishkinAHMorrisonJCNguyenTTStoneHWCooperBKWilcoxBH (1998) Experiences with operations and autonomy of the Mars Pathfinder Microrover. In IEEE Aerospace Conference Proceedings, 1998, vol. 2, pp. 337–351.
32.
NeiraJTardosJ (2001) Data association in stochastic mapping using the joint compatibility test. IEEE Transactions on Robotics and Automation17: 890–897.
33.
RoumeliotisSBurdickJ (2002) Stochastic cloning: A generalized framework for processing relative state measurements. In Proceedings of the IEEE International Conference on Robotics and Automation, 2002, vol. 2, pp. 1788–1795.
34.
RoumeliotisSSukhatmeGBekeyG (1999) Circumventing dynamic modeling: Evaluation of the error-state kalman filter applied to mobile robot localization. In Proceedings of the 1999 IEEE International Conference on Robotics and Automation, vol. 2, pp. 1656–1663.
35.
SimmonsRHenriksenLChrismanLWhelanG (1998) Obstacle avoidance and safeguarding for a Lunar rover. In Proceedings AlAA Forum on Advanced Developments in Space Robotics, Madison, WI.
36.
StentzA (1994) Optimal and efficient path planning for partially-known environments. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3310–3317.
37.
VasconcelosJOliveiraPSilvestreC (2005) Inertial navigation system aided by GPS and selective frequency contents of vector measurements. In Proceedings of the AIAA Guidance, Navigation, and Control Conference (GNC2005), San Francisco, CA.
38.
WoodenDMalchanoMBlankespoorKHowardARizziARaibertM (2010) Autonomous navigation for BigDog. In Proceedings of the IEEE International Conference on Robotics and Automation.
39.
ZabihRWoodfillJ (1994) Non-parametric local transforms for computing visual correspondance. In Proceedings of the European Conference of Computer Vision, Stockholm, Sweden, pp. 151–158.
