This article presents a new dataset of ultra-wide field of view images with accurate ground truth, called PanoraMIS. The dataset covers a large spectrum of panoramic cameras (catadioptric, twin-fisheye), robotic platforms (wheeled, aerial, and industrial robots), and testing environments (indoors and outdoors), and it is well suited to rigorously validate novel image-based robot-motion estimation algorithms, including visual odometry, visual SLAM, and deep learning-based methods. PanoraMIS and the accompanying documentation is publicly available on the Internet for the entire research community.
BarretoJ (2006) A unifying geometric representation for central projection systems. Computer Vision and Image Understanding103(3): 208–217.
2.
BenosmanRKangSB (2013) Panoramic Vision: Sensors Theory and Applications. Berlin: Springer.
3.
Blanco-ClaracoJLMoreno-DuenasFAGonzalez-JimenezJ (2014) Málaga Urban Dataset: High-rate stereo and lidars in a realistic urban scenario. The International Journal of Robotics Research33(2): 207–214.
4.
BurriMNikolicJGohlP, et al. (2016) The EuRoC micro aerial vehicle datasets. The International Journal of Robotics Research35(10): 1157–1163.
5.
CadenaCCarloneLCarrilloH, et al. (2016) Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics32(6): 1309–1332.
6.
Carlevaris-BiancoNUshaniAEusticeR (2016) University of Michigan North Campus Long-Term Vision and Lidar Dataset. The International Journal of Robotics Research35(9): 1023–1035.
7.
CaronGEynardD (2011) Multiple camera types simultaneous stereo calibration. In:Proceedings IEEE International Conference on Robotics and Automation (ICRA), pp. 2933–2938.
8.
CaronGMorbidiF (2018) Spherical visual gyroscope for autonomous robots using the mixture of photometric potentials. In:Proceedings IEEE International Conference on Robotics and Automation (ICRA), pp. 820–827.
9.
CerianiSFontanaGGiustiA, et al. (2009) Rawseeds ground truth collection systems for indoor self-localization and mapping. Autonomous Robots27(4): 353–371.
10.
FarrellJ (2008) Aided Navigation: GPS with High Rate Sensors. New York: McGraw-Hill.
11.
GeigerALenzPStillerCUrtasunR (2013) Vision meets robotics: The KITTI dataset. The International Journal of Robotics Research32(11): 1231–1237.
12.
GeyerCDaniilidisK (2001) Catadioptric Projective Geometry. International Journal of Computer Vision45(3): 223–243.
13.
GoodfellowIBengioYCourvilleA (2016) Deep Learning. Cambridge, MA: MIT Press.
14.
JeongJChoYShinYSRohHKimA (2019) Complex urban dataset with multi-level sensors from highly diverse urban environments. The International Journal of Robotics Research38(6): 642–657.
15.
KorrapatiHCourbonJAlizonSMarmoitonF (2013) The Institut Pascal data sets. In: Proceedings Journées Francophones des Jeunes Chercheurs en Vision par Ordinateur (ORASIS). Available at: http://ipds.univ-bpclermont.fr
16.
KoschorrekPPicciniTObergPFelsbergMNielsenLMesterR (2013) A multi-sensor traffic scene dataset with omnidirectional video. In:Proceedings IEEE Conference on Computer Vision and Pattern Recognition - Workshops, pp. 727–734. Availabe at: http://www.cvl.isy.liu.se/research/datasets
17.
LiMMourikisA (2013) High-precision, consistent EKF-based visual–inertial odometry. The International Journal of Robotics Research32(6): 690–711.
18.
MaddernWPascoeGLinegarCNewmanP (2017) 1 year, 1000 km: The Oxford RobotCar dataset. The International Journal of Robotics Research36(1): 3–15.
19.
MajdikATillCScaramuzzaD (2017) The Zurich urban micro aerial vehicle dataset. The International Journal of Robotics Research36(3): 269–273.
20.
MarchandESpindlerFChaumetteF (2005) ViSP for visual servoing: A generic software platform with a wide class of robot control skills. IEEE Robotics and Automation Magazine12(4): 40–52.
21.
MatsukiHvon StumbergLUsenkoVStücklerJCremersD (2018) Omnidirectional DSO: Direct sparse odometry with fisheye cameras. IEEE Robotics and Autonomation Letters3(4): 3693–3700.
22.
MoralesYWatanabeAFerreriFEvenJShinozawaKHagitaN (2018) Passenger discomfort map for autonomous navigation in a robotic wheelchair. Robotics and Autonomous Systems103: 13–26.
23.
MorbidiFCaronG (2017) Phase correlation for dense visual compass from omnidirectional camera–robot images. IEEE Robotics and Autonomation Letters2(2): 688–695.
24.
PandeyGMcBrideJEusticeR (2011) Ford Campus vision and lidar data set. The International Journal of Robotics Research30(13): 1543–1552.
25.
PasteauFNarayananVBabelMChaumetteF (2016) A visual servoing approach for autonomous corridor following and doorway passing in a wheelchair. Robotics and Autonomous Systems75: 28–40.
26.
PeynotTSchedingSTerhoS (2010) The Marulan data sets: Multi-sensor perception in a natural environment with challenging conditions. The International Journal of Robotics Research29(13): 1602–1607.
27.
PfrommerBSanketNDaniilidisKClevelandJ (2017) PennCOSYVIO: A challenging visual inertial odometry benchmark. In: Proceedings IEEE International Conference on Robotics and Automation (ICRA), pp. 3847–3854.
28.
PodobnikJRejcJŠlajpahSMunihMMiheljM (2017) All-terrain wheelchair: Increasing personal mobility with a powered wheel-track hybrid wheelchair. IEEE Robotics and Autonomation Letters24(4): 26–36.
29.
RebsamenBGuanCZhangH, et al. (2010) A brain controlled wheelchair to navigate in familiar environments. IEEE Transactions on Neural Systems and Rehabilitation Engineering18(6): 590–598.
30.
SchubertDGollTDemmelNUsenkoVStücklerJCremersD (2018) The TUM VI benchmark for evaluating visual–inertial odometry. In: Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1680–1687.
31.
SmithMBaldwinIChurchillWPaulRNewmanP (2009) The New College vision and laser data set. The International Journal of Robotics Research28(5): 595–599.
32.
SturmJEngelhardNEndresFBurgardWCremersD (2012) A benchmark for the evaluation of RGB-D SLAM systems. In: Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 573–580.
33.
SumikuraSShibuyaMSakuradaK (2019) OpenVSLAM: A versatile visual SLAM framework. In: Proceedings 27th ACM International Conference on Multimedia, pp. 2292–2295. Available at: http://github.com/xdspacelab/openvslam
34.
UrbanSJutziB (2017) LaFiDa - A laserscanner multi-fisheye camera dataset. Journal of Imaging3(1): art. num. 5.
35.
ZhangZRebecqHForsterCScaramuzzaD (2016) Benefit of large field-of-view cameras for visual odometry. In: Proceedings IEEE International Conference on Robotics and Automation (ICRA), pp. 801–808.
