Accurate and robust vehicle localization, a fundamental task for autonomous driving, is still a challenging problem especially in GPS-denied scenarios. Recently, high definition (HD) map suggests a promising solution. However, the matching between online sensed data and HD map is difficult and time-consuming. In our work, road markings are selected as landmarks due to salient appearance features. Based on the detection results of road markings from the vehicle-borne images, the points of edge lines are employed to fit straight lines with RANSAC for outlier removal. The distances between the ego-vehicle and the fitted edge lines can be computed with camera-vehicle calibration in advance. Subsequently, the point-to-line distances from the sensed data are mapped into global linear constraints on the vehicle’s positions with the support of a lane-level HD map, which provides centimeter-level coordinates of road markings. Finally, the distances and the localization from the integrated navigation system (INS) are fused with the proposed linear Kalman filter based on the second-order Markov model (KF-MM2). The proposed method has been verified in different daily driving scenarios. Experimental results demonstrate that our method can achieve good performance with an average localization error of 0.53 m and a standard deviation of 0.17 m.
LinJGuoG. Vehicle localization during GPS outages with extended Kalman filter and deep learning. IEEE Trans Instrum Meas2021; 70: 1–10.
2.
Dinh-VanNNashashibiFThanh-HuongN, et al. Indoor intelligent vehicle localization using WiFi received signal strength indicator. In: 2017 IEEE MTT-S International conference on microwaves for intelligent mobility (ICMIM), 2017, pp.33–36. New York: IEEE.
3.
YangJWangMYangY, et al. A device-free localization and size prediction system for road vehicle surveillance via UWB networks. IEEE Trans Instrum Meas2022; 71: 1–11.
4.
NazemzadehPFontanelliDMaciiD, et al. Indoor localization of mobile robots through QR code detection and dead reckoning data fusion. IEEE ASME Trans Mechatron2017; 22(6): 2588–2599.
5.
ZhangGNgHFWenW, et al. 3D Mapping database aided GNSS based collaborative positioning using factor graph optimization. IEEE Trans Intell Transp Syst2021; 22(10): 6175–6187.
6.
ShanTEnglotB. LeGO-LOAM: lightweight and ground-optimized LiDAR odometry and mapping on variable terrain. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), 2018, pp.4758–4765. New York: IEEE.
7.
Mur-ArtalRTardosJD. ORB-SLAM2: an open-source SLAM system for monocular, stereo, and RGB-D cameras. IEEE Trans Robot2017; 33(5): 1255–1262.
8.
LiuZShiDLiR, et al. PLC-VIO: visual–inertial odometry based on point-line constraints. IEEE Trans Autom Sci Eng2022; 19(3): 1880–1897.
9.
CuiDXueJZhengN. Real-time global localization of robotic cars in lane level via lane marking detection and shape registration. IEEE Trans Intell Transp Syst2016; 17(4): 1039–1050.
10.
LiuRWangJZhangB. High definition map for automated driving: overview and analysis. J Navig2020; 73(2): 324–341.
11.
LiTQianYde La FortelleA, et al. Lane-level localization system using surround-view cameras adaptive to different driving conditions. Int J Adv Robot Syst2020; 17(2): 1–13.
12.
FengGMaLTanX. Visual map construction using RGB-D sensors for image-based localization in indoor environments. J Sens2017; 2017(99): 1–18.
13.
LiYHuZCaiY, et al. Visual map-based localization for intelligent vehicles from multi-view site matching. IEEE Trans Intell Transp Syst2021; 22(2): 1068–1079.
14.
GuoCMeguroJKojimaY, et al. Automatic lane-level map generation for advanced driver assistance systems using low-cost sensors. In: Proceedings - IEEE International conference on robotics and automation, 2014, pp.3975–3982. New York: IEEE.
15.
KimDChungTYiK. Lane map building and localization for automated driving using 2D laser rangefinder. In: 2015 IEEE intelligent vehicles symposium (IV), 2015, pp.680–685. New York: IEEE.
16.
WangHXueCZhouY, et al. Visual semantic localization based on HD map for autonomous vehicles in urban scenarios. In: 2021 IEEE International conference on robotics and automation (ICRA), 2021, pp.11255–11261. New York: IEEE.
17.
WenWPfeiferTBaiX, et al. It is time for factor graph optimization for GNSS/INS integration: Comparison between FGO and EKF. arXiv: 2004.10572, April2020, 19.
18.
LinCYLianFL. System integration of sensor-fusion localization tasks using vision-based driving lane detection and road-marker recognition. IEEE Syst J2020; 14(3): 4523–4534.
19.
CaiHHuZHuangG, et al. Integration of GPS, monocular vision, and high definition (HD) map for accurate vehicle localization. Sensors2018; 18(10): 3270.
20.
KimSKimSSeokJ, et al. Road shape classification-based matching between lane detection and HD map for robust localization of autonomous cars. IEEE Trans Intell Vehicles2023; 8: 13431–13443.
21.
GruyerDBelaroussiRRevilloudM. Map-aided localization with lateral perception. In: 2014 IEEE intelligent vehicles symposium (IV), 2014, pp.674–680. New York: IEEE.
22.
KimDKimBChungT, et al. Lane-level localization using an AVM camera for an automated driving vehicle in urban environments. IEEE ASME Trans Mechatron2017; 22(1): 280–290.
23.
HuJYangMXuH, et al. Mapping and localization using semantic road marking with centimeter-level accuracy in indoor parking lots. In: 2019 IEEE intelligent transportation systems conference (ITSC), 2019, pp.4068–4073. New York: IEEE.
24.
QinTChenTChenY, et al. AVP-SLAM: semantic visual mapping and localization for autonomous vehicles in the parking lot. In: 2020 IEEE/RSJ International conference on intelligent robots and systems (IROS), 2021, pp.5939–5945. New York: IEEE.
25.
LiLYangMWangC, et al. Hybrid filtering framework based robust localization for industrial vehicles. IEEE Trans Ind Inform2018; 14(3): 941–950.
26.
HeoSChaJParkCG. EKF-based visual inertial navigation using sliding window nonlinear optimization. IEEE Trans Intell Transp Syst2019; 20(7): 2470–2479.
27.
ZhangZ. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell2000; 22(11): 1330–1334.
28.
GeigerALenzPStillerC, et al. Vision meets robotics: the KITTI dataset. Int J Rob Res2013; 32(11): 1231–1237.
29.
YuZRenXHuangY, et al. Detecting lane and road markings at a distance with perspective transformer layers. In: 2020 IEEE 23rd International conference on intelligent transportation systems (ITSC), 2020, pp.1–6. New York: IEEE.
30.
XuXYuJZhuY, et al. Leveraging smartphones for vehicle lane-level localization on highways. IEEE Trans Mob Comput2018; 17(8): 1894–1907.
31.
ZhangJSinghS. Low-drift and real-time LiDAR odometry and mapping. Auton. Robots2017; 41(2): 401–416.
