As one of important advanced driving assistance systems (ADAS) for intelligent vehicles, forward collision warning system is an effective solution to avoid the traffic accidents. Accurately trajectory prediction can obtain the future spatial distribution of the vehicles in contextual traffic, which will help the driver make the decisions and avoid potential collisions. This paper proposes an effective trajectory prediction method based on long short term memory model integrated with attention mechanism and regularization strategy (AR-LSTM). The long short-term memory and convolutional neural network (LSTM-CNN) is utilized to recognize the driver’s lane change intention. Combined with the multi-modal information of the vehicles such as vehicle status variables, traffic information, and driver’s lane change intention, the AR-LSTM model is designed to predict the vehicle’s future trajectory. Besides, the AR-LSTM and LSTM- CNN model are trained and tested by the real traffic data set NGSIM (next generation simulation). Finally, considering two maneuvers to avoid the collisions by braking or changing lane, the proposed forward collision warning system is verified by the hardware-in-loop (HIL) platform compared to the existed fixed TTC (time to collision) method. And the statistical results demonstrate that the proposed system can provide correct warnings of braking and decrease invalid warnings of braking.
KusanoKDGablerHC.Safety benefits of forward collision warning, brake assist, and autonomous braking systems in rear-end collisions. IEEE Trans Intell Transp2012; 13(4): 1546–1555.
2.
LiYXingLWangW, et al. Evaluating impacts of different longitudinal driver assistance systems on reducing multi-vehicle rear-end crashes during small-scale inclement weather. Accid Anal Prev2017; 107: 63–76.
3.
XueWZhengL.Active collision avoidance system design based on model predictive control with varying sampling time. Automot Innov2020; 3(1): 62–72.
4.
KilicarslanMZhengJY.Predict vehicle collision by TTC from motion using a single video camera. IEEE Trans Intell Transp2018; 20(2): 522–533.
5.
NagataniT.Bunching transition in a time-headway model of a bus route. Phys Rev E Stat Nonlin Soft Matter Phys2001; 63(3-2): 36–115.
6.
ChenTLiuKWangZ, et al. Vehicle forward collision warning algorithm based on road friction, transp. Res D Transp Environ2019; 66: 49–57.
7.
Abdel-AtyMCunninghamRJGayahVV, et al. Dynamic variable speed limit strategies for real-time crash risk reduction on freeways. Transp Res Rec2008; 2078(1): 108–116.
8.
KumarSShawVMaitraJ, et al. FCW: a forward collision warning system using convolutional neural network. In: 2020 International conference on electrical and electronics engineering (ICE3), 2020, pp.1–5. New York: IEEE.
9.
YangWWanBQuX.A forward collision warning system using driving intention recognition of the front vehicle and V2V communication. IEEE Access2020; 8: 11268–11278.
10.
LefevreSVasquezDLaugierC.A survey on motion prediction and risk assessment for intelligent vehicles. Robomech J2014; 1(1): 1–14.
11.
HuangJTanH.Vehicle future trajectory prediction with a DGPS/INS-based positioning system. In: Proc. IEEE Amer. Control Conf, 2006, pp.5831–5836. New York: IEEE.
12.
HouenouABonnifaitPCherfaouiV, et al. Vehicle trajectory prediction based on motion model and maneuver recognition. In: Intelligent Robots and Systems (IROS), IEEE/RSJ international conference, 2013, pp.4363–4369. New York: IEEE.
13.
SchreierMWillertVAdamyJ. Bayesian, maneuver- based, long-term trajectory prediction and criticality assessment for driver assistance systems. In: Intelligent Transportation Systems (ITSC), 2014 IEEE 17th international conference, 2014, pp.334–341. New York: IEEE.
14.
DeoNRangeshATrivediMM.How would surround vehicles move a united framework for maneuver classification and motion prediction. IEEE Trans Intel Veh2018; 3: 129–140.
15.
SchlechtriemenJWirthmuellerFWedelA, et al. When will it change the lane a probabilistic regression approach for rarely occurring events. In: Intelligent vehicles symposium (IV), 2015, pp.1373–1379. New York: IEEE.
16.
XingYLvCCaoD.Personalized vehicle trajectory prediction based on joint time-series modeling for connected vehicles. IEEE Trans Veh Tech2020; 69(2): 1341–1352.
17.
KimSKumDChoiJWJW. RECUP net: recursive prediction network for surrounding vehicle trajectory prediction with future trajectory feedback. In: 2020 IEEE 23rd international conference on intelligent transportation systems (ITSC), 2020, pp.1–6. New York: IEEE.
18.
ZhouXYuXZhangY, et al. Trajectory planning and tracking strategy applied to an unmanned ground vehicle in the presence of obstacles. IEEE Trans Auto Sci Eng2021; 18(4): 1575–1589.
19.
LaugierCParomtchikIEPerrollazM, et al. Probabilistic analysis of dynamic scenes and collision risks assessment to improve driving safety. IEEE Intel Trans Syst Mag2011; 3(1): 4–19.
20.
LiXWangWRoettingM.Estimating driver’s lane-change intent considering driving style and contextual traffic. IEEE Trans Intel Trans Syst2018; 20: 3258–3271.
21.
XieGGaoHQianL, et al. Vehicle trajectory prediction by integrating physics- and maneuver- based approaches using interactive multiple models. IEEE Trans Ind Elec2018; 65(7): 5999–6008.
22.
HaoZHuangXWangK, et al. Attention –based GRU for driver intention recognition and vehicle trajectory prediction. In: 2020 4th CAA international conference on vehicular control and intelligence (CVCI), pp.86–91.
HouLXinLLiSE, et al. Interactive trajectory prediction of surrounding road users for autonomous driving using structural-LSTM network. IEEE Trans Intell Transp Syst2019; 21(11): 4615–4625.
KhosroshahiAOhn-BarETrivediMM.Surround vehicles trajectory analysis with recurrent neural networks. In: 2016 IEEE 19th International conference on intelligent transportation systems (ITSC), 2016, pp.2267–2272. New York: IEEE.
27.
KimBKangCMLeeSH, et al. Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network. arXiv preprint arXiv:1704.07049, 2017.
28.
DeoNTrivediM. Multi-modal trajectory prediction of surrounding vehicles with maneuver based LSTMs. In: 2018 IEEE intelligent vehicles symposium (IV), 2018, pp.1179–1184. New York: IEEE.
29.
DaiSLiLLiZ.Modeling vehicle interactions via modified LSTM models for trajectory prediction. IEEE Access2019; 7: 38287–38296.
30.
HouYEdaraPSunC.Modeling mandatory lane changing using bayes classifier and decision trees. IEEE Trans Intell Transp Syst2014; 15(2): 647–655.
31.
DoQHTehraniHMitaS, et al. Human drivers based active-passive model for automated lane change. IEEE Intell Transp Syst Mag2017; 9(1): 42–56.
32.
NilssonJSilvlinJBrannstromM, et al. If, when, and how to perform lane change maneuvers on highways. IEEE Intell Transp Syst Mag2016; 8(4): 68–78.
33.
ZhangHYueMYangL. Driver-automation cooperative steering control system in avoiding obstacle for road vehicles. In: 2019 IEEE 4th international conference on advanced robotics and mechatronics (ICARM), Toyonaka, Japan, pp.930–935. New York: IEEE.
BahdanauDChoKBengioY.Neural machine translation by jointly learning to align and translate. Computer Science, 2014.
36.
DeoNTrivediMM. Multi-modal trajectory prediction of surrounding vehicles with maneuver based LSTMs. In: Proceedings of the IEEE intelligent vehicles symposium (IV), 2018, pp.1179–1184. New York: IEEE.
37.
DeoNTrivediMM. Convolutional social pooling for vehicle trajectory prediction. In: Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), June 2018, pp.1468–1476. New York: IEEE.
38.
TijerinaLGarrottWRStoltzfusD, et al. Eye glance behavior of van and passenger car drivers during lane change decision phase. Transp Res Rec2005; 1937: 37–43.
39.
HouDZLiuGGaoF, et al. A new safety distance model for vehicle collision avoidance. Automot Eng2005; 27(2): 186–190.
40.
LiuQQiuXXieL, et al. Anti-collision warning time algorithm based on driving speed of vehicle. Trans CSAE2017; 33(12): 99–106.
41.
YanXXueQMaL, et al. Driving-simulator-based test on the effectiveness of auditory red-light running vehicle warning system based on time-to-collision sensor. Sens2014; 14(2): 3631–3651.
