Lateral semi-trailer truck control using a parameter self-learning MPC method in urban environment

Abstract

This paper analyzes the lateral control technology of autonomous semi-trailer trucks. Existing researches on the lateral control algorithm of semi-trailer trucks focus on making the head-truck or trailer follow a track well while ignoring the motion characteristics during the turning process, leading to specific security issues. Meanwhile, it is difficult to cope with the complex and uncertain factors influencing lateral control effect, such as the curvature of the desired trajectory, the load, and the velocity of the semi-trailer truck. This paper proposes a parametric self-learning model predictive control (MPC) based on the Proximal Policy Optimization of One Step (OSPPO) method to solve these problems. After modeling the kinematics of the semi-trailer truck, a lateral motion controller for the relationship between the head-truck and trailer based on the MPC method is established. The traditional MPC method has difficulty in adapting to the changeable influencing factors. Thus, a deep reinforcement learning algorithm named OSPPO is introduced to improve the flexibility of the MPC method. OSPPO establishes the nonlinear mapping relationship between the critical parameter of the MPC method and the factors influencing control effect by self-learning, avoiding a large amount of labeled data for training. In simulations, Trucksim and Matlab were used to conduct co-simulation to verify the usefulness of the control method. The method was implemented on an autonomous semi-trailer truck for many outdoor scenes. The actual experimental results showed the validity and advantages of the proposed method.

Keywords

Goods vehicles/ trucks heavy duty vehicles intelligent vehicles transportation control heavy vehicle systems

Get full access to this article

View all access options for this article.

References

Paden

Čáp

Yong

, et al. A survey of motion planning and control techniques for self-driving urban vehicles. IEEE Trans Intel Veh 2016; 1: 33–55.

Eskandarian

Sun

Research advances and challenges of autonomous and connected ground vehicles. IEEE Trans Intell Transp Syst 2019; 22: 683–711.

Dixit

Fallah

Montanaro

, et al. Trajectory planning and tracking for autonomous overtaking: state-of-the-art and future prospects. Annu Rev Control 2018; 45: 76–86.

Jujnovich

Cebon

Path-following steering control for articulated vehicles. J Dyn Syst Meas Control 2013; 135(3): 031006.

Hac

Fulk

Chen

Stability and control considerations of vehicle-trailer combination. SAE Int J Passeng Cars Mech Syst 2008; 1: 925–937.

Kim

K-I

Guan

Wang

, et al. Active steering control strategy for articulated vehicles. Front Inf Technol Electron Eng 2016; 17: 576–586.

Widyotriatmo

Nazaruddin

Putranto

MRF

, et al. Forward and backward motions path following controls of a truck-trailer with references on the head-truck and on the trailer. ISA Trans 2021; 105: 349–366.

Werling

Reinisch

Heidingsfeld

, et al. Reversing the general one-trailer system: asymptotic curvature stabilization and path tracking. IEEE Trans Intell Transp Syst 2014; 15: 627–636.

Hung

. Path following for a tractor-trailer system using model predictive control. In: SoutheastCon 2017, Concord, NC, USA, 30 March 2017–2 April 2017, pp.1–5. New York: IEEE.

10.

Hung

. Lateral position control for a tractor-trailer system using coordinate transformation and hybrid controllers. In: SoutheastCon 2017, Concord, NC, USA, 30 March 2017–2 April 2017, pp.1–6. New York: IEEE.

11.

Yue

Hou

Gao

, et al. Trajectory tracking control for tractor-trailer vehicles: a coordinated control approach. Nonlinear Dyn 2018; 91: 1061–1074.

12.

Barbosa

Marcos

da Silva

, et al. Robust path-following control for articulated heavy-duty vehicles. Control Eng Pract 2019; 85: 246–256.

13.

Yun

Yang

Huh

KS.

development of a narrow passage driving system for semi-trailer truck by using MPC. Int J Automot Technol 2022; 23(3): 785–791.

14.

Rigatos

Siano

Wira

, et al. Nonlinear optimal control for autonomous navigation of a truck and trailer system. In: 2017 18th international conference on advanced robotics, 10–12 July 2017, pp.505–510. New York: IEEE.

15.

Tian

Zeng

Wang

, et al. Active steering control based on preview theory for articulated heavy vehicles. PLoS ONE 2021, 16(5): e0252098.

16.

Khoukhi

AJC

Engineering

. Data-driven multi-stage multi-objective motion planning of mobile robots, application to near minimum power fuzzy parking. Comput Electr Eng 2015; 43: 218–237.

17.

Chen

Yuan

Tomizuka

. Deep imitation learning for autonomous driving in generic urban scenarios with enhanced safety. In: 2019 IEEE/RSJ international conference on intelligent robots and systems, Macau, China, 3–8 November 2019, pp.2884–2890. New York: IEEE.

18.

Paxton

Raman

Hager

, et al. Combining neural networks and tree search for task and motion planning in challenging environments. In: 2017 IEEE/RSJ international conference on intelligent robots and systems, Vancouver, BC, Canada, 24–28 September 2017, pp.6059–6066. New York: IEEE.

19.

Kempf

Weber

Müller

. A multi model neural network approach for longitudinal model predictive control of a passenger vehicle. In: 2020 IEEE 23rd international conference on intelligent transportation systems, Rhodes, Greece, 20–23 September 2020, pp.1–6. New York: IEEE.

20.

Sieberg

Blume

Schramm

. Side-slip angle estimation by artificial neural networks for vehicle dynamics control applications. In: AME 2021-automotive meets electronics; 12th GMM-Symposium, 10–11 March 2021, pp.1–6. New York: IEEE.

21.

Huang

Yan

. Trajectory tracking of intelligent vehicle using model predictive control based on neural-dynamics optimization. In: 2019 Chinese automation congress, Hangzhou, China, 22–24 November 2019, pp.588–593. New York: IEEE.

22.

Grigorescu

Trasnea

Cocias

, et al. A survey of deep learning techniques for autonomous driving. J Field Robot 2020; 37: 362–386.

23.

Lin

Duan

, et al. Continuous-time finite-horizon ADP for automated vehicle controller design with high efficiency. In: 2020 3rd international conference on unmanned systems, Harbin, China, 27–28 November 2020, pp.978–984. New York: IEEE.

24.

Ruder

SJ.

An overview of multi-task learning in deep neural networks. arXiv 2017; 1706.05098.

25.

Xie

D-F

Fang

Z-Z

Jia

, et al. A data-driven lane-changing model based on deep learning. Transp Res Part C Emerg Technol 2019; 106: 41–60.

26.

Lefevre

Carvalho

Borrelli

, et al. A learning-based framework for velocity control in autonomous driving. IEEE Trans Automa Sci Eng 2016; 13: 32–42.

27.

Lefevre

Carvalho

Borrelli

Autonomous car following: a learning-based approach. In: 2015 IEEE intelligent vehicles symposium, Seoul, Korea, 28 June 2015–1 July 2015, pp.920–926. New York: IEEE.

28.

Brunner

Rosolia

Gonzales

, et al. Repetitive learning model predictive control: an autonomous racing example. In: 2017 IEEE 56th annual conference on decision and control, Melbourne, VIC, Australia, 12–15 December 2017, pp.2545–2550. New York: IEEE.

29.

Kuhne

Lages

da Silva

Jr . Model predictive control of a mobile robot using linearization. In: Proceedings of mechatronics and robotics, Aachen, Germany, 2004, pp.525–530.

30.

Sutton

McAllester

Singh

, et al. Policy gradient methods for reinforcement learning with function approximation. Adv Neural Inf Process Syst 2000; 12: 1057–1063.