Annealing Robust Radial Basis Function Networks with Support Vector Regression for Nonlinear Inverse System Identification with Outliers

Abstract

In this paper, the proposed annealing robust radial basis function networks (RBFNs) based on support vector regression (SVR), RBFNs and annealing robust learning algorithm (ARLA) for the nonlinear inverse system identification with outliers. That is, a two-stage structure; namely, an identification stage and an inverse identification stage is proposed. Firstly, the ε or v SVR uses the quadratic programming optimization to determine the initial structure of the annealing robust RBFNs in each stage for the system identification and the inverse system identification with outliers. Then, the proposed annealing robust RBFNs are trained by the ARLA, which uses the annealing concept in the cost function of robust back-propagation learning algorithm, can overcome the error measurement caused by the outliers for each stage. Hence, the proposed method has the same capability of universal approximator with the traditional RBFNs, a faster learning speed than the traditional RBFNs and outlier noise rejection with the proposed neural network for the nonlinear inverse system identification with outliers. Finally, the proposed approach is applied to magneto-rheological damper systems. Simulation results show the superiority of the proposed method for the prototype magneto-rheological damper and the nonlinear inverse system identification with outliers.

Keywords

Annealing robust learning algorithm outliers radial basis function networks support vector regression.

Get full access to this article

View all access options for this article.

References

Burt, P.M.S. , 2007, "Inverse identification adaptive IIR filtering: Convergence speed analysis and successive approximations algorithm," in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Honolulu, HI, April 15-20, pp. 1309-1312.

Chuang, C.C. , Su, S.F. , and Hsiao, C.C. , 2000, "The annealing robust backpropagation (BP) learning algorithm ," IEEE Transactions on Neural Networks 11(5), 1067-1077.

Chuang, C.C. , Jeng, J.T. , and Lin, P.T. , 2004, "Annealing robust radial basis function networks for function approximation with outliers," Neurocomputing 56, 123-139.

Du, H. , Lam, J. , and Zhang, N. , 2006, "Modelling of a magneto-rheological damper by evolving radial basis function networks," Engineering Applications of Artificial Intelligence 19, 869-881.

Jeng, J.T. , 2006, "Hybrid approach of selecting hyper-parameters of support vector machine for regression," IEEE Transactions on Systems, Man, and Cybernatics B 36, 699-709.

Li, Y. , Lan, N. , and Yang F. , 1999, "The inverse identification of neuromuscular system by using neural networks in elbow function self-correcting system," in Proceedings of International Joint Conference on Neural Networks , Washington, DC, July 10-16, pp. 229-232.

Narendra, K.S. , 1990, "Identification and control of dynamical systems using neural network," IEEE Transactions on Neural Networks 1(1), 4-27.

Pham, D.T. and Oh, S.J. , 1999, "Identification of plant inverse dynamics using neural networks," Artificial Intelligence in Engineering 13, 309-320.

Renno, J.M. , 2007, "Inverse dynamics based tuning of a fuzzy logic controller for a single-link flexible manipulator," Journal of Vibration and Control 13, 1741-1759.

10.

Schölkopf, B. , Smola, A.J. , Williamson, R.C. , and Bartlett, P.L. , 2000, "New support vector algorithms," Neural Computation 12, 1207-1245.

11.

Shaode, Z. and Xiao, Z. , 2007, "Application of the control scheme based on RBF inverse dynamic identification in electrode system of ladle furnace," in Proceedings of the Second IEEE Conference on Industrial Electronics and Applications, Harbin, China, May 23-25, pp.1109-1112.

12.

Smola, A.J. and Schölkopf, B. , 1998, "From regularization operators to support vector kernels ," Advances in Neural Information Processing Systems 10, 343-349.

13.

Spencer Jr., B.F. , Dyke, S.J. , Sain, M.K. , and Carlson, J.D. , 1997, "Phenomenological model for magnetorheological dampers ," Journal of Engineering Mechanics 123(3), 230-238.

14.

Vapnik, V. , 1995, The Nature of Statistical Learning Theory, Springer, Berlin.

15.

Widrow, B. and Bilello, M. , 1993, "Adaptive inverse control," in Proceedings of the International Symposium on Intelligent Control , Chicago, IL, August 25-27, pp. 1-6.

16.

Yildirim, S. , Erkaya, S. , Eski, I. , and Uzmay I. , 2009, "Noise and vibration analysis of car engines using proposed neural network ," Journal of Vibration and Control 15, 133 -156.

17.

Zhang, M.G. , 2007, "Inverse model identification of nonlinear dynamic system using neural network," in Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, Hong Kong, August 19-22, pp. 2451-2455.

18.

Zhang, S. and Zheng X. , 2007, "Application of double model control scheme based on RBF inverse identification in electrode system of electrical arc furnace ," in Proceedings of the IEEE International Conference on Automation and Logistics, Jinan, China, August 18-21, pp. 485-489.