Optimum grouping in a modified genetic algorithm for discrete-time,non-linear system identification

Abstract

The genetic algorithm approach is widely recognized as an effective and flexible optimization method for system identification. The flexibility of a genetic algorithm allows various strategies to be applied to it. One of the strategies applied is the modified genetic algorithm which relies on, among other things, the separation of the population into groups where each group undergoes mutual recombination operations. The strategy has been shown to be better than the simple genetic algorithm and conventional statistical method, but it contains inadequate justification of how the separation is made. The usage of objective function values for separation of groups does not carry much flexibility and is not suitable since different time-dependent data have different levels of equilibrium and thus different ranges of objective function values. This paper investigates the optimum grouping of chromosomes by fixed group ratios, enabling more efficient identification of dynamic systems using a NARX (Non-linear AutoRegressive with eXogenous input) model. Several simulated systems and real-world timedependent data are used in the investigation. Comparisons based on widely used optimization performance indicators along with outcomes from other research are used. The issue of model parsimony is also addressed, and the model is validated using correlation tests. The study reveals that, when recombination and mutation are used for different groups, equal composition of both groups produces a better result in terms of accuracy, parsimony, speed, and consistency.

Keywords

model structure selection NARX model parameter estimation system identification correlation test genetic algorithm

Get full access to this article

View all access options for this article.

References

Holland

J. H.

Adaptation in natural and artificial systems, First edition, 1975 (The University of Michigan); 1st MIT Press edition, 1992 (Massachusetts Institute of Technology, Ann Arbor).

Zalzala

A. M.S.

Fleming

P. J.

(Eds) Genetic algorithms in engineering systems, 1997 (The Institution of Electrical Engineers, London, UK).

Goldberg

D. E.

Genetic algorithms in search, optimization and machine learning, 1989 (Addison-Wesley Publishing Company, Reading, Massachusetts).

Gen

Cheng

Genetic algorithm and engineering design, 1997 (John Wiley, New York).

Sakaguchi

Yamamoto

A study on system identification using GA and GMDH network. In Proceedings of the 29th Annual Conference of the IEEE Industrial Electronics Society, IECON ′03, Roanoke, Virginia, 2–6 November 2003, Vol. 3, pp. 2387–2392.

Yen

T. G.

Kang

C. C.

Wang

W. J.

A genetic based fuzzy-neural networks design for system identification

In Proceedings of the IEEE International Conference on Systems, man and cybernetics, Hawaii, 10-12 October 2005, Vol. 1, pp. 672–678.

Tan

Yang

The optimization of nonlinear systems identification based on genetic algorithms

In Proceedings of the International Conference on Computational intelligence and security, Gvangzhai, People's Republic of China, November 2006, Vol. 1, pp. 266–269.

Juang

Application of genetic algorithm and recurrent network to nonlinear system identification

In Proceedings of 2003 IEEE Conference on Control applications, Istanbul, Turkey, 23-25 June 2003, Vol. 1, pp. 129–134.

Hatanaka

Uosaki

Koga

Evolutionary computation approach to block oriented nonlinear model identification. In Proceedings of the Fifth Asian Control Conference, Melbourne, Australia, 20-23 July 2004, Vol. 1, pp. 90–96.

10.

Abbas

H. M.

Bayoumi

M. M.

Volterra-system identification using adaptive real-coded genetic algorithm

IEEE Trans. Syst., Man and Cybernetics, Part A, 2006, 36 (4), 671–684.

11.

Tcholakian

A. B.

Martins

Pacheco

R. C. S.

Barcia

R. M.

Fuzzy system identification through hybrid genetic algorithm. In Proceedings of the 1997 Annual Meeting of the North American Fuzzy Information Processing Society, NAFIPS ′97, Syracuse, New York, 21–24 September 1997, pp. 428–433.

12.

Pereira

D. S.

Pinto

J. O. P.

Genetic algorithm based system identification and PID tuning for optimum adaptive control

In Proceedings of 2005 IEEE/ASME International Conference on Advanced intelligent mechatronics, California, USA, 24-28 July 2005, pp. 801–806.

13.

Lee

K. Y.

Mohamed

Syed P.

A real-coded genetic algorithm involving a hybrid crossover method for power plant control system design

In Proceedings of 2002 Congress on Evolutionary computation, CEC'02, Piscataway, New Jersey, 12-17 May 2002, Vol. 2, pp. 1069–1074.

14.

Iwasaki

Miwa

Matsui

GA-based evolutionary identification algorithm for unknown structured mechatronic systems

IEEE Trans. Ind. Electronics, 2005, 52 (1), 300–305.

15.

Mitsukura

Fukumi

Akamatsu

Yamamoto

A system identification method using a hybrid-type genetic algorithm. In Proceedings of 41st SICE Annual Conference, SICE 2002, Osaka, Japan, 5–7 August 2002, Vol. 3, pp. 1598–1602.

16.

Duong

Stubberud

A. R.

System identification by genetic algorithm. IEEE Aerospace Conference Proceedings, Big Sky, Montana, 2002, Vol. 5, pp. 2331–2337.

17.

Ahmad

Jamaluddin

Hussain

M. A.

Multivariable system identification for dynamic discrete-time nonlinear system using genetic algorithm. In Proceedings of the IEEE International Conference on Systems, man and cybernetics, Hammamet, Tunisia, 6-9 October 2002, Vol. 5.

18.

Eshelman

L. J.

Genetic algorithms In Evolutionary computation 1: Basic algorithms and operators (Eds Bäck

Fogel

D. B.

Michalewicz

), 2000, ch. 8 (IOP Publishing Ltd).

19.

Perry

M. J.

Koh

G. C.

Choo

Y. S.

Modified genetic algorithm approach to structural identification. The Third International Conference on Structural stability and dynamics, Orlando, USA, 19-22 June 2005.

20.

Ahmad

Jamaluddin

Hussain

M. A.

Model structure selection for a discrete-time nonlinear system using genetic algorithm

Proc. Instn Mech. Engrs, Part I: J. Systems and Control Engineering, 2004, 218, 85–98.

21.

Grefenstette

J. J.

Optimization of control parameters for genetic algorithms

IEEE Trans. Syst., Man and Cybernetics, 1986, 16 (1), 122–128.

22.

Wei

H. L.

Billings

S. A.

Liu

Term and variable selection for non-linear system identification

Int. J. Control, 2004, 77 (1), 86–110.

23.

Michalewicz

Genetic algorithms + data structures = evolution programs, Second edition, 1994 (Springer-Verlag, Berlin-Heidelberg).

24.

Veres

S. M.

Structure selection of stochastic dynamic systems, 1991 (OPA (Amsterdam) BV).

25.

Ljung

System identification: theory for the user, 2nd edition, 1999 (Prentice-Hall PTR, New Jersey).

26.

Johansson

System modeling and identification, 1993 (Prentice-Hall, Englewood Cliffs, New Jersey).

27.

Holland

J. H.

Genetic algorithms and the optimal allocation of trials

SIAM J. Computing, 1973, 2 (2), 88–105.

28.

Bäck

Fogel

D. B.

Whitley

Angeline

P. J.

Mutation operators In Evolutionary computation 1: Basic algorithms and operators (Eds Bäck

Fogel

D. B.

Michalweicz

), 2000, ch. 32 (IOP Publishing Ltd).

29.

Billings

S. A.

Voon

W. S. F.

Correlation based model validity tests for non-linear models

Int. J. Control, 1986, 44 (1), 235–244.

30.

Billings

S. A.

Zhu

Q. M.

Nonlinear model validation using correlation tests, Int. J. Control, 1994, 60 (6), 1107–1120.

31.

Box

G. E. P.

Jenkins

G. M.

Reinsel

G. C.

Time series analysis forecasting and control, 1994 (Prentice-Hall, Englewood Cliffs, New Jersey).

32.

Chen

Billings

S. A.

Representations of nonlinear systems: The NARMAX model

Int. J. Control, 1989, 49 (3), 1013–1032.

33.

Yao

Evolutionary computation: A gentle introduction In Evolutionary optimization (Eds Sarker

Mohammadian

Xin

), 2002, ch. 2 (Kluwer Academic Publishers, Boston).