Evolutionary programming and genetic algorithms are compared on two constrained optimization problems. The constrained problems are redesigned as related unconstrained problems by the application of penalty functions. The experiments indicate that evolutionary programming outperforms the genetic algorithm. The results are statistically significant under nonparametric hypothesis testing. The results also indicate potential difficulties in the design of suitable penalty functions for constrained optimization problems. A discussion is offered regarding the suitability of different methods of evolutionary computation for such problems.
B.D.O. Anderson, R.R. Bitmead, C.R. Johnson, P.V. Kokotovic, R.L. Kosut, I.M.Y. Mareels, L. Prahy, and B.D. Riedle (1986) Stability of Adaptive Systems: Passivity and Averaging Analysis, MIT Press, Cambridge, MA.
2.
L. Ljung, System Identification: Theory for the User, Prentice-Hall , Englewood Cliffs, NJ, 1989.
3.
D.B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence , IEEE Press, Piscataway, NJ, 1995.
4.
D.B. Fogel, "An introduction to simulated evolutionary optimization," IEEE Trans. Neural Networks, Vol. 5:1,1994, pp. 3-14.
5.
T. Back and H.-P. Schwefel, "An overview of evolutionary algorithms for parameter optimization ," Evolutionary Computation, Vol. 1:1, 1993, pp. 1-24.
6.
T. Bäck, G. Rudolph, and H.-P. Schwefel, "Evolutionary programming and evolution strategies: similarities and differences," Proc. of the Second Annual Conf. on Evolutionary Programming, D.B. Fogel and W. Atmar (eds.), Evolutionary Programming Society, La Jolla, CA, 1993 , pp. 11-22.
7.
G. Rudolph, "Convergence analysis of canonical genetic algorithms," IEEE Trans. Neural Networks, Vol. 5:1,1994, pp. 96-101.
8.
K.A. De Jong , "An analysis of the behavior of a class of genetic adaptive systems," Doctoral dissertation, University of Michigan, Ann Arbor, 1975
9.
L. Davis (ed.), Handbook of Genetic Algorithms, Van NostrandReinhold, NY, 1991.
10.
S. Forrest (ed.), Proceedings of the Fifth International Conference on Genetic Algorithms, Morgan Kaufmann, San Mateo, CA, 1993.
11.
A. Homaifar , C.X. Qi and S.H. Lai, "Constrained optimization via genetic algorithms ," SIMULATION, Vol. 62:4,1994, pp. 242-254.
12.
N.A. Baricelli , "Esempi numerici di processi di evoluzione," Methodos, 1954, pp. 45-68.
13.
N.A. Baricelli , "Symbiogenetic evolution processes realized by artificial methods," Methodos, Vol. 9:35-36, 1957, pp. 143-182.
14.
A.S. Fraser , "Simulation of genetic systems by automatic digital computers. I. introduction," Australian Journal of Biological Sciences, Vol. 10, 1957 , pp. 484-491.
15.
H.J. Bremermann , "Optimization through evolution and recombination ," Self-Organizing Systems, M.C. Yovits, G.T. Jacobi and G.D. Goldstine (eds.), Spartan Books, Washington, D.C., 1962, pp. 93-106.
L.J. Fogel, A.J. Owens and M.J. Walsh, Artificial Intelligence Through Simulated Evolution, John Wiley, NY, 1966.
18.
I. Rechenberg, "Cybernetic solution path of an experimental problem," Royal Aircraft Establishment, Library Translation No. 1122, August, 1965
19.
H.-P. Schwefel, "Kybernetische evolution als strategie der experimentellen forschung in der strömungstechnik," Diploma thesis, Technical University of Berlin, 1965
20.
M. Conrad, "Evolutionary learning circuits," Journal of Theoretical Biology, Vol. 46, 1974, pp. 167-188.
21.
J.H. Holland, Adaptation in Natural and Artificial Systems, Univ. of Michigan Press, Ann Arbor, 1975.
22.
Y. Davidor, H.-P. Schwefel and R. Männer (eds.), Parallel Problem Solving from Nature 3, Springer Verlag , Berlin, 1994.
23.
A.V. Sebald and L.J. Fogel (eds.), Proceedings of the Third Annual Conference on Evolutionary Programming, World Scientific, River Edge, NJ, 1994.
24.
D.B. Fogel, "On the philosophical differences between evolutionary algorithms and genetic algorithms," Proc. of the Second Annual Conf. on Evolutionary Programming, D.B. Fogel and W. Atmar (eds.), Evolutionary Programming Society, La Jolla, CA, 1993, pp. 23-29.
25.
D.B. Fogel and J.W. Atmar, "Comparing genetic operators to Gaussian mutations in simulated evolutionary processes using linear systems," Biol. Cybern., Vol. 63,1990, pp. 111-114.
26.
N.N. Schraudolph and R.K. Belew, "Dynamic parameter encoding," Machine Learning, Vol. 9:1,1992, pp. 9-21.
27.
D.B. Fogel and L.C. Stayton, "On the effectiveness of crossover in simulated evolutionary optimization," BioSystems, Vol. 32:3,1994 , pp. 171-182.
28.
Z. Michalewicz , T.D. Logan, and S. Swaminathan, "Evolutionary operators for continuous convex parameter spaces," Proc. of the Third Annual Conference on Evolutionary Programming, A.V. Sebald and L.J. Fogel (eds.), World Scientific Publishing, River Edge, NJ, 1994, pp. 84-97.
29.
Z. Michalewicz , Genetic Algorithms + Data Structures = Evolution Programs, Springer Verlag, NY, 1992.
30.
Z. Michalewicz and N.F. Attia, "Evolutionary optimization of constrained problems," Proc. of the Third Annual Conference on Evolutionary Programming, A.V. Sebald and L.J. Fogel (eds.), World Scientific Publishing, River Edge, NJ, 1994, pp. 98-108.
31.
J.A. Joines and C.R. Houck (1994) "On the Use of Non-Stationary Penalty Functions to Solve Nonlinear Constrained Optimization Problems with GA's," Proceedings of the First IEEE Conference on Evolutionary Computation , Vol. 2, IEEE Press, Piscataway, NJ, pp. 579-584.
32.
D.B. Fogel , "An evolutionary approach to the traveling salesman problem," Biological Cybernetics, Vol. 60:2, 1988, pp. 139-144.
33.
D.B. Fogel , "Asymptotic convergence properties of genetic algorithms and evolutionary programming: analysis and experiments," Cybernetics and Systems, Vol. 25:3,1994, pp. 389-407.
34.
T. Bäck, Evolutionary algorithms in theory and practice, IOP Press , Philadelphia, PA, 1995.
35.
D.J. Nettleton and R. Garigliano, "Evolutionary algorithms and a fractal inverse problem," BioSystems, 1994, vol 33:3, pp 221-231.
36.
A. Fukunaga, J. Marks and J.T. Ngo, "Automatic control of physically realistic animated figures using evolutionary programming," Proc. of the Third Ann. Conf. on Evolutionary Programming, A.V. Sebald and L.J. Fogel (eds.), World Scientific Publishers, River Edge, NJ, 1994, pp 76-83.
