Abstract:
Many known evolutionary algorithms for optimization problems use elite individuals that are guaranteed to be preserved in the population of the evolutionary algorithm due to their advantage with respect to the objective function compared to other individuals. Despite the fact that there are no elite individuals in nature, in evolutionary algorithms the elite ensures the constant presence of record solutions in the population and allows an intensive study of the search space near such solutions. Nevertheless, there are families of problems in which the presence of elite individuals complicates the study of new areas of the solution space, prevents exit from local optima, and increases the mathematical expectation of the time to obtain a global optimum. Non-elitist evolutionary algorithms, in particular, when using tournament and linear ranking selection, are effective for these problems, but require an appropriate adjustment of the selection and mutation parameters. One of the standard approaches to analyzing the efficiency of evolutionary algorithms is based on dividing the solution space into subsets (level sets) numbered in the expected order of their visit by the population of the evolutionary algorithm. In this paper, we consider the class SparseLocalOpt$_{\alpha,\varepsilon}$ of pseudo-Boolean optimization problems in which the union of a family of level sets that are in some sense inconsistent with respect to the objective function is an $\varepsilon$-sparse set, and the solution sets where the objective function is greater than in inconsistent level sets have density at least $\alpha$. The main result is a new polynomial upper bound for the mathematical expectation of the time in which non-elitist evolutionary algorithms first reach the global optimum; this bound holds for problems from SparseLocalOpt$_{\alpha, \varepsilon}$, where elitist evolutionary algorithms are inefficient, i.e., reach the optimum in exponential time on average. In addition, the efficiency of non-elitist evolutionary algorithms is shown on a wider class of problems. The values of adjustable parameters that guarantee the polynomial boundedness of the optimization time for some $\alpha$ and $\varepsilon$ are found for evolutionary algorithms with tournament and linear ranking selection. An example of using the obtained results for a family of vertex covering problems on star graphs is given, and the advantage of non-elitist evolutionary algorithms is demonstrated compared to the simplest algorithm with one elite individual.
Keywords:
evolutionary algorithm, local optimum, optimization time, density, sparsity.
The work is supported by the Mathematical Center in Akademgorodok under agreement no. 075-15-2022-282 with the Ministry of Science and Higher Education of the Russian Federation.
Citation:
A. V. Eremeev, “On the efficiency of non-elitist evolutionary algorithms in the case of sparsity of the level sets inconsistent with respect to the objective function”, Trudy Inst. Mat. i Mekh. UrO RAN, 30, no. 4, 2024, 84–105; Proc. Steklov Inst. Math. (Suppl.), 327, suppl. 1 (2024), S91–S111
\Bibitem{Ere24}
\by A.~V.~Eremeev
\paper On the efficiency of non-elitist evolutionary algorithms in the case of sparsity of the level sets inconsistent with respect to the objective function
\serial Trudy Inst. Mat. i Mekh. UrO RAN
\yr 2024
\vol 30
\issue 4
\pages 84--105
\mathnet{http://mi.mathnet.ru/timm2130}
\crossref{https://doi.org/10.21538/0134-4889-2024-30-4-84-105}
\elib{https://elibrary.ru/item.asp?id=75134208}
\edn{https://elibrary.ru/knfxuh}
\transl
\jour Proc. Steklov Inst. Math. (Suppl.)
\yr 2024
\vol 327
\issue , suppl. 1
\pages S91--S111
\crossref{https://doi.org/10.1134/S0081543824070071}