Ockham's Razor in Memetic Computing: Three Stage Optimal Memetic Exploration
This work addresses the problem of unnecessary complexity in algorithmic design for researchers in computational intelligence optimization, offering a counter-tendency approach that is incremental in nature.
The paper tackles the trend of increasing complexity in Memetic Computing optimization algorithms by proposing a structurally simple algorithm, Three Stage Optimal Memetic Exploration, which uses three memes with varying search radii and a trial-and-error logic. Numerical results show it performs competitively with state-of-the-art complex algorithms on various test problems and a digital signal processing application, despite its low computational cost.
Memetic Computing is a subject in computer science which considers complex structures as the combination of simple agents, memes, whose evolutionary interactions lead to intelligent structures capable of problem-solving. This paper focuses on Memetic Computing optimization algorithms and proposes a counter-tendency approach for algorithmic design. Research in the field tends to go in the direction of improving existing algorithms by combining different methods or through the formulation of more complicated structures. Contrary to this trend, we instead focus on simplicity, proposing a structurally simple algorithm with emphasis on processing only one solution at a time. The proposed algorithm, namely Three Stage Optimal Memetic Exploration, is composed of three memes; the first stochastic and with a long search radius, the second stochastic and with a moderate search radius and the third deterministic and with a short search radius. The bottom-up combination of the three operators by means of a natural trial and error logic, generates a robust and efficient optimizer, capable of competing with modern complex and computationally expensive algorithms. This is suggestive of the fact that complexity in algorithmic structures can be unnecessary, if not detrimental, and that simple bottom-up approaches are likely to be competitive is here invoked as an extension to Memetic Computing basing on the philosophical concept of Ockham's Razor. An extensive experimental setup on various test problems and one digital signal processing application is presented. Numerical results show that the proposed approach, despite its simplicity and low computational cost displays a very good performance on several problems, and is competitive with sophisticated algorithms representing the-state-of-the-art in computational intelligence optimization.