Refine
Year of publication
- 2015 (2) (remove)
Document Type
- Report (2)
Has Fulltext
- yes (2)
Keywords
- Optimierung (2)
- Ensemble Methods (1)
- Evolution Strategies (1)
- Evolutionary Algorithms (1)
- Evolutionsstrategie (1)
- Evolutionsstrategien (1)
- Evolutionäre Algorithmen (1)
- Evolutionärer Algorithmus (1)
- Genetic Algorithms (1)
- Genetic Programming (1)
- Genetic programming (1)
- Genetische Algorithmen (1)
- Genetisches Programmieren (1)
- Metaheuristik (1)
- Modellierung (1)
- Optimierungsproblem (1)
- Soft Computing (1)
- Surrogate-Model-Based Optimization (1)
- Versuchsplanung (1)
Institute
We propose to apply typed Genetic Programming (GP) to the problem of finding surrogate-model ensembles for global optimization on compute-intensive target functions. In a model ensemble, base-models such as linear models, random forest models, or Kriging models, as well as pre- and post-processing methods, are combined. In theory, an optimal ensemble will join the strengths of its comprising base-models while avoiding their weaknesses, offering higher prediction accuracy and robustness. This study defines a grammar of model ensemble expressions and searches the set for optimal ensembles via GP. We performed an extensive experimental study based on 10 different objective functions and 2 sets of base-models. We arrive at promising results, as on unseen test data, our ensembles perform not significantly worse than the best base-model.
Evolutionary algorithm (EA) is an umbrella term used to describe population-based stochastic direct search algorithms that in some sense mimic natural evolution. Prominent representatives of such algorithms are genetic algorithms, evolution strategies, evolutionary programming, and genetic programming. On the basis of the evolutionary cycle, similarities and differences between these algorithms are described. We briefly discuss how EAs can be adapted to work well in case of multiple objectives, and dynamic or noisy optimization problems. We look at the tuning of algorithms and present some recent developments coming from theory. Finally, typical applications of EAs to real-world problems are shown, with special emphasis on data-mining applications