From Real World Data to Test Functions
- When researchers and practitioners in the field of computational intelligence are confronted with real-world problems, the question arises which method is the best to apply. Nowadays, there are several, well established test suites and well known artificial benchmark functions available. However, relevance and applicability of these methods to real-world problems remains an open question in many situations. Furthermore, the generalizability of these methods cannot be taken for granted. This paper describes a data-driven approach for the generation of test instances, which is based on real-world data. The test instance generation uses data-preprocessing, feature extraction, modeling, and parameterization. We apply this methodology on a classical design of experiment real-world project and generate test instances for benchmarking, e.g. design methods, surrogate techniques, and optimization algorithms. While most available results of methods applied on real-world problems lack availability of the data for comparison, our future goal is to create a toolbox covering multiple data sets of real-world projects to provide a test function generator to the research community.
Author: | Andreas Fischbach, Martin Zaefferer, Jörg Stork, Martina Friese, Thomas Bartz-BeielsteinGND |
---|---|
URN: | urn:nbn:de:hbz:832-cos4-4326 |
Series (Serial Number): | CIplus (6/2016) |
Document Type: | Working Paper |
Language: | English |
Year of Completion: | 2016 |
Release Date: | 2016/11/28 |
Tag: | Benchmarking; Modeling; Optimization; Test Function |
GND Keyword: | Modelierung; Optimierung; Benchmarking; Funktionstest |
Page Number: | 24 |
Institutes and Central Facilities: | Fakultät für Informatik und Ingenieurwissenschaften (F10) |
CCS-Classification: | F. Theory of Computation / F.2 ANALYSIS OF ALGORITHMS AND PROBLEM COMPLEXITY (B.6-7, F.1.3) / F.2.1 Numerical Algorithms and Problems (G.1, G.4, I.1) |
Dewey Decimal Classification: | 000 Allgemeines, Informatik, Informationswissenschaft / 004 Informatik |
Open Access: | Open Access |
Licence (German): | Creative Commons - Namensnennung, Nicht kommerziell, Keine Bearbeitung |