---
_id: '46396'
abstract:
- lang: eng
text: The steady supply of new optimization methods makes the algorithm selection
problem (ASP) an increasingly pressing and challenging task, specially for real-world
black-box optimization problems. The introduced approach considers the ASP as
a cost-sensitive classification task which is based on Exploratory Landscape Analysis.
Low-level features gathered by systematic sampling of the function on the feasible
set are used to predict a well-performing algorithm out of a given portfolio.
Example-specific label costs are defined by the expected runtime of each candidate
algorithm. We use one-sided support vector regression to solve this learning problem.
The approach is illustrated by means of the optimization problems and algorithms
of the BBOB’09/10 workshop.
author:
- first_name: Bernd
full_name: Bischl, Bernd
last_name: Bischl
- first_name: Olaf
full_name: Mersmann, Olaf
last_name: Mersmann
- first_name: Heike
full_name: Trautmann, Heike
id: '100740'
last_name: Trautmann
orcid: 0000-0002-9788-8282
- first_name: Mike
full_name: Preuß, Mike
last_name: Preuß
citation:
ama: 'Bischl B, Mersmann O, Trautmann H, Preuß M. Algorithm Selection Based on Exploratory
Landscape Analysis and Cost-Sensitive Learning. In: Proceedings of the 14th
Annual Conference on Genetic and Evolutionary Computation. GECCO ’12. Association
for Computing Machinery; 2012:313–320. doi:10.1145/2330163.2330209'
apa: Bischl, B., Mersmann, O., Trautmann, H., & Preuß, M. (2012). Algorithm
Selection Based on Exploratory Landscape Analysis and Cost-Sensitive Learning.
Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation,
313–320. https://doi.org/10.1145/2330163.2330209
bibtex: '@inproceedings{Bischl_Mersmann_Trautmann_Preuß_2012, place={New York, NY,
USA}, series={GECCO ’12}, title={Algorithm Selection Based on Exploratory Landscape
Analysis and Cost-Sensitive Learning}, DOI={10.1145/2330163.2330209},
booktitle={Proceedings of the 14th Annual Conference on Genetic and Evolutionary
Computation}, publisher={Association for Computing Machinery}, author={Bischl,
Bernd and Mersmann, Olaf and Trautmann, Heike and Preuß, Mike}, year={2012}, pages={313–320},
collection={GECCO ’12} }'
chicago: 'Bischl, Bernd, Olaf Mersmann, Heike Trautmann, and Mike Preuß. “Algorithm
Selection Based on Exploratory Landscape Analysis and Cost-Sensitive Learning.”
In Proceedings of the 14th Annual Conference on Genetic and Evolutionary Computation,
313–320. GECCO ’12. New York, NY, USA: Association for Computing Machinery, 2012.
https://doi.org/10.1145/2330163.2330209.'
ieee: 'B. Bischl, O. Mersmann, H. Trautmann, and M. Preuß, “Algorithm Selection
Based on Exploratory Landscape Analysis and Cost-Sensitive Learning,” in Proceedings
of the 14th Annual Conference on Genetic and Evolutionary Computation, 2012,
pp. 313–320, doi: 10.1145/2330163.2330209.'
mla: Bischl, Bernd, et al. “Algorithm Selection Based on Exploratory Landscape Analysis
and Cost-Sensitive Learning.” Proceedings of the 14th Annual Conference on
Genetic and Evolutionary Computation, Association for Computing Machinery,
2012, pp. 313–320, doi:10.1145/2330163.2330209.
short: 'B. Bischl, O. Mersmann, H. Trautmann, M. Preuß, in: Proceedings of the 14th
Annual Conference on Genetic and Evolutionary Computation, Association for Computing
Machinery, New York, NY, USA, 2012, pp. 313–320.'
date_created: 2023-08-04T15:51:56Z
date_updated: 2023-10-16T13:48:48Z
department:
- _id: '34'
- _id: '819'
doi: 10.1145/2330163.2330209
keyword:
- machine learning
- exploratory landscape analysis
- fitness landscape
- benchmarking
- evolutionary optimization
- bbob test set
- algorithm selection
language:
- iso: eng
page: 313–320
place: New York, NY, USA
publication: Proceedings of the 14th Annual Conference on Genetic and Evolutionary
Computation
publication_identifier:
isbn:
- '9781450311779'
publisher: Association for Computing Machinery
series_title: GECCO ’12
status: public
title: Algorithm Selection Based on Exploratory Landscape Analysis and Cost-Sensitive
Learning
type: conference
user_id: '15504'
year: '2012'
...
---
_id: '46401'
abstract:
- lang: eng
text: Exploratory Landscape Analysis subsumes a number of techniques employed to
obtain knowledge about the properties of an unknown optimization problem, especially
insofar as these properties are important for the performance of optimization
algorithms. Where in a first attempt, one could rely on high-level features designed
by experts, we approach the problem from a different angle here, namely by using
relatively cheap low-level computer generated features. Interestingly, very few
features are needed to separate the BBOB problem groups and also for relating
a problem to high-level, expert designed features, paving the way for automatic
algorithm selection.
author:
- first_name: Olaf
full_name: Mersmann, Olaf
last_name: Mersmann
- first_name: Bernd
full_name: Bischl, Bernd
last_name: Bischl
- first_name: Heike
full_name: Trautmann, Heike
id: '100740'
last_name: Trautmann
orcid: 0000-0002-9788-8282
- first_name: Mike
full_name: Preuss, Mike
last_name: Preuss
- first_name: Claus
full_name: Weihs, Claus
last_name: Weihs
- first_name: Günter
full_name: Rudolph, Günter
last_name: Rudolph
citation:
ama: 'Mersmann O, Bischl B, Trautmann H, Preuss M, Weihs C, Rudolph G. Exploratory
Landscape Analysis. In: Proceedings of the 13th Annual Conference on Genetic
and Evolutionary Computation. GECCO ’11. Association for Computing Machinery;
2011:829–836. doi:10.1145/2001576.2001690'
apa: Mersmann, O., Bischl, B., Trautmann, H., Preuss, M., Weihs, C., & Rudolph,
G. (2011). Exploratory Landscape Analysis. Proceedings of the 13th Annual Conference
on Genetic and Evolutionary Computation, 829–836. https://doi.org/10.1145/2001576.2001690
bibtex: '@inproceedings{Mersmann_Bischl_Trautmann_Preuss_Weihs_Rudolph_2011, place={New
York, NY, USA}, series={GECCO ’11}, title={Exploratory Landscape Analysis}, DOI={10.1145/2001576.2001690}, booktitle={Proceedings
of the 13th Annual Conference on Genetic and Evolutionary Computation}, publisher={Association
for Computing Machinery}, author={Mersmann, Olaf and Bischl, Bernd and Trautmann,
Heike and Preuss, Mike and Weihs, Claus and Rudolph, Günter}, year={2011}, pages={829–836},
collection={GECCO ’11} }'
chicago: 'Mersmann, Olaf, Bernd Bischl, Heike Trautmann, Mike Preuss, Claus Weihs,
and Günter Rudolph. “Exploratory Landscape Analysis.” In Proceedings of the
13th Annual Conference on Genetic and Evolutionary Computation, 829–836. GECCO
’11. New York, NY, USA: Association for Computing Machinery, 2011. https://doi.org/10.1145/2001576.2001690.'
ieee: 'O. Mersmann, B. Bischl, H. Trautmann, M. Preuss, C. Weihs, and G. Rudolph,
“Exploratory Landscape Analysis,” in Proceedings of the 13th Annual Conference
on Genetic and Evolutionary Computation, 2011, pp. 829–836, doi: 10.1145/2001576.2001690.'
mla: Mersmann, Olaf, et al. “Exploratory Landscape Analysis.” Proceedings of
the 13th Annual Conference on Genetic and Evolutionary Computation, Association
for Computing Machinery, 2011, pp. 829–836, doi:10.1145/2001576.2001690.
short: 'O. Mersmann, B. Bischl, H. Trautmann, M. Preuss, C. Weihs, G. Rudolph, in:
Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation,
Association for Computing Machinery, New York, NY, USA, 2011, pp. 829–836.'
date_created: 2023-08-04T15:58:22Z
date_updated: 2023-10-16T13:54:34Z
department:
- _id: '34'
- _id: '819'
doi: 10.1145/2001576.2001690
keyword:
- exploratory landscape analysis
- evolutionary optimization
- fitness landscape
- benchmarking
- BBOB test set
language:
- iso: eng
page: 829–836
place: New York, NY, USA
publication: Proceedings of the 13th Annual Conference on Genetic and Evolutionary
Computation
publication_identifier:
isbn:
- '9781450305570'
publisher: Association for Computing Machinery
series_title: GECCO ’11
status: public
title: Exploratory Landscape Analysis
type: conference
user_id: '15504'
year: '2011'
...
---
_id: '46405'
abstract:
- lang: eng
text: 'We present methods to answer two basic questions that arise when benchmarking
optimization algorithms. The first one is: which algorithm is the ’best’ one?
and the second one: which algorithm should I use for my real world problem? Both
are connected and neither is easy to answer. We present methods which can be used
to analyse the raw data of a benchmark experiment and derive some insight regarding
the answers to these questions. We employ the presented methods to analyse the
BBOB’09 benchmark results and present some initial findings.'
author:
- first_name: Olaf
full_name: Mersmann, Olaf
last_name: Mersmann
- first_name: Mike
full_name: Preuss, Mike
last_name: Preuss
- first_name: Heike
full_name: Trautmann, Heike
id: '100740'
last_name: Trautmann
orcid: 0000-0002-9788-8282
citation:
ama: 'Mersmann O, Preuss M, Trautmann H. Benchmarking Evolutionary Algorithms: Towards
Exploratory Landscape Analysis. In: Proceedings of the 11th International Conference
on Parallel Problem Solving from Nature: Part I. PPSN’10. Springer-Verlag;
2010:73–82.'
apa: 'Mersmann, O., Preuss, M., & Trautmann, H. (2010). Benchmarking Evolutionary
Algorithms: Towards Exploratory Landscape Analysis. Proceedings of the 11th
International Conference on Parallel Problem Solving from Nature: Part I,
73–82.'
bibtex: '@inproceedings{Mersmann_Preuss_Trautmann_2010, place={Berlin, Heidelberg},
series={PPSN’10}, title={Benchmarking Evolutionary Algorithms: Towards Exploratory
Landscape Analysis}, booktitle={Proceedings of the 11th International Conference
on Parallel Problem Solving from Nature: Part I}, publisher={Springer-Verlag},
author={Mersmann, Olaf and Preuss, Mike and Trautmann, Heike}, year={2010}, pages={73–82},
collection={PPSN’10} }'
chicago: 'Mersmann, Olaf, Mike Preuss, and Heike Trautmann. “Benchmarking Evolutionary
Algorithms: Towards Exploratory Landscape Analysis.” In Proceedings of the
11th International Conference on Parallel Problem Solving from Nature: Part I,
73–82. PPSN’10. Berlin, Heidelberg: Springer-Verlag, 2010.'
ieee: 'O. Mersmann, M. Preuss, and H. Trautmann, “Benchmarking Evolutionary Algorithms:
Towards Exploratory Landscape Analysis,” in Proceedings of the 11th International
Conference on Parallel Problem Solving from Nature: Part I, 2010, pp. 73–82.'
mla: 'Mersmann, Olaf, et al. “Benchmarking Evolutionary Algorithms: Towards Exploratory
Landscape Analysis.” Proceedings of the 11th International Conference on Parallel
Problem Solving from Nature: Part I, Springer-Verlag, 2010, pp. 73–82.'
short: 'O. Mersmann, M. Preuss, H. Trautmann, in: Proceedings of the 11th International
Conference on Parallel Problem Solving from Nature: Part I, Springer-Verlag, Berlin,
Heidelberg, 2010, pp. 73–82.'
date_created: 2023-08-04T16:02:28Z
date_updated: 2023-10-16T13:55:43Z
department:
- _id: '34'
- _id: '819'
keyword:
- benchmarking
- multidimensional scaling
- consensus ranking
- evolutionary optimization
- BBOB test set
language:
- iso: eng
page: 73–82
place: Berlin, Heidelberg
publication: 'Proceedings of the 11th International Conference on Parallel Problem
Solving from Nature: Part I'
publication_identifier:
isbn:
- '3642158439'
publisher: Springer-Verlag
series_title: PPSN’10
status: public
title: 'Benchmarking Evolutionary Algorithms: Towards Exploratory Landscape Analysis'
type: conference
user_id: '15504'
year: '2010'
...