---
_id: '46405'
abstract:
- lang: eng
  text: 'We present methods to answer two basic questions that arise when benchmarking
    optimization algorithms. The first one is: which algorithm is the ’best’ one?
    and the second one: which algorithm should I use for my real world problem? Both
    are connected and neither is easy to answer. We present methods which can be used
    to analyse the raw data of a benchmark experiment and derive some insight regarding
    the answers to these questions. We employ the presented methods to analyse the
    BBOB’09 benchmark results and present some initial findings.'
author:
- first_name: Olaf
  full_name: Mersmann, Olaf
  last_name: Mersmann
- first_name: Mike
  full_name: Preuss, Mike
  last_name: Preuss
- first_name: Heike
  full_name: Trautmann, Heike
  id: '100740'
  last_name: Trautmann
  orcid: 0000-0002-9788-8282
citation:
  ama: 'Mersmann O, Preuss M, Trautmann H. Benchmarking Evolutionary Algorithms: Towards
    Exploratory Landscape Analysis. In: <i>Proceedings of the 11th International Conference
    on Parallel Problem Solving from Nature: Part I</i>. PPSN’10. Springer-Verlag;
    2010:73–82.'
  apa: 'Mersmann, O., Preuss, M., &#38; Trautmann, H. (2010). Benchmarking Evolutionary
    Algorithms: Towards Exploratory Landscape Analysis. <i>Proceedings of the 11th
    International Conference on Parallel Problem Solving from Nature: Part I</i>,
    73–82.'
  bibtex: '@inproceedings{Mersmann_Preuss_Trautmann_2010, place={Berlin, Heidelberg},
    series={PPSN’10}, title={Benchmarking Evolutionary Algorithms: Towards Exploratory
    Landscape Analysis}, booktitle={Proceedings of the 11th International Conference
    on Parallel Problem Solving from Nature: Part I}, publisher={Springer-Verlag},
    author={Mersmann, Olaf and Preuss, Mike and Trautmann, Heike}, year={2010}, pages={73–82},
    collection={PPSN’10} }'
  chicago: 'Mersmann, Olaf, Mike Preuss, and Heike Trautmann. “Benchmarking Evolutionary
    Algorithms: Towards Exploratory Landscape Analysis.” In <i>Proceedings of the
    11th International Conference on Parallel Problem Solving from Nature: Part I</i>,
    73–82. PPSN’10. Berlin, Heidelberg: Springer-Verlag, 2010.'
  ieee: 'O. Mersmann, M. Preuss, and H. Trautmann, “Benchmarking Evolutionary Algorithms:
    Towards Exploratory Landscape Analysis,” in <i>Proceedings of the 11th International
    Conference on Parallel Problem Solving from Nature: Part I</i>, 2010, pp. 73–82.'
  mla: 'Mersmann, Olaf, et al. “Benchmarking Evolutionary Algorithms: Towards Exploratory
    Landscape Analysis.” <i>Proceedings of the 11th International Conference on Parallel
    Problem Solving from Nature: Part I</i>, Springer-Verlag, 2010, pp. 73–82.'
  short: 'O. Mersmann, M. Preuss, H. Trautmann, in: Proceedings of the 11th International
    Conference on Parallel Problem Solving from Nature: Part I, Springer-Verlag, Berlin,
    Heidelberg, 2010, pp. 73–82.'
date_created: 2023-08-04T16:02:28Z
date_updated: 2023-10-16T13:55:43Z
department:
- _id: '34'
- _id: '819'
keyword:
- benchmarking
- multidimensional scaling
- consensus ranking
- evolutionary optimization
- BBOB test set
language:
- iso: eng
page: 73–82
place: Berlin, Heidelberg
publication: 'Proceedings of the 11th International Conference on Parallel Problem
  Solving from Nature: Part I'
publication_identifier:
  isbn:
  - '3642158439'
publisher: Springer-Verlag
series_title: PPSN’10
status: public
title: 'Benchmarking Evolutionary Algorithms: Towards Exploratory Landscape Analysis'
type: conference
user_id: '15504'
year: '2010'
...