Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers
P. Kerschke, J. Bossek, H. Trautmann, in: Proceedings of the Genetic and Evolutionary Computation Conference Companion, Association for Computing Machinery, New York, NY, USA, 2018, pp. 1737–1744.
Download
No fulltext has been uploaded.
Conference Paper
| English
Author
Kerschke, Pascal;
Bossek, JakobLibreCat 
;
Trautmann, Heike
;
Trautmann, HeikeDepartment
Abstract
Performance comparisons of optimization algorithms are heavily influenced by the underlying indicator(s). In this paper we investigate commonly used performance indicators for single-objective stochastic solvers, such as the Penalized Average Runtime (e.g., PAR10) or the Expected Running Time (ERT), based on exemplary benchmark performances of state-of-the-art inexact TSP solvers. Thereby, we introduce a methodology for analyzing the effects of (usually heuristically set) indicator parametrizations - such as the penalty factor and the method used for aggregating across multiple runs - w.r.t. the robustness of the considered optimization algorithms.
Keywords
Publishing Year
Proceedings Title
Proceedings of the Genetic and Evolutionary Computation Conference Companion
forms.conference.field.series_title_volume.label
GECCO’18
Page
1737–1744
ISBN
LibreCat-ID
Cite this
Kerschke P, Bossek J, Trautmann H. Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers. In: Proceedings of the Genetic and Evolutionary Computation Conference Companion. GECCO’18. Association for Computing Machinery; 2018:1737–1744. doi:10.1145/3205651.3208233
Kerschke, P., Bossek, J., & Trautmann, H. (2018). Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers. Proceedings of the Genetic and Evolutionary Computation Conference Companion, 1737–1744. https://doi.org/10.1145/3205651.3208233
@inproceedings{Kerschke_Bossek_Trautmann_2018, place={New York, NY, USA}, series={GECCO’18}, title={Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers}, DOI={10.1145/3205651.3208233}, booktitle={Proceedings of the Genetic and Evolutionary Computation Conference Companion}, publisher={Association for Computing Machinery}, author={Kerschke, Pascal and Bossek, Jakob and Trautmann, Heike}, year={2018}, pages={1737–1744}, collection={GECCO’18} }
Kerschke, Pascal, Jakob Bossek, and Heike Trautmann. “Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers.” In Proceedings of the Genetic and Evolutionary Computation Conference Companion, 1737–1744. GECCO’18. New York, NY, USA: Association for Computing Machinery, 2018. https://doi.org/10.1145/3205651.3208233.
P. Kerschke, J. Bossek, and H. Trautmann, “Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers,” in Proceedings of the Genetic and Evolutionary Computation Conference Companion, 2018, pp. 1737–1744, doi: 10.1145/3205651.3208233.
Kerschke, Pascal, et al. “Parameterization of State-of-the-Art Performance Indicators: A Robustness Study Based on Inexact TSP Solvers.” Proceedings of the Genetic and Evolutionary Computation Conference Companion, Association for Computing Machinery, 2018, pp. 1737–1744, doi:10.1145/3205651.3208233.
Google Scholar
ISBN Search