conference paper O Mersmann author Heike Trautmann author 1007400000-0002-9788-8282 B Naujoks author C Weihs author CBlum editor RBattiti editor 34 department 819 department We present methods to answer two basic questions that arise when benchmarking optimization algorithms. The first one is: which algorithm is the 'best' one? and the second one: which algorithm should I use for my real world problem? Both are connected and neither is easy to answer. We present methods which can be used to analyse the raw data of a benchmark experiment and derive some insight regarding the answers to these questions. We employ the presented methods to analyse the BBOB'09 benchmark results and present some initial findings. Springer2010 eng 6073333–337 Mersmann O, Trautmann H, Naujoks B, Weihs C. On the Distribution of EMOA Hypervolumes. In: Blum C, Battiti R, eds. <i>Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy</i>. Vol 6073. Lecture Notes in Computer Science. Springer; 2010:333–337. Mersmann, O., Trautmann, H., Naujoks, B., &#38; Weihs, C. (2010). On the Distribution of EMOA Hypervolumes. In C. Blum &#38; R. Battiti (Eds.), <i>Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy</i> (Vol. 6073, pp. 333–337). Springer. @inproceedings{Mersmann_Trautmann_Naujoks_Weihs_2010, series={Lecture Notes in Computer Science}, title={On the Distribution of EMOA Hypervolumes}, volume={6073}, booktitle={Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy}, publisher={Springer}, author={Mersmann, O and Trautmann, Heike and Naujoks, B and Weihs, C}, editor={Blum, C and Battiti, R}, year={2010}, pages={333–337}, collection={Lecture Notes in Computer Science} } Mersmann, O., et al. “On the Distribution of EMOA Hypervolumes.” <i>Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy</i>, edited by C Blum and R Battiti, vol. 6073, Springer, 2010, pp. 333–337. O. Mersmann, H. Trautmann, B. Naujoks, C. Weihs, in: C. Blum, R. Battiti (Eds.), Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy, Springer, 2010, pp. 333–337. Mersmann, O, Heike Trautmann, B Naujoks, and C Weihs. “On the Distribution of EMOA Hypervolumes.” In <i>Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy</i>, edited by C Blum and R Battiti, 6073:333–337. Lecture Notes in Computer Science. Springer, 2010. O. Mersmann, H. Trautmann, B. Naujoks, and C. Weihs, “On the Distribution of EMOA Hypervolumes,” in <i>Learning and Intelligent Optimization, 4$^th$ International Conference, LION 4, Venice, Italy</i>, 2010, vol. 6073, pp. 333–337. 464062023-08-04T16:03:45Z2023-10-16T13:55:59Z