---
_id: '21004'
abstract:
- lang: eng
text: 'Automated machine learning (AutoML) supports the algorithmic construction
and data-specific customization of machine learning pipelines, including the selection,
combination, and parametrization of machine learning algorithms as main constituents.
Generally speaking, AutoML approaches comprise two major components: a search
space model and an optimizer for traversing the space. Recent approaches have
shown impressive results in the realm of supervised learning, most notably (single-label)
classification (SLC). Moreover, first attempts at extending these approaches towards
multi-label classification (MLC) have been made. While the space of candidate
pipelines is already huge in SLC, the complexity of the search space is raised
to an even higher power in MLC. One may wonder, therefore, whether and to what
extent optimizers established for SLC can scale to this increased complexity,
and how they compare to each other. This paper makes the following contributions:
First, we survey existing approaches to AutoML for MLC. Second, we augment these
approaches with optimizers not previously tried for MLC. Third, we propose a benchmarking
framework that supports a fair and systematic comparison. Fourth, we conduct an
extensive experimental study, evaluating the methods on a suite of MLC problems.
We find a grammar-based best-first search to compare favorably to other optimizers.'
author:
- first_name: Marcel Dominik
full_name: Wever, Marcel Dominik
id: '33176'
last_name: Wever
orcid: ' https://orcid.org/0000-0001-9782-6818'
- first_name: Alexander
full_name: Tornede, Alexander
id: '38209'
last_name: Tornede
- first_name: Felix
full_name: Mohr, Felix
last_name: Mohr
- first_name: Eyke
full_name: Hüllermeier, Eyke
id: '48129'
last_name: Hüllermeier
citation:
ama: 'Wever MD, Tornede A, Mohr F, Hüllermeier E. AutoML for Multi-Label Classification:
Overview and Empirical Evaluation. IEEE Transactions on Pattern Analysis and
Machine Intelligence. Published online 2021:1-1. doi:10.1109/tpami.2021.3051276'
apa: 'Wever, M. D., Tornede, A., Mohr, F., & Hüllermeier, E. (2021). AutoML
for Multi-Label Classification: Overview and Empirical Evaluation. IEEE Transactions
on Pattern Analysis and Machine Intelligence, 1–1. https://doi.org/10.1109/tpami.2021.3051276'
bibtex: '@article{Wever_Tornede_Mohr_Hüllermeier_2021, title={AutoML for Multi-Label
Classification: Overview and Empirical Evaluation}, DOI={10.1109/tpami.2021.3051276},
journal={IEEE Transactions on Pattern Analysis and Machine Intelligence}, author={Wever,
Marcel Dominik and Tornede, Alexander and Mohr, Felix and Hüllermeier, Eyke},
year={2021}, pages={1–1} }'
chicago: 'Wever, Marcel Dominik, Alexander Tornede, Felix Mohr, and Eyke Hüllermeier.
“AutoML for Multi-Label Classification: Overview and Empirical Evaluation.” IEEE
Transactions on Pattern Analysis and Machine Intelligence, 2021, 1–1. https://doi.org/10.1109/tpami.2021.3051276.'
ieee: 'M. D. Wever, A. Tornede, F. Mohr, and E. Hüllermeier, “AutoML for Multi-Label
Classification: Overview and Empirical Evaluation,” IEEE Transactions on Pattern
Analysis and Machine Intelligence, pp. 1–1, 2021, doi: 10.1109/tpami.2021.3051276.'
mla: 'Wever, Marcel Dominik, et al. “AutoML for Multi-Label Classification: Overview
and Empirical Evaluation.” IEEE Transactions on Pattern Analysis and Machine
Intelligence, 2021, pp. 1–1, doi:10.1109/tpami.2021.3051276.'
short: M.D. Wever, A. Tornede, F. Mohr, E. Hüllermeier, IEEE Transactions on Pattern
Analysis and Machine Intelligence (2021) 1–1.
date_created: 2021-01-16T14:48:13Z
date_updated: 2022-01-06T06:54:42Z
department:
- _id: '34'
- _id: '355'
- _id: '26'
doi: 10.1109/tpami.2021.3051276
keyword:
- Automated Machine Learning
- Multi Label Classification
- Hierarchical Planning
- Bayesian Optimization
language:
- iso: eng
page: 1-1
project:
- _id: '1'
name: SFB 901
- _id: '3'
name: SFB 901 - Project Area B
- _id: '10'
name: SFB 901 - Subproject B2
- _id: '52'
name: Computing Resources Provided by the Paderborn Center for Parallel Computing
publication: IEEE Transactions on Pattern Analysis and Machine Intelligence
publication_identifier:
issn:
- 0162-8828
- 2160-9292
- 1939-3539
publication_status: published
status: public
title: 'AutoML for Multi-Label Classification: Overview and Empirical Evaluation'
type: journal_article
user_id: '5786'
year: '2021'
...
---
_id: '3852'
abstract:
- lang: eng
text: "In automated machine learning (AutoML), the process of engineering machine
learning applications with respect to a specific problem is (partially) automated.\r\nVarious
AutoML tools have already been introduced to provide out-of-the-box machine learning
functionality.\r\nMore specifically, by selecting machine learning algorithms
and optimizing their hyperparameters, these tools produce a machine learning pipeline
tailored to the problem at hand.\r\nExcept for TPOT, all of these tools restrict
the maximum number of processing steps of such a pipeline.\r\nHowever, as TPOT
follows an evolutionary approach, it suffers from performance issues when dealing
with larger datasets.\r\nIn this paper, we present an alternative approach leveraging
a hierarchical planning to configure machine learning pipelines that are unlimited
in length.\r\nWe evaluate our approach and find its performance to be competitive
with other AutoML tools, including TPOT."
author:
- first_name: Marcel Dominik
full_name: Wever, Marcel Dominik
id: '33176'
last_name: Wever
orcid: ' https://orcid.org/0000-0001-9782-6818'
- first_name: Felix
full_name: Mohr, Felix
last_name: Mohr
- first_name: Eyke
full_name: Hüllermeier, Eyke
id: '48129'
last_name: Hüllermeier
citation:
ama: 'Wever MD, Mohr F, Hüllermeier E. ML-Plan for Unlimited-Length Machine Learning
Pipelines. In: ICML 2018 AutoML Workshop. ; 2018.'
apa: Wever, M. D., Mohr, F., & Hüllermeier, E. (2018). ML-Plan for Unlimited-Length
Machine Learning Pipelines. In ICML 2018 AutoML Workshop. Stockholm, Sweden.
bibtex: '@inproceedings{Wever_Mohr_Hüllermeier_2018, title={ML-Plan for Unlimited-Length
Machine Learning Pipelines}, booktitle={ICML 2018 AutoML Workshop}, author={Wever,
Marcel Dominik and Mohr, Felix and Hüllermeier, Eyke}, year={2018} }'
chicago: Wever, Marcel Dominik, Felix Mohr, and Eyke Hüllermeier. “ML-Plan for Unlimited-Length
Machine Learning Pipelines.” In ICML 2018 AutoML Workshop, 2018.
ieee: M. D. Wever, F. Mohr, and E. Hüllermeier, “ML-Plan for Unlimited-Length Machine
Learning Pipelines,” in ICML 2018 AutoML Workshop, Stockholm, Sweden, 2018.
mla: Wever, Marcel Dominik, et al. “ML-Plan for Unlimited-Length Machine Learning
Pipelines.” ICML 2018 AutoML Workshop, 2018.
short: 'M.D. Wever, F. Mohr, E. Hüllermeier, in: ICML 2018 AutoML Workshop, 2018.'
conference:
end_date: 2018-07-15
location: Stockholm, Sweden
name: ICML 2018 AutoML Workshop
start_date: 2018-07-10
date_created: 2018-08-09T06:14:54Z
date_updated: 2022-01-06T06:59:46Z
ddc:
- '006'
department:
- _id: '355'
file:
- access_level: open_access
content_type: application/pdf
creator: wever
date_created: 2018-08-09T06:14:43Z
date_updated: 2018-08-09T06:14:43Z
file_id: '3853'
file_name: 38.pdf
file_size: 297811
relation: main_file
file_date_updated: 2018-08-09T06:14:43Z
has_accepted_license: '1'
keyword:
- automated machine learning
- complex pipelines
- hierarchical planning
language:
- iso: eng
main_file_link:
- url: https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxhdXRvbWwyMDE4aWNtbHxneDo3M2Q3MjUzYjViNDRhZTAx
oa: '1'
project:
- _id: '1'
name: SFB 901
- _id: '3'
name: SFB 901 - Project Area B
- _id: '10'
name: SFB 901 - Subproject B2
publication: ICML 2018 AutoML Workshop
quality_controlled: '1'
status: public
title: ML-Plan for Unlimited-Length Machine Learning Pipelines
type: conference
urn: '38527'
user_id: '49109'
year: '2018'
...