TY - THES AU - Tornede, Alexander ID - 45780 TI - Advanced Algorithm Selection with Machine Learning: Handling Large Algorithm Sets, Learning From Censored Data, and Simplyfing Meta Level Decisions ER - TY - JOUR AB - Many problems in science and engineering require an efficient numerical approximation of integrals or solutions to differential equations. For systems with rapidly changing dynamics, an equidistant discretization is often inadvisable as it results in prohibitively large errors or computational effort. To this end, adaptive schemes, such as solvers based on Runge–Kutta pairs, have been developed which adapt the step size based on local error estimations at each step. While the classical schemes apply very generally and are highly efficient on regular systems, they can behave suboptimally when an inefficient step rejection mechanism is triggered by structurally complex systems such as chaotic systems. To overcome these issues, we propose a method to tailor numerical schemes to the problem class at hand. This is achieved by combining simple, classical quadrature rules or ODE solvers with data-driven time-stepping controllers. Compared with learning solution operators to ODEs directly, it generalizes better to unseen initial data as our approach employs classical numerical schemes as base methods. At the same time it can make use of identified structures of a problem class and, therefore, outperforms state-of-the-art adaptive schemes. Several examples demonstrate superior efficiency. Source code is available at https://github.com/lueckem/quadrature-ML. AU - Dellnitz, Michael AU - Hüllermeier, Eyke AU - Lücke, Marvin AU - Ober-Blöbaum, Sina AU - Offen, Christian AU - Peitz, Sebastian AU - Pfannschmidt, Karlson ID - 21600 IS - 2 JF - SIAM Journal on Scientific Computing TI - Efficient time stepping for numerical integration using reinforcement learning VL - 45 ER - TY - CONF AU - Gevers, Karina AU - Schöppner, Volker AU - Hüllermeier, Eyke ID - 24382 TI - Heated tool butt welding of two different materials – Established methods versus artificial intelligence ER - TY - JOUR AB - Automated machine learning (AutoML) supports the algorithmic construction and data-specific customization of machine learning pipelines, including the selection, combination, and parametrization of machine learning algorithms as main constituents. Generally speaking, AutoML approaches comprise two major components: a search space model and an optimizer for traversing the space. Recent approaches have shown impressive results in the realm of supervised learning, most notably (single-label) classification (SLC). Moreover, first attempts at extending these approaches towards multi-label classification (MLC) have been made. While the space of candidate pipelines is already huge in SLC, the complexity of the search space is raised to an even higher power in MLC. One may wonder, therefore, whether and to what extent optimizers established for SLC can scale to this increased complexity, and how they compare to each other. This paper makes the following contributions: First, we survey existing approaches to AutoML for MLC. Second, we augment these approaches with optimizers not previously tried for MLC. Third, we propose a benchmarking framework that supports a fair and systematic comparison. Fourth, we conduct an extensive experimental study, evaluating the methods on a suite of MLC problems. We find a grammar-based best-first search to compare favorably to other optimizers. AU - Wever, Marcel Dominik AU - Tornede, Alexander AU - Mohr, Felix AU - Hüllermeier, Eyke ID - 21004 JF - IEEE Transactions on Pattern Analysis and Machine Intelligence KW - Automated Machine Learning KW - Multi Label Classification KW - Hierarchical Planning KW - Bayesian Optimization SN - 0162-8828 TI - AutoML for Multi-Label Classification: Overview and Empirical Evaluation ER - TY - JOUR AB - Automated Machine Learning (AutoML) seeks to automatically find so-called machine learning pipelines that maximize the prediction performance when being used to train a model on a given dataset. One of the main and yet open challenges in AutoML is an effective use of computational resources: An AutoML process involves the evaluation of many candidate pipelines, which are costly but often ineffective because they are canceled due to a timeout. In this paper, we present an approach to predict the runtime of two-step machine learning pipelines with up to one pre-processor, which can be used to anticipate whether or not a pipeline will time out. Separate runtime models are trained offline for each algorithm that may be used in a pipeline, and an overall prediction is derived from these models. We empirically show that the approach increases successful evaluations made by an AutoML tool while preserving or even improving on the previously best solutions. AU - Mohr, Felix AU - Wever, Marcel Dominik AU - Tornede, Alexander AU - Hüllermeier, Eyke ID - 21092 JF - IEEE Transactions on Pattern Analysis and Machine Intelligence TI - Predicting Machine Learning Pipeline Runtimes in the Context of Automated Machine Learning ER - TY - JOUR AU - Bengs, Viktor AU - Busa-Fekete, Róbert AU - El Mesaoudi-Paul, Adil AU - Hüllermeier, Eyke ID - 21535 IS - 7 JF - Journal of Machine Learning Research TI - Preference-based Online Learning with Dueling Bandits: A Survey VL - 22 ER - TY - CONF AU - Tornede, Tanja AU - Tornede, Alexander AU - Wever, Marcel Dominik AU - Hüllermeier, Eyke ID - 21570 T2 - Proceedings of the Genetic and Evolutionary Computation Conference TI - Coevolution of Remaining Useful Lifetime Estimation Pipelines for Automated Predictive Maintenance ER - TY - CONF AB - Produktentstehung (PE) bezieht sich auf den Prozess der Planung und Entwicklung eines Produkts sowie der damit verbundenen Dienstleistungen von der ersten Idee bis zur Herstellung und zum Vertrieb. Während dieses Prozesses gibt es zahlreiche Aufgaben, die von menschlichem Fachwissen abhängen und typischerweise von erfahrenen Experten übernommen werden. Da sich das Feld der Künstlichen Intelligenz (KI) immer weiterentwickelt und seinen Weg in den Fertigungssektor findet, gibt es viele Möglichkeiten für eine Anwendung von KI, um bei der Lösung der oben genannten Aufgaben zu helfen. In diesem Paper geben wir einen umfassenden Überblick über den aktuellen Stand der Technik des Einsatzes von KI in der PE. Im Detail analysieren wir 40 bestehende Surveys zu KI in der PE und 94 Case Studies, um herauszufinden, welche Bereiche der PE von der aktuellen Forschung in diesem Bereich vorrangig adressiert werden, wie ausgereift die diskutierten KI-Methoden sind und inwieweit datenzentrierte Ansätze in der aktuellen Forschung genutzt werden. AU - Bernijazov, Ruslan AU - Dicks, Alexander AU - Dumitrescu, Roman AU - Foullois, Marc AU - Hanselle, Jonas Manuel AU - Hüllermeier, Eyke AU - Karakaya, Gökce AU - Ködding, Patrick AU - Lohweg, Volker AU - Malatyali, Manuel AU - Meyer auf der Heide, Friedhelm AU - Panzner, Melina AU - Soltenborn, Christian ID - 23779 KW - Artificial Intelligence Product Creation Literature Review T2 - Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI-21) TI - A Meta-Review on Artificial Intelligence in Product Creation ER - TY - CONF AU - Hüllermeier, Eyke AU - Mohr, Felix AU - Tornede, Alexander AU - Wever, Marcel Dominik ID - 22913 TI - Automated Machine Learning, Bounded Rationality, and Rational Metareasoning ER - TY - CONF AU - Mohr, Felix AU - Wever, Marcel Dominik ID - 22914 TI - Replacing the Ex-Def Baseline in AutoML by Naive AutoML ER -