TY - GEN
AB - Many problems in science and engineering require the efficient numerical
approximation of integrals, a particularly important application being the
numerical solution of initial value problems for differential equations. For
complex systems, an equidistant discretization is often inadvisable, as it
either results in prohibitively large errors or computational effort. To this
end, adaptive schemes have been developed that rely on error estimators based
on Taylor series expansions. While these estimators a) rely on strong
smoothness assumptions and b) may still result in erroneous steps for complex
systems (and thus require step rejection mechanisms), we here propose a
data-driven time stepping scheme based on machine learning, and more
specifically on reinforcement learning (RL) and meta-learning. First, one or
several (in the case of non-smooth or hybrid systems) base learners are trained
using RL. Then, a meta-learner is trained which (depending on the system state)
selects the base learner that appears to be optimal for the current situation.
Several examples including both smooth and non-smooth problems demonstrate the
superior performance of our approach over state-of-the-art numerical schemes.
The code is available under https://github.com/lueckem/quadrature-ML.
AU - Dellnitz, Michael
AU - Hüllermeier, Eyke
AU - Lücke, Marvin
AU - Ober-Blöbaum, Sina
AU - Offen, Christian
AU - Peitz, Sebastian
AU - Pfannschmidt, Karlson
ID - 21600
T2 - arXiv:2104.03562
TI - Efficient time stepping for numerical integration using reinforcement learning
ER -
TY - JOUR
AB - It is a challenging task to identify the objectives on which a certain decision was based, in particular if several, potentially conflicting criteria are equally important and a continuous set of optimal compromise decisions exists. This task can be understood as the inverse problem of multiobjective optimization, where the goal is to find the objective function vector of a given Pareto set. To this end, we present a method to construct the objective function vector of an unconstrained multiobjective optimization problem (MOP) such that the Pareto critical set contains a given set of data points with prescribed KKT multipliers. If such an MOP can not be found, then the method instead produces an MOP whose Pareto critical set is at least close to the data points. The key idea is to consider the objective function vector in the multiobjective KKT conditions as variable and then search for the objectives that minimize the Euclidean norm of the resulting system of equations. By expressing the objectives in a finite-dimensional basis, we transform this problem into a homogeneous, linear system of equations that can be solved efficiently. Potential applications of this approach include the identification of objectives (both from clean and noisy data) and the construction of surrogate models for expensive MOPs.
AU - Gebken, Bennet
AU - Peitz, Sebastian
ID - 16295
JF - Journal of Global Optimization
TI - Inverse multiobjective optimization: Inferring decision criteria from data
VL - 80
ER -
TY - GEN
AB - As in almost every other branch of science, the major advances in data
science and machine learning have also resulted in significant improvements
regarding the modeling and simulation of nonlinear dynamical systems. It is
nowadays possible to make accurate medium to long-term predictions of highly
complex systems such as the weather, the dynamics within a nuclear fusion
reactor, of disease models or the stock market in a very efficient manner. In
many cases, predictive methods are advertised to ultimately be useful for
control, as the control of high-dimensional nonlinear systems is an engineering
grand challenge with huge potential in areas such as clean and efficient energy
production, or the development of advanced medical devices. However, the
question of how to use a predictive model for control is often left unanswered
due to the associated challenges, namely a significantly higher system
complexity, the requirement of much larger data sets and an increased and often
problem-specific modeling effort. To solve these issues, we present a universal
framework (which we call QuaSiModO:
Quantization-Simulation-Modeling-Optimization) to transform arbitrary
predictive models into control systems and use them for feedback control. The
advantages of our approach are a linear increase in data requirements with
respect to the control dimension, performance guarantees that rely exclusively
on the accuracy of the predictive model, and only little prior knowledge
requirements in control theory to solve complex control problems. In particular
the latter point is of key importance to enable a large number of researchers
and practitioners to exploit the ever increasing capabilities of predictive
models for control in a straight-forward and systematic fashion.
AU - Peitz, Sebastian
AU - Bieker, Katharina
ID - 21199
T2 - arXiv:2102.04722
TI - On the Universal Transformation of Data-Driven Models to Control Systems
ER -
TY - JOUR
AB - In this article, we present an efficient descent method for locally Lipschitz
continuous multiobjective optimization problems (MOPs). The method is realized
by combining a theoretical result regarding the computation of descent
directions for nonsmooth MOPs with a practical method to approximate the
subdifferentials of the objective functions. We show convergence to points
which satisfy a necessary condition for Pareto optimality. Using a set of test
problems, we compare our method to the multiobjective proximal bundle method by
M\"akel\"a. The results indicate that our method is competitive while being
easier to implement. While the number of objective function evaluations is
larger, the overall number of subgradient evaluations is lower. Finally, we
show that our method can be combined with a subdivision algorithm to compute
entire Pareto sets of nonsmooth MOPs.
AU - Gebken, Bennet
AU - Peitz, Sebastian
ID - 16867
JF - Journal of Optimization Theory and Applications
TI - An efficient descent method for locally Lipschitz multiobjective optimization problems
VL - 188
ER -
TY - JOUR
AU - Goelz, Christian
AU - Mora, Karin
AU - Stroehlein, Julia Kristin
AU - Haase, Franziska Katharina
AU - Dellnitz, Michael
AU - Reinsberger, Claus
AU - Vieluf, Solveig
ID - 21195
JF - Cognitive Neurodynamics
TI - Electrophysiological signatures of dedifferentiation differ between fit and less fit older adults
ER -
TY - JOUR
AB - Model predictive control is a prominent approach to construct a feedback
control loop for dynamical systems. Due to real-time constraints, the major
challenge in MPC is to solve model-based optimal control problems in a very
short amount of time. For linear-quadratic problems, Bemporad et al. have
proposed an explicit formulation where the underlying optimization problems are
solved a priori in an offline phase. In this article, we present an extension
of this concept in two significant ways. We consider nonlinear problems and -
more importantly - problems with multiple conflicting objective functions. In
the offline phase, we build a library of Pareto optimal solutions from which we
then obtain a valid compromise solution in the online phase according to a
decision maker's preference. Since the standard multi-parametric programming
approach is no longer valid in this situation, we instead use interpolation
between different entries of the library. To reduce the number of problems that
have to be solved in the offline phase, we exploit symmetries in the dynamical
system and the corresponding multiobjective optimal control problem. The
results are verified using two different examples from autonomous driving.
AU - Ober-Blöbaum, Sina
AU - Peitz, Sebastian
ID - 16294
IS - 2
JF - International Journal of Robust and Nonlinear Control
TI - Explicit multiobjective model predictive control for nonlinear systems with symmetries
VL - 31
ER -
TY - GEN
AU - Ridderbusch, Steffen
AU - Offen, Christian
AU - Ober-Blöbaum, Sina
AU - Goulart, Paul
ID - 21572
TI - Learning ODE Models with Qualitative Structure Using Gaussian Processes
ER -
TY - JOUR
AB - We present a flexible trust region descend algorithm for unconstrained and
convexly constrained multiobjective optimization problems. It is targeted at
heterogeneous and expensive problems, i.e., problems that have at least one
objective function that is computationally expensive. The method is
derivative-free in the sense that neither need derivative information be
available for the expensive objectives nor are gradients approximated using
repeated function evaluations as is the case in finite-difference methods.
Instead, a multiobjective trust region approach is used that works similarly to
its well-known scalar pendants. Local surrogate models constructed from
evaluation data of the true objective functions are employed to compute
possible descent directions. In contrast to existing multiobjective trust
region algorithms, these surrogates are not polynomial but carefully
constructed radial basis function networks. This has the important advantage
that the number of data points scales linearly with the parameter space
dimension. The local models qualify as fully linear and the corresponding
general scalar framework is adapted for problems with multiple objectives.
Convergence to Pareto critical points is proven and numerical examples
illustrate our findings.
AU - Berkemeier, Manuel Bastian
AU - Peitz, Sebastian
ID - 21337
IS - 2
JF - Mathematical and Computational Applications
TI - Derivative-Free Multiobjective Trust Region Descent Method Using Radial Basis Function Surrogate Models
VL - 26
ER -
TY - JOUR
AB - The reduction of high-dimensional systems to effective models on a smaller set of variables is an essential task in many areas of science. For stochastic dynamics governed by diffusion processes, a general procedure to find effective equations is the conditioning approach. In this paper, we are interested in the spectrum of the generator of the resulting effective dynamics, and how it compares to the spectrum of the full generator. We prove a new relative error bound in terms of the eigenfunction approximation error for reversible systems. We also present numerical examples indicating that, if Kramers–Moyal (KM) type approximations are used to compute the spectrum of the reduced generator, it seems largely insensitive to the time window used for the KM estimators. We analyze the implications of these observations for systems driven by underdamped Langevin dynamics, and show how meaningful effective dynamics can be defined in this setting.
AU - Nüske, Feliks
AU - Koltai, Péter
AU - Boninsegna, Lorenzo
AU - Clementi, Cecilia
ID - 21820
JF - Entropy
SN - 1099-4300
TI - Spectral Properties of Effective Dynamics from Conditional Expectations
ER -
TY - JOUR
AU - Liebendörfer, Michael
AU - Göller, Robin
AU - Biehler, Rolf
AU - Hochmuth, Reinhard
AU - Kortemeyer, Jörg
AU - Ostsieker, Laura
AU - Rode, Jana
AU - Schaper, Niclas
ID - 16961
JF - Journal für Mathematik-Didaktik
SN - 0173-5322
TI - LimSt – Ein Fragebogen zur Erhebung von Lernstrategien im mathematikhaltigen Studium
ER -
TY - JOUR
AB - The control of complex systems is of critical importance in many branches of science, engineering, and industry, many of which are governed by nonlinear partial differential equations. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy (e.g., wind, tidal, and combustion), transportation (e.g., planes, trains, and automobiles), security (e.g., tracking airborne contamination), and health (e.g., artificial hearts and artificial respiration). However, the high-dimensional, nonlinear, and multi-scale dynamics make real-time feedback control infeasible. Fortunately, these high- dimensional systems exhibit dominant, low-dimensional patterns of activity that can be exploited for effective control in the sense that knowledge of the entire state of a system is not required. Advances in machine learning have the potential to revolutionize flow control given its ability to extract principled, low-rank feature spaces characterizing such complex systems.We present a novel deep learning modelpredictive control framework that exploits low-rank features of the flow in order to achieve considerable improvements to control performance. Instead of predicting the entire fluid state, we use a recurrent neural network (RNN) to accurately predict the control relevant quantities of the system, which are then embedded into an MPC framework to construct a feedback loop. In order to lower the data requirements and to improve the prediction accuracy and thus the control performance, incoming sensor data are used to update the RNN online. The results are validated using varying fluid flow examples of increasing complexity.
AU - Bieker, Katharina
AU - Peitz, Sebastian
AU - Brunton, Steven L.
AU - Kutz, J. Nathan
AU - Dellnitz, Michael
ID - 16290
JF - Theoretical and Computational Fluid Dynamics
SN - 0935-4964
TI - Deep model predictive flow control with limited sensor data and online learning
VL - 34
ER -
TY - GEN
AB - In backward error analysis, an approximate solution to an equation is
compared to the exact solution to a nearby "modified" equation. In numerical
ordinary differential equations, the two agree up to any power of the step
size. If the differential equation has a geometric property then the modified
equation may share it. In this way, known properties of differential equations
can be applied to the approximation. But for partial differential equations,
the known modified equations are of higher order, limiting applicability of the
theory. Therefore, we study symmetric solutions of discretized partial
differential equations that arise from a discrete variational principle. These
symmetric solutions obey infinite-dimensional functional equations. We show
that these equations admit second-order modified equations which are
Hamiltonian and also possess first-order Lagrangians in modified coordinates.
The modified equation and its associated structures are computed explicitly for
the case of rotating travelling waves in the nonlinear wave equation.
AU - McLachlan, Robert I
AU - Offen, Christian
ID - 19941
T2 - arXiv:2006.14172
TI - Backward error analysis for variational discretisations of partial differential equations
ER -
TY - JOUR
AU - Kreusser, Lisa Maria
AU - McLachlan, Robert I
AU - Offen, Christian
ID - 19939
IS - 5
JF - Nonlinearity
SN - 0951-7715
TI - Detection of high codimensional bifurcations in variational PDEs
VL - 33
ER -
TY - JOUR
AB - We derive a data-driven method for the approximation of the Koopman generator called gEDMD, which can be regarded as a straightforward extension of EDMD (extended dynamic mode decomposition). This approach is applicable to deterministic and stochastic dynamical systems. It can be used for computing eigenvalues, eigenfunctions, and modes of the generator and for system identification. In addition to learning the governing equations of deterministic systems, which then reduces to SINDy (sparse identification of nonlinear dynamics), it is possible to identify the drift and diffusion terms of stochastic differential equations from data. Moreover, we apply gEDMD to derive coarse-grained models of high-dimensional systems, and also to determine efficient model predictive control strategies. We highlight relationships with other methods and demonstrate the efficacy of the proposed methods using several guiding examples and prototypical molecular dynamics problems.
AU - Klus, Stefan
AU - Nüske, Feliks
AU - Peitz, Sebastian
AU - Niemann, Jan-Hendrik
AU - Clementi, Cecilia
AU - Schütte, Christof
ID - 16288
JF - Physica D: Nonlinear Phenomena
SN - 0167-2789
TI - Data-driven approximation of the Koopman generator: Model reduction, system identification, and control
VL - 406
ER -
TY - JOUR
AB - Many dimensionality and model reduction techniques rely on estimating dominant eigenfunctions of associated dynamical operators from data. Important examples include the Koopman operator and its generator, but also the Schrödinger operator. We propose a kernel-based method for the approximation of differential operators in reproducing kernel Hilbert spaces and show how eigenfunctions can be estimated by solving auxiliary matrix eigenvalue problems. The resulting algorithms are applied to molecular dynamics and quantum chemistry examples. Furthermore, we exploit that, under certain conditions, the Schrödinger operator can be transformed into a Kolmogorov backward operator corresponding to a drift-diffusion process and vice versa. This allows us to apply methods developed for the analysis of high-dimensional stochastic differential equations to quantum mechanical systems.
AU - Klus, Stefan
AU - Nüske, Feliks
AU - Hamzi, Boumediene
ID - 21819
JF - Entropy
SN - 1099-4300
TI - Kernel-Based Approximation of the Koopman Generator and Schrödinger Operator
ER -
TY - JOUR
AB - Multi-objective optimization is an active field of research that has many applications. Owing to its success and because decision-making processes are becoming more and more complex, there is a recent trend for incorporating many objectives into such problems. The challenge with such problems, however, is that the dimensions of the solution sets—the so-called Pareto sets and fronts—grow with the number of objectives. It is thus no longer possible to compute or to approximate the entire solution set of a given problem that contains many (e.g. more than three) objectives. On the other hand, the computation of single solutions (e.g. via scalarization methods) leads to unsatisfying results in many cases, even if user preferences are incorporated. In this article, the Pareto Explorer tool is presented—a global/local exploration tool for the treatment of many-objective optimization problems (MaOPs). In the first step, a solution of the problem is computed via a global search algorithm that ideally already includes user preferences. In the second step, a local search along the Pareto set/front of the given MaOP is performed in user specified directions. For this, several continuation-like procedures are proposed that can incorporate preferences defined in decision, objective, or in weight space. The applicability and usefulness of Pareto Explorer is demonstrated on benchmark problems as well as on an application from industrial laundry design.
AU - Schütze, Oliver
AU - Cuate, Oliver
AU - Martín, Adanay
AU - Peitz, Sebastian
AU - Dellnitz, Michael
ID - 10596
IS - 5
JF - Engineering Optimization
SN - 0305-215X
TI - Pareto Explorer: a global/local exploration tool for many-objective optimization problems
VL - 52
ER -
TY - CHAP
AB - In the development of model predictive controllers for PDE-constrained problems, the use of reduced order models is essential to enable real-time applicability. Besides local linearization approaches, proper orthogonal decomposition (POD) has been most widely used in the past in order to derive such models. Due to the huge advances concerning both theory as well as the numerical approximation, a very promising alternative based on the Koopman operator has recently emerged. In this chapter, we present two control strategies for model predictive control of nonlinear PDEs using data-efficient approximations of the Koopman operator. In the first one, the dynamic control system is replaced by a small number of autonomous systems with different yet constant inputs. The control problem is consequently transformed into a switching problem. In the second approach, a bilinear surrogate model is obtained via a convex combination of these autonomous systems. Using a recent convergence result for extended dynamic mode decomposition (EDMD), convergence of the reduced objective function can be shown. We study the properties of these two strategies with respect to solution quality, data requirements, and complexity of the resulting optimization problem using the 1-dimensional Burgers equation and the 2-dimensional Navier–Stokes equations as examples. Finally, an extension for online adaptivity is presented.
AU - Peitz, Sebastian
AU - Klus, Stefan
ID - 16289
SN - 0170-8643
T2 - Lecture Notes in Control and Information Sciences
TI - Feedback Control of Nonlinear PDEs Using Data-Efficient Reduced Order Models Based on the Koopman Operator
VL - 484
ER -
TY - CHAP
AB - Diagrammatisches Schlie{\ss}en wird im Zusammenhang mit dem Lernen von Mathmematik und ihrer Symbolsprache als wesentliche Theorie der Wissenskonstruktion diskutiert. Dabei wird h{\"{a}}ufig davon ausgegangen, dass die Wissenskonstruktion im Sinne diagrammatischen Schlie{\ss}ens erfolgt. Deskriptive Rekonstruktionen diagrammatischen Schlie{\ss}ens bei Lernenden stellen jedoch ein Desiderat der mathematikdidaktischen Forschung dar. Der vorliegende Beitrag befasst sich mit der Fragestellung, wie sich diagrammatisches Schlie{\ss}en bei Lernenden rekonstruieren l{\"{a}}sst. Als m{\"{o}}gliche Werkzeuge f{\"{u}}r eine solche Rekonstruktion werden Toulmins Argumentationsschema und Vergnauds Schema-Begriff exemplarisch angewandt, um das diagrammatische Schlie{\ss}en eines Sch{\"{u}}lerpaars beim Einstieg in die Subtraktion negativer Zahlen zu rekonstruieren. Abschlie{\ss}end wird die tats{\"{a}}chliche Eignung der beiden Ans{\"{a}}tze zur Rekonstruktion diagrammatischen Schlie{\ss}ens diskutiert.
AU - Schumacher, Jan
AU - Rezat, Sebastian
ED - Kadunz, Gert
ID - 13108
T2 - Zeichen und Sprache im Mathematikunterricht
TI - Rekonstruktion diagrammatischen Schließens beim Erlernen der Subtraktion negativer Zahlen. Vergleich zweier methodischer Zugänge
ER -
TY - JOUR
AB - In this work we present a set-oriented path following method for the computation of relative global
attractors of parameter-dependent dynamical systems. We start with an initial approximation of the
relative global attractor for a fixed parameter λ0 computed by a set-oriented subdivision method.
By using previously obtained approximations of the parameter-dependent relative global attractor
we can track it with respect to a one-dimensional parameter λ > λ0 without restarting the whole
subdivision procedure. We illustrate the feasibility of the set-oriented path following method by
exploring the dynamics in low-dimensional models for shear flows during the transition to turbulence
and of large-scale atmospheric regime changes .
AU - Gerlach, Raphael
AU - Ziessler, Adrian
AU - Eckhardt, Bruno
AU - Dellnitz, Michael
ID - 16710
JF - SIAM Journal on Applied Dynamical Systems
SN - 1536-0040
TI - A Set-Oriented Path Following Method for the Approximation of Parameter Dependent Attractors
ER -
TY - JOUR
AB - In recent years, the success of the Koopman operator in dynamical systems
analysis has also fueled the development of Koopman operator-based control
frameworks. In order to preserve the relatively low data requirements for an
approximation via Dynamic Mode Decomposition, a quantization approach was
recently proposed in [Peitz & Klus, Automatica 106, 2019]. This way, control
of nonlinear dynamical systems can be realized by means of switched systems
techniques, using only a finite set of autonomous Koopman operator-based
reduced models. These individual systems can be approximated very efficiently
from data. The main idea is to transform a control system into a set of
autonomous systems for which the optimal switching sequence has to be computed.
In this article, we extend these results to continuous control inputs using
relaxation. This way, we combine the advantages of the data efficiency of
approximating a finite set of autonomous systems with continuous controls. We
show that when using the Koopman generator, this relaxation --- realized by
linear interpolation between two operators --- does not introduce any error for
control affine systems. This allows us to control high-dimensional nonlinear
systems using bilinear, low-dimensional surrogate models. The efficiency of the
proposed approach is demonstrated using several examples with increasing
complexity, from the Duffing oscillator to the chaotic fluidic pinball.
AU - Peitz, Sebastian
AU - Otto, Samuel E.
AU - Rowley, Clarence W.
ID - 16309
IS - 3
JF - SIAM Journal on Applied Dynamical Systems
TI - Data-Driven Model Predictive Control using Interpolated Koopman Generators
VL - 19
ER -