TY - GEN
AB - We push the boundaries of electronic structure-based ab-initio
molecular dynamics (AIMD) beyond 100 million atoms. This scale is otherwise
barely reachable with classical force-field methods or novel neural network and
machine learning potentials. We achieve this breakthrough by combining
innovations in linear-scaling AIMD, efficient and approximate sparse linear
algebra, low and mixed-precision floating-point computation on GPUs, and a
compensation scheme for the errors introduced by numerical approximations.
The core of our work is the non-orthogonalized local submatrix (NOLSM)
method, which scales very favorably to massively parallel computing systems and
translates large sparse matrix operations into highly parallel, dense matrix
operations that are ideally suited to hardware accelerators. We demonstrate
that the NOLSM method, which is at the center point of each AIMD step, is able
to achieve a sustained performance of 324 PFLOP/s in mixed FP16/FP32 precision
corresponding to an efficiency of 67.7% when running on 1536 NVIDIA A100 GPUs.
AU - Schade, Robert
AU - Kenter, Tobias
AU - Elgabarty, Hossam
AU - Lass, Michael
AU - Schütt, Ole
AU - Lazzaro, Alfio
AU - Pabst, Hans
AU - Mohr, Stephan
AU - Hutter, Jürg
AU - Kühne, Thomas
AU - Plessl, Christian
ID - 21732
TI - Enabling Electronic Structure-Based Ab-Initio Molecular Dynamics Simulations with Hundreds of Millions of Atoms
ER -
TY - CONF
AU - Nickchen, Tobias
AU - Heindorf, Stefan
AU - Engels, Gregor
ID - 20886
T2 - Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision
TI - Generating Physically Sound Training Data for Image Recognition of Additively Manufactured Parts
ER -
TY - CHAP
AB - Solving partial differential equations on unstructured grids is a cornerstone of engineering and scientific computing. Nowadays, heterogeneous parallel platforms with CPUs, GPUs, and FPGAs enable energy-efficient and computationally demanding simulations. We developed the HighPerMeshes C++-embedded Domain-Specific Language (DSL) for bridging the abstraction gap between the mathematical and algorithmic formulation of mesh-based algorithms for PDE problems on the one hand and an increasing number of heterogeneous platforms with their different parallel programming and runtime models on the other hand. Thus, the HighPerMeshes DSL aims at higher productivity in the code development process for multiple target platforms. We introduce the concepts as well as the basic structure of the HighPerMeshes DSL, and demonstrate its usage with three examples, a Poisson and monodomain problem, respectively, solved by the continuous finite element method, and the discontinuous Galerkin method for Maxwell’s equation. The mapping of the abstract algorithmic description onto parallel hardware, including distributed memory compute clusters, is presented. Finally, the achievable performance and scalability are demonstrated for a typical example problem on a multi-core CPU cluster.
AU - Alhaddad, Samer
AU - Förstner, Jens
AU - Groth, Stefan
AU - Grünewald, Daniel
AU - Grynko, Yevgen
AU - Hannig, Frank
AU - Kenter, Tobias
AU - Pfreundt, Franz-Josef
AU - Plessl, Christian
AU - Schotte, Merlind
AU - Steinke, Thomas
AU - Teich, Jürgen
AU - Weiser, Martin
AU - Wende, Florian
ID - 21587
KW - tet_topic_hpc
SN - 0302-9743
T2 - Euro-Par 2020: Parallel Processing Workshops
TI - HighPerMeshes – A Domain-Specific Language for Numerical Algorithms on Unstructured Grids
ER -
TY - JOUR
AU - Alhaddad, Samer
AU - Förstner, Jens
AU - Groth, Stefan
AU - Grünewald, Daniel
AU - Grynko, Yevgen
AU - Hannig, Frank
AU - Kenter, Tobias
AU - Pfreundt, Franz‐Josef
AU - Plessl, Christian
AU - Schotte, Merlind
AU - Steinke, Thomas
AU - Teich, Jürgen
AU - Weiser, Martin
AU - Wende, Florian
ID - 24788
JF - Concurrency and Computation: Practice and Experience
KW - tet_topic_hpc
SN - 1532-0626
TI - The HighPerMeshes framework for numerical algorithms on unstructured grids
ER -
TY - CHAP
AU - Nickchen, Tobias
AU - Engels, Gregor
AU - Lohn, Johannes
ID - 18789
SN - 9783030543334
T2 - Industrializing Additive Manufacturing
TI - Opportunities of 3D Machine Learning for Manufacturability Analysis and Component Recognition in the Additive Manufacturing Process Chain
ER -
TY - JOUR
AB - CP2K is an open source electronic structure and molecular dynamics software package to perform atomistic simulations of solid-state, liquid, molecular, and biological systems. It is especially aimed at massively parallel and linear-scaling electronic structure methods and state-of-theart ab initio molecular dynamics simulations. Excellent performance for electronic structure calculations is achieved using novel algorithms implemented for modern high-performance computing systems. This review revisits the main capabilities of CP2K to perform efficient and accurate electronic structure simulations. The emphasis is put on density functional theory and multiple post–Hartree–Fock methods using the Gaussian and plane wave approach and its augmented all-electron extension.
AU - Kühne, Thomas
AU - Iannuzzi, Marcella
AU - Ben, Mauro Del
AU - Rybkin, Vladimir V.
AU - Seewald, Patrick
AU - Stein, Frederick
AU - Laino, Teodoro
AU - Khaliullin, Rustam Z.
AU - Schütt, Ole
AU - Schiffmann, Florian
AU - Golze, Dorothea
AU - Wilhelm, Jan
AU - Chulkov, Sergey
AU - Mohammad Hossein Bani-Hashemian, Mohammad Hossein Bani-Hashemian
AU - Weber, Valéry
AU - Borstnik, Urban
AU - Taillefumier, Mathieu
AU - Jakobovits, Alice Shoshana
AU - Lazzaro, Alfio
AU - Pabst, Hans
AU - Müller, Tiziano
AU - Schade, Robert
AU - Guidon, Manuel
AU - Andermatt, Samuel
AU - Holmberg, Nico
AU - Schenter, Gregory K.
AU - Hehn, Anna
AU - Bussy, Augustin
AU - Belleflamme, Fabian
AU - Tabacchi, Gloria
AU - Glöß, Andreas
AU - Lass, Michael
AU - Bethune, Iain
AU - Mundy, Christopher J.
AU - Plessl, Christian
AU - Watkins, Matt
AU - VandeVondele, Joost
AU - Krack, Matthias
AU - Hutter, Jürg
ID - 16277
IS - 19
JF - The Journal of Chemical Physics
TI - CP2K: An electronic structure and molecular dynamics software package - Quickstep: Efficient and accurate electronic structure calculations
VL - 152
ER -
TY - CONF
AB - FPGAs have found increasing adoption in data center applications since a new generation of high-level tools have become available which noticeably reduce development time for FPGA accelerators and still provide high-quality results. There is, however, no high-level benchmark suite available, which specifically enables a comparison of FPGA architectures, programming tools, and libraries for HPC applications. To fill this gap, we have developed an OpenCL-based open-source implementation of the HPCC benchmark suite for Xilinx and Intel FPGAs. This benchmark can serve to analyze the current capabilities of FPGA devices, cards, and development tool flows, track progress over time, and point out specific difficulties for FPGA acceleration in the HPC domain. Additionally, the benchmark documents proven performance optimization patterns. We will continue optimizing and porting the benchmark for new generations of FPGAs and design tools and encourage active participation to create a valuable tool for the community. To fill this gap, we have developed an OpenCL-based open-source implementation of the HPCC benchmark suite for Xilinx and Intel FPGAs. This benchmark can serve to analyze the current capabilities of FPGA devices, cards, and development tool flows, track progress over time, and point out specific difficulties for FPGA acceleration in the HPC domain. Additionally, the benchmark documents proven performance optimization patterns. We will continue optimizing and porting the benchmark for new generations of FPGAs and design tools and encourage active participation to create a valuable tool for the community.
AU - Meyer, Marius
AU - Kenter, Tobias
AU - Plessl, Christian
ID - 21632
KW - FPGA
KW - OpenCL
KW - High Level Synthesis
KW - HPC benchmarking
SN - 9781665415927
T2 - 2020 IEEE/ACM International Workshop on Heterogeneous High-performance Reconfigurable Computing (H2RC)
TI - Evaluating FPGA Accelerator Performance with a Parameterized OpenCL Adaptation of Selected Benchmarks of the HPCChallenge Benchmark Suite
ER -
TY - CONF
AB - Electronic structure calculations based on density-functional theory (DFT)
represent a significant part of today's HPC workloads and pose high demands on
high-performance computing resources. To perform these quantum-mechanical DFT
calculations on complex large-scale systems, so-called linear scaling methods
instead of conventional cubic scaling methods are required. In this work, we
take up the idea of the submatrix method and apply it to the DFT computations
in the software package CP2K. For that purpose, we transform the underlying
numeric operations on distributed, large, sparse matrices into computations on
local, much smaller and nearly dense matrices. This allows us to exploit the
full floating-point performance of modern CPUs and to make use of dedicated
accelerator hardware, where performance has been limited by memory bandwidth
before. We demonstrate both functionality and performance of our implementation
and show how it can be accelerated with GPUs and FPGAs.
AU - Lass, Michael
AU - Schade, Robert
AU - Kühne, Thomas
AU - Plessl, Christian
ID - 16898
T2 - Proc. International Conference for High Performance Computing, Networking, Storage and Analysis (SC)
TI - A Submatrix-Based Method for Approximate Matrix Function Evaluation in the Quantum Chemistry Code CP2K
ER -
TY - JOUR
AB - In scientific computing, the acceleration of atomistic computer simulations by means of custom hardware is finding ever-growing application. A major limitation, however, is that the high efficiency in terms of performance and low power consumption entails the massive usage of low precision computing units. Here, based on the approximate computing paradigm, we present an algorithmic method to compensate for numerical inaccuracies due to low accuracy arithmetic operations rigorously, yet still obtaining exact expectation values using a properly modified Langevin-type equation.
AU - Rengaraj, Varadarajan
AU - Lass, Michael
AU - Plessl, Christian
AU - Kühne, Thomas
ID - 12878
IS - 2
JF - Computation
TI - Accurate Sampling with Noisy Forces from Approximate Computing
VL - 8
ER -
TY - CONF
AU - Groth, Stefan
AU - Grünewald, Daniel
AU - Teich, Jürgen
AU - Hannig, Frank
ID - 16852
T2 - Proceedings of the 17th ACM International Conference on Computing Frontiers (CF '2020)
TI - A Runtime System for Finite Element Methods in a Partitioned Global Address Space
ER -
TY - JOUR
AU - Platzner, Marco
AU - Plessl, Christian
ID - 12871
JF - Informatik Spektrum
SN - 0170-6012
TI - FPGAs im Rechenzentrum
ER -
TY - JOUR
AU - Riebler, Heinrich
AU - Vaz, Gavin Francis
AU - Kenter, Tobias
AU - Plessl, Christian
ID - 7689
IS - 2
JF - ACM Trans. Archit. Code Optim. (TACO)
KW - htrop
TI - Transparent Acceleration for Heterogeneous Platforms with Compilation to OpenCL
VL - 16
ER -
TY - CONF
AB - Stratix 10 FPGA cards have a good potential for the acceleration of HPC workloads since the Stratix 10 product line introduces devices with a large number of DSP and memory blocks. The high level synthesis of OpenCL codes can play a fundamental role for FPGAs in HPC, because it allows to implement different designs with lower development effort compared to hand optimized HDL. However, Stratix 10 cards are still hard to fully exploit using the Intel FPGA SDK for OpenCL. The implementation of designs with thousands of concurrent arithmetic operations often suffers from place and route problems that limit the maximum frequency or entirely prevent a successful synthesis. In order to overcome these issues for the implementation of the matrix multiplication, we formulate Cannon's matrix multiplication algorithm with regard to its efficient synthesis within the FPGA logic. We obtain a two-level block algorithm, where the lower level sub-matrices are multiplied using our Cannon's algorithm implementation. Following this design approach with multiple compute units, we are able to get maximum frequencies close to and above 300 MHz with high utilization of DSP and memory blocks. This allows for performance results above 1 TeraFLOPS.
AU - Gorlani, Paolo
AU - Kenter, Tobias
AU - Plessl, Christian
ID - 15478
T2 - Proceedings of the International Conference on Field-Programmable Technology (FPT)
TI - OpenCL Implementation of Cannon's Matrix Multiplication Algorithm on Intel Stratix 10 FPGAs
ER -
TY - JOUR
AB - We address the general mathematical problem of computing the inverse p-th
root of a given matrix in an efficient way. A new method to construct iteration
functions that allow calculating arbitrary p-th roots and their inverses of
symmetric positive definite matrices is presented. We show that the order of
convergence is at least quadratic and that adaptively adjusting a parameter q
always leads to an even faster convergence. In this way, a better performance
than with previously known iteration schemes is achieved. The efficiency of the
iterative functions is demonstrated for various matrices with different
densities, condition numbers and spectral radii.
AU - Richters, Dorothee
AU - Lass, Michael
AU - Walther, Andrea
AU - Plessl, Christian
AU - Kühne, Thomas
ID - 21
IS - 2
JF - Communications in Computational Physics
TI - A General Algorithm to Calculate the Inverse Principal p-th Root of Symmetric Positive Definite Matrices
VL - 25
ER -
TY - JOUR
AU - Mertens, Jan Cedric
AU - Boschmann, Alexander
AU - Schmidt, M.
AU - Plessl, Christian
ID - 6516
IS - 4
JF - Sports Engineering
SN - 1369-7072
TI - Sprint diagnostic with GPS and inertial sensor fusion
VL - 21
ER -
TY - JOUR
AB - Approximate computing has shown to provide new ways to improve performance
and power consumption of error-resilient applications. While many of these
applications can be found in image processing, data classification or machine
learning, we demonstrate its suitability to a problem from scientific
computing. Utilizing the self-correcting behavior of iterative algorithms, we
show that approximate computing can be applied to the calculation of inverse
matrix p-th roots which are required in many applications in scientific
computing. Results show great opportunities to reduce the computational effort
and bandwidth required for the execution of the discussed algorithm, especially
when targeting special accelerator hardware.
AU - Lass, Michael
AU - Kühne, Thomas
AU - Plessl, Christian
ID - 20
IS - 2
JF - Embedded Systems Letters
SN - 1943-0663
TI - Using Approximate Computing for the Calculation of Inverse Matrix p-th Roots
VL - 10
ER -
TY - CONF
AU - Riebler, Heinrich
AU - Vaz, Gavin Francis
AU - Kenter, Tobias
AU - Plessl, Christian
ID - 1204
KW - htrop
SN - 9781450349826
T2 - Proc. ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP)
TI - Automated Code Acceleration Targeting Heterogeneous OpenCL Devices
ER -
TY - CONF
AB - The exploration of FPGAs as accelerators for scientific simulations has so far mostly been focused on small kernels of methods working on regular data structures, for example in the form of stencil computations for finite difference methods. In computational sciences, often more advanced methods are employed that promise better stability, convergence, locality and scaling. Unstructured meshes are shown to be more effective and more accurate, compared to regular grids, in representing computation domains of various shapes. Using unstructured meshes, the discontinuous Galerkin method preserves the ability to perform explicit local update operations for simulations in the time domain. In this work, we investigate FPGAs as target platform for an implementation of the nodal discontinuous Galerkin method to find time-domain solutions of Maxwell's equations in an unstructured mesh. When maximizing data reuse and fitting constant coefficients into suitably partitioned on-chip memory, high computational intensity allows us to implement and feed wide data paths with hundreds of floating point operators. By decoupling off-chip memory accesses from the computations, high memory bandwidth can be sustained, even for the irregular access pattern required by parts of the application. Using the Intel/Altera OpenCL SDK for FPGAs, we present different implementation variants for different polynomial orders of the method. In different phases of the algorithm, either computational or bandwidth limits of the Arria 10 platform are almost reached, thus outperforming a highly multithreaded CPU implementation by around 2x.
AU - Kenter, Tobias
AU - Mahale, Gopinath
AU - Alhaddad, Samer
AU - Grynko, Yevgen
AU - Schmitt, Christian
AU - Afzal, Ayesha
AU - Hannig, Frank
AU - Förstner, Jens
AU - Plessl, Christian
ID - 1588
KW - tet_topic_hpc
T2 - Proc. Int. Symp. on Field-Programmable Custom Computing Machines (FCCM)
TI - OpenCL-based FPGA Design to Accelerate the Nodal Discontinuous Galerkin Method for Unstructured Meshes
ER -
TY - CONF
AB - We present the submatrix method, a highly parallelizable method for the approximate calculation of inverse p-th roots of large sparse symmetric matrices which are required in different scientific applications. Following the idea of Approximate Computing, we allow imprecision in the final result in order to utilize the sparsity of the input matrix and to allow massively parallel execution. For an n x n matrix, the proposed algorithm allows to distribute the calculations over n nodes with only little communication overhead. The result matrix exhibits the same sparsity pattern as the input matrix, allowing for efficient reuse of allocated data structures.
We evaluate the algorithm with respect to the error that it introduces into calculated results, as well as its performance and scalability. We demonstrate that the error is relatively limited for well-conditioned matrices and that results are still valuable for error-resilient applications like preconditioning even for ill-conditioned matrices. We discuss the execution time and scaling of the algorithm on a theoretical level and present a distributed implementation of the algorithm using MPI and OpenMP. We demonstrate the scalability of this implementation by running it on a high-performance compute cluster comprised of 1024 CPU cores, showing a speedup of 665x compared to single-threaded execution.
AU - Lass, Michael
AU - Mohr, Stephan
AU - Wiebeler, Hendrik
AU - Kühne, Thomas
AU - Plessl, Christian
ID - 1590
KW - approximate computing
KW - linear algebra
KW - matrix inversion
KW - matrix p-th roots
KW - numeric algorithm
KW - parallel computing
SN - 978-1-4503-5891-0/18/07
T2 - Proc. Platform for Advanced Scientific Computing (PASC) Conference
TI - A Massively Parallel Algorithm for the Approximate Calculation of Inverse p-th Roots of Large Sparse Matrices
ER -
TY - CONF
AB - This paper describes a data structure and a heuristic to plan and map arbitrary resources in complex combinations while applying time dependent constraints. The approach is used in the planning based workload manager OpenCCS at the Paderborn Center for Parallel Computing (PC\(^2\)) to operate heterogeneous clusters with up to 10000 cores. We also show performance results derived from four years of operation.
AU - Keller, Axel
ED - Klusáček, D.
ED - Cirne, W.
ED - Desai, N.
ID - 22
KW - Scheduling Planning Mapping Workload management
SN - 978-3-319-77398-8
T2 - Proc. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP)
TI - A Data Structure for Planning Based Workload Management of Heterogeneous HPC Systems
VL - 10773
ER -