Advanced parallel programming with MPI and OpenMP

The focus is on advanced programming with MPI and OpenMP. The course addresses participants who have already some experience with C/C++ or Fortran and MPI and OpenMP, the most popular programming models in high performance computing (HPC).

The course will teach newest methods in MPI-3.0/3.1/4.0 and OpenMP-4.5 and 5.0, which were developed for the efficient use of current HPC hardware. Topics with MPI are the group and communicator concept, process topologies, derived data types, the new MPI-3.0 Fortran language binding, one-sided communication and the new MPI-3.0 shared memory programming model within MPI. Topics with OpenMP are the OpenMP-4.0/4.5/5.0 extensions, as the vectorization directives, thread affinity and OpenMP places. (The GPU programming with OpenMP directives is not part of this course.) The course also contains performance and best practice considerations.

Hands-on sessions (in C and Fortran) will allow users to immediately test and understand the taught constructs of the Message Passing Interface (MPI) and the shared memory directives of OpenMP. Most MPI exercises will (in addition to C and Fortran) also be available for Python + mpi4py + numpy.

This course provides scientific training in Computational Science, and in addition, the scientific exchange of the participants among themselves. It is organized by JSC in cooperation with HLRS.

Slides and exercises:

A few days before the course starts, you will receive pdf files from the slides and tar/zip files for installing the exercises on your system.

Target audience:

Supercomputer users who want to optimize their programs with MPI or OpenMP and already have experience in parallel programming

Agenda

preliminary agenda

Language:

This course is given in English.

Registration

Registration possible here