Parallel Programming (IN2147) (Vorlesung)
| Lecturer (assistant) | |
|---|---|
| Duration | 2 SWS |
| Term | Sommersemester 2021 |
| Language of instruction | English |
Links
This lecture will be held in English.
Time slots for SS2021
It has come to our attention that TUMOnline is not yet displaying our time slots for the upcoming semester. For your reference, here are the preliminary allocations for lecture and exercise:
| Lecture | Mondays, 10:15-11:45 (pre-recorded video upload, occasionally live with recording) |
| Exercises | Wednesdays, 08:30-10:00 (livestream with recording) |
Course Links
Lecture in TUM Online: https://campus.tum.de/tumonline/WBMODHB.wbShowMHBReadOnly?pKnotenNr=457062
Tutorials in TUM Online: https://campus.tum.de/tumonline/wbLv.wbShowLVDetail?pStpSpNr=950462048
Moodle Course: https://www.moodle.tum.de/course/view.php?id=63406 (you can self-enroll here to gain access to the course material)
Course Material
All material accessible from our moodle course. See the links above, you can self-enroll yourself to get access.
Prerequisites
Participants need to have experience with working on Linux or Linux-like systems as well as experience in programming C/C++.
Course Content
The course starts with a motivation for parallel programming and a classification of parallel architectures. It focuses first on parallelization for distributed memory architectures with MPI. It introduces the major concepts, e.g., point to point communication, collective operations, communicators, virutal topologies, non-blocking communication, single-sided communication and parallel IO. In addition, it covers the overall parallelization approach based on four phases, i.e., decomposition, assignment, orchestration and mapping. The next section presents dependence analysis as the major theoretical basis for parallelization. It introduces program transformations and discusses their profitability and safety based on data dependence analysis. The second major programming interface in the course is OpenMP for shared memory systems. This section covers most of the language concepts as well as proposed extensions. In the last part, the lecture presents novel programming interfaces, such as PGAS languages, threading building blocks, CUDA, OpenCL, and OpenACC.
For more information, please see TUMOnline.