Parallel Programming
|
Instructor
Subodh Kumar <subodh@cse.*> |
With the growing number of cores on a chip, programming them efficiently has become an indispensable knowledge for the future. Modern Parallel Programming is a hands-on course involving significant parallel programming on compute-clusters, multi-core CPUs and massive-core GPUs.
Contents: Parallel performance metrics, Models of parallel computation, Parallel computer organization, Parallel programming environments, Load distribution, Throughput, Latency and Latency hiding, Memory and Data Organizations, Inter-process communication, Distributed memory architecture, Interconnection network and routing, Shared memory architecture, Memory consistency, Non-uniform memory, Parallel Algorithm techniques: Searching, Sorting, Prefix operations, Pointer Jumping, Divide-and-Conquer, Partitioning, Pipelining, Accelerated Cascading, Symmetry Breaking, Synchronization (Locked/Lock-free).
This means you must protect your code from access by others. Do not leave it where others can find it. Do not give it to someone for submission on your behalf. Do not use any fragment of code obtained online or from someone else, except what is explicitly authorised as a part of the course. When authorised, any non-original code that you do use must be clearly identified with due reference to the source. Falsifying program output or results is cheating also.
Academic honesty also means not accepting dishonesty from others.
When it doubt, please ask your professor.
Students who are caught cheating will be given a 0 and a letter grade
penalty. Second violation will result in summary failure from the course.
| Work | Points | Tentative Schedule |
|---|---|---|
| Assignment 1 | 5 | Due Sep 5, 1159p. |
| Assignment 2 | 7 | Due Sep 17, 1159p. (Extended to 23 Sep) |
| Assignment 3 | 10 | Due Oct 11, 1159p. (Extended to Oct 17) |
| Assignment 4 | 10 | Due Oct 31, 1159p. (Extended to Nov 5) |
| Assignment 5 | 8 | Due Nov 13, 1159p. |
| Quizzes | 15 | |
| Minor | 15 | |
| Major | 30 |
Late Policy: A total of seven days of late submission is allowed across the assignments. Use them when you need them. Beyond these days, you lose 0.5 marks per day of delay.
Attendance Policy: 100% participation is required. Intimation is required for any absence.
Audit Policy: At least 40% in total AND At least 30% each in exams, assignment and quizzes. 100% participation.
An Introduction to Parallel Programming by Subodh Kumar Introduction to Parallel Computing by Ananth Grama, George Karypis, Vipin Kumar, and Anshul Gupta Parallel Programming in C with MPI and OpenMP by M J Quinn Programming Massively Parallel Processors by D. Kirk and W. Hwu