Syllabus for Distributed and Parallel Computing (CSC4005)
¡@
Instructor : 钟叶«C (Yeh-Ching Chung)
Office : Research A Building Room 403 (RA-403)
Phone. 0755-23519576 (Office)
185-7673-9791 (Mobile)
WeChat Group : 2019_CSC4005
Office Hours: Monday 10:30-12:00
Wednesday 10:30 - 12:00
Goals :
1. Understand the distributed and parallel computing systems
2. Familiar with parallel and distributed languages MPI, Pthread, and OpenMP
3. Design parallel and distributed algorithms using these parallel languages
Textbooks :
1. Parallel Programming - Techniques and applications Using Networked Workstations and Parallel Computers (2nd Edition), Barry Wilkinson and Michael Allen, Prentice Hall, 2001.
References:
1. Documentation (MPI, Pthread, OpenMP).
2. Parallel Programming in C with MPI and OpenMP, Michael J. Quinn, McGraw Hill 2003.
3. Designing and Building Parallel Programs, Ian Foster, Addison Wesley, 1995.
Contents:
- Introduction to Parallel Computers (slides-0, slides-1)
- Message-Passing Computing and Programming (slides-2, MPI, tutorial)
- Multithread Programming (slides-8, Pthread)
- OpenMP Programming (Quinn-17, Quinn-18)
- Embarrassingly Parallel Computations (slides-3)
- Partitioning and Divide-and-Conquer Strategies (slides-4)
- Pipelined Computations (slides-5)
- Synchronous Computations (slides-6)
- Load Balancing and Termination Detection (slides-7)
- Sorting Algorithms (Bitonic Sort, slides-10)
¡@
Grading:
Class participation - 5%
Programs - 70%
¡V Parallel Odd-Even Transposition Sort (09/23 HW#1 (PPT), Due: 23:59 on 10/06)
¡V Mandelbrot Set Computation (10/09 HW#2 (PPT), Due: 23:59 on 10/22)
¡V N-Body Simulation (10/23 HW#3, Due: 23:59 on 11/10)
¡V Heat Distribution Simulation (11/11 HW#4, Due: 23:59 on 11/26)
Final - 25%
¡@
TAs:
Li Yingru (§õ^¾§): 218019038@link.cuhk.edu.cn
¡@
Last modified: 2019/11/25 15:20:48