Introduction to Parallel Computing
Master of Science in Computer Science · University · Computer Architecture
This unit introduces the concepts and techniques of parallel computing, covering different parallel architectures and programming models. Students will gain an understanding of the challenges and benefits of parallel computing, enabling them to design and implement efficient parallel algorithms.
What's included
- Flynn's Taxonomy of Parallel Architectures
- Shared Memory Architectures
- Distributed Memory Architectures
- OpenMP Programming Model
- MPI Programming Model
- Performance Analysis of Parallel Algorithms
- Scalability and Load Balancing
- Applications of Parallel Computing
Keywords
- Parallelism
- Shared Memory
- Distributed Memory
- OpenMP
- MPI
- Scalability
- Performance
- Amdahl's Law
- Gustafson's Law