Thinkycap logo
Worksheets

Introduction to Parallel Computing

Master of Science in Computer Science · University · Computer Architecture

This unit introduces the concepts and techniques of parallel computing, covering different parallel architectures and programming models. Students will gain an understanding of the challenges and benefits of parallel computing, enabling them to design and implement efficient parallel algorithms.

Coming soonPractice questions for this topic are coming soonUntil then, you can already practice other topics.Browse topics

What's included

  • Flynn's Taxonomy of Parallel Architectures
  • Shared Memory Architectures
  • Distributed Memory Architectures
  • OpenMP Programming Model
  • MPI Programming Model
  • Performance Analysis of Parallel Algorithms
  • Scalability and Load Balancing
  • Applications of Parallel Computing

Keywords

  • Parallelism
  • Shared Memory
  • Distributed Memory
  • OpenMP
  • MPI
  • Scalability
  • Performance
  • Amdahl's Law
  • Gustafson's Law