Parallelism

• The Hidden Backbone of Parallelism: How Prefix Sums Power Distributed Computation · 2025-09-21

  Discover how the humble prefix sum (scan) quietly powers GPUs, distributed clusters, and big data frameworks—an obscure but essential building block of parallel and distributed computation.

• Amdahl’s Law vs. Gustafson’s Law: What They Really Predict · 2024-06-15

  When does parallelism pay off? Compare Amdahl’s and Gustafson’s models, see where each applies, and learn how to reason about speedups in practice.