Hpc

• The Hidden Backbone of Parallelism: How Prefix Sums Power Distributed Computation · 2025-09-21

  Discover how the humble prefix sum (scan) quietly powers GPUs, distributed clusters, and big data frameworks—an obscure but essential building block of parallel and distributed computation.

• GPUDirect Storage in 2025: Optimizing the End-to-End Data Path · 2025-09-16

  How modern systems move data from NVMe and object storage into GPU kernels with minimal CPU overhead and maximal throughput.

• MPI vs. OpenMP in 2025: Where Each Wins · 2025-07-04

  A practical guide to choosing between message passing and shared-memory parallelism for modern HPC and hybrid nodes.

• Amdahl’s Law vs. Gustafson’s Law: What They Really Predict · 2024-06-15

  When does parallelism pay off? Compare Amdahl’s and Gustafson’s models, see where each applies, and learn how to reason about speedups in practice.

• Optimizing HPC Deployment: Enhancing Accessibility and Efficiency through the OMPC Framework
• Patterns for Parallel Programming