Mpi

• The Hidden Backbone of Parallelism: How Prefix Sums Power Distributed Computation · 2025-09-21

  Discover how the humble prefix sum (scan) quietly powers GPUs, distributed clusters, and big data frameworks—an obscure but essential building block of parallel and distributed computation.

• MPI vs. OpenMP in 2025: Where Each Wins · 2025-07-04

  A practical guide to choosing between message passing and shared-memory parallelism for modern HPC and hybrid nodes.

• Parallel Programming in C with MPI and OpenMP
• Using MPI: Portable Programming with the Message Passing Interface (3rd ed.)