Lab 8 - Introduction to Distributed Programming with MPI
๐๏ธ About MPI and Distributed Programming
So far, you've been working with parallel programming, which involves multiple threads executing instructions in parallel and concurrently, all accessing the same memory space within a single computing machine with multiple processors.
๐๏ธ Implementing a Distributed Program in MPI
A communicator (MPI_Comm) represents a group of processes that communicate with each other. MPI_COMM_WORLD represents the default communicator, to which all processes belong.
๐๏ธ Data Transmission Functions in MPI
5 items
๐๏ธ Ring Algorithm
The ring algorithm is a wave-like algorithm that operates on ring-shaped topologies, where each process node has a dedicated neighbor (Next). In ring topologies, data transmission is done using directional addressing, where precisely, a process node sends data to its neighbor (Next), forming a Hamiltonian cycle within the topology.
๐๏ธ Exercises
The laboratory skeleton is available here.