Ring Topology
An arrangement of P GPUs in a logical circle where GPU i communicates with GPU i-1 (receives data) and GPU i+1 (sends data).
An arrangement of P GPUs in a logical circle where GPU i communicates with GPU i-1 (receives data) and GPU i+1 (sends data). Each device has only two neighbours. Avoids all-to-all communication, making the approach scalable.