NVLink

NVIDIA's high-speed GPU interconnect (576 GB/s per link). Available within a single machine. Provides fast enough communication for Ring Attention to work well. Models without NVLink (consumer GPUs) are much slower.