NVLink / NVSwitch
NVIDIA's very fast GPU-to-GPU links *inside a server*; what makes tensor parallelism viable.
NVIDIA's very fast GPU-to-GPU links inside a server; what makes tensor parallelism viable.
NVIDIA's very fast GPU-to-GPU links *inside a server*; what makes tensor parallelism viable.
NVIDIA's very fast GPU-to-GPU links inside a server; what makes tensor parallelism viable.