Data parallelism (DP)

Appears in 1 tutorial

Running multiple full copies (replicas) of a fitting model behind a load balancer to add throughput.

As used in LLM Infrastructure →

Running multiple full copies (replicas) of a fitting model behind a load balancer to add throughput. Scales nearly linearly.