Capacity planning

Appears in 1 tutorial

Estimating how many replicas/GPUs a workload needs: peak demand ÷ single-replica capacity × safety factor.

As used in LLM Infrastructure →

Estimating how many replicas/GPUs a workload needs: peak demand ÷ single-replica capacity × safety factor.