Single-replica capacity

Appears in 1 tutorial

The throughput one replica sustains within SLO at your length profile; the basis for sizing.

As used in LLM Infrastructure →

The throughput one replica sustains within SLO at your length profile; the basis for sizing.