The knee / operating point

Appears in 1 tutorial

The point of maximum throughput still within your latency SLO; your target operating point (≈ goodput maximum).

As used in LLM Infrastructure →

The point of maximum throughput still within your latency SLO; your target operating point (≈ goodput maximum).