Admission control / rate limiting

Appears in 1 tutorial

Capping the queue and per-user load; rejecting fast under overload instead of accepting unservable work.

As used in LLM Infrastructure →

Capping the queue and per-user load; rejecting fast under overload instead of accepting unservable work.