Closed-loop vs open-loop load

Appears in 1 tutorial

Keeping exactly N requests in flight vs sending requests at an arrival rate (queuing if busy).

As used in LLM Infrastructure →

Keeping exactly N requests in flight vs sending requests at an arrival rate (queuing if busy). Both reveal different behavior.