Model routing / cascading

Appears in 1 tutorial

Sending each request to the cheapest model that can handle it; escalating to a bigger model only when needed.

Sending each request to the cheapest model that can handle it; escalating to a bigger model only when needed. A major cost saver. (Mod 5)