Rolling / blue-green / canary deployment
Update strategies: replace replicas gradually / run new alongside old then switch / send a small traffic slice to the new version first.
Update strategies: replace replicas gradually / run new alongside old then switch / send a small traffic slice to the new version first. Canary is vital for LLMs because new models can change output quality.