LoRA / multi-LoRA serving

Appears in 1 tutorial

LoRA = small add-on weight patches that customize a base model.

As used in LLM Infrastructure →

LoRA = small add-on weight patches that customize a base model. Multi-LoRA serving runs many such adapters on one shared base model, saving memory vs loading full separate models.