LoRA (Low-Rank Adaptation)

Definition

LoRA is a parameter-efficient adaptation method that learns only small low-rank matrices instead of updating all model weights. It enables fine-tuning with much less compute and memory.