LoRA:LoRA: Low-Rank Adaptation of Large Language Models
ICLR 2022 · Microsoft
冻结原权重,只训练低秩分解的增量矩阵,参数量降低上万倍,推理时可合并、零额外延迟。
arXiv:2106.09685