Term tag: LoRA

Low-Rank Adaptation (LoRA)

LoRA freezes a model's weights and trains two thin matrices beside each one: 98,304 numbers instead of 151 million, and no added inference latency.

Pre-trained Models

A neural network someone else already trained on a huge general dataset, which you download and adapt to your task instead of training from scratch.