Definition
A family of techniques, including LoRA, prefix tuning and adapters, that adapt pre-trained models while updating a limited subset of parameters or adding trainable components. This can reduce adaptation and checkpoint-storage requirements compared with full fine-tuning. Actual memory, compute and quality depend on the method and configuration.
Knowing the Terms Is Step One. Applying Them Is Step Two.
Book a Physical AI Fit Call to discuss how these AI concepts translate to your specific industry and business challenges.