Skip to content
Back to Glossary

Techniques

PEFT (Parameter-Efficient Fine-Tuning)

Definition

A family of techniques, including LoRA, prefix tuning and adapters, that adapt pre-trained models while updating a limited subset of parameters or adding trainable components. This can reduce adaptation and checkpoint-storage requirements compared with full fine-tuning. Actual memory, compute and quality depend on the method and configuration.

Knowing the Terms Is Step One. Applying Them Is Step Two.

Book a Physical AI Fit Call to discuss how these AI concepts translate to your specific industry and business challenges.