Skip to content
Back to Glossary

Techniques

Knowledge Distillation

Definition

A training technique in which a student model learns from a teacher model’s outputs or representations. It can support smaller models for constrained deployments, but latency and quality must be evaluated for the intended task. Training-data rights and the teacher’s licence or service terms also affect whether the planned use is permitted.

Knowing the Terms Is Step One. Applying Them Is Step Two.

Book a Physical AI Fit Call to discuss how these AI concepts translate to your specific industry and business challenges.