A training technique where a smaller "student" model is trained to replicate the behaviour of a larger "teacher" model. Distillation produces compact, fast models suitable for latency-sensitive or resource-constrained deployments without sacrificing too much quality.
Book a 30-minute call to discuss how these AI concepts translate to your specific industry and business challenges.