Definition
Techniques such as quantization, distillation, pruning, and low-rank factorisation that aim to reduce model size or computation. Compression introduces trade-offs that depend on the model, task, runtime and hardware. Validate quality, resource use and latency for the resulting configuration before treating it as suitable for deployment.
Knowing the Terms Is Step One. Applying Them Is Step Two.
Book a Physical AI Fit Call to discuss how these AI concepts translate to your specific industry and business challenges.