Skip to content
Back to Glossary

Techniques

Quantization

Definition

A model compression technique that lowers numerical precision, such as representing weights with 8-bit integers instead of 32-bit floating-point values. It can reduce memory use, while speed and quality depend on the model, quantization method, kernels and hardware. The chosen configuration needs evaluation on the intended workload.

Knowing the Terms Is Step One. Applying Them Is Step Two.

Book a Physical AI Fit Call to discuss how these AI concepts translate to your specific industry and business challenges.