Deployment

Inference

Definition

The process of using a trained model to make predictions on new data. Inference is distinct from training and typically requires optimization for speed and cost in production environments.

Related Terms

Model Serving

The process of deploying trained ML models to production environments where they can receive inputs and return predictions. Model serving must handle scalability, latency, and reliability requirements.

Need Help Understanding AI for Your Business?

Book a consultation to discuss how AI concepts apply to your specific challenges.