Deployment

Canary Deployment

Definitie

A progressive rollout strategy that routes a small percentage of production traffic to a new model version while the remainder continues to receive the old version. Canary deployments limit blast radius if the new model underperforms or causes regressions.

Gerelateerde Termen

A/B Testing (ML)

A controlled experiment that compares the performance of two or more model versions by routing live traffic between them and measuring business and technical metrics. A/B testing is essential for validating that a new model version improves outcomes before full rollout.

Shadow Mode

A deployment technique where a new model processes production traffic in parallel with the existing system but its predictions are logged rather than served to users. Shadow mode enables risk-free validation of model behaviour on real-world data before cutover.

Model Serving

The process of deploying trained ML models to production environments where they can receive inputs and return predictions at scale. Model serving infrastructure must address throughput, latency, versioning, and cost while meeting SLAs.

Hulp Nodig bij het Begrijpen van AI?

Boek een consultatie om te bespreken hoe AI-concepten op uw uitdagingen van toepassing zijn.