Canary Testing

A deployment strategy that gradually releases a new application version to a small subset of users before expanding it to everyone.

An experimentation method that compares two variants under similar conditions to determine which performs better against predefined metrics.

An evaluation technique where live production traffic is duplicated to a candidate model or system without impacting the end-user response.

A preliminary execution of an experiment or pipeline designed to test functionality and validate configurations before full deployment.

The practice of keeping variables, conditions, and procedures consistent across experiments so that observed differences in outcomes can be attributed to the factors being tested.