Shadow Testing

An experimentation method that compares two variants under similar conditions to determine which performs better against predefined metrics.

A testing approach that exposes changes to a small subset of users or traffic to validate behavior before a full rollout.

An experimentation method that tests multiple variables and their combinations simultaneously to measure their effects on an AI system or product.

An evaluation performed outside production using fixed datasets, test cases, or recorded interactions to assess an AI system before deployment.

An evaluation performed on live or production-like interactions to continuously assess an AI system's behavior, quality, safety, or performance.