Win Rate

The proportion of evaluation tasks or head-to-head comparisons in which an AI model outperforms a baseline or competitor.

Explore more about Metrics

A metric that measures the proportion of correct predictions or outputs produced by a model or AI system out of all evaluated cases.

The proportion of attempted tasks or requests that an AI agent or system completes successfully.

A code-generation metric measuring the probability that at least one of k generated solutions correctly solves a given programming problem.

An evaluation method that compares two outputs directly to determine which performs better against a defined criterion or preference.

An evaluation method that uses a large language model to assess the quality, correctness, or other attributes of AI-generated outputs.

Related terms