Comparative Evaluation

An evaluation method that compares two outputs directly to determine which performs better against a defined criterion or preference.

An evaluation method that assigns an independent score to each individual model response using defined criteria, without comparing it directly to another response.

An evaluation method where evaluators assess outputs without knowing which model, system, or approach produced them to reduce bias.

An evaluation method that compares AI models on the same tasks, datasets, or metrics to identify differences in capabilities and performance.

An evaluation method in which human reviewers assess the quality of AI system outputs against defined criteria such as correctness, relevance, helpfulness, safety, or fluency, providing judgments that complement or validate automated evaluation metrics.