Expert Review

An evaluation method in which human reviewers assess the quality of AI system outputs against defined criteria such as correctness, relevance, helpfulness, safety, or fluency, providing judgments that complement or validate automated evaluation metrics.

An AI agent specialized in assessing the quality, accuracy, safety, or effectiveness of AI systems, workflows, or outputs using predefined metrics, evaluation criteria, or benchmarks.

An evaluation method that measures model output quality by comparing generated responses against ground-truth reference data or golden datasets.

A curated collection of test examples, inputs, and expected outcomes used to measure the quality, accuracy, safety, and reliability of AI models and systems.

A metric that measures whether an AI system's output is factually accurate, logically valid, and satisfies the intended task or expected result.