MMMU-Pro

A multimodal benchmark for evaluating models on complex tasks spanning diverse academic disciplines and requiring both visual and textual reasoning.

A benchmark for evaluating multimodal large language models across a broad range of vision-language tasks and capabilities.

A more challenging version of MMLU designed to evaluate advanced reasoning and knowledge across diverse academic and professional subjects.

A single execution of a benchmark used to measure and record a model or system's performance under defined conditions.