Perplexity

A metric that measures the proportion of correct predictions or outputs produced by a model or AI system out of all evaluated cases.

The total volume of prompt and completion tokens consumed during interactions with a language model.

A performance metric measuring the rate at which an inference engine generates output tokens per second.