Reinforcement Learning from Human Feedback

A fine-tuning method that optimizes model behavior using feedback generated by another AI system rather than human annotators.

Data that records preferences between AI outputs or behaviors, typically used to train or optimize models toward preferred responses.

The process of optimizing an AI system to produce outputs that better match preferred responses, behaviors, or outcomes.

A preference optimization technique that directly trains a language model to prefer chosen responses over rejected ones without requiring an explicit reward model.

The process of training a mathematical model to score AI outputs based on human or automated preferences.