Reward Modeling
The process of training a mathematical model to score AI outputs based on human or automated preferences.
Explore more about Feedback Loops
Related terms
A machine learning alignment technique that optimizes model behavior based on preferences gathered from human evaluators.
Reinforcement Learning from AI FeedbackRLAIFA fine-tuning method that optimizes model behavior using feedback generated by another AI system rather than human annotators.
Preference DataData that records preferences between AI outputs or behaviors, typically used to train or optimize models toward preferred responses.
Preference OptimizationThe process of optimizing an AI system to produce outputs that better match preferred responses, behaviors, or outcomes.
Reward FunctionA mathematical function that quantifies the feedback or score an agent receives for taking a specific action in a given state.