TRL

An open-source Python library by Hugging Face providing pre-trained state-of-the-art transformer models.

A library for parameter-efficient fine-tuning of pretrained models by updating a small subset of parameters instead of the full model.

An open-source Hugging Face library that simplifies distributed training and inference across CPUs, GPUs, TPUs, and multiple devices with minimal code changes.

An open-source machine learning framework designed for deep learning, tensor computation, and dynamic neural network construction.

A preference optimization technique that directly trains a language model to prefer chosen responses over rejected ones without requiring an explicit reward model.