Accelerate

An open-source Python library by Hugging Face providing pre-trained state-of-the-art transformer models.

An open-source machine learning framework designed for deep learning, tensor computation, and dynamic neural network construction.

A library for parameter-efficient fine-tuning of pretrained models by updating a small subset of parameters instead of the full model.

An open-source Python library by Hugging Face for training transformer models using reinforcement learning techniques like RLHF and DPO.

A training approach that distributes model training across multiple machines or accelerators to reduce training time and enable larger models or datasets.