PEFT

The process of further training a pretrained AI model on a task-specific or domain-specific dataset to improve its performance, behavior, or specialization for particular use cases.

An open-source Python library by Hugging Face providing pre-trained state-of-the-art transformer models.

A parameter-efficient fine-tuning method that adapts a model by training low-rank matrices while keeping the original model weights frozen.

An open-source Python library by Hugging Face for training transformer models using reinforcement learning techniques like RLHF and DPO.

An open-source Hugging Face library that simplifies distributed training and inference across CPUs, GPUs, TPUs, and multiple devices with minimal code changes.