Distributed Training

A computing approach in which processing tasks are distributed across multiple interconnected computers that work together as a single system.

An inference approach that distributes model execution across multiple machines or accelerators to improve throughput, reduce latency, or support models that exceed the resources of a single device.

A Graphics Processing Unit (GPU) is a specialized parallel processor designed to perform large-scale mathematical computations efficiently, making it the primary hardware for training and running AI models.

A specialized hardware device designed to speed up compute-intensive workloads such as AI training and inference by efficiently executing parallel operations.

A group of interconnected computers that work together as a single system to provide scalable computing, storage, or application services.