CUDA

A Graphics Processing Unit (GPU) is a specialized parallel processor designed to perform large-scale mathematical computations efficiently, making it the primary hardware for training and running AI models.

An open-source software platform developed by AMD for GPU computing and deep learning workloads.

A specialized hardware device designed to speed up compute-intensive workloads such as AI training and inference by efficiently executing parallel operations.

A training approach that distributes model training across multiple machines or accelerators to reduce training time and enable larger models or datasets.

An inference approach that distributes model execution across multiple machines or accelerators to improve throughput, reduce latency, or support models that exceed the resources of a single device.