Distributed Computing

A group of interconnected computers that work together as a single system to provide scalable computing, storage, or application services.

A training approach that distributes model training across multiple machines or accelerators to reduce training time and enable larger models or datasets.

An inference approach that distributes model execution across multiple machines or accelerators to improve throughput, reduce latency, or support models that exceed the resources of a single device.

The practice of distributing workloads or requests across multiple computing resources to improve scalability, availability, and resource utilization.

A virtual or physical compute resource that provides CPU, memory, storage, and networking for running applications and workloads.