Inference API
Also called: Prediction API, Model Inference API
An API that enables applications to send input data to a deployed AI model and receive generated predictions or outputs, providing programmatic access to inference capabilities without managing the underlying model infrastructure.
Explore more about SDKs & APIs
Related terms
Model Serving
The process of making an AI model available for inference by deploying it behind an interface that accepts requests and returns predictions or generated outputs.
Inference ServerA software service that hosts one or more AI models and processes inference requests by receiving inputs, executing model predictions, and returning outputs through APIs while managing resources, batching, scaling, and hardware acceleration.