LM Studio
A desktop application for discovering, downloading, and running large language models locally on consumer hardware.
Explore more about Model Providers
Related terms
Ollama
A tool for running and managing large language models locally, providing a simple interface for downloading, serving, and interacting with models.
llama.cppA lightweight C/C++ library for running and deploying large language models locally across a range of hardware.
Model ServingThe process of making an AI model available for inference by deploying it behind an interface that accepts requests and returns predictions or generated outputs.
On-device AIAI capabilities that run directly on local devices, reducing reliance on remote servers and enabling lower-latency, privacy-focused inference.