Glossary

Ollama

A tool for running and managing large language models locally, providing a simple interface for downloading, serving, and interacting with models.

Explore more about Libraries

Related terms

llama.cpp

A lightweight C/C++ library for running and deploying large language models locally across a range of hardware.

Model Serving

The process of making an AI model available for inference by deploying it behind an interface that accepts requests and returns predictions or generated outputs.

Quantization

The process of reducing the precision of a model's weights and activations to lower memory footprint and speed up inference.

Signal, not noise.

Focused newsletter for builders and knowledge workers tracking how AI is changing real work. We surface what matters in practice, not every headline. Curated for practitioners, not spectators.

Subscribe to our newsletter