Glossary

Latency

The time delay between an AI system receiving a request and producing a response or completing an operation.

Explore more about Metrics

Related terms

Response Time

The total duration required for an AI system or service to process an input query and return the completed output.

Time to First TokenTTFT

The duration of time it takes for a language model to produce its initial output token after receiving a request.

Latency Monitoring

The practice of tracking response latency over time to detect slowdowns, performance degradation, and service issues.

Latency Optimization

The practice of reducing response latency in AI systems to improve responsiveness, throughput, and user experience.

Signal, not noise.

Focused newsletter for builders and knowledge workers tracking how AI is changing real work. We surface what matters in practice, not every headline. Curated for practitioners, not spectators.

Subscribe to our newsletter