Load Balancer

A dedicated infrastructure layer that manages service-to-service communication, security, and traffic routing across distributed applications.

A service that acts as a single entry point for APIs, routing requests while handling authentication, rate limiting, monitoring, and other cross-cutting concerns.

A mechanism that periodically verifies whether a service, application, model endpoint, or AI agent is operational, responsive, and able to perform its intended functions, enabling orchestration systems to detect failures and route traffic appropriately.

A network address or communication entry point where a specific service or agent capability can be accessed.