Related terms
A testing method that evaluates system behavior and performance under expected levels of concurrent requests or workload.
Stress TestingAn evaluation technique that tests a system under extreme workloads or adversarial conditions to identify failure points.
LatencyThe time delay between an AI system receiving a request and producing a response or completing an operation.
ThroughputThe amount of data, tokens, or requests processed by a system within a specified period.
Response TimeThe total duration required for an AI system or service to process an input query and return the completed output.
Performance TuningThe process of improving an AI system's speed, resource efficiency, throughput, or responsiveness by adjusting its implementation and runtime configuration.