Prompt Caching
A technique that stores reusable prompt content so repeated requests can avoid processing the same input repeatedly, reducing latency and inference cost.
Explore more about Prompt Engineering
Related terms
A technique that links multiple prompts so the output of one prompt becomes the input to the next, enabling complex tasks through sequential steps.
Prompt TemplateA reusable prompt structure containing fixed instructions and variable placeholders for generating consistent inputs to an AI model.
Prompt OptimizationThe process of systematically improving prompts to increase the quality, consistency, efficiency, or reliability of AI model outputs.
Prompt CompressionA technique for reducing the size of a prompt while preserving the information needed for an AI model to produce the desired output.
Prompt VersioningThe practice of tracking and managing different versions of prompts to preserve changes, compare variants, and maintain reproducibility.