Jailbreak Detection
Also called: Prompt Jailbreak Detection, Jailbreak Prevention
The process of identifying prompts or interactions that attempt to bypass an AI system's safety policies, behavioral constraints, or security controls, enabling the system to block, flag, or mitigate unauthorized or unsafe requests.
Explore more about Guardrails
Related terms
A security testing method that evaluates whether an AI system can be manipulated into bypassing its safety policies, behavioral constraints, or security guardrails through adversarial prompts or other attack techniques.
Prompt InjectionAn attack that inserts malicious or unintended instructions into prompts or external content to manipulate an AI system's behavior.
Input ValidationThe process of verifying and sanitizing user inputs or external data before they are processed by an AI system to ensure they conform to expected formats, constraints, and security policies, helping prevent errors, misuse, prompt injection, and malicious inputs.
Agent GuardrailsPolicies, constraints, and runtime controls that keep an AI agent operating within defined safety, security, and behavioral boundaries.
Content FilteringThe process of detecting, blocking, or modifying content that violates safety policies, compliance requirements, or application rules.