Prompt Injection Detection

A guardrail that detects or blocks malicious prompt content and instruction-based attacks before they can influence an AI system.

The process of identifying prompts or interactions that attempt to bypass an AI system's safety policies, behavioral constraints, or security controls, enabling the system to block, flag, or mitigate unauthorized or unsafe requests.

The process of verifying and sanitizing user inputs or external data before they are processed by an AI system to ensure they conform to expected formats, constraints, and security policies, helping prevent errors, misuse, prompt injection, and malicious inputs.

The process of detecting, blocking, or modifying content that violates safety policies, compliance requirements, or application rules.

A mechanism designed to detect and block toxic, harmful, or policy-violating content in model inputs and outputs.