Red Hat maps a prompt-injection defense beyond model guardrails
The Emerging Technologies team points agent builders toward structural instruction/data separation and privilege boundaries, while warning that no current technique is foolproof.
Prompt injection is an architecture problem, not merely a filtering problem. That is the central argument in a new Red Hat Emerging Technologies analysis that examines three research directions for reducing the risk: instruction hierarchy, structural separation of instructions from data, and containment of the damage a compromised agent can cause.
Why guardrails are not the boundary
Red Hat describes semantic input and output filters as useful safety nets but insufficient security boundaries. A filter adds another probabilistic model to the path, can itself be manipulated and creates a performance trade-off: a small model may miss attacks a larger backend model can understand, while an equally capable filter adds latency and token cost to every request.
That becomes more difficult in agentic systems, where untrusted text can arrive through email, web pages, pull requests or other tools. The post’s comparison with web application firewalls is instructive: filtering can catch known attack patterns, but it does not make an application structurally safe.
Separate authority from content
The first research family attempts to teach a model that system instructions, user instructions, data and output do not carry equal authority. Red Hat reviews instructional segment embedding and instruction-hierarchy training, but notes that their protections are learned during model training and still fail some benchmark cases.
A more structural proposal, Architectural Separation of Instructions and Data, rotates data-token embeddings so the application—not the model—marks which content is data. The model must still be fine-tuned to understand the representation, and the technique is not presented as complete protection. Its practical attraction is that the trust classification remains under application control.
Reduce what a compromised agent can do
The immediately actionable part for platform teams is containment. Red Hat highlights a three-risk rule: avoid giving the same agent untrusted inputs, sensitive-system access and the ability to change state or exfiltrate data. It also reviews type-directed privilege separation, where unprivileged agents process hostile free-form text into restricted structured types before privileged agents act on it.
That design can reduce indirect prompt-injection paths, but it costs context and must be tailored to the application. It also does not eliminate denial-of-service behavior such as wasting tokens or time.
The engineering takeaway is defense in depth with explicit trust boundaries. Agent builders should classify external content as untrusted, constrain tool permissions, keep state-changing operations away from agents that directly consume arbitrary text, and pass narrow structured data across privilege boundaries. Guardrails can remain one layer, but Red Hat’s analysis argues they should not be mistaken for the security architecture itself.
sources
- Beyond guardrails: mitigating prompt injection attacksnext.redhat.com
comments · 0