Skip to content

AAK-METIS-REFUSAL-REFEED-001: Refusal text re-fed into prompt without policy mediation (Metis, research-grade)

Severity
MEDIUM
Category
Tool Poisoning (tool-poisoning)
Scanner
agent_audit_kit/scanners/metis_pomdp.py
Auto-fixable
No.
SARIF name
MetisRefusalRefeed

What it detects

A function consumes an LLM-refusal signal (parameter name or local variable matches refusal/rejected/denied/decline/handle_refusal) and either (a) returns the refusal value or (b) passes it as an argument to a prompt-sink call (format / append / add_message / build_prompt / etc.) without first re-categorizing it into an opaque token. Per Metis: Learning to Jailbreak LLMs via Self-Evolving Metacognitive Policy Optimization (arXiv:2605.10067, ICML 2026), structured refusal feedback used as a semantic gradient is the exploited surface. Research-grade — MEDIUM severity reflects non-trivial false-positive risk; treat as a code-review prompt, not an automatic block.

How to fix

Wrap the refusal value in a policy-mediated transformation before re-use: discretize into a fixed enum (e.g., RefusalKind.POLICY / RefusalKind.SAFETY), rate-limit retries, strip free-text content. Never echo a verbatim refusal sentence into the next prompt — that is the closed-loop reasoning gradient Metis exploits.

To confirm the finding is gone, report only this rule:

agent-audit-kit scan . --rules AAK-METIS-REFUSAL-REFEED-001

Limitations

Follows a refusal only through a parameter or variable whose name contains refusal, rejected, denied, denial or decline (and plain copies of it), and reports it only when it is returned or passed as a bare argument to append, extend, format, add_message and the other listed sink calls. Wrapped in a dict or an f-string (messages.append({"role": "user", "content": refusal})) it is not reported, and a variable called refused is never tracked. A Python file over 512 KB is not read.

References


All rules. This page is generated from the rule registry when the documentation is built; to change it, change the rule in agent_audit_kit/rules/builtin.py. To give the rule a hand-written write-up, add docs/rules/AAK-METIS-REFUSAL-REFEED-001.md: the page then shows that text, with the registry reference appended under it.