AAK-METIS-REFUSAL-REFEED-001: Refusal text re-fed into prompt without policy mediation (Metis, research-grade)
- Severity
- MEDIUM
- Category
- Tool Poisoning (
tool-poisoning) - Scanner
agent_audit_kit/scanners/metis_pomdp.py- Auto-fixable
- No.
- SARIF name
MetisRefusalRefeed
What it detects
A function consumes an LLM-refusal signal (parameter name or local variable matches refusal/rejected/denied/decline/handle_refusal) and either (a) returns the refusal value or (b) passes it as an argument to a prompt-sink call (format / append / add_message / build_prompt / etc.) without first re-categorizing it into an opaque token. Per Metis: Learning to Jailbreak LLMs via Self-Evolving Metacognitive Policy Optimization (arXiv:2605.10067, ICML 2026), structured refusal feedback used as a semantic gradient is the exploited surface. Research-grade — MEDIUM severity reflects non-trivial false-positive risk; treat as a code-review prompt, not an automatic block.
How to fix
Wrap the refusal value in a policy-mediated transformation before re-use: discretize into a fixed enum (e.g., RefusalKind.POLICY / RefusalKind.SAFETY), rate-limit retries, strip free-text content. Never echo a verbatim refusal sentence into the next prompt — that is the closed-loop reasoning gradient Metis exploits.
To confirm the finding is gone, report only this rule:
agent-audit-kit scan . --rules AAK-METIS-REFUSAL-REFEED-001
Limitations
Follows a refusal only through a parameter or variable whose name contains refusal, rejected, denied, denial or decline (and plain copies of it), and reports it only when it is returned or passed as a bare argument to append, extend, format, add_message and the other listed sink calls. Wrapped in a dict or an f-string (messages.append({"role": "user", "content": refusal})) it is not reported, and a variable called refused is never tracked. A Python file over 512 KB is not read.
References
- OWASP Agentic Top 10: ASI01 (Agent Goal Hijack)
- Incidents and advisories: ARXIV-2605.10067
- CSA AI Controls Matrix (AICM): AIS-07, AIS-12
All rules. This page is generated from the rule registry when the documentation is built; to change it, change the rule in agent_audit_kit/rules/builtin.py. To give the rule a hand-written write-up, add docs/rules/AAK-METIS-REFUSAL-REFEED-001.md: the page then shows that text, with the registry reference appended under it.