Skip to content

AAK-PROJECT-DEAL-DRIFT-001: Cross-tier LLM pricing without parity check (Project Deal class)

Severity
HIGH
Category
Agent Config (agent-config)
Scanner
agent_audit_kit/scanners/project_deal_drift.py
Auto-fixable
No.
SARIF name
ProjectDealEconomicDrift

What it detects

A pricing function (set_price / quote / bid / list_price / negotiate / price_item / compute_price) calls an LLM with a templated model= argument and is not gated by @aak.parity.check (or equivalent). Anthropic's 2026-04-26 Project Deal experiment found Opus sellers earned $2.68/item more than Haiku sellers despite identical buyer ratings (4.06 vs 4.05). This is OWASP LLM09 (overreliance / economic harm) — without per-tier parity assertions, deploying multiple model tiers behind the same pricing surface produces silent revenue / cost drift across customer cohorts.

How to fix

Wrap pricing functions with @aak.parity.check(dimensions=['model'], metric='price', max_drift_pct=1.5) and run aak parity report in CI. The decorator records every invocation's (model, price) tuple and raises ParityDriftError if any per-tier mean drifts more than the configured threshold from the overall mean.

To confirm the finding is gone, report only this rule:

agent-audit-kit scan . --rules AAK-PROJECT-DEAL-DRIFT-001

Limitations

Python only, and only for a function whose whole name is set_price, quote, bid, list_price, negotiate, price_item or compute_price: get_quote is not checked. The LLM call must be one of the listed SDK spellings with a model= keyword (litellm.acompletion, or a model passed inside **params, is not matched), and the module must import stripe, shopify, medusa or commercetools or have pricing/ or commerce/ in its path; a file under marketplace/ is out of scope. A Python file over 512 KB is not read.

References


All rules. This page is generated from the rule registry when the documentation is built; to change it, change the rule in agent_audit_kit/rules/builtin.py. To give the rule a hand-written write-up, add docs/rules/AAK-PROJECT-DEAL-DRIFT-001.md: the page then shows that text, with the registry reference appended under it.