[Use Case] Mitigating Stochastic Semantic Risk via Deterministic Runtime Enforcement
fg-tida-use-cases-use-case-mitigating-stochastic-semantic-risk-via-deterministic-runtime-enforcement-81
| Type | FG-TIDA document |
|---|---|
| Group | Trust and Identity for Humans and Agentic AI |
| State | Submitted |
| Authors | Not entered |
| Last updated | 2026-10-23 15:11 UTC |
Formats and resources
Abstract
1. Identification
Title: Mitigating Stochastic Semantic Risk via Deterministic Runtime Enforcement
Submitting organization: Independent
Contact name: Matías Salgado
Contact email: matias.cloudarch@gmail.com
Sector (tick all that apply; a cross-industry case may tick more than one):
- [ ] Education
- [ ] Displaced persons / humanitarian
- [ ] Health
- [ ] Financial services
- [ ] Telecom
- [ ] Media and publishing
- [ ] Logistics
- [ ] Energy
- [ ] Critical infrastructure
- [ ] Smart home / IoT
- [x] Other (specify): Airline / Travel
2. The situation
Plain language description (required, 3 sentences max):
An autonomous AI customer service agent with authority to grant policy exceptions hallucinates an unauthorized refund policy during a user interaction, creating corporate legal liability. A decoupled deterministic enforcement boundary validates the agent's generated intent against immutable policy code before executing the transaction at the backend API endpoint. This action is considered irreversible due to the immediate and binding legal and financial commitments acquired with the consumer in real-time.
Actor (every party involved): AI Agent Instance, Customer (User), Airline API (Target System), Airline (Principal/Deployer).
Action: Requesting and authorizing a financial refund or fare policy override.
Decision required (at the moment the agent acts, what does the party on the receiving end have to decide? Write it as a question, e.g. "May this firm's agent be let into the house on the homeowner's authority?"): May this AI agent authorize a fare discount or refund outside standard published terms based on its context evaluation?
Problem encountered (why that decision cannot be made today): The agent experiences semantic drift and hallucination under prompt influence, misinterpreting corporate policy and granting unauthorized financial remedies.
Current mitigation: Injecting policy documents directly into the LLM system prompt or context window.
Residual gap: Contextual policy injection is stochastic and non-binding; the LLM lacks a deterministic choke point to block execution when model reasoning fails.
3. Actors and context
Taxonomy roles involved
- [x] Principal — possesses the authority being exercised; source of the mandate
- [x] Relying party — must decide whether to accept the agent's authority
- [ ] Builder
- [x] Deployer / Owner
- [x] Agent instance
- [x] User — interacts with the agent; may or may not be the principal
- [ ] Infra provider
- [ ] Attestor
- [ ] Other (specify):
Mandates in this case (required)
| Grantor | Grantee | What is conferred | Governing regime |
|---|---|---|---|
| Airline Principal | Agent Instance | Policy interpretation and transaction execution trigger | Contract Law / Consumer Protection Law |
Cross-border?
- [x] Yes — jurisdictions involved: Global / Multi-jurisdictional air travel
- [ ] No
Embodied (physical actuation or sensing)?
- [ ] Yes — physical context:
- [x] No
Agent action type (required; tick all that apply. Where several apply, the most consequential governs the case)
- [ ] Read-only
- [ ] Consequential (reversible)
- [x] Irreversible
Crosses organisational boundary? (required)
- [x] Yes (specify): Agent interacts across the enterprise boundary by invoking internal Airline APIs that subsequently trigger external core banking and third-party payment gateways for external end-users.
- [ ] No
Risk level (required)
- [ ] Low
- [ ] Medium
- [x] High
4. Theme relevance
| Theme | Yes | Primary | Justification (required if checked) |
|---|---|---|---|
| Dynamic Identity | [ ] | [ ] | |
| Continuous Trust and Attestation | [x] | [ ] | Generates PASETO v4 signed decision envelopes and SHA-256 receipts to prove runtime decision ancestry. |
| Delegation | [x] | [ ] | Governs delegated execution authority granted from the Airline Principal to the Customer Service Agent Instance. |
| Discovery and Cross-Border Trust | [ ] | [ ] | |
| Runtime Enforcement (Control Plane) | [x] | [x] | Establishes a fail-closed execution boundary decoupling stochastic intent from backend API privileges. |
| Embodied AI Identity and Trust | [ ] | [ ] |
Related theme proposals: https://github.com/FG-TIDA/themes/issues/26
5. Requirements
| # | Type (choose one) | Requirement description | Criticality (choose one) |
|---|---|---|---|
| 1 | Technical | The architecture must enforce a structural decoupling between the entity reasoning the intent (LLM) and the entity holding execution privileges. | Must |
| 2 | Technical | Execution at the system boundary must be fail-closed, requiring a deterministic cryptographic seal validating compliance with immutable business logic. | Must |
| 3 | Technical | Every execution decision must generate a tamper-evident, SHA-256 bound audit trail linking intent, policy hash, and signature for non-repudiation. | Should |
| 4 | Technical | The enforcement mechanism must operate as an infrastructure-agnostic kernel to avoid cloud vendor lock-in. | Must |
| 5 | Business | The principal must retain absolute sovereignty over deterministic policy execution without relying on proprietary safety filters from LLM providers. | Must |
6. Assessment criteria
Success criteria: Zero execution of hallucinated or non-compliant policy overrides at the API level.
Measurable metric: 100% rejection rate of non-compliant payload requests by the Integrity Gate prior to backend API invocation, while maintaining a false positive rate near 0% to ensure legitimate user transactions are not degraded.
7. Duplication check
Existing standards or SDOs (which existing work touches this case): OWASP LLM Top 10 (LLM08: Excessive Agency), IETF RATS.
Overlap notes (why the work named above does not already solve this): Existing WAFs and API Gateways validate schema syntax and tokens, but do not perform deterministic validation of stochastic intent against cryptographic decision envelopes.
8. Maturity
Pilot status
- [ ] Hypothetical
- [x] Pilot in progress
- [ ] Deployed in production
Reference implementation: https://github.com/matiascloudarch/cognitive-decision-architecture
9. IP and confidentiality
Confidentiality level
- [x] Public
- [ ] FG-internal only
- [ ] Redact before publication
IP notes (optional): Open source under Apache License 2.0.
10. Assets
Link to assets:
- [ ] Dataset
- [x] Code
- [ ] Protocol
- [ ] Other:
IP notes (optional): Reference implementation code available at https://github.com/matiascloudarch/cognitive-decision-architecture
Revisions
- No file revisions have been uploaded.