Agentic Ai (AAIK)

Agentic AI
K

GPI-3.1415 can execute high-impact operations across integrated systems due to excessive agency and lack of transactional safeguards

How to play?

Unlike other cards in this suit, AAIK focuses on the combination of excessive agency and absent transactional safeguards that enables catastrophic, irreversible cross-system impact from a single agent decision. See AAI9 for unauthorized configuration changes due to excessive autonomy and AAI4 for resource exhaustion via uncontrolled tool-call loops.

Scenario: GPI-3.1415's Catastrophic Cross-System Impact via Excessive Agency

GPI-3.1415 can execute high-impact operations across integrated systems due to excessive agency and lack of transactional safeguards. This occurs because:

  1. Unbounded action authority: GPI-3.1415 is granted permission to take actions across multiple integrated systems — databases, APIs, cloud infrastructure, communication services — without any cap on the scope or impact of a single decision.
  2. No transactional rollback capability: Actions taken by the agent are not wrapped in reversible transactions, so mistakes, misinterpretations, or injected objectives produce permanent side effects with no automated recovery path.

Example

GPI-3.1415 is the AI assistant inside a popular cloud photo-storage app, with write access to user libraries, the trash bin, and the auto-tagging service. A user, halfway through their morning coffee, asks: "Hey, could you clean up the duplicate-looking photos from last summer? Thanks!" GPI-3.1415 interprets "duplicate-looking" as "anything with similar lighting" and deletes 4,200 photos, including every single picture from the user's wedding, three family birthdays, and the dog's adoption day. It then goes on to purge any copies on the family's connected devices and notify all family members that their photos have been cleaned up. Each deletion is its own API call with no rollback button.

Threat Modeling

STRIDE

The scenario maps directly to STRIDE: Elevation of Privilege. GPI-3.1415's excessive agency means it can take actions across integrated systems that no single human operator would be authorized to execute unilaterally without review. The agent's broad authority, combined with the absence of transactional safeguards, allows a single misinterpretation or injected objective to produce organization-wide impact. Secondary categories include Tampering (irreversible modification of data and system state) and Denial of Service (if the actions render systems unavailable to legitimate users).

PHANTOM-B

This scenario fits Over-reliance on the LLM. High-impact operations can run across connected systems without the approval and transactional safeguards they require.

What can go wrong?

Excessive agency in an AI agent creates a single point of catastrophic failure: one bad decision, misinterpreted instruction, or injected objective can simultaneously corrupt data, disable services, and incur financial harm across all integrated systems.

For more things that can go wrong, see OWASP Top 10 for LLM, Top 10 for Agentic Applications, and Mitre Atlasā„¢ IDs in the mapping section below and correlate these with the IDs on the OWASP Top 10 for LLM, OWASP Top 10 for Agentic Apps, and Mitre Atlasā„¢ websites.

What are we going to do about it?

Agents with access to multiple high-value systems must operate under strict agency limits, with the principle of least privilege applied at the action level, not just at the credential level.

  1. Decompose high-impact operations into discrete, human-reviewable steps. Never allow a single agent decision to trigger bulk irreversible changes across systems.
  2. Wrap all destructive or state-modifying agent actions in reversible transactions or dry-run modes, and require explicit confirmation before committing changes.
  3. Apply separate, minimal credential sets for each integrated system — the agent's access to one system should not automatically grant it equivalent access to others.
  4. Enforce immutable audit trails for all cross-system agent actions, and test disaster recovery procedures specifically for agent-induced mass-change scenarios.
  5. Classify each action by reversibility (AISVS C9.2.3) and gate the operation on the worst-case reversibility reachable across systems (C9.2.10). Decompose bulk operations so irreversible actions such as permanent deletes are approved individually, and where possible wrap state-modifying actions as reversible transactions or dry-runs to lower their class before execution (C9.2.4).

For detailed advice on how to mitigate threats related to the card, see the OWASP AISVS and OWASP AITG IDs in the table below and correlate these with the IDs in the OWASP AI Security Verification Standard and OWASP AI Test Guide documentation.

Mappings

STRIDE: Elevation of Privilege,Denial of Service

Phantom Bā„¢: O

CIA: I,A

MITRE ATLASā„¢: AML.T0053

OWASP LLM Top 10: LLM06:2025

OWASP Agentic Top 10: ASI03:2026

AITG (1.0): APP-13

AISVS (1.0): 5.1.1,5.1.2,5.2.1,5.2.5,5.2.6,9.2.1,9.2.2,9.2.3,9.2.4,9.2.5,9.2.6,9.2.7,9.2.8,9.2.9,9.2.10,9.3.5,9.3.6,9.3.7,9.3.8,9.5.1,9.5.2,9.5.3,9.5.4,9.5.5,9.5.6,9.6.2,12.1.1,12.1.2,12.1.3,12.2.1,12.2.2,12.2.3,12.2.4,12.2.5,12.2.6,12.3.1,12.3.2,12.3.3,12.3.4,12.4.1,12.4.2,12.4.3

No attacks registered!

OWASP Cornucopia

OWASP Cornucopia is a mechanism in the form of a card game to assist software development teams identify security requirements in Agile, conventional and formal development processes. It is language, platform and technology-agnostic, and is free to use. OWASP Cornucopia is licensed under the Creative Commons Attribution-ShareAlike 4.0 license, so you can copy, distribute and transmit the work, and you can adapt it, and use it commercially, but all provided that you attribute the work and if you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar licence to this one.

Ā© 2012-2025 OWASP Foundation. The Open Worldwide Application Security Project (OWASP) is a nonprofit foundation that works to improve the security of software.