智能体
arxiv.org ·
ActGov:通过策略约束验证治理 LLM 智能体行为
该论文提出 ActGov 运行时执行框架,在 LLM 智能体提议的工具动作产生外部影响前进行验证。ActGov-Policy 从工具规范、良性任务和观测到的失败轨迹迭代构建策略集,每次更新经 SMT 反例检查验证;ActGov-Runtime 将工具调用抽象为有限策略记录,仅当处于任务授权边界内且满足全部适用策略时放行,从而在长周期、动态分支工作流中维持授权。作者在 AgentDojo 和 AgentDyn 基准上跨多个模型与攻击配置评测,称其持续降低间接提示注入攻击成功率并保持任务效用,优于现有防御,且不依赖底层 LLM 正确识别恶意指令。
AI推荐理由 arXiv 新论文(v2,2026-09-21 提交),提出 ActGov 运行时执行框架:用统一语义模型描述授权、动作、运行时上下文与安全约束,ActGov-Policy 从工具规范、良性任务和失败轨迹迭代构建策略集并用 SMT 反例检查验证,ActGov-Runtime 将每次工具调用抽象为有限策略记录,仅在任务授权边界内且满足全部策略时放行。在 AgentDojo 与 AgentDyn 上跨多模型和攻击配置评测,称降低间接提示注入成功率并保持任务效用。具体新信息是逐动作运行时授权执行机制与 SMT 验证策略构建流程;局限是摘要未给出具体数值、基线对比细节和误报率,效果需查全文验证。
78
正文
Computer Science > Cryptography and Security
arXiv:2609.24446 (cs)
[Submitted on 21 Sep 2026 (v1), last revised 22 Sep 2026 (this version, v2)]
Title:ActGov: Governing LLM Agent Actions via Policy-Constrained Validation
Authors:Kaiyuan Zhang, Yuke Peng, Ke Jiang, Yinqian Zhang
View a PDF of the paper titled ActGov: Governing LLM Agent Actions via Policy-Constrained Validation, by Kaiyuan Zhang and 3 other authors
View PDF
HTML (experimental)
Abstract:Large language model (LLM) agents increasingly execute long-horizon workflows through external tools, allowing untrusted outputs to influence subsequent actions and exceed user authorization. Existing defenses isolate injected content or constrain execution with predefined plans and static policies, but these approaches are brittle under dynamic workflows and scale poorly across extensible tool ecosystems.
In this work, we present ActGov, a runtime enforcement framework that validates each LLM-proposed tool action before it causes external effects. Built on a unified semantic model of authorization, actions, runtime context, and security constraints, the ActGov-Policy component iteratively constructs a policy set from tool specifications, benign tasks, and observed failure traces, with each update verified through SMT-based counterexample checking. At runtime, ActGov-Runtime abstracts each tool call into finite policy records and permits it only if it remains within the task-scoped authorization boundary and satisfies all applicable policies. This per-action enforcement preserves authorization throughout long-horizon, dynamically branching workflows.
We evaluate ActGov on the AgentDojo and AgentDyn benchmarks across multiple models and attack configurations. It shows that ActGov consistently reduces the success rate of indirect prompt-injection attacks while preserving task utility, significantly outperforming existing defenses. These results demonstrate that ActGov can enforce fine-grained authorization over dynamic agent executions without relying on the underlying LLM to correctly identify malicious instructions.
Subjects:
Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.24446 [cs.CR]
(or
arXiv:2609.24446v2 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2609.24446
Focus to learn more
arXiv-issued DOI via DataCite
Submission history
From: Kaiyuan Zhang [view email]
[v1]
Mon, 21 Sep 2026 11:47:09 UTC (263 KB)
[v2]
Tue, 22 Sep 2026 10:20:09 UTC (264 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled ActGov: Governing LLM Agent Actions via Policy-Constrained Validation, by Kaiyuan Zhang and 3 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CR
new
|
recent
| 2026-09
Change to browse by:
cs
cs.AI
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)