最新资讯
dev.to 在信任 AI 生成的测试用例前,如何逐条复核 unite.ai Franklin Templeton 构建 AI 研究工作流以揭示风险 techxplore.com AI 助力寻找更优的钛合金 3D 打印工艺参数 engadget.com Perplexity 推出“teammates”日常工作任务 AI agent computerworld.com 别提数据中心:OpenAI 改称“compute campuses” theguardian.com 俄美试图阻止就自主武器制定具有约束力的规则 bloomberg.com Nvidia 加强东南亚芯片追踪以打击走私 thestack.technology 模型路由需求升温,Agent Router 推出开源替代方案 www.youtube.com Google DeepMind 的 Philipp Schmid:AI 同事需要具备的七个要素 unite.ai Cashfree 为 AI Agent 的托管结账加入 WebMCP 工具 dev.to 我们在 DolphinBench 上测试记忆检索:纯关键词搜索暴露了自身回归 dev.to 别再把 Agent 写成 while 循环,把它建模为状态机
多元动态
登录 注册
智能体 arxiv.org ·

ActGov:通过策略约束验证治理 LLM 智能体行为

原文 我的收藏

该论文提出 ActGov 运行时执行框架,在 LLM 智能体提议的工具动作产生外部影响前进行验证。ActGov-Policy 从工具规范、良性任务和观测到的失败轨迹迭代构建策略集,每次更新经 SMT 反例检查验证;ActGov-Runtime 将工具调用抽象为有限策略记录,仅当处于任务授权边界内且满足全部适用策略时放行,从而在长周期、动态分支工作流中维持授权。作者在 AgentDojo 和 AgentDyn 基准上跨多个模型与攻击配置评测,称其持续降低间接提示注入攻击成功率并保持任务效用,优于现有防御,且不依赖底层 LLM 正确识别恶意指令。

AI推荐理由 arXiv 新论文(v2,2026-09-21 提交),提出 ActGov 运行时执行框架:用统一语义模型描述授权、动作、运行时上下文与安全约束,ActGov-Policy 从工具规范、良性任务和失败轨迹迭代构建策略集并用 SMT 反例检查验证,ActGov-Runtime 将每次工具调用抽象为有限策略记录,仅在任务授权边界内且满足全部策略时放行。在 AgentDojo 与 AgentDyn 上跨多模型和攻击配置评测,称降低间接提示注入成功率并保持任务效用。具体新信息是逐动作运行时授权执行机制与 SMT 验证策略构建流程;局限是摘要未给出具体数值、基线对比细节和误报率,效果需查全文验证。

78

正文

Computer Science > Cryptography and Security arXiv:2609.24446 (cs) [Submitted on 21 Sep 2026 (v1), last revised 22 Sep 2026 (this version, v2)] Title:ActGov: Governing LLM Agent Actions via Policy-Constrained Validation Authors:Kaiyuan Zhang, Yuke Peng, Ke Jiang, Yinqian Zhang View a PDF of the paper titled ActGov: Governing LLM Agent Actions via Policy-Constrained Validation, by Kaiyuan Zhang and 3 other authors View PDF HTML (experimental) Abstract:Large language model (LLM) agents increasingly execute long-horizon workflows through external tools, allowing untrusted outputs to influence subsequent actions and exceed user authorization. Existing defenses isolate injected content or constrain execution with predefined plans and static policies, but these approaches are brittle under dynamic workflows and scale poorly across extensible tool ecosystems. In this work, we present ActGov, a runtime enforcement framework that validates each LLM-proposed tool action before it causes external effects. Built on a unified semantic model of authorization, actions, runtime context, and security constraints, the ActGov-Policy component iteratively constructs a policy set from tool specifications, benign tasks, and observed failure traces, with each update verified through SMT-based counterexample checking. At runtime, ActGov-Runtime abstracts each tool call into finite policy records and permits it only if it remains within the task-scoped authorization boundary and satisfies all applicable policies. This per-action enforcement preserves authorization throughout long-horizon, dynamically branching workflows. We evaluate ActGov on the AgentDojo and AgentDyn benchmarks across multiple models and attack configurations. It shows that ActGov consistently reduces the success rate of indirect prompt-injection attacks while preserving task utility, significantly outperforming existing defenses. These results demonstrate that ActGov can enforce fine-grained authorization over dynamic agent executions without relying on the underlying LLM to correctly identify malicious instructions. Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI) Cite as: arXiv:2609.24446 [cs.CR] (or arXiv:2609.24446v2 [cs.CR] for this version) https://doi.org/10.48550/arXiv.2609.24446 Focus to learn more arXiv-issued DOI via DataCite Submission history From: Kaiyuan Zhang [view email] [v1] Mon, 21 Sep 2026 11:47:09 UTC (263 KB) [v2] Tue, 22 Sep 2026 10:20:09 UTC (264 KB) Full-text links: Access Paper: View a PDF of the paper titled ActGov: Governing LLM Agent Actions via Policy-Constrained Validation, by Kaiyuan Zhang and 3 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.CR new | recent | 2026-09 Change to browse by: cs cs.AI References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

aihot::arXiv - LLM ActGov:通过策略约束验证治理 LLM 智能体行为 09-23 · 原文发布
← 返回精选动态 原文

更多内容