最新资讯
bloomberg.com 台积电据报考虑生产先进 AI 存储芯片 www.infoq.com Yelp 为 AI Assistant 融合原生与服务器驱动 UI computerworld.com 英国监管机构:企业须为自家 AI 代理的错误负责 siliconangle.com Atomicwork 推出面向企业 IT 与安全的认证 AI 同事市场 computerworld.com OpenAI 收购小型软件公司以改进 Codex bdtechtalks.com Next-Concept Modeling 如何重新思考 AI 文本生成 computerworld.com Box 发布 Architect:用自然语言构建业务流程工作流 techrepublic.com Perplexity 推出 Teammates:每月 200 美元的 AI Agent 如何工作 the-decoder.com METR 称 Anthropic 或已在 7 月越过自身 AI 加速预警阈值 towardsdatascience.com 用 Ollama 和 Python 构建你的第一个多工具 AI Agent the-decoder.com Thinking Machines 的 Inkling 2 Small 称霸西方开放权重模型 dev.to 为 CI/CD 构建 AI 质量门禁
多元动态
登录 注册
智能体 arxiv.org ·

GRUET:量化智能体推理与行动过程的不确定性

原文 我的收藏

该论文针对 ReAct 智能体在开放动态环境中同一任务产生分歧轨迹、高不确定性轨迹行为难以理解的问题,提出 GRUET 方法:将潜在推理分支构成的空间建模为图,用图复杂度近似推理空间复杂度以量化轮级推理不确定性,再通过简单聚合策略得到轨迹级可信度。作者在 9 个 LLM 和 5 个基准上以 AUROC、AUPRC、AUARC 衡量选择性生成性能,验证方法有效性。

AI推荐理由 arXiv 预印本,作者提出 GRUET 方法,用图建模推理分支空间来量化 ReAct 智能体单轮推理不确定性与轨迹级不确定性聚合,并在 9 个 LLM、5 个基准上以 AUROC/AUPRC/AUARC 评估选择性生成表现。新信息在于把轨迹不确定性归因于累积的轮级推理不确定性,并给出可量化的图复杂度近似;局限是仅摘要级证据,未提供代码、复现细节或与既有不确定性量化方法的对比数据,实际效果仍需验证。

72

正文

Computer Science > Artificial Intelligence arXiv:2609.24831 (cs) [Submitted on 21 Sep 2026] Title:GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes Authors:Shuang Liang, Xin-Yu Hu, Shao-Qun Zhang View a PDF of the paper titled GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes, by Shuang Liang and 2 other authors View PDF HTML (experimental) Abstract:Agents have attracted considerably increasing attention due to the power of executing both Reasoning and Acting (ReAct) in open and dynamic environments. The ReAct process typically exhibits a multi-turn trajectory in which one drives Large Language Models (LLMs) to generate both reasoning chains and task-specific actions in an interleaved manner. However, agents often suffer from significant uncertainty, where identical tasks yield divergent trajectories; trajectories with higher uncertainty often produce incomprehensible behaviors, severely undermining agent credibility. This work conjectures that such trajectory-level uncertainty frequently stems from cumulative turn-level reasoning uncertainty induced by LLMs; the latter often exhibits a collection of branches of divergent reasoning chains and their resulting actions. Built upon this, we present the Graph-based Reasoning UncErtainty in Trajectories (GRUET) method for the uncertainty quantification of ReAct, comprising turn-level reasoning uncertainty quantification and trajectory-level uncertainty aggregation; the former precisely quantifies reasoning uncertainty via modeling the reasoning space spanned by potential reasoning branches as a graph and then approximating the reasoning space complexity with graph complexity, while the latter employs simple aggregation strategies for quantifying the overall trajectory credibility. Empirical evaluations across nine LLMs and five benchmarks validate the effectiveness of our proposed GRUET in terms of selective generation performance, measured by AUROC, AUPRC, and AUARC. Subjects: Artificial Intelligence (cs.AI) Cite as: arXiv:2609.24831 [cs.AI] (or arXiv:2609.24831v1 [cs.AI] for this version) https://doi.org/10.48550/arXiv.2609.24831 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Shao-Qun Zhang [view email] [v1] Mon, 21 Sep 2026 16:15:35 UTC (6,247 KB) Full-text links: Access Paper: View a PDF of the paper titled GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes, by Shuang Liang and 2 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.AI new | recent | 2026-09 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

aihot::arXiv - LLM GRUET:量化智能体推理与行动过程的不确定性 09-22 · 原文发布
← 返回精选动态 原文

更多内容