智能体
arxiv.org ·
GRUET:量化智能体推理与行动过程的不确定性
该论文针对 ReAct 智能体在开放动态环境中同一任务产生分歧轨迹、高不确定性轨迹行为难以理解的问题,提出 GRUET 方法:将潜在推理分支构成的空间建模为图,用图复杂度近似推理空间复杂度以量化轮级推理不确定性,再通过简单聚合策略得到轨迹级可信度。作者在 9 个 LLM 和 5 个基准上以 AUROC、AUPRC、AUARC 衡量选择性生成性能,验证方法有效性。
AI推荐理由 arXiv 预印本,作者提出 GRUET 方法,用图建模推理分支空间来量化 ReAct 智能体单轮推理不确定性与轨迹级不确定性聚合,并在 9 个 LLM、5 个基准上以 AUROC/AUPRC/AUARC 评估选择性生成表现。新信息在于把轨迹不确定性归因于累积的轮级推理不确定性,并给出可量化的图复杂度近似;局限是仅摘要级证据,未提供代码、复现细节或与既有不确定性量化方法的对比数据,实际效果仍需验证。
72
正文
Computer Science > Artificial Intelligence
arXiv:2609.24831 (cs)
[Submitted on 21 Sep 2026]
Title:GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes
Authors:Shuang Liang, Xin-Yu Hu, Shao-Qun Zhang
View a PDF of the paper titled GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes, by Shuang Liang and 2 other authors
View PDF
HTML (experimental)
Abstract:Agents have attracted considerably increasing attention due to the power of executing both Reasoning and Acting (ReAct) in open and dynamic environments. The ReAct process typically exhibits a multi-turn trajectory in which one drives Large Language Models (LLMs) to generate both reasoning chains and task-specific actions in an interleaved manner. However, agents often suffer from significant uncertainty, where identical tasks yield divergent trajectories; trajectories with higher uncertainty often produce incomprehensible behaviors, severely undermining agent credibility. This work conjectures that such trajectory-level uncertainty frequently stems from cumulative turn-level reasoning uncertainty induced by LLMs; the latter often exhibits a collection of branches of divergent reasoning chains and their resulting actions. Built upon this, we present the Graph-based Reasoning UncErtainty in Trajectories (GRUET) method for the uncertainty quantification of ReAct, comprising turn-level reasoning uncertainty quantification and trajectory-level uncertainty aggregation; the former precisely quantifies reasoning uncertainty via modeling the reasoning space spanned by potential reasoning branches as a graph and then approximating the reasoning space complexity with graph complexity, while the latter employs simple aggregation strategies for quantifying the overall trajectory credibility. Empirical evaluations across nine LLMs and five benchmarks validate the effectiveness of our proposed GRUET in terms of selective generation performance, measured by AUROC, AUPRC, and AUARC.
Subjects:
Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.24831 [cs.AI]
(or
arXiv:2609.24831v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.24831
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Shao-Qun Zhang [view email]
[v1]
Mon, 21 Sep 2026 16:15:35 UTC (6,247 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled GRUET: Quantifying Uncertainty of Agentic Reasoning-and-Acting Processes, by Shuang Liang and 2 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.AI
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)