大模型
arxiv.org ·
当工具成为阻碍：不必要工具可用性对大语言模型回答的影响
该 arXiv 预印本研究不必要工具可用性对 LLM 回答的影响。作者构建覆盖 10 个知识域的 500 组查询对，每组包含需要工具的工具查询与不需要工具的闭域查询，在工具不可用、可用以及先发生一次工具调用后可用三种条件下评估 6 个模型。3000 次基线试验的汇总回答率为 98.2%，当不必要工具可用时降至 63.5%，且模型间差异较大；下降在工具很少被调用时仍出现，说明不能仅用不必要调用解释。一句范围感知的系统指令可恢复大部分丢失的回答。
AI推荐理由 arXiv 预印本，摘要给出明确实验设计：500 组查询对、10 个知识域、6 个模型、3000 次基线试验，报告不必要工具可用时回答率从 98.2% 降至 63.5%，并指出下降不能仅由工具调用解释，且一句范围感知系统指令可恢复大部分丢失回答。这些具体数字和可复现设置对 Agent 工具调用与提示设计有直接参考价值；局限是仅为预印本、未提供同行评审或代码链接，结论需进一步验证。
82
正文
Computer Science > Computation and Language
arXiv:2609.14157 (cs)
[Submitted on 12 Sep 2026]
Title:When Tools Get in the Way: The Effect of Unnecessary Tool Availability on LLM Answering
Authors:Saanvi Paturi, Arsen Kenzhebayev, Arham Sethi, Vyas Raina, Ivaxi Sheth, Vatsal Raina
View a PDF of the paper titled When Tools Get in the Way: The Effect of Unnecessary Tool Availability on LLM Answering, by Saanvi Paturi and 5 other authors
View PDF
HTML (experimental)
Abstract:Large language models (LLMs) are increasingly deployed with external tools that extend what they can do beyond their own knowledge. Tools help on tasks that need external information, but their availability may also change how a model handles questions that do not need them. Prior work has mostly asked whether models select and use tools appropriately; whether an unnecessary tool changes the correctness of answers has received less attention. We ask whether making a related but unnecessary tool available affects a model's ability to answer from its own knowledge, and whether a preceding tool interaction changes this behaviour. We construct 500 query pairs across 10 knowledge domains. Each pair consists of a tool query, which needs the domain's tool, and a closed-domain query, which does not. Six LLMs are evaluated with the tool unavailable, available, and available after a prior tool call. Across 3,000 baseline trials the pooled answer rate is 98.2%. When an unnecessary tool is available it falls to 63.5%, with large differences between models. The decrease occurs even when the tool is rarely called, so it cannot be explained by unnecessary tool invocation alone. A one-sentence scope-aware system instruction recovers most of the lost answers.
Comments:
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.14157 [cs.CL]
(or
arXiv:2609.14157v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.14157
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Vatsal Raina [view email]
[v1]
Sat, 12 Sep 2026 21:15:58 UTC (1,943 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled When Tools Get in the Way: The Effect of Unnecessary Tool Availability on LLM Answering, by Saanvi Paturi and 5 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CL
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)