大模型
arxiv.org ·
DRT:面向高效且有据多模态推理的密集推理轨迹
该论文提出 Dense Reasoning Trace(DRT)范式,将多模态推理从自然语言 CoT 改为紧凑结构化轨迹,用符号连接词表达中间状态,并将视觉观察与逻辑推导解耦。方法包括 Dense Trace Initialization 以将推理模式内化到模型,以及 Trace-Grounded RL 框架,通过三视角验证流程构建参考轨迹,并用带结构化奖励的 Trace-Grounded GRPO 训练。作者在推理基准上报告相对 Qwen3-VL 基线 token 效率提升 5.5 倍、准确率提升 1.3 个百分点,并称代码与数据已公开。
AI推荐理由 arXiv 新提交论文(2026-09-18),提出 DRT 密集推理轨迹范式,用紧凑结构化轨迹替代自然语言 CoT,并给出 Trace-Grounded RL 与三视角验证流程;摘要报告相对 Qwen3-VL 基线 token 效率提升 5.5 倍、准确率提升 1.3 个百分点,并称代码与数据已公开。信息密度高、方法具体,但结果均为作者自报,尚无第三方复现或同行评审,需保留不确定性。
78
正文
Computer Science > Computer Vision and Pattern Recognition
arXiv:2609.21675 (cs)
[Submitted on 18 Sep 2026]
Title:DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning
Authors:Wan Xu, Yuanfan Guo, Kevin Han, LaLa Chen, Wangmeng Zuo
View a PDF of the paper titled DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning, by Wan Xu and 4 other authors
View PDF
HTML (experimental)
Abstract:Despite the remarkable progress in Multimodal Large Language Models (MLLMs), prevailing Chain-of-Thought (CoT) paradigms remain confined to the natural-language expression space. Consequently, they inherently incur excessive linguistic overhead, leading to information dilution and weak visual grounding. To address this challenge, we propose Dense Reasoning Trace (DRT), a paradigm that departs from natural-language-centered CoT by expressing reasoning as compact structured traces, which include concise intermediate states with symbolic connectors and disentangle visual observations from logical deductions. First, we introduce the Dense Trace Initialization to internalize the DRT reasoning mode into the model, substantially improving token efficiency while preserving visual evidence. To further enable the model to faithfully capture the logical relations within traces, we propose the Trace-Grounded Reinforcement Learning framework, which builds reference traces through a tri-perspective verification pipeline and employs Trace-Grounded GRPO with structured rewards, encouraging the model to generate concise DRT-style traces with reduced hallucination and stronger logical grounding. Extensive experiments on challenging reasoning benchmarks show that DRT achieves 5.5$\times$ token efficiency improvement while improving 1.3 accuracy points over the Qwen3-VL baseline. These findings suggest that complex multimodal reasoning may not require verbose natural-language traces, opening a more efficient path for next-generation MLLMs. Our code and data are available at: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2609.21675 [cs.CV]
(or
arXiv:2609.21675v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.21675
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Wan Xu [view email]
[v1]
Fri, 18 Sep 2026 12:09:58 UTC (2,212 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning, by Wan Xu and 4 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CV
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)