最新资讯
dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离 wechat 这波杀疯了!旗舰级模型不限量、1个月视频额度免费领 bloomberg.com AI 抛售蔓延至信用市场,软银领跌亚洲美元债 dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单
多元动态
登录 注册
论文研究 arxiv.org ·

当扩展失败时:通过多步感知感知推理缓解大型音频语言模型的音频感知衰减

原文 我的收藏

该 arXiv 论文研究大型音频语言模型(LALM)中一个反直觉现象:对结构化推理轨迹做后训练,相比直接回答的后训练收益有限甚至为负。作者提出 CAFE 评测框架以量化音频推理错误,发现 LALM 在推理过程中感知能力随推理长度增加而衰减。为此提出 MPAR^2 范式,将复杂问题分解为感知丰富的子问题并借助强化学习进行动态感知推理,使 CAFE 感知性能从 31.74% 提升至 63.51%,并在 MMAU 基准上达到 74.59% 准确率。

AI推荐理由 arXiv 论文(v2,2026-09-21 修订),摘要给出明确问题、方法与量化结果:指出 LALM 在推理时存在音频感知衰减,提出 CAFE 评测框架与 MPAR^2 范式,报告 CAFE 感知性能从 31.74% 提升至 63.51%、MMAU 达 74.59%。属可验证的研究进展,对音频多模态模型与推理扩展方向有参考价值;局限是仅摘要级证据,未提供复现细节与第三方验证。

78

正文

Computer Science > Sound arXiv:2603.02266 (cs) [Submitted on 28 Feb 2026 (v1), last revised 21 Sep 2026 (this version, v2)] Title:When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning Authors:Ruixiang Mao, Xiangnan Ma, Dan Chen, Ziming Zhu, Yuan Ge, Aokai Hao, Haishu Zhao, Yifu Huo, Qing Yang, Kaiyan Chang, Xiaoqian Liu, Chenglong Wang, Qiaozhi He, Tong Xiao, Jingbo Zhu View a PDF of the paper titled When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning, by Ruixiang Mao and 14 other authors View PDF HTML (experimental) Abstract:Test-Time Scaling has shown notable efficacy in addressing complex problems through scaling inference compute. However, within Large Audio-Language Models (LALMs), an unintuitive phenomenon exists: post-training models for structured reasoning trajectories results in marginal or even negative gains compared to post-training for direct answering. To investigate it, we introduce CAFE, an evaluation framework designed to precisely quantify audio reasoning errors. Evaluation results reveal LALMs struggle with perception during reasoning and encounter a critical bottleneck: reasoning performance suffers from audio perception decay as reasoning length extends. To address it, we propose MPAR$^2$, a paradigm that encourages dynamic perceptual reasoning and decomposes complex questions into perception-rich sub-problems. Leveraging reinforcement learning, MPAR$^2$ improves perception performance on CAFE from 31.74% to 63.51% and effectively mitigates perception decay, concurrently enhancing reasoning capabilities to achieve a significant 74.59% accuracy on the MMAU benchmark. Further analysis demonstrates that MPAR$^2$ reinforces LALMs to attend to audio input and dynamically adapts reasoning budget to match task complexity. Comments: Subjects: Sound (cs.SD); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS) Cite as: arXiv:2603.02266 [cs.SD] (or arXiv:2603.02266v2 [cs.SD] for this version) https://doi.org/10.48550/arXiv.2603.02266 Focus to learn more arXiv-issued DOI via DataCite Submission history From: Ruixiang Mao [view email] [v1] Sat, 28 Feb 2026 12:54:51 UTC (1,704 KB) [v2] Mon, 21 Sep 2026 15:40:24 UTC (1,704 KB) Full-text links: Access Paper: View a PDF of the paper titled When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning, by Ruixiang Mao and 14 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.SD new | recent | 2026-03 Change to browse by: cs cs.AI eess eess.AS References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容