最新资讯
techxplore.com 外部研究机构称 Anthropic 正加速 AI 开发,与放缓呼吁相悖 unite.ai AmeriLife 在健康与财富分销业务中推广 Palantir AI techmeme.com Meta 在美国为 Muse 应用推出实时语音模式与表情化虚拟形象 unite.ai Meta 为 Muse 带来实时语音与表情化虚拟形象 theinformation.com 更便宜的 AI 能否跑赢数据中心遭遇的反弹? techmeme.com 消息称约 60 万颗英伟达 H200 芯片滞留香港,等待运往中国大陆 techcrunch.com Meta 警告:针对数据中心的选举反弹可能加大 AI 扩张难度 theverge.com Muse 上线语音模式 techmeme.com METR:Anthropic 模型改进速度翻倍,内部 AI 使用贡献约 80% 加速 thenewstack.io OpenAI 发布 GPT-6 Cyber:更强攻防能力与更严格的行为边界 pub.towardsai.net 实测 Qwen3-8B 单次 LLM API 调用:KV 缓存、prefill/decode 差距与 JSON 输出失败 thenewstack.io Together AI 用编码 Agent 改写 GPU 推理代码,部署仍由人工把关
多元动态
登录 注册
大模型 arxiv.org ·

预填充推理通道:针对推理 LLM 的输出前缀攻击

原文 我的收藏

该论文系统研究了将推理模型的 scratchpad 推理通道作为输出前缀攻击向量的可行性,采用 3 种前缀类型 × 2 种推理注入的因子设计,在 AdvBench 的 1800 个测试用例上攻击 Gemini 3 Flash Preview、DeepSeek V4 Flash 和 Claude Haiku 4.5。结果显示,单独注入恶意推理几乎无效(攻击成功率约 0%),但叠加一个简单的输出前缀后,部分模型的攻击成功率最高可达 99%;上下文相关前缀优于静态前缀,且易感性因模型而异。

AI推荐理由 arXiv 论文,摘要给出明确实验设计(3 种前缀类型 × 2 种推理注入、1800 个 AdvBench 测试用例)和量化结果(单独注入恶意推理约 0% 攻击成功率,叠加简单输出前缀后部分模型最高达 99%),并对比了暴露/隐藏推理通道的模型,属于可验证的安全研究新信息。局限在于仅基于摘要,未提供代码或复现细节,且所涉模型为 2026 年版本,需以原文为准。

82

正文

Computer Science > Cryptography and Security arXiv:2609.29775 (cs) [Submitted on 24 Sep 2026] Title:Prefilling the Reasoning Channel: Output-Prefix Attacks on Reasoning LLMs Authors:Lukáš Brůna, Robert Bridges, Adam Ek View a PDF of the paper titled Prefilling the Reasoning Channel: Output-Prefix Attacks on Reasoning LLMs, by Luk\'a\v{s} Br\r{u}na and 2 other authors View PDF HTML (experimental) Abstract:Large Language Models (LLMs) consume and produce a single sequence of text; hence, if text can be added to the beginning of the LLM's response, i.e., an output prefix, then all subsequent tokens will be conditioned on it. This output-prefix attack technique is a cheap black-box prompt injection. Prior work has shown this type of attack can reliably jailbreak non-reasoning models. Most reasoning models add an intermediate scratchpad reasoning step before the assistant's final response. The ability to edit this reasoning channel is exposed by some APIs and attack vectors can be leveraged for reasoning injection attacks. We present the first systematic, controlled study that isolates the scratchpad reasoning channel as an output-prefix attack vector, and the first to compare reasoning-only, output-prefix-only and reasoning-plus-output-prefix attacks across both exposed- and hidden-reasoning models. Using a factorial design of 3 prefix types $\times$ 2 reasoning injections over $1{,}800$ test cases drawn from AdvBench, we attack three 2026-era frontier models Gemini 3 Flash Preview, DeepSeek V4 Flash, and Claude Haiku 4.5. We find that injecting malicious reasoning alone is essentially inert ($\approx0\%$ attack success), but injecting the same reasoning together with a trivial output prefix raises the attack success rate to as high as $99\%$ for some models. For this type of attack we find that contextual prefixes work better than static prefixes; and that susceptibility is dependent on the model. Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI) Cite as: arXiv:2609.29775 [cs.CR] (or arXiv:2609.29775v1 [cs.CR] for this version) https://doi.org/10.48550/arXiv.2609.29775 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Lukáš Brůna [view email] [v1] Thu, 24 Sep 2026 13:18:21 UTC (1,046 KB) Full-text links: Access Paper: View a PDF of the paper titled Prefilling the Reasoning Channel: Output-Prefix Attacks on Reasoning LLMs, by Luk\'a\v{s} Br\r{u}na and 2 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.CR new | recent | 2026-09 Change to browse by: cs cs.AI References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容