最新资讯
dev.to 我们在 DolphinBench 上测试记忆检索:纯关键词搜索暴露了自身回归 dev.to 别再把 Agent 写成 while 循环,把它建模为状态机 bloomberg.com Rightmove 与 Scout24 借 AI 产品应对低迷房市并上调展望 stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器 reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者
多元动态
登录 注册
论文研究 arxiv.org ·

当上下文误导时:大型语言模型中带管辖权的上下文学习

原文 我的收藏

该论文指出当前 ICL 后训练方法擅长从示例中提取模式,却忽视“上下文权威性”——判断上下文信息是否应主导最终答案。作者构建 FakeContextBench,覆盖七个领域的伪科学主张,评测显示仅靠大规模预训练不足以可靠区分上下文权威性,且常见 ICL 微调会提高对误导性上下文的敏感性,现实准确率相对基座最多下降 14.95 个百分点。为此提出 Jurisdiction In-Context Learning(J-ICL),将上下文验证纳入训练目标;在四个模型骨干上,J-ICL 使 ICLEval 平均提升 5.84 个百分点、现实准确率提升 9.20 点,相对 MetaICL 与 Symbol Tuning 现实率平均提升 18.09 点。

AI推荐理由 arXiv 新论文,提出 FakeContextBench 基准与 J-ICL 后训练框架,针对 ICL 中“上下文权威性”盲点。摘要给出具体量化结果:ICL 微调可使现实准确率相对基座下降最多 14.95 个百分点;J-ICL 在四个骨干模型上 ICLEval 平均提升 5.84 个百分点、现实准确率提升 9.20 点,相对 MetaICL 与 Symbol Tuning 现实率平均提升 18.09 点。信息密度高、方法可验证,但结果均为作者自报,尚无第三方复现,且基准与代码可用性仅以链接形式提及。

78

正文

Computer Science > Computation and Language arXiv:2609.27603 (cs) [Submitted on 23 Sep 2026] Title:When Context Misleads: In-context Learning with Jurisdiction in Large Language Models Authors:Pei-lin Li, Qingle Liu, Junyang Feng, Siyu Li, Sunqi Fan, Xin-Sheng Chen, Shuojin Yang View a PDF of the paper titled When Context Misleads: In-context Learning with Jurisdiction in Large Language Models, by Pei-lin Li and 6 other authors View PDF HTML (experimental) Abstract:In-Context Learning (ICL) has become a cornerstone of modern LLM deployment. However, existing ICL post-training methods have a critical blind spot: they excel at extracting patterns from demonstrations while often neglecting context authority, the ability to determine whether contextual information should govern the final answer. To benchmark this capability, we introduce FakeContextBench, which contains pseudoscientific claims across seven domains. Our evaluation of commercial and open-source models shows that large-scale pre-training alone is insufficient for reliable context-authority discrimination. Moreover, prevalent ICL fine-tuning methods can increase susceptibility to misleading context, reducing reality accuracy by up to 14.95 percentage points relative to the base model. To address this trade-off, we propose Jurisdiction In-Context Learning (J-ICL), a post-training framework that incorporates context validation into the training objective. Across four model backbones, J-ICL improves ICLEval by an average of 5.84 percentage points and reality accuracy by 9.20 points over the corresponding base models. It also raises the Reality Rate by an average of 18.09 points relative to MetaICL and Symbol Tuning. These results demonstrate that ICL capability and resistance to deceptive context can be improved together. The benchmark is available at this https URL. Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI) Cite as: arXiv:2609.27603 [cs.CL] (or arXiv:2609.27603v1 [cs.CL] for this version) https://doi.org/10.48550/arXiv.2609.27603 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Pei-Lin Li [view email] [v1] Wed, 23 Sep 2026 09:21:14 UTC (2,053 KB) Full-text links: Access Paper: View a PDF of the paper titled When Context Misleads: In-context Learning with Jurisdiction in Large Language Models, by Pei-lin Li and 6 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.CL new | recent | 2026-09 Change to browse by: cs cs.AI References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容