论文研究
arxiv.org ·
当上下文误导时:大型语言模型中带管辖权的上下文学习
该论文指出当前 ICL 后训练方法擅长从示例中提取模式,却忽视“上下文权威性”——判断上下文信息是否应主导最终答案。作者构建 FakeContextBench,覆盖七个领域的伪科学主张,评测显示仅靠大规模预训练不足以可靠区分上下文权威性,且常见 ICL 微调会提高对误导性上下文的敏感性,现实准确率相对基座最多下降 14.95 个百分点。为此提出 Jurisdiction In-Context Learning(J-ICL),将上下文验证纳入训练目标;在四个模型骨干上,J-ICL 使 ICLEval 平均提升 5.84 个百分点、现实准确率提升 9.20 点,相对 MetaICL 与 Symbol Tuning 现实率平均提升 18.09 点。
AI推荐理由 arXiv 新论文,提出 FakeContextBench 基准与 J-ICL 后训练框架,针对 ICL 中“上下文权威性”盲点。摘要给出具体量化结果:ICL 微调可使现实准确率相对基座下降最多 14.95 个百分点;J-ICL 在四个骨干模型上 ICLEval 平均提升 5.84 个百分点、现实准确率提升 9.20 点,相对 MetaICL 与 Symbol Tuning 现实率平均提升 18.09 点。信息密度高、方法可验证,但结果均为作者自报,尚无第三方复现,且基准与代码可用性仅以链接形式提及。
78
正文
Computer Science > Computation and Language
arXiv:2609.27603 (cs)
[Submitted on 23 Sep 2026]
Title:When Context Misleads: In-context Learning with Jurisdiction in Large Language Models
Authors:Pei-lin Li, Qingle Liu, Junyang Feng, Siyu Li, Sunqi Fan, Xin-Sheng Chen, Shuojin Yang
View a PDF of the paper titled When Context Misleads: In-context Learning with Jurisdiction in Large Language Models, by Pei-lin Li and 6 other authors
View PDF
HTML (experimental)
Abstract:In-Context Learning (ICL) has become a cornerstone of modern LLM deployment. However, existing ICL post-training methods have a critical blind spot: they excel at extracting patterns from demonstrations while often neglecting context authority, the ability to determine whether contextual information should govern the final answer. To benchmark this capability, we introduce FakeContextBench, which contains pseudoscientific claims across seven domains. Our evaluation of commercial and open-source models shows that large-scale pre-training alone is insufficient for reliable context-authority discrimination. Moreover, prevalent ICL fine-tuning methods can increase susceptibility to misleading context, reducing reality accuracy by up to 14.95 percentage points relative to the base model. To address this trade-off, we propose Jurisdiction In-Context Learning (J-ICL), a post-training framework that incorporates context validation into the training objective. Across four model backbones, J-ICL improves ICLEval by an average of 5.84 percentage points and reality accuracy by 9.20 points over the corresponding base models. It also raises the Reality Rate by an average of 18.09 points relative to MetaICL and Symbol Tuning. These results demonstrate that ICL capability and resistance to deceptive context can be improved together. The benchmark is available at this https URL.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.27603 [cs.CL]
(or
arXiv:2609.27603v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.27603
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Pei-Lin Li [view email]
[v1]
Wed, 23 Sep 2026 09:21:14 UTC (2,053 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled When Context Misleads: In-context Learning with Jurisdiction in Large Language Models, by Pei-lin Li and 6 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CL
new
|
recent
| 2026-09
Change to browse by:
cs
cs.AI
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)