最新资讯
dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单 dev.to 如何通过工具调用引导模型以提升 Harness 质量 dev.to AI Agent 审计轨迹不等于对话记录 dev.to 精简 MCP server 工具数量:更少工具、更小影响面,双重收益 dev.to 为什么 git checkout 无法撤销 AI 编码 agent 的改动? wechat AI短剧门槛降降降!实测即梦短剧工作室:剧本分镜预演一条龙,伙伴计划长期护航 dev.to 让模型改写文档前,先量化事实保真度 dev.to 回放 153 个 Claude Code 与 Codex 会话,审计 Agent 的生产影响范围
多元动态
登录 注册
大模型 arxiv.org ·

论匿名化对大型语言模型性能的影响

原文 我的收藏

该论文系统实证研究了隐私与性能的权衡:在 11 个基准上对比 5 个主流语言模型在原始与假名化输入下的表现。结果显示匿名化总体降低性能,但影响因模型和任务而异——Qwen2.5-72B、GPT-4o mini 等更强模型降幅最大,TruthfulQA 反而改善,RGB 等检索任务急剧下降;保留实体唯一性的可逆匿名化明显优于 redaction,显式提示模型匿名化无可见收益。作者认为匿名化需与模型和任务协同设计。

AI推荐理由 arXiv 论文,作者与摘要明确,实验设计具体(5 个模型、11 个基准,对比原始与假名化输入)。核心新信息:匿名化普遍降低性能,但影响高度依赖任务与模型——能力更强的 Qwen2.5-72B 与 GPT-4o mini 降幅最大;TruthfulQA 反而提升,RGB 等检索类任务灾难性下降;保留实体唯一性的可逆匿名化显著优于 redaction,且显式提示模型匿名化无收益。局限:仅摘要,未提供具体数值与统计细节,结论需以全文验证。

78

正文

Computer Science > Computation and Language arXiv:2609.11335 (cs) [Submitted on 10 Sep 2026] Title:On the Impact of Anonymization on the Performance of Large Language Models Authors:Tobias Deußer, Max Hahnbück, Lorenz Sparrenberg, Tobias Uelwer, Christian Bauckhage, Rafet Sifa View a PDF of the paper titled On the Impact of Anonymization on the Performance of Large Language Models, by Tobias Deu{\ss}er and 5 other authors View PDF HTML (experimental) Abstract:As large language models are increasingly deployed in sensitive domains, anonymizing input data to protect personally identifiable information has become a critical practice. However, the impact of this anonymization on model utility is not well understood. This paper presents a systematic empirical study of the trade-off between privacy and performance. We evaluate five prominent language models across eleven diverse benchmarks, comparing their performance on original versus pseudonymized inputs. Our results reveal that while anonymization generally degrades performance, the effect is highly nuanced. We find that more capable models, such as Qwen2.5-72B and GPT-4o mini, suffer the largest performance drops, suggesting a stronger reliance on specific entity information. The impact is also task-dependent: performance on TruthfulQA improves with anonymization, while retrieval-focused tasks like RGB experience a catastrophic decline. Further experiments show that reversible anonymization techniques that preserve entity uniqueness significantly outperform irreversible ones like redaction, and that explicitly prompting models about anonymization offers no discernible benefit. We conclude that anonymization is not a one-size-fits-all solution and must be co-designed with the model and task in mind to balance privacy and utility effectively. Our findings provide a crucial baseline for developing more robust, privacy-aware AI systems. Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI) Cite as: arXiv:2609.11335 [cs.CL] (or arXiv:2609.11335v1 [cs.CL] for this version) https://doi.org/10.48550/arXiv.2609.11335 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Tobias Deußer [view email] [v1] Thu, 10 Sep 2026 10:12:36 UTC (111 KB) Full-text links: Access Paper: View a PDF of the paper titled On the Impact of Anonymization on the Performance of Large Language Models, by Tobias Deu{\ss}er and 5 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.CL new | recent | 2026-09 Change to browse by: cs cs.AI References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

aihot::arXiv - LLM 论匿名化对大型语言模型性能的影响 09-11 · 原文发布
← 返回精选动态 原文

更多内容