最新资讯
wechat 这波杀疯了!旗舰级模型不限量、1个月视频额度免费领 dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单 dev.to 如何通过工具调用引导模型以提升 Harness 质量 dev.to AI Agent 审计轨迹不等于对话记录 dev.to 精简 MCP server 工具数量:更少工具、更小影响面,双重收益 dev.to 为什么 git checkout 无法撤销 AI 编码 agent 的改动? wechat AI短剧门槛降降降!实测即梦短剧工作室:剧本分镜预演一条龙,伙伴计划长期护航 dev.to 让模型改写文档前,先量化事实保真度
多元动态
登录 注册
大模型 arxiv.org ·

大型语言模型中的交叉性公平

原文 我的收藏

该论文系统评估六个 LLM 的交叉性公平性,使用 BBQ 的两个数据集,将种族与性别、社会经济地位组合。评估维度包括偏见、子群公平、准确率和跨语境与问题极性的一致性。结果显示:模型在歧义语境表现较好,但非 unknown 预测稀疏,限制了公平性评估;在消歧语境中,刻板印象对齐对准确率的影响因数据集而异——六个模型中有五个在 Race-SES 上偏向刻板印象强化项,在 Race-Gender 上偏向反刻板印象项;子群公平指标显示结果分布不均,部分情况下观察到的差异虽低;重复运行显示回答一致性存在波动。总体而言,没有模型能同时稳定实现公平与可靠,作者据此强调需在交叉性语境下综合评估偏见、子群公平与一致性。

AI推荐理由 arXiv 正式论文(v3,2026-09-12 修订),摘要给出明确实验设计:用 BBQ 两个数据集在六个 LLM 上评估种族×性别、种族×社会经济地位的交叉性公平,并报告了具体发现(歧义语境下非 unknown 预测稀疏限制公平评估;消歧语境下五个模型在 Race-SES 偏向刻板印象强化项、在 Race-Gender 偏向反刻板印象项;子群公平指标显示结果分布不均;重复运行一致性波动;无模型同时兼顾公平与可靠性)。信息密度和可验证性较好,但属于公平性评测类工作,对模型能力、Agent 或产业落地的直接价值有限,故兴趣分中等。

62

正文

Computer Science > Computation and Language arXiv:2604.20677 (cs) [Submitted on 22 Apr 2026 (v1), last revised 12 Sep 2026 (this version, v3)] Title:Intersectional Fairness in Large Language Models Authors:Chaima Boufaied, Ronnie De Souza Santos, Ann Barcomb View a PDF of the paper titled Intersectional Fairness in Large Language Models, by Chaima Boufaied and 2 other authors View PDF HTML (experimental) Abstract:Large Language Models (LLMs) are increasingly deployed in socially sensitive settings, raising concerns about fairness and bias, particularly when multiple sensitive attributes intersect. We systematically evaluate intersectional fairness in six LLMs using two datasets from the Bias Benchmark for Question Answering (BBQ), combining race with gender and socioeconomic status. We assess bias, subgroup fairness, accuracy, and consistency across contexts and question polarities. While models perform well in ambiguous contexts, sparse non-unknown predictions limit fairness evaluation. In disambiguated contexts, stereotype alignment affects accuracy differently across datasets: models favor stereotype-reinforcing items in Race-SES but counter-stereotype items in Race-Gender for five of six models. Subgroup fairness metrics reveal uneven outcome distributions despite low observed disparities in some cases, while repeated runs show variable response consistency. Overall, no model consistently achieves both fairness and reliability, highlighting the need to evaluate bias, subgroup fairness, and consistency across intersectional contexts. Subjects: Computation and Language (cs.CL) Cite as: arXiv:2604.20677 [cs.CL] (or arXiv:2604.20677v3 [cs.CL] for this version) https://doi.org/10.48550/arXiv.2604.20677 Focus to learn more arXiv-issued DOI via DataCite Submission history From: Chaima Boufaied [view email] [v1] Wed, 22 Apr 2026 15:25:47 UTC (100 KB) [v2] Thu, 23 Apr 2026 01:37:34 UTC (99 KB) [v3] Sat, 12 Sep 2026 19:28:55 UTC (86 KB) Full-text links: Access Paper: View a PDF of the paper titled Intersectional Fairness in Large Language Models, by Chaima Boufaied and 2 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.CL new | recent | 2026-04 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

aihot::arXiv - LLM 大型语言模型中的交叉性公平 09-15 · 原文发布
← 返回精选动态 原文

更多内容