最新资讯
dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单 dev.to 如何通过工具调用引导模型以提升 Harness 质量 dev.to AI Agent 审计轨迹不等于对话记录 dev.to 精简 MCP server 工具数量:更少工具、更小影响面,双重收益 dev.to 为什么 git checkout 无法撤销 AI 编码 agent 的改动? wechat AI短剧门槛降降降!实测即梦短剧工作室:剧本分镜预演一条龙,伙伴计划长期护航 dev.to 让模型改写文档前,先量化事实保真度 dev.to 回放 153 个 Claude Code 与 Codex 会话,审计 Agent 的生产影响范围
多元动态
登录 注册
大模型 arxiv.org ·

SafeTutors:AI 辅导系统中的教学安全基准测试

原文 我的收藏

该论文提出 SafeTutors 基准,针对 LLM 作为 AI 导师的场景,联合评估教学有效性与安全性,覆盖数学、物理、化学三科,基于学习科学文献构建 11 个危害维度、48 个子风险的风险分类体系。研究发现:所有被测模型均表现出广泛危害;模型规模扩大并不能可靠改善表现;多轮对话会恶化行为,教学失败率从 17.7% 升至 77.8%;危害还因学科而异,因此缓解措施需考虑学科差异,单轮“安全/有帮助”的评测结果可能掩盖长程交互中的系统性辅导失败。

AI推荐理由 arXiv 论文(v2,2026-09-23 修订),提出 SafeTutors 基准,用 11 类危害维度、48 个子风险联合评估数学/物理/化学 AI 辅导的教学安全与教学有效性。具体新信息:指出所有模型均存在广泛危害、规模扩大不能可靠改善、多轮对话使教学失败率从 17.7% 升至 77.8%,且危害随学科变化,单轮“安全/有帮助”结果会掩盖长对话中的系统性失败。局限:仅摘要可见,未提供具体模型清单、评测规模与复现细节,结论需以全文验证。

82

正文

Computer Science > Computation and Language arXiv:2603.17373 (cs) [Submitted on 18 Mar 2026 (v1), last revised 23 Sep 2026 (this version, v2)] Title:SafeTutors: Benchmarking Pedagogical Safety in AI Tutoring Systems Authors:Rima Hazra, Bikram Ghuku, Ilona Marchenko, Yaroslava Tokarieva, Sayan Layek, Somnath Banerjee, Julia Stoyanovich, Mykola Pechenizkiy View a PDF of the paper titled SafeTutors: Benchmarking Pedagogical Safety in AI Tutoring Systems, by Rima Hazra and Bikram Ghuku and Ilona Marchenko and Yaroslava Tokarieva and Sayan Layek and Somnath Banerjee and Julia Stoyanovich and Mykola Pechenizkiy View PDF HTML (experimental) Abstract:Large language models are rapidly being deployed as AI tutors, yet current evaluation paradigms assess problem-solving accuracy and generic safety in isolation, failing to capture whether a model is simultaneously pedagogically effective and safe across student-tutor interaction. We argue that tutoring safety is fundamentally different from conventional LLM safety: the primary risk is not toxic content but the quiet erosion of learning through answer over-disclosure, misconception reinforcement, and the abdication of scaffolding. To systematically study this failure mode, we introduce SafeTutors, a benchmark that jointly evaluates safety and pedagogy across mathematics, physics, and chemistry. SafeTutors is organized around a theoretically grounded risk taxonomy comprising 11 harm dimensions and 48 sub-risks drawn from learning-science literature. We uncover that all models show broad harm; scale doesn't reliably help; and multi-turn dialogue worsens behavior, with pedagogical failures rising from 17.7% to 77.8%. Harms also vary by subject, so mitigations must be discipline-aware, and single-turn "safe/helpful" results can mask systematic tutor failure over extended interaction. Comments: Subjects: Computation and Language (cs.CL) Cite as: arXiv:2603.17373 [cs.CL] (or arXiv:2603.17373v2 [cs.CL] for this version) https://doi.org/10.48550/arXiv.2603.17373 Focus to learn more arXiv-issued DOI via DataCite Submission history From: Rima Hazra [view email] [v1] Wed, 18 Mar 2026 05:33:50 UTC (480 KB) [v2] Wed, 23 Sep 2026 16:42:06 UTC (480 KB) Full-text links: Access Paper: View a PDF of the paper titled SafeTutors: Benchmarking Pedagogical Safety in AI Tutoring Systems, by Rima Hazra and Bikram Ghuku and Ilona Marchenko and Yaroslava Tokarieva and Sayan Layek and Somnath Banerjee and Julia Stoyanovich and Mykola Pechenizkiy View PDF HTML (experimental) TeX Source view license Current browse context: cs.CL new | recent | 2026-03 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

aihot::arXiv - LLM SafeTutors:AI 辅导系统中的教学安全基准测试 09-24 · 原文发布
← 返回精选动态 原文

更多内容