最新资讯
bloomberg.com Nvidia 加强东南亚芯片追踪以打击走私 thestack.technology 模型路由需求升温,Agent Router 推出开源替代方案 www.youtube.com Google DeepMind 的 Philipp Schmid:AI 同事需要具备的七个要素 unite.ai Cashfree 为 AI Agent 的托管结账加入 WebMCP 工具 dev.to 我们在 DolphinBench 上测试记忆检索:纯关键词搜索暴露了自身回归 dev.to 别再把 Agent 写成 while 循环,把它建模为状态机 analyticsindiamag.com 小语言模型可能重塑企业 AI 部署方式 bloomberg.com Rightmove 与 Scout24 借 AI 产品应对低迷房市并上调展望 stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器
多元动态
登录 注册
论文研究 arxiv.org ·

C-HAT-Bench:超越完全生成文本的中文 AI 文本检测基准

原文 我的收藏

该论文提出 C-HAT-Bench,一个面向中文人机协作文本检测的统一基准,将 5 个领域的 5000 篇人类原文与 6 个生成模型在 Prefix-Conditioned Continuation 参考设定及三种协作生产模式下生成的 24 万余变体关联。作者用四种协议评测 21 个检测器,涵盖零样本与预训练监督的文档级检测、边界定位和跨条件泛化。结果显示,协作生产模式下文档级检测器平均 AUROC 比参考设定低 12.0%,最大单检测器相对下降 44.4%,且跨协作模式迁移不对称,说明某一生产设定下的性能不能可靠预测其他设定。

AI推荐理由 arXiv 新论文,提出 C-HAT-Bench 中文人机协作文本检测基准,将 5000 篇人类原文与 6 个生成模型在 4 种协作生产模式下产生的 24 万余变体关联,并评测 21 个检测器。具体新信息是:在协作生产模式下文档级检测器平均 AUROC 比 Prefix-Conditioned Continuation 低 12.0%,最大单检测器相对下降达 44.4%,且跨模式迁移不对称。局限是仅摘要级证据,未提供数据集开放情况与复现细节,检测器可靠性结论限于该基准设定。

72

正文

Computer Science > Computation and Language arXiv:2609.32770 (cs) [Submitted on 26 Sep 2026] Title:C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text Authors:Qing Yang, Zixiang Luo, Zhenyu Mao, Zezheng Wu, Xinghe Cheng, Haibo Chen, Qinggang Zhang, Jiapu Wang, Jingwei Zhang View a PDF of the paper titled C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text, by Qing Yang and 8 other authors View PDF HTML (experimental) Abstract:Large Language Models (LLMs) increasingly participate in writing by modifying or extending human drafts, causing machine involvement to vary in both form and extent. Yet most Machine-Generated Text (MGT) detectors are evaluated only on fully human-written versus fully AI-generated text. Because human--AI collaboration can weaken or redistribute cues associated with machine generation, strong performance under this binary setting may overstate detector reliability. This mismatch remains underexplored in Chinese: detection cues are shaped by tokenization and language-specific text distributions, yet controlled resources spanning production settings, domains, and generators remain limited. To fill this gap, we present a Chinese Human-AI Collaborative Text Detection Benchmark (C-HAT-Bench), a unified benchmark that links $5,000$ human-written source texts from five domains to more than $240,000$ variants produced using six generative models under Prefix-Conditioned Continuation as a reference setting and three collaborative production modes. We evaluate $21$ detectors through four protocols spanning zero-shot and pretrained supervised document-level detection, boundary localization, and cross-condition generalization. Relative to Prefix-Conditioned Continuation, mean AUROC across document-level detectors is $12.0\%$ lower on the collaborative production modes, with the largest detector-specific relative decrease reaching $44.4\%$. Transfer across collaborative production modes is also asymmetric, indicating that performance in a given production setting is not a reliable predictor of performance in other production settings. Subjects: Computation and Language (cs.CL) Cite as: arXiv:2609.32770 [cs.CL] (or arXiv:2609.32770v1 [cs.CL] for this version) https://doi.org/10.48550/arXiv.2609.32770 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Jiapu Wang [view email] [v1] Sat, 26 Sep 2026 16:46:51 UTC (11,656 KB) Full-text links: Access Paper: View a PDF of the paper titled C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text, by Qing Yang and 8 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.CL new | recent | 2026-09 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容