论文研究
arxiv.org ·
C-HAT-Bench:超越完全生成文本的中文 AI 文本检测基准
该论文提出 C-HAT-Bench,一个面向中文人机协作文本检测的统一基准,将 5 个领域的 5000 篇人类原文与 6 个生成模型在 Prefix-Conditioned Continuation 参考设定及三种协作生产模式下生成的 24 万余变体关联。作者用四种协议评测 21 个检测器,涵盖零样本与预训练监督的文档级检测、边界定位和跨条件泛化。结果显示,协作生产模式下文档级检测器平均 AUROC 比参考设定低 12.0%,最大单检测器相对下降 44.4%,且跨协作模式迁移不对称,说明某一生产设定下的性能不能可靠预测其他设定。
AI推荐理由 arXiv 新论文,提出 C-HAT-Bench 中文人机协作文本检测基准,将 5000 篇人类原文与 6 个生成模型在 4 种协作生产模式下产生的 24 万余变体关联,并评测 21 个检测器。具体新信息是:在协作生产模式下文档级检测器平均 AUROC 比 Prefix-Conditioned Continuation 低 12.0%,最大单检测器相对下降达 44.4%,且跨模式迁移不对称。局限是仅摘要级证据,未提供数据集开放情况与复现细节,检测器可靠性结论限于该基准设定。
72
正文
Computer Science > Computation and Language
arXiv:2609.32770 (cs)
[Submitted on 26 Sep 2026]
Title:C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text
Authors:Qing Yang, Zixiang Luo, Zhenyu Mao, Zezheng Wu, Xinghe Cheng, Haibo Chen, Qinggang Zhang, Jiapu Wang, Jingwei Zhang
View a PDF of the paper titled C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text, by Qing Yang and 8 other authors
View PDF
HTML (experimental)
Abstract:Large Language Models (LLMs) increasingly participate in writing by modifying or extending human drafts, causing machine involvement to vary in both form and extent. Yet most Machine-Generated Text (MGT) detectors are evaluated only on fully human-written versus fully AI-generated text. Because human--AI collaboration can weaken or redistribute cues associated with machine generation, strong performance under this binary setting may overstate detector reliability. This mismatch remains underexplored in Chinese: detection cues are shaped by tokenization and language-specific text distributions, yet controlled resources spanning production settings, domains, and generators remain limited. To fill this gap, we present a Chinese Human-AI Collaborative Text Detection Benchmark (C-HAT-Bench), a unified benchmark that links $5,000$ human-written source texts from five domains to more than $240,000$ variants produced using six generative models under Prefix-Conditioned Continuation as a reference setting and three collaborative production modes. We evaluate $21$ detectors through four protocols spanning zero-shot and pretrained supervised document-level detection, boundary localization, and cross-condition generalization. Relative to Prefix-Conditioned Continuation, mean AUROC across document-level detectors is $12.0\%$ lower on the collaborative production modes, with the largest detector-specific relative decrease reaching $44.4\%$. Transfer across collaborative production modes is also asymmetric, indicating that performance in a given production setting is not a reliable predictor of performance in other production settings.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.32770 [cs.CL]
(or
arXiv:2609.32770v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.32770
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Jiapu Wang [view email]
[v1]
Sat, 26 Sep 2026 16:46:51 UTC (11,656 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled C-HAT-Bench: Benchmarking Chinese AI-Text Detection Beyond Fully Generated Text, by Qing Yang and 8 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CL
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)