大模型
arxiv.org ·
文化分歧保留:诊断 LLM 模拟调查人群中的扁平化与漫画化
该论文针对 LLM 作为合成调查受访者估计人群分布的场景,指出现有 Jensen-Shannon 散度等距离指标无法直接刻画跨国差异,提出基于一次性人工校准的轻量诊断指标 Cultural Divergence Preservation(CDP),将跨国分歧缩小定义为文化扁平化、放大定义为文化漫画化。实验覆盖 4 个 LLM 主干、3 种 persona 提示方法和 WVS、Big Five 两个调查域,结果显示传统保真度指标与 CDP 存在系统性偏差:CDP 随跨国分歧衰减或放大单调变化,而 JSD 变化相对较小;DeepPersona-Inspired 提示常被传统指标偏好,却在每个模型-领域组合中表现出最强扁平化。
AI推荐理由 arXiv 预印本,作者与摘要信息完整,提出可复现的诊断指标 CDP,并给出跨 4 个 LLM 主干、3 种 persona 提示方法、WVS 与 Big Five 两个调查域的对照实验,指出传统 JSD 保真度指标与 CDP 存在系统性偏差,DeepPersona-Inspired 提示在保真度指标上占优却出现最强文化扁平化。局限在于仅为预印本、未经同行评审,摘要未给出具体数值与人类校准细节,结论需进一步验证。
72
正文
Computer Science > Computation and Language
arXiv:2609.29928 (cs)
[Submitted on 24 Sep 2026]
Title:Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations
Authors:Yeeun Chae, Yewon Choi, Seunghyun Lee, IL Im
View a PDF of the paper titled Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations, by Yeeun Chae and 3 other authors
View PDF
HTML (experimental)
Abstract:Large language models (LLMs) are increasingly used as synthetic survey respondents to estimate population response distributions. In cross-cultural survey simulation, evaluations should assess not only distributional fidelity within countries but also whether differences across countries are preserved. However, existing distance-based metrics such as Jensen--Shannon divergence (JSD) do not directly capture such cross-country differences. To address this limitation, we introduce Cultural Divergence Preservation (CDP), a reference-light diagnostic based on a one-time human calibration. CDP identifies reduced cross-country divergence as cultural flattening and increased divergence as cultural caricature. To evaluate CDP, we conduct experiments across four LLM backbones, three persona-based prompting methods, and two survey domains, the World Values Survey (WVS) and the Big Five Personality Test. The results reveal a systematic discrepancy between conventional fidelity metrics and CDP. Controlled experiments show that CDP changes monotonically as cross-country divergence is attenuated or amplified, while the corresponding changes in JSD remain relatively small. In our audit of real LLM generations, DeepPersona-Inspired prompting is frequently favored by conventional fidelity metrics but exhibits the strongest flattening in every model--domain block. CDP thus complements fidelity metrics by directly quantifying the attenuation or amplification of cross-country divergence.
Comments:
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.29928 [cs.CL]
(or
arXiv:2609.29928v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.29928
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Yeeun Chae [view email]
[v1]
Thu, 24 Sep 2026 14:59:06 UTC (4,175 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations, by Yeeun Chae and 3 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CL
new
|
recent
| 2026-09
Change to browse by:
cs
cs.AI
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)