智能体
arxiv.org ·
@Nikolaos Aletras
一项人权值多少钱?ECtHR-NPD:非金钱损害赔偿预测基准
现有法律基准覆盖多种任务,但连续金额赔偿这一方向相对欠缺。本文提出 ECtHR-NPD,据称是首个在无成文公式或明确计算规则的情况下,依据案件信息预测欧洲人权法院(ECtHR)非金钱损害赔偿(NPD)金额的基准,包含 14,575 个案件、案件级名义欧元赔偿额、按时间切分的数据,以及将目标构建与模型输入分离的协议。作者评测了常数预测器、梯度提升树、检索方法、微调编码器语言模型、提示式解码器语言模型和知识增强智能体等方法,结果显示更复杂的语言模型与智能体方法并未稳定优于最强的特征基线,各模型族在识别零赔偿和高额赔偿校准上均表现困难。
AI推荐理由 提出 ECtHR-NPD,据称是首个从案件信息预测欧洲人权法院非金钱损害赔偿金额的基准,包含 14,575 个案件、按时间切分,并设计协议将目标构建与模型输入分离。评测覆盖常数预测器、梯度提升树、检索方法、微调编码器语言模型、提示式解码器语言模型和知识增强智能体,结果显示更复杂的语言模型与智能体方法并未稳定优于最强的特征基线,且各模型族在识别零赔偿和高额赔偿校准上均存在困难。对法律 AI 与基准设计有参考意义,但摘要未给出具体误差数值。
60
正文
Computer Science > Computation and Language
arXiv:2609.18908v1 (cs)
[Submitted on 16 Sep 2026]
Title:How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards
Authors:Yanyi Pu, Damian A. Gonzalez-Salzberg, Zheng Yuan, Nikolaos Aletras
View a PDF of the paper titled How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards, by Yanyi Pu and 3 other authors
View PDF
HTML (experimental)
Abstract:Existing legal benchmarks cover diverse tasks, while continuous monetary remedies remain comparatively underexplored. We introduce ECtHR-NPD, to the best of our knowledge, the first benchmark for predicting non-pecuniary damage (NPD) awards at the European Court of Human Rights (ECtHR) from case information when no statutory formula or explicit calculation rule determines the amount. ECtHR-NPD contains 14,575 cases with case-level awards in nominal euros, chronological splits, and a protocol separating target construction from model input. We evaluate a battery of methods, including constant predictors, gradient-boosted trees, retrieval methods, fine-tuned encoder language models (LMs), prompted decoder LMs, and knowledge-augmented agents. Our results show that more sophisticated LM and agentic approaches do not consistently outperform the strongest feature-based baseline. All model families struggle to identify zero awards and to calibrate high-award predictions, with further degradation on the Challenging test view, making ECtHR-NPD a challenging testbed for current state-of-the-art open-weight and proprietary LMs.
Comments:
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2609.18908 [cs.CL]
(or
arXiv:2609.18908v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.18908
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Yanyi Pu [view email]
[v1]
Wed, 16 Sep 2026 16:49:48 UTC (1,779 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled How Much is a Human Right Worth? ECtHR-NPD: A Benchmark for Predicting Non-Pecuniary Damage Awards, by Yanyi Pu and 3 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CL
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)