论文研究
arxiv.org ·
面向 TEE 认证的差分隐私:在旧代 GPU 上实现可验证的差分隐私训练
该论文研究如何在训练过程中认证差分隐私(DP)被忠实执行:外部验证者无需访问私有训练数据即可检查模型是否按声明的 DP 保护训练。作者指出零知识证明等密码学方案开销过大,而 TEE 方案的多 GPU 支持目前仅限较新平台,旧代 GPU 上缺失或低效。为此提出用 CPU 侧 TEE 配合不可信 GPU 的框架:将昂贵的梯度计算卸载到 GPU,由 CPU TEE 通过概率性检查验证梯度上 DP 的正确执行。作者称该方法能以高概率检测频繁的完全偏离,对面向效用的伪造梯度攻击,稀疏偏离带来的效用收益有限且未观察到额外的成员泄露;实验显示相比标准 GPU DP 训练仅增加适度开销。
AI推荐理由 arXiv 密码学与安全方向新论文,提出用 CPU 侧 TEE 配合不可信 GPU 实现可验证的差分隐私训练,核心思路是把梯度计算卸载到 GPU、由 CPU TEE 通过概率性检查验证 DP 是否被正确执行,从而在旧代 GPU 上也能获得可认证的 DP 训练。摘要给出了明确的问题动机(零知识证明开销过大、多 GPU TEE 支持局限于新平台)和设计取舍,并声称对频繁的完全偏离检测概率高、对稀疏偏离的伪造梯度攻击收益有限,开销相比标准 GPU DP 训练仅小幅增加。局限在于:结论均来自论文自述,尚无第三方复现或实际部署证据,'近乎免费午餐'的表述需谨慎看待;且未提供具体实验规模与数据集细节。对关注隐私计算、可信执行环境与合规训练的研究者和工程团队有参考价值。
72
正文
Computer Science > Cryptography and Security
arXiv:2609.20532 (cs)
[Submitted on 17 Sep 2026]
Title:Towards TEE-Certified DP: Verifiable Differentially Private Training on Legacy GPUs
Authors:Li Ge, Wenjie Qu, Weitao Feng, Yi Zeng, Jiaheng Zhang, Xiaofeng Wang, Wei Dong
View a PDF of the paper titled Towards TEE-Certified DP: Verifiable Differentially Private Training on Legacy GPUs, by Li Ge and 6 other authors
View PDF
HTML (experimental)
Abstract:Wide adoption of machine learning has created growing policy and regulatory demand for protecting sensitive training data, with differential privacy (DP) emerging as a key mechanism. Yet a less-studied problem is how to certify the faithful execution of DP during training: an external verifier should be able to check that a released model was trained with proper DP protection, without accessing the private training data. Existing cryptographic approaches, such as zero-knowledge proofs, provide strong guarantees but often incur prohibitive overhead, in some cases by orders of magnitude. Trusted Execution Environments (TEEs) offer a more efficient alternative, but the multi-GPU TEE support needed for training and fine-tuning large language models remains limited to recent platforms and is absent or inefficient on legacy GPUs.
To address this, we propose a practical framework for verifiable DP training using CPU-side TEEs together with untrusted GPUs. Our design addresses a fundamental efficiency-security tension: training entirely inside a CPU TEE is too slow, while unrestricted GPU offloading can allow malicious deviations from DP. We therefore offload expensive gradient computation to GPUs, while using the CPU TEE to efficiently verify the correct enforcement of DP on gradients through probabilistic checking. Our framework detects frequent full deviations from DP with high probability; for the utility-oriented forged-gradient attacks evaluated in this work, sparse deviations provide limited utility benefit and show no measurable additional membership leakage. Experiments further show that our approach nearly achieves a ``free lunch'': it incurs only modest overhead compared with standard GPU-based DP training, while effectively constraining malicious deviations from the claimed DP execution.
Subjects:
Cryptography and Security (cs.CR)
Cite as:
arXiv:2609.20532 [cs.CR]
(or
arXiv:2609.20532v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2609.20532
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Li Ge [view email]
[v1]
Thu, 17 Sep 2026 15:06:30 UTC (249 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Towards TEE-Certified DP: Verifiable Differentially Private Training on Legacy GPUs, by Li Ge and 6 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CR
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)