大模型
arxiv.org ·
多模态大语言模型指纹识别
该论文提出首个多模态大模型指纹识别研究,针对 MLLM 被非法部署和未授权蒸馏的问题。方法包括白盒溯源方案 AttnPrint,提取跨模态注意力分布的低频分量作为模型指纹;以及黑盒审计方案 DistillTrace,通过对 MLLM 输出做假设检验识别潜在侵权。作者在 19 种多模态架构的 154 个模型实例上实验,称 AttnPrint 对衍生模型检测有效且对五种下游修改技术保持鲁棒,DistillTrace 在三种参数无关技术下给出蒸馏关系证据。
AI推荐理由 arXiv 论文,作者提出首个多模态大模型指纹识别研究:AttnPrint 利用跨模态注意力低频分量做白盒溯源,DistillTrace 通过输出假设检验做黑盒蒸馏审计,在 19 种多模态架构、154 个模型实例上实验,并称对五类下游修改保持鲁棒。新信息在于把模型指纹从纯文本 LLM 扩展到多模态并针对蒸馏侵权,对模型版权与合规有实际用途;局限是摘要未给出具体检测指标与误报率,鲁棒性结论仅来自作者自述实验,尚待复现。
72
正文
Computer Science > Cryptography and Security
arXiv:2609.20457 (cs)
[Submitted on 17 Sep 2026]
Title:Fingerprinting Multimodal Large Language Models
Authors:Chao Huang, Meng Tong, Kejiang Chen
View a PDF of the paper titled Fingerprinting Multimodal Large Language Models, by Chao Huang and 2 other authors
View PDF
HTML (experimental)
Abstract:While multimodal large language models (MLLMs) enable a wide range of image-text reasoning tasks, recent incidents indicate that they are vulnerable to illicit deployment and unauthorized distillation. Existing solutions for model provenance are typically confounded by shared language backbones in MLLMs and struggle to detect violations of distillation. To bridge this gap and safeguard model ownership, we present the first study on multimodal model fingerprinting. Inspired by recent findings that self-attention acts as a low-pass filter and that its low-frequency components are informative, we develop AttnPrint for white-box provenance. Specifically, we extract cross-modal attention distributions and isolate their low-frequency components to serve as model fingerprints. To facilitate black-box auditing, we further introduce DistillTrace, which employs hypothesis testing of MLLM outputs to identify potential model infringement. We conduct extensive experiments on 154 model instances across 19 multimodal architectures. Notably, AttnPrint achieves strong derivative-model detection performance while remaining robust to five downstream modification techniques. DistillTrace also provides evidence of distillation relationships under three parameter-independent techniques.
Comments:
Subjects:
Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.20457 [cs.CR]
(or
arXiv:2609.20457v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2609.20457
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Chao Huang [view email]
[v1]
Thu, 17 Sep 2026 14:21:39 UTC (890 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Fingerprinting Multimodal Large Language Models, by Chao Huang and 2 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CR
new
|
recent
| 2026-09
Change to browse by:
cs
cs.AI
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)