论文研究
arxiv.org ·
UFO:多模态图像生成中全条件对齐的评估链
该论文提出 UFO,一个面向多模态图像生成全条件对齐的统一评估框架。它引入原子化评估链范式,将全条件对齐分解为细粒度、解耦的原子评估单元(AEU),按模态相关性分类后用通用或专用功能调用验证。作者称 UFO 与人类评估偏好的相关性最高,平均提升 15.25%,并发布 UFO-Bench 基准,用于评估现有定制模型在文本与视觉条件交互下的表现。论文被 ICML 2026 接收。
AI推荐理由 arXiv 论文(ICML 2026 接收),提出 UFO 统一评估框架,将多模态图像生成的全条件对齐拆解为原子化评估单元链,并给出 UFO-Bench 基准;摘要称与人类偏好相关性平均提升 15.25%。新信息在于评估方法从单模态孤立评估转向同时条件对齐评估,对 subject-driven 定制生成模型的评测有实际用途;局限是仅依据摘要,未提供具体实验设置与复现细节,提升幅度需看原文验证。
72
正文
Computer Science > Computer Vision and Pattern Recognition
arXiv:2609.12397 (cs)
[Submitted on 11 Sep 2026 (v1), last revised 17 Sep 2026 (this version, v2)]
Title:UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation
Authors:Danning Zhang, Yijing Lin, Shuhan Zhuang, Mengqi Huang, Shaojin Wu, Shancheng Fang, Zhendong Mao
View a PDF of the paper titled UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation, by Danning Zhang and 6 other authors
View PDF
HTML (experimental)
Abstract:Multi-modal image generation, particularly subject-driven customization, has garnered growing attention in recent years. Despite the rapid advancement of generative models, their evaluation remains largely lagging. Existing methods, whether embedding-based or Multi-modal Large Language Model (MLLM)-based, evaluate alignment with each modal condition in isolation, which contradicts the simultaneous condition alignment objective of multi-modal image generation, leading to poor consistency with human judgments. To address this challenge, we propose UFO, the first unified framework for omni-condition alignment simultaneous evaluation. Specifically, UFO introduces a novel Atomized Chain-of-Evaluation paradigm, i.e., it first decomposes omni-condition alignment into a sequential chain of fine-grained, disentangled Atomic Evaluation Units (AEUs), categorizes them into distinct modality-relevance classes, and then employs general or dedicated functional calls for accurate verification of different AEU types. Experimental results demonstrate that UFO achieves the highest correlation with human evaluation preferences, delivering an average improvement of 15.25%. Furthermore, we present UFO-Bench, a dedicated benchmark designed to holistically evaluate the performance of existing customization models under the diverse mutual interactions of textual and visual conditions.
Comments:
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.12397 [cs.CV]
(or
arXiv:2609.12397v2 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2609.12397
Focus to learn more
arXiv-issued DOI via DataCite
Journal reference:
Proceedings of the Forty-Third International Conference on Machine Learning, 2026
Submission history
From: Danning Zhang [view email]
[v1]
Fri, 11 Sep 2026 03:40:11 UTC (26,707 KB)
[v2]
Thu, 17 Sep 2026 13:13:59 UTC (26,711 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation, by Danning Zhang and 6 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.CV
new
|
recent
| 2026-09
Change to browse by:
cs
cs.AI
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)