大模型
arxiv.org ·
STHMoE:面向基于大语言模型的城市交通数据预测的超图增强异构依赖协调
该论文提出 STHMoE,一个时空超图增强的混合专家框架,用于城市交通数据预测。方法将交通动态解耦为频域、时域、空域和高阶空间四类表示,由基于部分冻结 LLM 骨干的提示引导异构专家分别建模:前三类专家使用领域统计提示,高阶空间专家使用结构占位提示并从自适应超图模块获取依赖信息。模型无需预定义拓扑即可联合学习一阶图依赖与高阶群体交互,并采用熵感知 MoE 路由与变异系数负载均衡自适应融合专家输出。在 10 个真实交通基准上,作者称其性能与时间模型、时空图模型及 LLM 基线相比具有竞争力。
AI推荐理由 arXiv 预印本,作者与摘要信息完整,方法描述具体(频域/时域/空域/高阶空间四类专家、部分冻结 LLM 骨干、自适应超图模块、熵感知 MoE 路由与变异系数负载均衡),并在 10 个真实交通数据集上与时间、时空图及 LLM 基线对比。局限:仅称取得 competitive 性能,未给出具体指标或提升幅度,且为预印本未经同行评审;应用面偏交通预测这一垂直领域,对通用 AI/Agent 生态的直接价值有限。
62
正文
Computer Science > Artificial Intelligence
arXiv:2609.15172 (cs)
[Submitted on 14 Sep 2026]
Title:STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting
Authors:Jiawen Chen, Qi Shao, Yongjian Chang, Mingtong Zhou, Duxin Chen, Wenwu Yu
View a PDF of the paper titled STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting, by Jiawen Chen and 5 other authors
View PDF
HTML (experimental)
Abstract:Spatio-temporal traffic forecasting is a fundamental big data analytics task for intelligent transportation systems, where massive urban sensor streams exhibit heterogeneous, non-stationary, and structurally dynamic patterns. Although recent deep learning and large language model (LLM)-based methods have advanced traffic forecasting, they often remain temporally centered and lack effective coordination of temporal, spectral, pairwise spatial, and higher-order structural cues under evolving traffic regimes. To address this heterogeneous dependency coordination problem, we propose STHMoE, a Spatio-Temporal Hypergraph-Enhanced Mixture of Experts framework for urban traffic data forecasting. STHMoE decouples traffic dynamics into frequency-domain, time-domain, spatio-domain, and higher-order spatial representations, which are modeled by prompt-guided heterogeneous experts built upon a partially frozen LLM backbone. The first three experts leverage domain-specific statistical prompts, while the higher-order spatio expert uses a structural placeholder prompt and obtains dependency information from an adaptive hypergraph module. To capture evolving spatial structures in traffic data,, STHMoE jointly learns first-order graph dependencies and higher-order group interactions without predefined topologies. An entropy-aware MoE router with coefficient-of-variation load balancing adaptively fuses expert outputs while improving expert utilization and routing confidence. Experiments on 10 real-world traffic benchmarks show that STHMoE achieves competitive performance against temporal, spatio-temporal graph, and LLM-based baselines.
Subjects:
Artificial Intelligence (cs.AI)
Cite as:
arXiv:2609.15172 [cs.AI]
(or
arXiv:2609.15172v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.15172
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Jiawen Chen [view email]
[v1]
Mon, 14 Sep 2026 07:57:54 UTC (5,222 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting, by Jiawen Chen and 5 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.AI
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)