大模型
arxiv.org ·
打破双工壁垒:面向大语言模型训练的通道粒度 OCS 调度
该论文提出 LACE,首个为 LLM 训练独立分配发送(TX)与接收(RX)通道的离线 OCS 调度编译器。现有需求感知 OCS 调度器以双工端口对分配容量,强制双向等带宽,在非对称节点对流量下造成容量闲置。LACE 在不改变集合通信算法、操作顺序和 rank 布局的前提下,重构有向节点级需求,联合决定哪些连续操作共享配置以及每个方向使用多少单工电路,并在每节点通道清单与多 OCS 组网约束下实现为物理通道绑定和光路;软件确认经独立配置的返回路径回传,链路配置与恢复在通信恢复前完成校验。在三服务器固定拓扑测试床上,非对称连接相对对称拓扑基线实现通信重放 1.80×、GPT-2 训练 1.27× 加速;在每服务器 16 个 400 Gb/s 端口的大规模模拟中,LLaMA-3.1 70B 与 405B 调度相对最新双工 OCS 调度器实现 1.21–2.04× 通信加速。
AI推荐理由 arXiv 新论文,提出 LACE——首个为 LLM 训练独立分配发送/接收通道的离线 OCS 调度编译器,打破现有 OCS 调度器按双工端口对等分配带宽的限制。论文给出具体机制(重构有向节点级需求、联合决定配置共享与单工电路数量、软件确认与链路配置校验)和量化结果:三服务器测试床上通信重放加速 1.80×、GPT-2 训练加速 1.27×;LLaMA-3.1 70B/405B 调度模拟中相对最新双工 OCS 调度器加速 1.21–2.04×。局限在于主要结果来自模拟和固定拓扑小规模测试床,尚未见大规模真实集群验证。
78
正文
Computer Science > Networking and Internet Architecture
arXiv:2609.14253 (cs)
[Submitted on 13 Sep 2026]
Title:Breaking the Duplex Barrier: Lane-Granularity OCS Scheduling for LLM Training
Authors:Bangbo Liang, Yupeng Chen, Sicheng Zhao, Peihao Huang, Di Yang, Bohua Xu, Bin Yang, Shizhen Zhao, Guo Chen
View a PDF of the paper titled Breaking the Duplex Barrier: Lane-Granularity OCS Scheduling for LLM Training, by Bangbo Liang and 8 other authors
View PDF
HTML (experimental)
Abstract:Optical circuit switch (OCS) can reconfigure physical connectivity to match the predictable communication schedules of large language model (LLM) training. Although each OCS light path is physically simplex, existing demand-aware OCS schedulers allocate capacity in duplex-port pairs, forcing equal bandwidth in both directions and stranding capacity under asymmetric node-pair traffic.
This paper present LACE, the first offline OCS schedule compiler that independently allocates transmit (TX) and receive (RX) lanes for LLM training. Without changing the selected collective algorithms, operation order, or rank placement, LACE reconstructs directed node-level demand, jointly determines which consecutive operations share a configuration and how many simplex circuits serve each direction, and realizes these allocations as physical lane bindings and optical paths under per-node lane-inventory and multi-OCS fabric constraints. Software acknowledgments carry feedback over independently provisioned return paths, while coordinated link configuration and recovery verify each configuration before communication resumes. On a separate three-server testbed using fixed topologies and matched per-port rate limits, LACE's asymmetric connectivity achieves $1.80\times$ speedup for communication replay and $1.27\times$ for GPT-2 training over a symmetric-topology baseline. At larger scale, simulations of LLaMA-3.1 70B and 405B schedules with sixteen 400-Gb/s ports per server show that LACE achieves $1.21$--$2.04\times$ communication speedup over the latest duplex OCS scheduler.
Comments:
Subjects:
Networking and Internet Architecture (cs.NI)
Cite as:
arXiv:2609.14253 [cs.NI]
(or
arXiv:2609.14253v1 [cs.NI] for this version)
https://doi.org/10.48550/arXiv.2609.14253
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Bangbo Liang [view email]
[v1]
Sun, 13 Sep 2026 03:08:45 UTC (1,412 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Breaking the Duplex Barrier: Lane-Granularity OCS Scheduling for LLM Training, by Bangbo Liang and 8 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.NI
new
|
recent
| 2026-09
Change to browse by:
cs
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)