最新资讯
reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离 wechat 这波杀疯了!旗舰级模型不限量、1个月视频额度免费领 bloomberg.com AI 抛售蔓延至信用市场,软银领跌亚洲美元债 dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露
多元动态
登录 注册
大模型 arxiv.org ·

打破双工壁垒:面向大语言模型训练的通道粒度 OCS 调度

原文 我的收藏

该论文提出 LACE,首个为 LLM 训练独立分配发送(TX)与接收(RX)通道的离线 OCS 调度编译器。现有需求感知 OCS 调度器以双工端口对分配容量,强制双向等带宽,在非对称节点对流量下造成容量闲置。LACE 在不改变集合通信算法、操作顺序和 rank 布局的前提下,重构有向节点级需求,联合决定哪些连续操作共享配置以及每个方向使用多少单工电路,并在每节点通道清单与多 OCS 组网约束下实现为物理通道绑定和光路;软件确认经独立配置的返回路径回传,链路配置与恢复在通信恢复前完成校验。在三服务器固定拓扑测试床上,非对称连接相对对称拓扑基线实现通信重放 1.80×、GPT-2 训练 1.27× 加速;在每服务器 16 个 400 Gb/s 端口的大规模模拟中,LLaMA-3.1 70B 与 405B 调度相对最新双工 OCS 调度器实现 1.21–2.04× 通信加速。

AI推荐理由 arXiv 新论文,提出 LACE——首个为 LLM 训练独立分配发送/接收通道的离线 OCS 调度编译器,打破现有 OCS 调度器按双工端口对等分配带宽的限制。论文给出具体机制(重构有向节点级需求、联合决定配置共享与单工电路数量、软件确认与链路配置校验)和量化结果:三服务器测试床上通信重放加速 1.80×、GPT-2 训练加速 1.27×;LLaMA-3.1 70B/405B 调度模拟中相对最新双工 OCS 调度器加速 1.21–2.04×。局限在于主要结果来自模拟和固定拓扑小规模测试床,尚未见大规模真实集群验证。

78

正文

Computer Science > Networking and Internet Architecture arXiv:2609.14253 (cs) [Submitted on 13 Sep 2026] Title:Breaking the Duplex Barrier: Lane-Granularity OCS Scheduling for LLM Training Authors:Bangbo Liang, Yupeng Chen, Sicheng Zhao, Peihao Huang, Di Yang, Bohua Xu, Bin Yang, Shizhen Zhao, Guo Chen View a PDF of the paper titled Breaking the Duplex Barrier: Lane-Granularity OCS Scheduling for LLM Training, by Bangbo Liang and 8 other authors View PDF HTML (experimental) Abstract:Optical circuit switch (OCS) can reconfigure physical connectivity to match the predictable communication schedules of large language model (LLM) training. Although each OCS light path is physically simplex, existing demand-aware OCS schedulers allocate capacity in duplex-port pairs, forcing equal bandwidth in both directions and stranding capacity under asymmetric node-pair traffic. This paper present LACE, the first offline OCS schedule compiler that independently allocates transmit (TX) and receive (RX) lanes for LLM training. Without changing the selected collective algorithms, operation order, or rank placement, LACE reconstructs directed node-level demand, jointly determines which consecutive operations share a configuration and how many simplex circuits serve each direction, and realizes these allocations as physical lane bindings and optical paths under per-node lane-inventory and multi-OCS fabric constraints. Software acknowledgments carry feedback over independently provisioned return paths, while coordinated link configuration and recovery verify each configuration before communication resumes. On a separate three-server testbed using fixed topologies and matched per-port rate limits, LACE's asymmetric connectivity achieves $1.80\times$ speedup for communication replay and $1.27\times$ for GPT-2 training over a symmetric-topology baseline. At larger scale, simulations of LLaMA-3.1 70B and 405B schedules with sixteen 400-Gb/s ports per server show that LACE achieves $1.21$--$2.04\times$ communication speedup over the latest duplex OCS scheduler. Comments: Subjects: Networking and Internet Architecture (cs.NI) Cite as: arXiv:2609.14253 [cs.NI] (or arXiv:2609.14253v1 [cs.NI] for this version) https://doi.org/10.48550/arXiv.2609.14253 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Bangbo Liang [view email] [v1] Sun, 13 Sep 2026 03:08:45 UTC (1,412 KB) Full-text links: Access Paper: View a PDF of the paper titled Breaking the Duplex Barrier: Lane-Granularity OCS Scheduling for LLM Training, by Bangbo Liang and 8 other authors View PDF HTML (experimental) TeX Source view license Current browse context: cs.NI new | recent | 2026-09 Change to browse by: cs References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation × loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer (What is the Explorer?) Connected Papers Toggle Connected Papers (What is Connected Papers?) Litmaps Toggle Litmaps (What is Litmaps?) scite.ai Toggle scite Smart Citations (What are Smart Citations?) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv (What is alphaXiv?) Links to Code Toggle CatalyzeX Code Finder for Papers (What is CatalyzeX?) DagsHub Toggle DagsHub (What is DagsHub?) GotitPub Toggle Gotit.pub (What is GotitPub?) Huggingface Toggle Hugging Face (What is Huggingface?) ScienceCast Toggle ScienceCast (What is ScienceCast?) Demos Demos Replicate Toggle Replicate (What is Replicate?) Spaces Toggle Hugging Face Spaces (What is Spaces?) Spaces Toggle TXYZ.AI (What is TXYZ.AI?) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower (What are Influence Flowers?) Core recommender toggle CORE Recommender (What is CORE?) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容