最新资讯
dev.to 如何在专用 GPU 服务器上用 OpenAI 兼容 API 部署 LLM dev.to 审计 153 份 Claude Code 与 Codex 会话记录:User-Agent 与 URL 中的邮箱泄露 dev.to 你的 Agent Harness 应具备的 17 项能力 dev.to 离线 AI 记忆中 0.8 余弦阈值为何失效 dev.to Kimi K3.1 Pro 开放权重:自托管 2.8T 模型前的开发者清单 dev.to 如何通过工具调用引导模型以提升 Harness 质量 dev.to AI Agent 审计轨迹不等于对话记录 dev.to 精简 MCP server 工具数量:更少工具、更小影响面,双重收益 dev.to 为什么 git checkout 无法撤销 AI 编码 agent 的改动? wechat AI短剧门槛降降降!实测即梦短剧工作室:剧本分镜预演一条龙,伙伴计划长期护航 dev.to 让模型改写文档前,先量化事实保真度 dev.to 回放 153 个 Claude Code 与 Codex 会话,审计 Agent 的生产影响范围
多元动态
登录 注册
行业动态 marktechpost.com · @Asif Razzaq

Fireworks AI 发布 Ember-1:基于 Kimi K3 后训练,token 用量约减少 40%

原文 我的收藏

Fireworks AI 发布 Ember-1,这是对 Kimi K3 进行后训练的版本,让模型学会生成更短的推理轨迹,而不是降低推理强度。据 Fireworks 称,在生产 A/B 测试中每任务输出 token 从 49.3K 降至 29.9K,约减少 40%,得分基本不变。Ember-1 目前以 API-only Research Preview 形式提供,定价与 Kimi K3 相同。

AI推荐理由 Fireworks AI 发布基于 Kimi K3 后训练的 Ember-1,核心新信息是通过缩短推理轨迹而非降低推理强度,在生产 A/B 测试中把每任务输出 token 从 49.3K 降到 29.9K(约减少 40%)且分数基本不变,并以 API-only Research Preview 形式按 Kimi K3 价格提供。数据来自厂商自述,尚无第三方复现,但属于可验证的模型效率方向。

80

正文

Editors Pick Agentic AI Artificial Intelligence AI Infrastructure Technology AI Shorts Applications For Devs Language Model Large Language Model Machine Learning New Releases Staff Tech News Fireworks AI has released Ember-1, a specialized model from Fireworks Research built by post-training Moonshot AI’s open-weight Kimi K3. Ember-1 learns to produce shorter reasoning traces while keeping task accuracy. This is different from lowering the reasoning effort setting at inference time. According to the Fireworks release post, Ember-1 delivers Kimi K3’s quality with about 40% fewer tokens. Is it deployable? Yes, but only through the Fireworks serverless API as a Research Preview. Fireworks has not released Ember-1’s weights, training code, or exact training algorithms, so self-hosting is not an option today. The Problem: Reasoning Models Think Too Much Fireworks team reports that reasoning models like Kimi K3 sometimes spend more than 90% of generated tokens on internal reasoning. That cost compounds in multi-turn agentic workloads. Each turn replays prior reasoning back to the model. Context grows roughly quadratically with the number of turns. Long traces from early turns get re-read, and re-billed, on every later call. Fireworks team explains how customers wanted K3’s coding capability at lower cost. Turning down K3’s reasoning effort did not solve it. Lower effort settings gave up too much quality. So the team trained the model to reason more efficiently instead. How Fireworks Research Built Ember-1 Not all of K3’s reasoning is waste. Some of it is useful self-reflection, like revisiting an assumption or reacting to feedback. Ember-1 keep that behavior while cutting redundant reasoning and unproductive loops. The training collection spans mathematics, coding, instruction following, conversation, search, tool use, and software engineering. It covers both standalone problems and extended multi-step interactions. Task and environment feedback guides on-policy planning and learning. Fireworks team ran more than 50 training experiments and over 200 evaluations. They also developed new training algorithms, which it has not published. All training ran on Fireworks Serverless Training. Fireworks states it used its own data and no customer data. Benchmark Results Fireworks compared Ember-1 with Kimi K3 at three reasoning effort levels. Cost was computed with public Kimi K3 API pricing. These are Fireworks’ own published evaluations. BenchmarkNK3 LowK3 HighK3 MaxEmber-1Ember-1 vs K3 Max (cost)Terminal Bench 2.18976.4%77.6%80.9%82.0%-51.9% / -23.1 USDSWE-bench Verified50080.4%86.0%93.2%92.2%-15.5% / -68.1 USDSWE-Interact756.7%13.3%21.3%20.0%-32.5% / -60.8 USDDeepSWE 1.111355.8%62.8%66.4%75.2%-23.7% / -126.9 USDτ-2 Bench Airline5064%64%64%66%-5.9% / -0.3 USD Ember-1 leads K3 Max on Terminal Bench 2.1 and DeepSWE 1.1. It trails slightly on SWE-bench Verified and SWE-Interact. Across seven benchmarks and two customers’ production traffic, Fireworks says K3’s reasoning was shortened by 35 to 50% without sacrificing accuracy. On Doximity’s Bedside Bench, a physician-validated set of 500 clinical cases, Ember-1 set a new cost-per-task Pareto frontier. That result comes from Fireworks’ new Specialized Intelligence Index. Production A/B Test Results Fireworks ran live A/B tests with 2 customers on production coding workloads. Both saw roughly 35% fewer tokens per task at comparable quality. In the published run, output tokens fell from 49.3K to 29.9K per task. Reasoning tokens dropped 71.3% and total tokens dropped 39%. The task score was essentially unchanged: 0.753 for Ember-1 versus 0.751 for K3. Average steps fell from 23.8 to 21.4. One customer now runs Ember-1 in production. Ember-1 costs the same per token as Kimi K3 on Fireworks: $3.00 input, $0.30 cached input, and $15.00 output per 1M tokens. The savings come entirely from generating fewer tokens. At that output rate, the A/B figures work out to about $0.74 versus $0.45 in output cost per task (our calculation, output only). Interactive Explainer Key Takeaways Ember-1 is Kimi K3 post-trained to reason in fewer tokens, not run at lower effort. Fireworks reports about 40% fewer tokens with accuracy held across its evaluations. In a production A/B test, output fell from 49.3K to 29.9K tokens per task at a 0.753 vs 0.751 score. It beats K3 Max on Terminal Bench 2.1 (82.0%) and DeepSWE 1.1 (75.2%), trailing on SWE-bench Verified (92.2%). API-only Research Preview at K3 pricing; weights and training code are not released. Check out the Technical Details. All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well. Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us Asif Razzaq Website |  + postsBio ⮌ Asif Razzaq is the CEO of Marktechpost AI Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences. Asif Razzaq 20 Agentic Use Cases of TypeSafe AI’s Jev Asif Razzaq Google Research Introduces an AI Video Co-Director: 4 Agentic Frameworks for Coherent, Minutes-Long Video Generation Asif Razzaq AI Coding Agents for Enterprise: IP Indemnity, Data Residency and 500-Seat Cost Compared Asif Razzaq Sarvam AI Releases Saaras V4: A Speech-to-Text Model for All 22 Indian Languages and Global English

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容