最新资讯
stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器 reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离
多元动态
登录 注册
智能体 x.com · @hwchase17

LangChain 分享降低编码 Agent 成本的三步实践

原文 我的收藏

Harrison Chase 表示其编码 Agent 成本连续第二个月显著下降,并给出三步做法:用 LangSmith 追踪实现细粒度成本可见性;通过 LLM gateway 设置用户级成本上限;优化 harness,包括使用开源云 Agent harness OpenSWE 和模型路由。完整博客后续发布。

AI推荐理由 LangChain 作者分享降低编码 Agent 成本的三步实践:通过 LangSmith 做成本可见性、通过 LLM gateway 设置用户级成本上限、优化 harness(如 OpenSWE 和模型路由)。属于一线开发者经验分享,有具体做法和链接,但成本下降幅度未给出量化数据,且带有自家产品推广成分。

66 浏览 3,379 点赞 50 评论 34 转发 2

正文

we're seeing our coding agent costs decrease significantly for second month in row longer blog on this later, but three quick steps we took 1/ cost visibility. you cant control what you cant measure. Start tracking everything to langsmith. This gives us super granular visibility into who is using what, how they are using it, etc. LangSmith supports first party integrations with all main coding harnesses [langchain.com/blog/your-codi…](https://www.langchain.com/blog/your-coding-agents-are-a-black-box-heres-how-to-crack-them-open) 2/ cost controls. Through our LLM gateway, set user level cost caps. (You can increase your cap by talking to our VPE). This helps curb unexpected or accidental spend. [docs.langchain.com/langsmith/llm-…](https://docs.langchain.com/langsmith/llm-gateway) 3/ optimize the harness. Obviously 3rd party harnesses are tougher to optimize, but we are doing more and more coding through OpenSWE, our open source cloud agent harness. Things like model routing help bring the cost down [langchain.com/blog/how-to-bu…](https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness) feel free to reach out if you want help implementing these at your co! ![Tweet Image](https://pbs.twimg.com/media/HTx8f9BXsAAQzjx.jpg)

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容