智能体
x.com ·
@hwchase17
LangChain 分享降低编码 Agent 成本的三步实践
Harrison Chase 表示其编码 Agent 成本连续第二个月显著下降,并给出三步做法:用 LangSmith 追踪实现细粒度成本可见性;通过 LLM gateway 设置用户级成本上限;优化 harness,包括使用开源云 Agent harness OpenSWE 和模型路由。完整博客后续发布。
AI推荐理由 LangChain 作者分享降低编码 Agent 成本的三步实践:通过 LangSmith 做成本可见性、通过 LLM gateway 设置用户级成本上限、优化 harness(如 OpenSWE 和模型路由)。属于一线开发者经验分享,有具体做法和链接,但成本下降幅度未给出量化数据,且带有自家产品推广成分。
66
浏览 3,379
点赞 50
评论 34
转发 2
正文
we're seeing our coding agent costs decrease significantly for second month in row
longer blog on this later, but three quick steps we took
1/ cost visibility. you cant control what you cant measure. Start tracking everything to langsmith. This gives us super granular visibility into who is using what, how they are using it, etc. LangSmith supports first party integrations with all main coding harnesses [langchain.com/blog/your-codi…](https://www.langchain.com/blog/your-coding-agents-are-a-black-box-heres-how-to-crack-them-open)
2/ cost controls. Through our LLM gateway, set user level cost caps. (You can increase your cap by talking to our VPE). This helps curb unexpected or accidental spend. [docs.langchain.com/langsmith/llm-…](https://docs.langchain.com/langsmith/llm-gateway)
3/ optimize the harness. Obviously 3rd party harnesses are tougher to optimize, but we are doing more and more coding through OpenSWE, our open source cloud agent harness. Things like model routing help bring the cost down [langchain.com/blog/how-to-bu…](https://www.langchain.com/blog/how-to-build-a-model-router-in-the-harness)
feel free to reach out if you want help implementing these at your co!
