最新资讯
stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器 reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离
多元动态
登录 注册
开源工具 dev.to · @Interro

实测 Cloudflare Workers AI 免费层:可用的开源模型与限制

原文 我的收藏

作者通过 Cloudflare 模型目录 API 查询到 300 多个模型,但发现部分模型虽出现在目录中,实际推理请求会被拦截(如 zai-org/glm-5.3)。文章围绕三个问题展开:免费计划实际可用哪些模型、哪些适合编码、Cloudflare 的限制与 Groq、Cerebras 等提供商相比如何。

AI推荐理由 作者实测 Cloudflare Workers AI 免费层,通过模型目录 API 返回 300 多个模型,但发现部分模型在推理时被拦截,并对比 Groq、Cerebras 等提供商的限制。对选型有参考价值,但属个人测试,样本与结论未完整呈现,标题中'24 个强大 LLM'的结论在摘要中缺乏支撑,需谨慎看待。

60

正文

Most developers know about OpenAI, Anthropic, Groq, and Cerebras. What many developers don't realize is that Cloudflare Workers AI provides access to a large collection of open-source models through a single API endpoint. The interesting part? Many of these models are usable on Cloudflare's free tier. I recently decided to test Cloudflare Workers AI to answer three questions: Which models are actually available on the free plan? Which models are best for coding? How do Cloudflare's limits compare to Groq, Cerebras, and other providers? The results were honestly surprising. The Experiment Cloudflare exposes a model catalog API: Invoke-RestMethod -Uri "https://api.cloudflare.com/client/v4/accounts/$AccountId/ai/models/search" -Headers $Headers My account returned more than 300 models. Initially, I assumed that every model listed would be available. I was wrong. Some models appeared in the catalog but were blocked when inference requests were executed. For example: zai-org/glm-5.3 zai-org/glm-5.3-flash zai-org/glm-5.2 moonshotai/kimi-k2.6 moonshotai/kimi-k2.7-code returned: { "code": 5035, "message": "Model is not available on the Workers Free plan" } This led me to create a discovery script that: Enumerated all available models Executed a test inference Recorded successful responses Recorded paid-plan restrictions Models That Worked on the Free Tier After testing, these models successfully accepted inference requests. OpenAI openai/gpt-oss-20b openai/gpt-oss-120b Qwen qwen/qwen2.5-coder-32b-instruct qwen/qwen3-30b-a3b-fp8 qwen/qwen3.8-27b qwen/qwq-32b DeepSeek deepseek-ai/deepseek-r1-distill-qwen-32b Meta Llama meta/llama-3.1-8b-instruct-fp8 meta/llama-3.2-1b-instruct meta/llama-3.2-3b-instruct meta/llama-3.3-70b-instruct-fp8-fast meta/llama-4-scout-17b-16e-instruct Google Gemma google/gemma-2b-it-lora google/gemma-7b-it-lora google/gemma-4-26b-a4b-it aisingapore/gemma-sea-lion-v4-27b-it Mistral mistral/mistral-7b-instruct-v0.2-lora mistralai/mistral-small-3.1-24b-instruct ZAI @cf/zai-org/glm-4.7-flash IBM ibm-granite/granite-4.0-h-micro NVIDIA nvidia/nemotron-3-120b-a12b Biggest Surprise I initially started testing because I wanted access to GLM 5.3 Flash. The result? GLM 4.7 Flash ✅ GLM 5.2 ❌ GLM 5.3 ❌ GLM 5.3 Flash ❌ GLM 4.7 Flash was available on the free tier while all newer GLM models required a paid plan. Best Models For Coding After testing many providers over the last year, this is how I would rank the Cloudflare free models for software development. 🥇 GPT-OSS-120B @cf/openai/gpt-oss-120b Best overall coding model. Excellent at: Terraform Kubernetes DevOps AWS Architecture Refactoring Multi-file repositories If I could pick only one model, it would be GPT-OSS-120B. 🥈 Qwen2.5-Coder-32B @cf/qwen/qwen2.5-coder-32b-instruct Purpose-built coding model. Excellent at: Generating code Reviewing pull requests Fixing bugs Understanding repositories Continue.dev Cline This model consistently performs above its size class. 🥉 DeepSeek-R1-Distill-Qwen-32B @cf/deepseek-ai/deepseek-r1-distill-qwen-32b Best reasoning model. Excellent at: Root cause analysis Complex debugging Architecture reviews Agent workflows This is the model I would use when a pipeline breaks at 2 AM and nobody knows why. Honorable Mentions QWQ-32B @cf/qwen/qwq-32b Very strong reasoning. Llama 4 Scout @cf/meta/llama-4-scout-17b-16e-instruct Excellent balance of speed and intelligence. Llama 3.3 70B @cf/meta/llama-3.3-70b-instruct-fp8-fast Great for reviews, documentation, and system design. Understanding Cloudflare Limits One thing I wanted to understand was whether Cloudflare behaves like Groq. The answer is no. Groq commonly applies limits per model. For example: Model A → X RPM Model B → Y RPM Cloudflare works differently. Cloudflare's free tier provides: 10,000 Neurons per day This is effectively a daily AI budget shared across your account. Cloudflare also documents: 300 requests per minute for text generation workloads. So the practical model looks like: Account Level Daily Budget + Text Generation RPM + Model-Specific Overrides This is much closer to an account-level quota system than Groq's model-centric approach. Why This Matters Many developers assume they need: OpenAI Subscription Anthropic Subscription GPU Server RunPod AWS Inference Endpoint before they can build an AI product. For many projects, that's no longer true. A single free Cloudflare account can already provide access to: GPT-OSS-120B Qwen Coder 32B DeepSeek R1 QWQ 32B Llama 4 Scout Gemma 4 through a single API. That's enough to power: Coding assistants AI agents Internal copilots RAG applications Startup MVPs Developer tools without touching a GPU. Final Thoughts I started this experiment trying to use GLM 5.3 Flash on the Cloudflare free plan. Instead, I discovered something much more valuable. Cloudflare Free currently provides access to some genuinely powerful models, including GPT-OSS-120B, Qwen Coder 32B, DeepSeek R1 Distill, QWQ 32B, and Llama 4 Scout. For indie hackers, startup founders, and developers building agents, Cloudflare Workers AI might be one of the most underrated free inference platforms available today. If you're experimenting with AI tooling, it is absolutely worth testing before paying for another inference provider. What I Plan To Test Next How many real coding requests fit within 10,000 free neurons? Which free model provides the best cost-to-quality ratio? Cloudflare vs Groq vs Cerebras benchmarks Using Cloudflare Workers AI with Continue.dev Building AI agents entirely on free infrastructure Stay tuned.

来源报道 · 1 篇 · 以下链接均前往原始媒体

← 返回精选动态 原文

更多内容