大模型
pub.towardsai.net ·
@Codebook Fusion
不生成文本的 AI 模型 Jev：号称比 LLM 快至多 200 倍
Towards AI 介绍 Jev，一种不生成文本、而是返回带置信度分数的类型化决策的 AI 模型，文章称其速度可达 LLM 的 200 倍。该思路指向判别式决策模型在低延迟场景替代生成式 LLM 的可能，但摘要未提供基准细节与验证证据。
AI推荐理由 介绍一种不生成文本、而是返回带置信度的类型化决策的模型 Jev，声称比 LLM 快至多 200 倍。该方向（判别式/决策型模型替代生成式 LLM）对 Agent 与低延迟应用有潜在价值，但摘要未给出基准方法、测试条件或可验证证据，200x 属未经核实的宣传性数字，需保留不确定性。
62
正文
Member-only story
Machine Learning
Artificial Intelligence
Technology
Software Development
Language
The AI Model That Doesn’t Generate Text Is Up to 200x Faster
Jev is an AI model that doesn’t generate text. It returns typed decisions with confidence scores, up to 200x faster than LLMs. Here’s how it works.
Codebook Fusion
7 min read
·
Just now
--
Listen
Share
I spent a long time treating one thing as normal. I would ask a text generator a simple yes or no question, beg it to answer in JSON, parse the reply, and retry when it decided to write a paragraph instead. It never occurred to me that the model itself might be the wrong shape for the job.
READ HERE FOR FREE — FRIEND’S LINK
Press enter or click to view image in full size
IMAGE GENERATED BY CHATGPT
Then I read about a model that never writes a single word.
The short answer: On September 15, 2026, TypeSafe AI launched a model called Jev that produces only typed decisions: Choices, Scores, and Yes/No probabilities. It is an AI model that doesn’t generate text. It reads some information, answers a set of structured questions, and hands back values your code can use directly.
What Is an AI Model That Doesn’t Generate Text?
An AI model that doesn’t generate text is one built to output decisions instead of language. You give it an input and a list of questions with fixed answer formats. It returns categories, numbers, or…