开源工具
x.com ·
@AnthropicAI
Anthropic 发布 FlashProve：可验证推理进展并开源代码
Anthropic 介绍 FlashProve，基于密码学技术让开发者验证某条回复是否由指定 AI 模型生成，称其效率显著高于此前的开源方法。应用包括防止聊天被劫持、让安全评估者确认被测模型与线上服务模型一致。Anthropic 已开源代码并列出合作者，完整细节见其研究文章。
AI推荐理由 Anthropic 公布可验证推理研究 FlashProve，声称可验证某条回复是否来自指定模型，且效率显著优于既有开源方法，并开源代码、列出合作者；对模型可信部署、防劫持和安全评估有实际用途。效率对比的具体数据未在片段中给出，需以论文为准。
82
正文
New Anthropic research: progress on provable inference for large language models.
Here, we introduce FlashProve. Building on established cryptographic techniques, FlashProve allows developers to verify whether a given response came from a given AI model. It’s substantially more efficient than prior open-source methods for doing so.
These proofs have a range of applications. They can, for instance, make it harder for attackers to hijack a chat, or enable safety evaluators to verify that the model they’re testing is the same one being served to customers.
For our full write-up, see here:
anthropic.com/research/prova…
Further progress in provable inference will likely be an important part of improving trust in AI deployment. To that end, we're open-sourcing FlashProve’s code, here:
github.com/anthropics/Fla…
We’re grateful to our collaborators: Alessandro Chiesa,
@GiacomoFenzi
,
@gwberg95
,
@miranda__christ
, Rahul Dalal (
rdalal.github.io
) and Ben Mayer (
@transmissions11
).