大模型
x.com ·
@OpenAI
OpenAI 推出 LifeVal 基准，衡量模型处理日常任务的能力
OpenAI 宣布构建 LifeVal 基准，依据数千名 ChatGPT 用户反馈，聚焦个人助理最常被需要的日常任务，包括寻找托儿服务、获取政府服务和家庭财务管理。OpenAI 称过去一年已用该基准衡量并改进模型表现，详情见官方页面。
AI推荐理由 OpenAI 官方账号发布 LifeVal 基准，声称基于数千名 ChatGPT 用户反馈构建，覆盖育儿、政府服务、个人财务等日常任务，并称过去一年已用于衡量和改进模型。这是可验证的官方基准发布，信息密度较高；但帖子本身仅为简介，未给出具体评测方法、模型得分或数据细节，实际效果需以链接页面为准。
78
正文
For AGI to benefit all of humanity, it should help people with the everyday tasks that matter most to them. So we built LifeVal, a new benchmark shaped by feedback from thousands of ChatGPT users on where they most want help from a personal assistant—from finding childcare to accessing government services to managing personal finances.
Over the past year, we’ve used LifeVal to measure and improve how well our models handle these everyday tasks.
openai.com/index/lifeval/
Your browser does not support the video tag.
🔗 View on Twitter