最新资讯
dev.to 让模型改写文档前,先量化事实保真度 dev.to 回放 153 个 Claude Code 与 Codex 会话,审计 Agent 的生产影响范围 dev.to 银行 77 意图分类最便宜 LLM:GPT-6.1 Terra 每次成功任务 $0.000727 theinformation.com Chesky的副业:Airbnb向CEO新设AI实验室出售IP theverge.com OpenAI 宣布数据中心项目不再与公职人员签署保密协议 dev.to NVIDIA 发布四个开放 Cosmos 3 仿真模型 dev.to 真实 MCP 客户端击穿我们服务器的五种方式 theverge.com Airbnb 正在开发 AI 旅行 agent,计划 2027 年上半年推出 wechat 这可能是美国AI最魔幻的一天。 nytimes.com 美众议院共和党领袖要求 Nvidia 黄仁勋闭门简报 pub.towardsai.net 忘掉我:为记忆而设计的系统中的删除难题 marktechpost.com Google 发布 Gemini Omni 1.2 Flash:15 秒视频,每秒 0.07 美元
多元动态
登录 注册
大模型 www.f-secure.com · @Hacker News

AI 购物代理可信吗?我们自建了一个来验证

原文 我的收藏

F-Secure 研究文章探讨 AI 购物代理的信任问题。文章先解释 AI 代理是基于 LLM 的程序化循环,可调用打开网页、保存文件等内置技能,并指出 LLM 仍会出错、易受提示注入等操纵,例如购物代理可能被恶意评论诱导下单。作者称其团队自建了一个购物代理进行验证,但提供的正文片段尚未给出实测结论。

AI推荐理由 F-Secure 研究人员 Laura Kankaala 撰文,基于其自建 AI 购物代理的实测,讨论 LLM 驱动的代理在购物场景中的信任问题,具体指出提示注入等操纵风险,属于有明确来源和具体技术议题的安全分析;但正文片段仅到风险引入部分,未给出实测结论与数据,实际效果无法确认。

72

正文

Domain: f-secure.com Points: 11 | Comments: 13 [Top Comments] - But what I'm more curious about is why you'd need to give shopping instructions to an AI in the first place. - The provided example is really bad and ignores why customer service is sometimes a good idea. I guess it's been so bad and corrupted by disingenuous marketing for so long that people have forgotten. Suppose you need to buy some stuff for an upcoming project or vacation, but *don't want to* go down a research rabbit hole for the next hour(s) to cure your ignorance. Suppose you don't even want to have a conversation with the AI. You just want it to build a shopping cart. At most, hopefully, your effort is just pruning the cart before placing the order (if even that). I'm not saying AI *wouldn't be corrupted* like human customer service. I'm saying that we're actually pretty close to this already on Amazon with their AI, but not all ecommerce can be or has to be Amazon. - Because people want to participate in activities that cost money. It's easy to see use cases like an AI agent notifying someone that a band they like is coming to town and asking if they want to secure tickets to the show. - > The demo uses Claude Haiku rather than newer models like Opus or Fable. This is because I'm assuming that shopping agents of the future won't use newer, more expensive models, even though they're more reliable and secure. I suspect it'll come down to cutting costs, and using a cheaper model is one of the easiest ways to save money. Stopped reading here. Author has little idea of the industry. - > Picture this: it's 2027. A chilly spring is approaching, and you want a new coat before the Super El Niño. Instead of scrolling through endless online stores, comparing reviews, checking size charts, and hunting for discount codes, you tell your AI shopping agent what you're looking for — and it takes care of the rest. Why would they AI slop this? Is this supposed to be ironic and I’m missing the joke? If it takes you less time to ‘write’ something than it does to read, I’m not reading it. - I think this is (was?) a good writing style, until it is everywhere. - >The demo uses Claude Haiku rather than newer models like Opus or Fable. This is because I'm assuming that shopping agents of the future won't use newer, more expensive models, Why are we assuming that shopping agents are going to be using the model that is easiest to fall for prompt injections? Only testing a year old, small model is going to lead to a misleading conclusion. - Author doesn’t understand cost dynamics of the industry - that prices keep falling. Author also needs to make a point, and can’t do so if they are using a powerful model. - "We will give you the ability to do shopping 24/7 so you never have to worry about it again and focus on more important things" "Cool! Will we get the money to do said 24/7 shopping as well?" "No." "Oh..." "In fact, you'll have even less money to do the normal shopping you do now!" "Oh..." "There's more! The things you used to buy with the remaining money you have will cost even more!" "Oh..." "But you can do it 24/7 though." "Sweet!" - > I ran the agent 100 times. In 88% of the tests, it didn't open the external website. It either hallucinated a discount code or simply ignored the instructions. Bad model? Don’t think I’ve ever seen a model ignore a link in instructions. It always wants to see what’s there

来源报道 · 2 篇 · 以下链接均前往原始媒体

iris::Hacker News (黑客新闻) AI 购物代理可信吗?我们自建了一个来验证 09-26 · 原文发布
← 返回精选动态 原文

更多内容