最新资讯
stackoverflow.blog 欢迎来到芯片时代:半导体制造、AI 数据中心与芯片设计的未来 www.youtube.com AI Agent 总犯同样的错:CentralAgent AI 将记忆重构为经验系统 pub.towardsai.net Netflix 科学家建议重采样 LLM 评判:5 次仅将误差棒缩小 13% pub.towardsai.net Jev 作为 LLM 前的静默层:构建提示感知的模型路由器 reddit.com OpenAI 称 Astra 仅满足 10% 安全任务标准 dev.to FreeToken:在自有 GPU 上运行前沿 MoE 模型及其内存需求 dev.to 当 AI Agent 说“完成”时,究竟完成了什么? dev.to 部署 Underdog Bark 3.0 Pro:逐字转写、自定义后端与分块设置 dev.to 为艰难对话构建 AI:五个 Agent、一条安全正则与一位盲评监督者 techcrunch.com Palo Alto Networks 洽谈以 5 亿美元收购 AI Agent 安全初创公司 Clutch theinformation.com 黄仁勋被要求就涉华间谍指控向国会作简报 www.infoq.com Edera 推出 Object Capability Bounded Authority,试图将凭证与 AI Agent 工作负载隔离
多元动态
登录 注册
智能体 dev.to · @Adam McClarin

从未运行的绿色测试套件不构成证据

原文 我的收藏

作者在指导 AI 编码 Agent 处理多周重构、类型化契约与影子路径时发现,最危险的问题不是崩溃而是静默失效:溯源日志数月零字节、测试未执行却显示绿色、否决逻辑持续丢弃有效配置。作者主张把 Agent 的报告视为待验证声明,每个否定结果都需阳性对照,先做变异测试确认测试能捕获真实故障。

AI推荐理由 作者基于指导 AI 编码 Agent 的实战经验,指出测试套件“绿色”但未真正执行、溯源日志长期零字节等静默失效问题,提出“每个否定结果需阳性对照、先做变异测试”的实践方法,对使用 AI 编码 Agent 的开发者有具体借鉴意义;属个人经验分享,非系统性研究。

60

正文

I have spent a stretch of weeks on a live system where the dangerous part was not a crash. It was quiet. A provenance log that had written zero bytes for months. Tests that scored green without executing. A veto that had been dropping valid setups while the board still looked calm. A calendar built for the wrong exchange. None of that announces itself. The UI still loads. The agent still reports progress. Someone still says the suite is green. I direct AI coding agents on work like this. Multi-week rewires. Typed contracts. Shadow paths. The agent is fast. The agent will also tell you a push landed when you have not checked the remote, or that a cost number is solid when it was inferred from a fixture. I treat the report as a claim. Then I check the claim. The practice I now keep is small. Every negative result needs a positive control. If the test says nothing happened, I need proof the test can detect a real break. Mutation first. Break the thing the fix is supposed to catch. Confirm the suite sees it. Restore. Distinguish measurement from inference. An extraction bug is not a market finding. A time zone error is not a data gap. Write the correction down before it becomes folklore. On a live rewire, keep the old path authoritative until the new path is proven in shadow. One boundary at a time. Do not cut over on confidence. If you are using an agent on a system that already carries money, records, or a book, the skill is not the prompt. The skill is knowing what to re-run yourself. I do this work at Meraki is Love. Studio site: merakislove.com

来源报道 · 1 篇 · 以下链接均前往原始媒体

Adam McClarin 从未运行的绿色测试套件不构成证据 09-12 · 原文发布
← 返回精选动态 原文

更多内容