行业动态
www.aibase.com ·
豆包手机助手消费者版发布:推出 GUI 协议,三方 App 可自主拒绝 AI 自动操作
豆包手机助手消费者版正式发布,强调稳定性与日常可用性,支持语音、AI 按键等多种唤醒方式,新增屏幕问答、本地数据检索、录音与飞书妙记整合等功能。同时以 Beta 形式开放“操作手机”能力,推出屏幕自动化操作声明协议 SAEP,允许第三方应用自主声明是否允许 AI 助手在其内执行屏幕自动化操作,并启动 30 天规则公示。
AI推荐理由 字节豆包手机助手消费者版发布,新增屏幕问答、本地数据检索、录音与飞书妙记整合等能力,并推出 SAEP 协议让三方 App 可自主声明是否允许 AI 屏幕自动化操作,同时启动 30 天规则公示。这是手机端 AI Agent 落地与生态治理的具体进展,GUI 操作权限边界设计对 Agent 应用开发有参考价值;但内容基于官方新闻稿转述,缺少实测数据与第三方验证,SAEP 实际执行效果尚待观察。
72
正文
Doubao Mobile Assistant Consumer Edition Released: Introduces GUI Protocol, Third-Party Apps Can Automatically Reject AI Auto-Operations
AIbase基地
Published inAI News · 5 min read · Sep 14, 2026
7
The Douyin Mobile Assistant Consumer Version is officially released. Compared to the preview version, this consumer version emphasizes stability, daily usability, and focuses on the interactive experience.
Multiple Ways to Wake Up with Voice and AI Button, New Screen Q&A
According to the official press release, Douyin Mobile Assistant supports multiple wake-up methods such as voice and AI button to adapt to different scenarios. The dedicated AI button has fingerprint authentication capabilities, allowing users to call the assistant and perform tasks without secondary unlocking after verification. Voice wake-up has also been optimized for scenarios such as far-field, internal noise, and noisy environments.
The newly added screen Q&A feature allows users to continue processing tasks with the assistant without taking screenshots or switching apps. For example, when a user opens the camera to point at an indoor environment and says, "Based on this decoration style, help me choose a cabinet under 1.2 meters and no more than 1000 yuan," Douyin can find suitable products on e-commerce platforms based on the image and requirements.
The assistant also provides a search tool for local data, which can retrieve information such as photos, messages, and notes when needed—for example, when a user asks about the expiration date of their Hong Kong and Macao travel permit, the assistant can find the answer from the phone's relevant information. The recording experience has also been upgraded and integrated with Feishu Miaoji capabilities, allowing users to directly ask specific questions like "the product suggestions mentioned in yesterday's user interview." Additionally, users can manually save the current screen content by voice input, three-finger swipe up, or pressing the AI button and volume key simultaneously, forming retrievable memories locally.
GUI Operations Opened as Beta, 30-Day Rule Announcement
Douyin Mobile Assistant will open the "operate the phone" function in Beta form. The official hopes to build an open and standardized mobile AI application ecosystem with partners, and therefore launched the Screen Automation Operation Declaration Agreement (SAEP), and started a 30-day rule announcement at the same time.
According to the agreement, third-party applications can independently declare their operational boundaries, clearly stating whether they allow or reject AI assistants from performing screen automation operations within their applications. Douyin Mobile Assistant will fully respect the developers' intentions and will not perform automated operations on third-party applications that clearly refuse such operations. In terms of data collection and processing, the assistant follows the principles of "reasonable necessity" and "user autonomy control," while also establishing an Agent protection system to manage the operable scope in a hierarchical and graded manner.
The first consumer version of Douyin Mobile Assistant will be equipped on the Nubia NaviX Ultra, which is already accepting reservations and will be officially released on September 16th.
Doubao Mobile AssistantAI ButtonScreen Q&AVoice Wake-Up
This article is from AIbase Daily
Scan to view
Welcome to the [AI Daily] column! This is your daily guide to exploring the world of artificial intelligence. Every day, we present you with hot topics in the AI field, focusing on developers, helping you understand technical trends, and learning about innovative AI product applications.
—— Created by the AIbase Daily Team
© Copyright AIbase Base 2024, Click to View Source -