算力商业
blogs.nvidia.com ·
@John Fanelli
NVIDIA 扩展机密计算,推出 Confidential Bare Metal 供前沿模型厂商全球部署
NVIDIA 宣布扩展 Confidential Computing,新增 Confidential Bare Metal 部署选项,使模型厂商可在第三方裸金属基础设施上运行敏感负载并保留对模型与数据的控制。该方案与已有的 Confidential Containers、Confidential Virtual Machines 构成三种部署形态,并扩展至 Grace Blackwell 与 Rubin 系统,同时与 DSX OS 集成作为 AI 工厂参考架构。Cohere 计划在 Model Vault 中集成该能力,Google Cloud 计划在基于 GB300 NVL72 的 A4X Max 实例上支持。
AI推荐理由 NVIDIA 官方博客宣布 Confidential Computing 新增 Confidential Bare Metal 部署选项,并给出 Cohere Model Vault 与 Google Cloud A4X Max(GB300 NVL72)的采用计划,属于可核验的产品发布信息。局限在于正文为厂商自述,未提供性能、安全认证或可用时间等量化证据,Cohere 与 Google Cloud 均为计划性表述。
78
正文
NVIDIA builds tools to enable safe agents across the stack. The NVIDIA OpenShell Reference Architecture, announced today, is part of NVIDIA’s growing portfolio of technologies that enables organizations to safely deploy agents at scale. NVIDIA Confidential Computing is the infrastructure layer that protects the models and data those agents depend on while running.
Today, NVIDIA is expanding that layer with Confidential Bare Metal, a new deployment option with NVIDIA Confidential Computing that enables frontier model builders to run sensitive workloads on dedicated third-party infrastructure while retaining control of their models and data.
NVIDIA is introducing new platform security controls that protect data in transit, measure platform integrity and enforce hardware-level access restrictions. These new controls let frontier model builders use bare-metal instances to own and operate their bespoke software stack, including host and platform infrastructure software, when operating on NVIDIA accelerated computing infrastructure across third-party cloud, neocloud and enterprise infrastructure.
Read All NVIDIA in Europe Announcements
NVIDIA Confidential Computing now offers a converged security architecture with three deployment options:
Confidential Bare Metal for bare-metal infrastructure
Confidential Containers for Kubernetes environments
Confidential Virtual Machines for virtualized environments
Organizations can match the right model to their trust boundaries and operating requirements.
NVIDIA Confidential Computing is also expanding across NVIDIA Grace Blackwell and Rubin systems and will integrate with NVIDIA DSX OS as a reference architecture for cloud providers building AI factories.
Model Builders Tap Global Capacity
Confidential Bare Metal gives supported providers a path to serve high-value workloads that require strong model and data privacy protections. For model builders, the expanding ecosystem offers more geographic, sovereign and operational options for scaling training and inference worldwide.
Cohere plans to integrate Confidential Bare Metal into Cohere Model Vault, using NVIDIA Confidential Computing trusted execution environments to extend hardware-rooted security directly to the GPU — protecting models and data in memory and across interconnects during execution.
“Enterprises trust Cohere to provide a secure and confidential platform for inference,” said Phil Blunsom, chief technology officer at Cohere. “With NVIDIA Confidential Computing in Cohere Model Vault, we’re extending hardware-rooted security directly to the GPU, protecting customer data in memory and across interconnects during execution.”
Google Cloud is extending support for Confidential Bare Metal to A4X Max instances powered by NVIDIA GB300 NVL72 systems. These will combine non-virtualized NVIDIA accelerated computing with cryptographic protection for training data and model intellectual property.
“Google Cloud introduces Confidential Bare Metal to provide AI labs with hardware-isolated, non-virtualized compute environments and end-to-end cryptographic protection. Our A4X instances, built using NVIDIA Confidential Computing, preserve the privacy of user data, protect model IP, provide top-line serving performance,” said Andrés Lagar-Cavilla, distinguished engineer and AI infrastructure security lead at Google Cloud.
Confidential Computing Expands Across the NVIDIA Platform
NVIDIA Confidential Computing uses hardware-rooted isolation and cryptographic attestation to help protect models and data during execution.
Support now extends to NVIDIA Grace Blackwell NVL72 — bringing Confidential Computing to NVL72 rack-scale systems — as well as x86-based NVIDIA HGX Rubin NVL8 and NVIDIA DGX Rubin NVL8 systems.
CoreWeave, Firmus, GMI Cloud, Google Cloud, IREN, Lambda, Microsoft Azure Infrastructure, Nebius, Nscale and Vultr support NVIDIA Confidential Computing deployments. Global systems partners including Cisco, Dell Technologies, HPE, Lenovo, Supermicro and Bull will support these capabilities with NVIDIA-Certified Systems.
NVIDIA DSX OS will support all NVIDIA Confidential Computing modes, giving cloud providers a software foundation for building and operating AI factories that support confidential workloads.
Learn more about NVIDIA Confidential Computing.
Read All NVIDIA in Europe Announcements