开源工具
developer.nvidia.com ·
@Luca Spindler
用 C++ 与 NVIDIA TensorRT RTX 示例构建本地 AI 应用
NVIDIA 开发者博客介绍开源 C++ 示例集 Do Inference Now (DIN) Deploy，它把 ONNX Runtime 与 NVIDIA TensorRT RTX 执行提供程序结合，用于在本地应用中部署 AI 模型，覆盖可移植模型格式、可靠运行时与跨目标系统加速三个环节。
AI推荐理由 NVIDIA 开发者博客介绍开源 C++ 示例集 Do Inference Now (DIN) Deploy，将 ONNX Runtime 与 NVIDIA TensorRT RTX 执行提供程序结合，帮助开发者把模型 checkpoint 迁移到本地原生应用。具体新信息是这一示例集与运行时组合的用途；局限是正文片段仅给出概述，未提供性能数据或实测结果。
72
正文
Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference Now...
Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference Now (DIN) Deploy is an open-source collection of practical C++ samples that bridges that gap. It combines ONNX Runtime with the NVIDIA TensorRT RTX execution provider to help developers move from a model checkpoint to a native…
Source