大模型
techspot.com ·
@Alfonso Maruccia
NVIDIA的PAIR软件将闲置家用电脑变成本地AI集群
NVIDIA推出开源软件Personal AI Router (PAIR),可将不同操作系统和系统的家用电脑连接成自定义AI集群,用于运行聊天机器人、AI代理等LLM应用。
AI推荐理由 TechSpot报道NVIDIA PAIR软件,与MarkTechPost内容重复,但来源不同,信息一致。作为独立报道,质量尚可,但无新增信息。
80
正文
服务科技爱好者超过25年。
TechSpot意味着您可以信赖的技术分析和建议。
连线:大多数聊天机器人和代理式AI仍然依赖云端和基于互联网的基础设施,但一些AI爱好者越来越寻求构建自己的本地计算设置。Nvidia的新PAIR软件可能有助于本地AI派对进一步发展。
Nvidia推出了一款新软件工具,旨在启动本地推理基础设施的爆发。个人AI路由器(PAIR)项目是开源软件,旨在连接不同的计算机系统,甚至不同的计算机操作系统,形成一个自定义AI集群,其中聊天机器人、AI代理和其他兼容的LLM应用共享处理资源。
这家GPU制造商将PAIR描述为一个具有四大主要功能点的系统。该软件框架可以将GeForce RTX游戏GPU、DGX Spark机器和Mac系统连接到一个单一AI平台。Nvidia表示,不需要特殊电缆或机架硬件,连接只需几分钟。
将多台机器连接在一起后,PAIR可以运行“传统”本地推理后端,如Ollama和LM Studio,让用户从Windows、Linux或macOS机器管理其AI工作负载。该框架旨在跨所有本地可用节点分配AI工作流和推理请求,利用空闲计算资源来提高整体任务性能。
PAIR可以提供完全本地的AI超级机器。数据文件、代理和聊天机器人查询保持在本地网络内,无需云或互联网连接,这应该为注重隐私的用户和敏感AI应用提供安心。
Nvidia将PAIR定位为本地AI平台,旨在异构计算环境中可靠工作,无需数据中心级硬件或强大的服务器AI加速器。然而,Nvidia产品经理Seth Schneider解释说,这个新软件框架很可能在SOHO和家庭中运行最佳,因为那里有强大的计算机器大部分时间闲置。
Schneider提供了一个“理想”场景:一位父亲使用RTX Spark笔记本电脑和DGX Spark台式机,一位母亲使用配备RTX 5090的笔记本电脑,两个孩子使用游戏台式机和MacBook Pro。所有这些强大的硬件拥有约165 teraFLOPS的计算能力和大量闲置的“免费令牌”,PAIR可以帮助将这些未充分利用的AI容量相对轻松地投入使用。
分享本文:
在Google中查看更多TechSpot
将我们添加为首选来源,当您搜索时,我们的报道会首先出现。
添加TechSpot
相关故事
GeForce RTX 5070 vs. Radeon RX 9070 XT:2026年更新
CERN将超过2200台专用计算机从RHEL迁移到Debian
TechSpot精选
Linus Torvalds告诉AI批评者分叉Linux或走开
初创公司构建CUDA编译器,可能在AMD GPU上击败AMD自己的工具
查看原文(中文正文为 AI 翻译)
Serving tech enthusiasts for over 25 years.
TechSpot means tech analysis and advice you can trust.
Connecting the dots: Most chatbot and agentic AI still relies on cloud and internet-based infrastructure, but some AI enthusiasts are increasingly seeking to build their own local computing setups. Nvidia's new PAIR software might help the local AI party grow even further.
Nvidia has introduced a new software tool for jumpstarting an explosion in local inferencing infrastructure. The Personal AI Router (PAIR) project is open-source software designed to link different computer systems, even different computer operating systems, into a custom AI cluster where chatbots, AI agents, and other compatible LLM applications share processing resources.
The GPU maker describes PAIR as a system with four major feature points. The software framework can link GeForce RTX gaming GPUs, DGX Spark machines, and Mac systems into a single AI platform. No special cables or rack hardware are required, Nvidia says, and the linking should only take a few minutes.
After linking several machines together, PAIR can run "traditional" local inference backends such as Ollama and LM Studio to let users manage their AI workloads from a Windows, Linux, or macOS machine. The framework is designed to allocate AI workflows and inferencing requests across all local available nodes, exploiting idle computing resources to improve an overall task's performance.
PAIR can provide a completely local AI super-machine. Data files, agents and chatbot queries stay within the local network without requiring cloud or internet connectivity, which should provide relief for privacy-conscious users and sensitive AI applications.
Nvidia positions PAIR as a local AI platform designed to reliably work in a heterogeneous computing environment, with no need for data center-level hardware or powerful server AI accelerators. However, Nvidia product manager Seth Schneider explained that the new software framework is most likely going to run best in SOHOs and homes where powerful computing machines are sitting idle most of the time.
Schneider provided an "ideal" scenario, with a dad working on both an RTX Spark laptop and a DGX Spark desktop machine, a mom with an RTX 5090-equipped laptop, and two kids with a gaming desktop and a MacBook Pro. All this powerful hardware holds around 165 teraFLOPS of computing power and a treasure trove of "free tokens" sitting idle, and PAIR can help put all that underutilized AI capacity to work with relative ease.
Share this article:
See more TechSpot in Google
Add us as a preferred source and our reporting shows up first when you search.
Add TechSpot
Related Stories
GeForce RTX 5070 vs. Radeon RX 9070 XT: 2026 Update
CERN is moving more than 2,200 specialized computers from RHEL to Debian
Featured on TechSpot
Linus Torvalds tells AI critics to fork Linux or walk away
Startup builds CUDA compiler that could beat AMD's own tools on AMD GPUs