算力商业
spectrum.ieee.org ·
@Dina Genkina
出租闲置算力,从AI热潮中获利
多家公司提供平台,让个人出租闲置计算资源用于AI推理,类似Uber或Airbnb模式。Far Labs创始人Ilman Shazhaev表示,这有助于缓解大型数据中心的资源压力。
AI推荐理由 IEEE Spectrum报道了利用闲置算力进行AI推理的商业模式,引用了具体公司CEO,内容新颖,但未提供实际效果数据。
75
正文
计算AI新闻
通过出租闲置计算能力,在 AI 热潮中获利
这些公司正在付费使用家用服务器
Dina Genkina
2026年9月1日
5 分钟阅读
Dina Genkina 是 IEEE Spectrum 的计算和硬件编辑
计算机爱好者已经在地下室和车库里有小型服务器机架。现在他们可以将其出租用于 AI 推理,赚取被动收入。
John Federico
如果你拥有家用服务器、游戏电脑或只是不太使用的笔记本电脑,请注意。你现在可以利用这些闲置计算能力,并在此过程中赚取被动收入。AI 公司渴望更多计算资源来运行 AI 推理——即使用预训练模型响应查询的过程——并且他们愿意为此付费。
“想象一下 Uber 或 Airbnb,但用于 AI 推理计算任务,”总部位于阿布扎比的 Far Labs 创始人兼首席执行官 Ilman Shazhaev 说。
AI 热潮推动了大规模数据中心建设,这些数据中心通常通过提高电价、给当地水资源带来压力、造成环境破坏和噪音,以及仅仅是不美观,而损害当地社区。大型数据中心可能不会消失——训练新的前沿模型和运行领先公司的 AI 模型可能仍将是这些巨头的领域。但现在,有几家公司正在较小的、主要是开源模型上提供 AI 推理。他们在遍布家庭和小企业的现有计算能力上运行推理,并补偿所有者。
“每个人都认为唯一的方法是数据中心。数据中心对其建设所在的社区是榨取性的,它们不向那里的人们返还服务、税收或任何东西。那么为什么不把整个事情颠倒过来呢?”位于德克萨斯州奥斯汀的 Evolving Edge 创始人兼首席执行官 John Federico 说。“计算能力就在那里。如果你能编排它,那么你实际上直接为这些社区增加了价值。”
这个想法并不完全是新的:例如,从 1999 年到 2020 年,一个名为 SETI@Home 的志愿者项目使用闲置计算机在射电望远镜数据中寻找外星生命迹象。但现在,商业公司渴望使用同样的策略。Shazhaev 的 Far Labs 将在未来几周内推出其平台 Far AI,而 Federico 的 Evolving Edge 目前处于公开测试阶段。其他公司,如 Bless Network、Salad 和 Gradient,在过去一年中已开始提供类似平台。
连接到网络
Federico 从小就是计算机爱好者,他在地下室积累了一整套服务器来运行他的项目。“有一天我突然想到——有很多关于计算能力不足的讨论,我只是想,嗯,全国 92% 的人有宽带,还有像我这样在壁橱里有迷你数据中心的人,”他说。
Federico 认为潜在的主机是像他这样已经投资于家用服务器的人,他的目标是让出售闲置计算的过程对他们来说尽可能无缝。
“注册计划,安装应用程序,”Federico 说。“我们只在你允许我们的时候在你的机器上运行作业。我们唯一做的是监控资源使用情况。当然,你可以给我们一个时间表。”有了足够大的设备网络,平台就可以在需要时随时提供计算能力。
隐私和安全是此类主机的主要关注点。为了向用户保证他们的本地数据是安全的,并且不会将恶意软件下载到他们的设备上,团队开源了他们的调度软件。“节点软件是开源的,所以任何人都可以查看它,看看它做什么,”Federico 说。
Far Labs 的 Shazhaev 解释说,该公司的软件是围绕称为“最小权限”的原则设计的,该原则授予主机和用户完成任务所需的最小访问权限。推理作为隔离的工作负载运行,具有经过身份验证的加密通信,并对其可能使用的 GPU、CPU、内存、存储和网络资源有明确限制。客户不会获得对主机机器的任意访问权限,提供商可以随时检查资源使用情况、暂停节点、撤销访问权限并删除软件。
保护也以另一种方式起作用。工作负载被分段,只有最低限度的必要信息暴露给单个节点。敏感的企业工作负载可以限制在受控硬件上,而不是通过消费设备路由。
分而治之
从用户的角度来看,大型数据中心仍然具有优势:顶级 GPU 和 CPU、高速网络、粗电缆和复杂的冷却。用户设备通常功能较弱、更多样化,并且彼此之间的连接可靠性较低。
“从科学角度来看,这是一个相当困难的问题,”Shazhaev 说。“你想完成与那些高基础设施数据中心中类似级别的任务,并在容量有限的用户设备上运行它们。”
Evolving Edge 的 Federico 说,这对于最大、最先进的 AI 模型来说是个问题。但这些并不总是需要的,而且通常甚至不是首选。“许多公司,一旦达到一定规模,突然为最先进的前沿模型支付令牌费用[而]不再符合他们的需求,”他说。“相反,他们正在针对业务中的特定任务微调开源模型。这些模型所需的资源远不及一些最先进的模型。这只是使用合适的工具来完成工作。”
较小的开源模型通常可以放在单个用户设备上。但如果这失败了,有工具可以将单个推理任务拆分到多个 GPU 或 CPU 上。Evolving Edge 正在使用一个名为 Ray 的开源工具来执行这种拆分,而 Far Labs 开发了自己的专有软件,不仅拆分工作负载,还将拆分包装在安全性和可靠性提供软件层中。
“我们做的一件事是共享模型,”Shazhaev 说。“我们获取模型,将其切成许多部分,然后这些部分将分布到不同的设备上。我们有一个编排器和负载均衡器来管理任务流,因此每个设备处理任务的一部分。然后我们在主脑(编排器)中组合答案。”
通过结合使用更小、更特定于任务的模型,以及在不同设备之间拆分更大的模型,团队声称他们可以比传统数据中心便宜得多地执行推理,“因为我们没有资本支出,”Shazhaev 说。
游戏 PC 是家庭中闲置计算能力的常见来源。Dizzaract
分布式优势
Shazhaev 声称,不仅以这种方式运行推理更便宜,而且更可靠。公司可以访问分布式计算资源网络,而不是一个可能发生故障的巨型设备。Shazhaev 将这与加密货币及其通过去中心化的弹性进行了比较。
“今天,要关闭比特币,你需要核平整个星球。在这里,我们有同样的概念,”Shazhaev 说。
Federico 解释说,这种弹性不仅对 AI 推理有益,而且对所有类型的应用程序都有益,包括智慧城市、环境传感器、自动驾驶汽车等。例如,在 2026 年亚马逊网络服务中断期间,智能床卡在直立位置,用户无法调整它们。Federico 说,一个分布式网络,不需要将所有内容都路由到单个数据中心(例如弗吉尼亚州阿什本),将使此类中断的影响小得多。“我们可以在 250,000 个节点的网络中丢失 100 个节点,这无关紧要,”他说。
如果用户设备网络足够大,每个作业都可以路由到附近的设备,从而减少延迟。Far Labs 声称其平台上的延迟为 100 毫秒或更短。这种方法的较低成本和较低延迟甚至可能启用新的用例,例如游戏内 AI 视频生成,目前这过于缓慢和昂贵。
“OpenAI 去年收入 300 亿美元,但他们以 80 亿美元的亏损结束了财年。为什么?官方原因是推理成本高,”Shazhaev 说。“而且那些大多是文本模型。对于游戏,你有音频、视频、动画:这是繁重的数据,你需要实时响应。所以,我们一直在努力解决这个问题。”
所有这些公司都在试图利用本地计算的未开发资源,并希望它能让设备主机和用户都受益。
“所有这些大公司都在到处建设数据中心,”Shazhaev 说,“但我相信世界上已经存在足够的计算能力。”
来自您网站的文章
初创公司希望从太空运行 AI 推理 ›
逃离数据中心:点对点云计算的承诺 ›
网络相关文章
SETI@home 更新:21 年的公民科学——以及 100 个待调查信号 ›
什么是分布式计算?- 分布式计算解释 - AWS ›
分布式计算推理seti@home数据中心
Dina Genkina
Dina Genkina 是 IEEE Spectrum 的副编辑,专注于计算和硬件。她拥有原子物理学博士学位,住在布鲁克林。
计算访谈
声音如何让大数据变得有意义
12 分钟
6 分钟阅读
机器人技术赞助文章
保护动态工业机器人电缆载体
2026年9月3日
3 分钟阅读
航空航天杂志专题 2026年9月
NASA 新设计为核动力航天器增加涡轮增压
2026年8月26日
13 分钟阅读
半导体新闻计算
欧盟的 AI 驱动削弱了其自身的芯片战略
能源新闻
电网运营商权衡数据中心的高压直流电源
计算新闻
光学纵向扩展终于接近了吗?
查看原文(中文正文为 AI 翻译)
ComputingAINews
Cash In on the AI Boom by Renting Out Your Spare Compute
These companies are paying to use home servers
Dina Genkina
01 Sep 2026
5 min read
Dina Genkina is the computing and hardware editor at IEEE Spectrum
Computer hobbyists already have small server racks in their basements and garages. Now they can rent them out for AI inference and earn some passive income.
John Federico
If you own an at-home server, a gaming computer, or just a laptop that doesn’t get much love, listen up. You can now put that spare computing power to use and earn some passive income in the process. AI companies are hungry for more compute to run AI inference—the process of using a pretrained model to respond to queries—and they’re willing to pay you for it.
“Imagine Uber or Airbnb, but for AI-inference computing tasks,” says Ilman Shazhaev, founder and CEO of Far Labs, based in Abu Dhabi.
The AI boom has spurred on the construction of massive data centers, often damaging local communities by raising electricity prices, straining local water resources, causing environmental damage and noise, and being just plain ugly. Huge data centers are likely not going anywhere—training new frontier models and running AI models from leading companies will likely still be the purview of these behemoths. But now, several companies are providing AI inference on smaller, mostly open-source models. They are running inference on the preexisting computing power spread throughout homes and small businesses, and compensating the owners.
“Everyone thinks the only way to do it is data centers. And data centers are extractive for the communities in which they’re built, and they don’t return services or taxes or much of anything to the people there. So why not just turn this whole thing on its head?” says John Federico, founder and CEO of Evolving Edge, in Austin, Texas. “The compute power is out there. If you can orchestrate it, then you’re actually adding value to those communities directly.”
The idea isn’t entirely new: From 1999 to 2020, a volunteer-based project called SETI@Home used spare computers to search for signs of extraterrestrial life in radio-telescope data, for instance. But now, commercial companies are eager to use the same strategy. Shazhaev’s Far Labs is launching its platform Far AI in the coming weeks, while Federico’s Evolving Edge is currently in open beta. Other companies, like Bless Network, Salad, and Gradient have started to provide similar platforms over the last year.
Connecting to the network
Federico has been a computer hobbyist since youth, and he has amassed a whole server in his basement to run his projects. “It just hit me one day—there’s all this talk about not having enough compute, and I just thought, well, 92 percent of the country has broadband, and you have people like me who have mini data centers in a closet,” he says.
Federico sees the potential hosts as people much like himself who have already invested in home servers, and he aims to make the process of selling spare compute as seamless for them as possible.
“Sign up for the program, install an application,” Federico says. “All we want to do is run jobs on your machine when you tell us we’re allowed to. The only thing we do is monitor the resource usage. And of course, you can give us a schedule.” With a large enough network of devices, the platform would have compute available whenever it’s needed.
Privacy and security are primary concerns for such hosts. To reassure the users that their local data is secure, and that no malware will be downloaded to their devices, the team open-sourced their scheduling software. “The node software is open source, so anyone can look at it, see what it does,” Federico says.
Shazhaev of Far Labs explains that the company’s software is designed around a principle known as “least privilege,” which grants both the host and the user the minimum access possible to accomplish the task. Inference runs as an isolated workload with authenticated, encrypted communication and explicit limits on the GPU, CPU, memory, storage, and network resources it may use. Customers do not receive arbitrary access to the host machine, and providers can inspect resource use, pause the node, revoke access, and remove the software at any time.
The protection also works in the other direction. Workloads are segmented, and only the minimum required information is exposed to an individual node. Sensitive enterprise workloads can be restricted to controlled hardware rather than routed through consumer devices.
Divide and conquer
Massive data centers still have advantages from the user perspective: top-of-the-line GPUs and CPUs, high-speed networking, thick cables, and sophisticated cooling. User devices are usually less powerful, more varied, and less reliably connected to one another.
“This is quite a difficult issue from the science angle,” Shazhaev says. “You want to do a similar level of tasks that are happening in those high-infrastructure data centers, and run them on the user device with limited capacity.”
Evolving Edge’s Federico says this is an issue for the largest, state-of-the art AI models. But those are not always needed and are often not even preferred. “There are numerous companies, once they reach a certain scale, suddenly paying for tokens on a state-of-the-art frontier model [that] no longer makes sense for their needs,” he says. “Instead, they are fine-tuning open-source models for specific tasks that they have in their business. These models don’t require anywhere near the resources that some of the state-of-the-art models do. It’s just using the right tool for the job.”
Smaller, open-source models can often fit on a single user device. But if that fails, there are tools to split a single inference task over multiple GPUs or CPUs. Evolving Edge is using an open-source tool called Ray to perform this splitting, while Far Labs has developed its own proprietary software that not only splits the workload but also wraps the splitting in a layer of security and reliability-providing software.
“One thing we have done is we shared the model,” Shazhaev says. “We take the model, we cut it into many pieces, and then these pieces will be distributed through different devices. And we have an orchestrator and a load balancer which manage the task flow, so each device processes a part of the task. Then we combine the answers in the main brain, the orchestrator.”
Through a combination of using smaller, more task-specific models, and splitting larger models between disparate devices, the teams claim they can perform inference much cheaper than a traditional data center “because we don’t have capital expenditure,” Shazhaev says.
Gaming PCs are a common source of spare computational power in the home. Dizzaract
The distributed advantage
Not only is it cheaper to run inference this way, it is also more reliable, Shazhaev claims. The companies have access to a distributed network of computing resources, rather than one giant device that can experience outages. Shazhaev compares this to cryptocurrencies and their resilience through decentralization.
“Today, to shut down Bitcoin, you need to nuke the whole planet. Here, we have the same concept,” Shazhaev says.
Federico explains that this resiliency would be beneficial not just for AI inference, but for all kinds of applications, including smart cities, environmental sensors, autonomous vehicles, and more. During an Amazon Web Services outage in 2026, for example, smart beds were stuck in their upright positions and their users couldn’t adjust them. Federico says that a distributed network where everything doesn’t need to be routed through a single data center, say, in Ashburn, Va., would make those kinds of outages much less impactful. “We could lose 100 nodes in a network of 250,000 and it wouldn’t matter,” he says.
If the network of user devices is substantial enough, every job can be routed to a nearby device, decreasing the latency. Far Labs claims a latency of 100 milliseconds or less on its platform. The lower cost and lower latency of this approach may even enable new use cases, such as in-game AI video generation, which is currently prohibitively slow and expensive.
“OpenAI last year had US $30 billion in revenue, but they closed the financial year at an $8 billion loss. Why? The official reason is due to the high cost of inference,” Shazhaev says. “And those are mostly text models. For gameplay, you have audio, video, animations: It’s heavy data, and you need real-time responses. So, we’ve been trying to solve this issue.”
All of these companies are trying to tap into an untapped resource of local compute and hoping it’ll benefit the device hosts and users alike.
“All these big guys are running around building data centers,” Shazhaev says, “but I believe there is enough compute power that already exists in the world.”
From Your Site Articles
Startup Wants to Run AI Inference From Space ›
Escape From the Data Center: The Promise of Peer-to-Peer Cloud Computing ›
Related Articles Around the Web
SETI@home Update: 21 Years of Citizen Science – and 100 Signals to Investigate ›
What is Distributed Computing? - Distributed Computing Explained - AWS ›
distributed computinginferencingseti@homedata centers
Dina Genkina
Dina Genkina is an associate editor at IEEE Spectrum focused on computing and hardware. She holds a PhD in atomic physics and lives in Brooklyn.
ComputingInterview
How Sound Could Make Sense of Big Data
12m
6 min read
RoboticsSponsored Article
Protecting Dynamic Industrial Robot Cable Carriers
03 Sep 2026
3 min read
AerospaceMagazineFeatureSeptember 2026
A New NASA Design Turbocharges Nuclear Spacecraft
26 Aug 2026
13 min read
SemiconductorsNewsComputing
The E.U.’s AI Drive Undermines Its Own Chip Strategy
EnergyNews
Grid Operators Weigh High-Voltage DC Power for Data Centers
ComputingNews
Is Optical Scale-Up Finally Approaching?