‘107,000 GPUs on the waitlist’ — Io.net beta launch attracts data centers, GPU clusters

Gareth Jenkinson10 hours ago‘107,000 GPUs on the waitlist’ — Io.net beta launch attracts data centers, GPU clustersIo.net’s recently developed decentralized physical infrastructure network has moved into its beta phase, allowing GPU computing providers to plug into the platform.2437 Total views22 Total sharesListen to article 0:00NewsJoin us on social networksOver 100,000 graphics processing units (GPUs) from data centers and private clusters are set to plug into a new decentralized physical infrastructure network (DePIN) beta launched by io.net.

As Cointelegraph previously reported, the startup has developed a decentralized network that sources GPU computing power from geographically diverse data centers, cryptocurrency miners and decentralized storage providers to power machine learning and artificial intelligence (AI) computing.

The company announced the launch of its beta platform during the Solana Breakpoint conference in Amsterdam, which coincided with a newly formed partnership with Render Network.

Tory Green, chief operating officer of io.net, and Angela Yi, head of business development, spoke exclusively to Cointelegraph after Green’s keynote speech at the conference. The pair outlined the critical differentiators between io.net’s DePIN and the broader cloud and GPU computing market.

Related: Google Cloud broadens Web3 startup program with 11 blockchain firms

Green identifies cloud providers like Amazon Web Services (AWS) and Microsoft Azure as entities that own their supplies of GPUs and rent them out. Meanwhile, peer-to-peer GPU aggregators were created to solve GPU shortages but “quickly ran into the same problems,” the exec explained.Proud to present @ionet_official at @Solana #Breakpoint2023 yesterday!

Whether you"re a GPU provider or an ML engineer - tune in for the live demonstration of the platform and join https://t.co/WLXlHkv6f1 now.

Watch the full video pic.twitter.com/E1XsgJLJNu— io.net (@ionet_official) November 4, 2023

The wider Web2 industry continues to look to tap into GPU computing from underutilized sources. Still, Green contends that none of these existing infrastructure providers cluster GPUs in the same way that io.net founder Ahmad Shadid has pioneered.

“The problem is that they don’t really cluster. They’re primarily single instance, and while they do have a cluster option on their websites, it’s likely that a salesperson is going to call up all of their different data centers to see what’s available,” Green adds.

Meanwhile, Web3 firms like Render, Filecoin and Storj have decentralized services not focused on machine learning. This is part of io.net’s potential benefit to the Web3 space as a primer for these services to tap into.

Green points to AI-focused solutions like Akash Network, which clusters an average of eight to 32 GPUs, as well as Gensyn, as the closest service providers in terms of functionality. Gensyn is building its own machine learning compute protocol to provide a peer-to-peer “supercluster” of computing resources.

With an overview of the industry established, Green believes io.net’s solution is novel in its ability to cluster over different geographic locations in minutes. This statement was tested by Yi, who created a cluster of GPUs from other networks and locations during a live demo on stage at the Solana Breakpoint conference.Io.net’s user interface allows users to deploy a cluster of GPUs from different locations and service providers globally. Source: io.net

As for its use of the Solana blockchain to facilitate payments to GPU computing providers, Green and Yi claim that the sheer scale of transactions and inferences that io.net will facilitate would not be processable by any other network.

“If you’re a generative art platform and you have a user base that’s giving you prompts, every single time those inferences are made, micro-transactions behind it,” Yi explains.“So now you can imagine just the sheer size and the scale of transactions that are being made there. And so that’s why we felt like Solana would be the best partner for us.”

The partnership with Render, an established DePIN network of distributed GPU suppliers, provides computing resources already deployed on its platform to io.net. Render’s network is primarily aimed at sourcing GPU rendering computing at lower costs and faster speeds than centralized cloud solutions.

Yi described the partnership as a win-win situation, with the company looking to tap into io.net’s clustering capabilities to use the GPU compute it has access to but cannot put to use for rendering applications.

Io.net will carry out a $700,000 incentive program for GPU resource providers, while Render nodes can expand their existing GPU capacity from graphical rendering to AI and machine learning applications. The program is aimed at users with consumer-grade GPUs, categorized as hardware from Nvidia RTX 4090s and under.

As for the broader market, Yi highlights that many data centers worldwide are sitting on significant percentages of underused GPU capacity. A number of these locations have “tens of thousands of top-end GPUs” that are idle:“They’re only utilizing 12% to 18% of their GPU capacity, and they didn’t really have a way to leverage their idle capacity. It’s a very inefficient market.”

Io.net’s infrastructure will primarily cater to machine learning engineers and businesses that can tap into a highly modular user interface that allows users to select how many GPUs they need, the location, security parameters and other metrics.

Magazine: Beyond crypto: Zero-knowledge proofs show potential from voting to finance# Blockchain# Decentralization# AI# P2P Networks# GPU# Machine LearningAdd reactionAdd reactionRead moreScammers play a long game using bogus, AI-backed "law firm"Startup demos upcoming decentralized GPU infrastructure network to OpenAI, UberHow decentralization can mitigate ‘dystopic’ artificial intelligence risks — SingularityNET exec