CONNECT WITH US
Tech

Tech

Power and cooling limits push 100,000+ accelerator AI clusters past single data centers

Tom's Hardware logo

Published on

Add as a preferred source on Google
Power and cooling limits push 100,000+ accelerator AI clusters past single data centers

The rapid growth of AI clusters is pushing computing infrastructure beyond the physical and power limitations of individual data centers, which creates demand for new networking architectures capable of connecting compute resources across multiple facilities and even geographical regions. At Supercomputing 2026 (SC26), researchers from The Ohio State University discussed the evolution of high-performance networking technologies. At the conference, they explained how efficient distributed computing at such a scale requires considerably more than faster network connections, highlighting the importance of scale across domains to stretch workloads across different data centers in separate geographical regions.

Modern AI clusters typically accommodate more than 100,000 AI accelerators and potentially millions of CPU endpoints, placing tremendous demands on network bandwidth, latency, and congestion management. Meanwhile, an accelerator's computational performance continues to increase faster than communication capabilities, which means that faster AI GPUs do not necessarily deliver proportional improvements in application performance. As a result, the efficiency of network infrastructure determines how effectively large-scale AI systems can use their computational resources.

Traditionally, high-performance computing systems have relied on two major interconnect domains: scale-up and scale-out. Scale-up networks connect processors and accelerators within tightly integrated systems using technologies like AMD's Infinity Fabric, Intel's UPI, Nvidia's NVLink, or emerging alternatives such as UALink. Scale-out networks, which typically rely on Ethernet, InfiniBand, HPE Slingshot, or, more recently, Ultra Ethernet, connect individual servers or rack-scale systems into larger clusters. These interconnects have different requirements for bandwidth, latency, and scalability, which is why they serve different purposes.

However, the massive size and power consumption of modern AI clusters create demand for a third interconnect domain, known as scale-across.


Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.