The rapid growth of AI clusters is pushing computing infrastructure beyond the physical and power limitations of individual data centers, which creates demand for new networking architectures capable of connecting compute resources across multiple facilities and even geographical regions. At Supercomputing 2026 (SC26), researchers from The Ohio State University discussed the evolution of high-performance networking technologies. At the conference, they explained how efficient distributed computing at such a scale requires considerably more than faster network connections, highlighting the importance of scale across domains to stretch workloads across different data centers in separate geographical regions.
Modern AI clusters typically accommodate more than 100,000 AI accelerators and potentially millions of CPU endpoints, placing tremendous demands on network bandwidth, latency, and congestion management. Meanwhile, an accelerator's computational performance continues to increase faster than communication capabilities, which means that faster AI GPUs do not necessarily deliver proportional improvements in application performance. As a result, the efficiency of network infrastructure determines how effectively large-scale AI systems can use their computational resources.
Traditionally, high-performance computing systems have relied on two major interconnect domains: scale-up and scale-out. Scale-up networks connect processors and accelerators within tightly integrated systems using technologies like AMD's Infinity Fabric, Intel's UPI, Nvidia's NVLink, or emerging alternatives such as UALink. Scale-out networks, which typically rely on Ethernet, InfiniBand, HPE Slingshot, or, more recently, Ultra Ethernet, connect individual servers or rack-scale systems into larger clusters. These interconnects have different requirements for bandwidth, latency, and scalability, which is why they serve different purposes.
However, the massive size and power consumption of modern AI clusters create demand for a third interconnect domain, known as scale-across.
Source link







